We need someone who can find the cause of non-human search queries on our Magento 2 website.
We are using the Doofinder search engine and regularly exceed our monthly query limit.
The Doofinder log shows our top search terms are
api v2_soap qrcode adminhtml_qrcode index downloader %23
We need to find the cause whether it's a 3rd party module or an external bot and ban the IP it originates from.
The query "qrcode adminhtml_qrcode index" relates to one of our modules which we disabled and the search term stopped being searched. We don't want to leave this disabled and need to find the cause.
We've emailed the doofinder support team and here is their response to the issue
"If the IP which has made those searches is your own, it's because the internal searches are performed server to server from your server to ours. In this case you need to double check doofinder logs with your server access logs in order to find out the origin IP and ban it in your server.
If the problem are bots, they're attacks are not performed to doofinder, are performed to your search, no matter what the search engine is. You can explore, try other alternatives, but the search spamming will continue unless you tame security measures server side, like Cloudfare. Doofinder secures the layer to avoid bots, but we can't secure our customers internal search, it must be done in their servers."
The full doofinder search logs are available.
If you require any further information please contact us.
SEO & Social Media Guru for Fashion Category: Facebook Marketing, Internet Marketing, Link Building, SEO, Social Media Marketing Budget: ₹1500 - ₹12500 INR