very aggressive bot (2 or 3 requests per second) + fell for bad bot trap + query string keywords all lowercased! This is a very bad bot, and is probably run by a fake company. Info on their site:
LiteFinder Network Crawler is a research project started by a group of Indian candidates from the cities of Bangalore, Patna and Jaipur. The project serves as a testing ground for information search technologies and programs, developed by a group of young scientists. LiteFinder Network Crawler was started as the means of simplifying the search of specific information at the sites that can be found with the help of general-purpose search engines. The project was developed due to the grants provided by several foreign companies specializing in research in the field of information search.
Livelap is a content discovery app that indexes web content. Probably you have seen the Livelapbot/0.1 or LivelapBot/0.2 crawler in your server logs. LivelapBot can visit a page if it is shared on social media, and as part of its RSS/page crawling schedule.
What does LivelapBot collect
Livelap indexes web content and makes meta data and a link to your content available in livelap.com and in the Livelap app. For indexing we only use official HTML and media meta tags in your page. We don't scrape the contents of your articles. The following fields are used for indexing: Title Description Author Publication date Type of content (article, photo, video, etc) Images (og, twitter and other standard tags) Videos (og, twitter and other standard tags) RSS links Detect whether showing page in iframe is allowed