mail.rwws.com requests WebKnight FAQ each time with different user agent (in 1 day), not the same interval, so it is not really monitoring. Connecting to http://mail.rwws.com/ shows coming soon page connecting to http://mail.rwws.com/ shows windows 2000 under construction site very bad thing, doesn't feel right!
Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.