hello, i have a home page with some links and mail ids i need to stop scraping my urls and mail-ids form that web page... i have used robots.txt but most of the bad crawlers wont respect that....
Originally asked by: raj on Stack Overflow
hello, i have a home page with some links and mail ids i need to stop scraping my urls and mail-ids form that web page... i have used robots.txt but most of the bad crawlers wont respect that....
Originally asked by: raj on Stack Overflow
Answers