Talk:Search engine scraping

I am a developer myself and have been working through the difficulties of scraping search engines for quite a long time. Now being quite experienced in this topic I want to share methods, difficulties and legal matters as this is a very difficult topic for many developers and I have been helping people on various platforms.

I considered adding a section the "web crawling" but it's a too big topic and would distort that page which is a general crawling info/tool site.

I would appreciate any constructive help on my article, I did not edit wikipedia for many years and might have made some mistakes.