About our crawler

IntellegoBeacon is the crawler of Intellego Softworks. It looks for Turkish companies that may need custom software, and reads a few public pages of their own websites, such as the home, about and contact pages, to understand what each company does.

It reads robots.txt first and follows it. It never reads a page that robots.txt forbids, waits between requests, reads at most a few pages per site, and never logs in or fills in forms.

It keeps the company's name, city, sector and a short description, with the address of the page each fact came from. Of contact details it keeps only company addresses such as info@, company phone numbers and the address of a contact form, never a named person's address.

To keep IntellegoBeacon off your site, add these lines to your robots.txt: User-agent: IntellegoBeacon and Disallow: /. To have your company's data removed, write to contact@intellego.com.tr.