After a long speculation, apply finally accepted that they have Apple Web Crawler and the same crawler is used for Siri and Spotlight as well. The user agent will follow the string which contains “AppleBot”. They also throw some light ...
Tag: Apple Web Crawler