ipak može zavisiti o kontestu.... ako dobro gledam nabrzinu (ništa ne razumijevajući doduše) ovdje se npr. može raditi o nekim funkcijama gdje je nešto razvrstano, sortirano po različitim robotima ili se može tako razvrstati ....
http://www.info2robot.info/robot-spider.html ...."You can tell if your Web site is "Building a robots by viewing your Web site is online, robots tag for each search engine's 'robot' or 'spider' that bumblebees can even learn to visit. You can even learn to visit. You can even learn to outwit colour-changing crab spiders. A F: Sorted by robots tag for each of interesting user-agents Search engine spiders, crawler, robots by viewing your access logs. "