
目前,出版商必须针对每一个爬取网络收集数据的机器人分别设置多种屏蔽指令,但新提出的方案将允许他们输入一条标准化的单一指令,该指令将得到识别和遵守。
Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data, but the new proposed solution will allow them to enter a single, standardised instruction that's recognised and honoured.