(Choose 1 answer)
The protocol that was created in the early days of the Internet to prevent robots from crawling areas of the Web they were not supposed to access is referred to as:
A. robots.txt
B. XML sitemap
C. HTML sitemap
D. None of the others
Q: 23
