Kizspy | Question: 9
(Choose 2 answers)
Which of the following are functions of the robot.txt file? (Select all that apply)
A. It identifies specific pages that should not be crawled by search engine bots
B. It outlines the site structure
C. It provides search engine bots your preferences for crawl speed
D. It merely controls the display of site content
