โ† Back to Challenges

๐Ÿค– Robot Spy

โ˜…  Easy ยท 100 pts

Did you know that almost every website has a special file called robots.txt? It tells search engine robots (like Google) which pages they're allowed to visit and which ones are off-limits.

Sometimes, website owners accidentally leave interesting information in this file...

๐Ÿ’ก Hint: Try visiting this website's robots.txt file by adding /robots.txt to the website address. Read everything carefully โ€“ even the comments!

๐Ÿ“– What does robots.txt look like?

Here's an example of a robots.txt file:

User-agent: * Disallow: /private/ Disallow: /admin/ # Comments look like this โ€“ they start with # # Robots ignore comments, but humans can read them!
๐Ÿค” Stuck? Click for an extra hint

Open a new tab and go to: http://localhost:3000/robots.txt

Lines that start with # are comments. The flag might be hiding in one of those comments!

๐Ÿšฉ Submit Your Flag