How To View Hidden Directories In A Website Using Robots.txt
Many a times in hacking you need to know the web directories. But its hard to find it out as a server might contain uncountable no. of Directories in it. But a major hole in this security is the Robots.txt What is Robots.txt Robot.txt is the file in the [ wwwroot ] of a server to define the Bots the Functionality on the website. There are many Bots on the internet like the most famous are Google Search Engine BOT aka Google Spider , Yahoo Search Engine Bot and many others. What robots.txt do is that it gives orders to the Bot on how to spider on the website…. Now you may ask what’s the use of Robots.txt file. Well it is used by webmasters to add functionality to the upcoming bots on there website and also to hide the directories in the website and where the Bot should not go and spider. Analyzing Robots.txt For Hacking Stuff Well its really simple, the first question you would ask is ...