How To View Hidden Directories In A Website Using Robots.txt
Many a times in hacking you need to know the web directories. But its hard to find it out as a server might contain uncountable no. of Directories in it.
But a major hole in this security is the Robots.txt
Robot.txt is the file in the [ wwwroot ]of a server to define the Bots the Functionality on the website.
There are many Bots on the internet like the most famous are Google Search Engine BOT aka Google Spider , Yahoo Search Engine Bot and many others.
What robots.txt do is that it gives orders to the Bot on how to spider on the website….
Now lets test Robots.txt files of various well known websites.
But a major hole in this security is the Robots.txt
What is Robots.txt
Robot.txt is the file in the [ wwwroot ]of a server to define the Bots the Functionality on the website.
There are many Bots on the internet like the most famous are Google Search Engine BOT aka Google Spider , Yahoo Search Engine Bot and many others.
What robots.txt do is that it gives orders to the Bot on how to spider on the website….
Now you may ask what’s the use of Robots.txt file.
Well it is used by webmasters to add functionality to the upcoming bots on there website and also to hide the directories in the website and where the Bot should not go and spider.
Well it is used by webmasters to add functionality to the upcoming bots on there website and also to hide the directories in the website and where the Bot should not go and spider.
Analyzing Robots.txt For Hacking Stuff
Well its really simple, the first question you would ask is Where is robots.txt Located ?
The answer is its in the [ WWWROOT ].
Don't Understand till yet , its in the main Directory.
Lets take the example of Hacker The Dude Website ;)
The answer is its in the [ WWWROOT ].
Don't Understand till yet , its in the main Directory.
Lets take the example of Hacker The Dude Website ;)
Go Ahead and type it in the Address bar of your Browser then what do you see,
Do you see that , this is the Robots.txt for the Hacker the dude website Now lets first Analyze this Robots.txt 
First Line :-
User-agent: Mediapartners-Google
This means that the above statements are given for the Google Search Engine Bot i.e. Google Spider.
Second Line :-
Disallow:
This mean that nothing is disallowed to the Google Bot, Remember these Orders are given to the Google bot only not other bots.
Third Line :-
User-agent: *
This means that now all the bots coming to the blog will follow these rules.note that previous rules were for only Google Bot.
Fourth Line :-
Disallow: /search
This means that all the bots will not spider the files under the directory /search in the following Blog.
Fifth Line :-
Sitemap: http://hackerthedude.blogspot.com/feeds/posts/default?orderby=updated
This is basically my blogs sitemap. Not very important.
Working Demo
Now lets test Robots.txt files of various well known websites.
1. Mine Favorite = Google !!
Now you would see some very useful links in it for example, in termas of the hacking its very useful to know more about our Victim.
Allow: /profiles
Disallow: /katrina?
Disallow: /tbproxy/
Hell, Google Knows Katrina Kaif :D
Conclusion
Now that you have seen the working demo and the uses and the read the whole article then you would be pretty sure on how we are going to find the vulnerability in a website without even first hacking it.
btw I Love Robos.txt
btw I Love Robos.txt
Comments
i have been a victim of scam to different hackers who almost ruined me, till i read about:(wizardcyprushacker@gmail.com) i decided to give him a try and just lastnight i checked my credit score and saw the positive changes he had made!! i have since then connected him to friends and family who all were flabbergasted by his results, i feel its only right i share him with the public as am sure there are so many in my situation...
believe all you see about hacking stuff
on here… Don’t fall prey to fake
hackers…contact (fabuloushacker01@gmail.com) for a legit hacking solution and he also refunds client money back if
he can’t meet up with the time given
for your job. Be
advised… Thank you.
how real hackers work, they never advertise themselves in such a
credulous manner and they are always discrete. I have been ripped off so
many times so from experience I know pretty much how they work.
Eventually my zeal to solve my issue paid off when a friend of mine
introduced me to this guy, his professionalism is top class.
I am sharing this piece of info for those who genuinely want the service
of a professional hacker...contact him ; wisetechhacker (at) gmail.com
He is fast and reliable
asorehackcorp@gmail.com
Asore Corp is a Russian based group of multinational Hacker's, an affiliate of Evil Corp. We have mutual interests obliged to fight online scam and scammers in general. In doing this, we make sure by all means necessary that our clients get the best of services on a🔐PAYMENT AFTER JOB IS DONE BASIS✔️. Rather than send money and trust a criminal to fulfill your deal, you can make sure the job is done before it's paid for. You'll get excellent customer service. And it will cost a lot less than you think.
That's a 100% guarantee.
⚠️ BEWARE OF FRAUDSTARS
if you have been a VICTIM, contact us via:
✅ mercurycrimewatch@gmail.com
Here, it's always a win for you.
Having been on various headlines since 2004 hitherto, Asore Corp hosted a conference in August 2006 tagged "The Hacker's profile", which was anchored by Morgan Marquis Boire a then Hacker at Microsoft. Also, Asore Corp have acquired a hall of fame well deserved for solving tedious puzzles shocking the internet countless times. We possess highly qualified hackers recruited and registered under the right agencies.
Without any reasonable doubts, it is no news that Asore Corp offer one of the best Hacking services world wide.
Amongst others, services we offer are listed 📌as follows :
Social media hack, (Facebook, Instagram, snapchat,Zoom, Tik tok etc)✔️
Credit card top up,✔️
Credit card dept clearing.✔️
Database hack,✔️
Money transfer,✔️
Verified Paypal Accounts hack,✔️
E mail hack,✔️
College score upgrade ,✔️
Android & iPhone Hack✔️
BinaryOption funds recovery ✔️
Website design ✔️
Website hack✔️
etc.
CONTACT:
🤳asorehackcorp@gmail.com
cryptocoinintel@gmail.com
Asore Corp®️
©️2020
Terms and conditions apply.