[roosiinfidel09]

One of the tricks I read about is adding random numbers and letters followed by /../ takes you to the previous directory. My question is are there any tricks for accessing URLs disallowed in robots.txt? like /users/password/

Also, how many times do you add the "/../" ..just once or multiple times?

[CyberStrike]

Directory traversal - https://www.owasp.org/index.php/Path_Traversal

URL's disallowed in robots.txt are just not supposed to be indexed by the spidering bots of google or whatever search engine. Read more here :

https://support.google.com/webmasters/an...2608?hl=en

When you say forbidden I think of 403 errors, is that what you are facing.

[roosiinfidel09]

Directory traversal - Path Traversal - OWASP

URL's disallowed in robots.txt are just not supposed to be indexed by the spidering bots of google or whatever search engine.  Read more here :

Introduction to robots.txt - Search Console Help

When you say forbidden I think of 403 errors, is that what you are facing.

In that case..I should be able to browse these pages. However, I am not. So, some other measure has been taken by the admin? I visit bex.rs/admin ..just shows a blank page..No erros..Run it through burp ..it shows connection timed out.

http://www.bex.rs/robots.txt

[CyberStrike]

In that case..I should be able to browse these pages. However, I am not. So, some other measure has been taken by the admin? I visit bex.rs/admin ..just shows a blank page..No erros..Run it through burp ..it shows connection timed out.

http://www.bex.rs/robots.txt

maybe they have a WAF? Perhaps ACLs?