SiteGrab v3.0 — Offline Web Archiver & Asset Discovery Pipeline
Greetings All,
After completing initial performance benchmarking, I am releasing SiteGrab v1.0 — a zero-dependency, multi-language pipeline designed for offline web mirroring, static asset mapping, and security reconnaissance.
Whether you are performing offline source code audits, archiving target assets during a bug bounty scope evaluation, or preserving documentation, SiteGrab automates the discovery and recursive harvesting of web assets.
Key Features:
- Core C++ Engine: Lightweight, zero-external-dependency CLI built for high-speed recursive crawling and DOM traversal.
- Multi-Interface Design: Native C# WinForms GUI for quick desktop use alongside Python components for custom scripting.
- Asset Path Reconstruction: Automatically harvests and rewrites relative/absolute paths for CSS, JS, fonts, and media to ensure functional offline viewing.
- Strict Domain Bounding: Keeps target crawling strictly within authorized scope boundaries.
- Static Asset Extraction: Isolates client-side scripts and endpoints for offline manual code review and vulnerability analysis.
Use Cases for Security Researchers:
- Bug Bounty Scope Archiving: Capture a full snapshot of target web applications before/during assessment.
- Client-Side JS Analysis: Harvest all JS endpoints locally to grep for hardcoded secrets, hidden endpoints, or API keys.
- Offline Security Auditing: Perform source code reviews on target DOM layouts without sending redundant traffic to target servers.
Repository & Downloads:
GitHub Repository: github[dot]com/aix567/sitegrab
Future Roadmap & Feedback:
I am currently working on adding more features to expand the C++ engine and polish the GUI interface. I'd love to hear your feedback or suggestions!
Feel free to test it out, report any issues on GitHub, or leave feedback below!
ZoR0