Commit Graph

2 Commits

Author SHA1 Message Date
IT狗 1a451681ee IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)
- crawl_hpe.js: v1 single-phase (Phase 1 only)
- crawl_hpe_v2.js: v2 two-phase (discover versions + sub-pages)
- v2: auto-detects Chrome across Mac/Linux, sets fake UA, handles cloudflare-like Access Denied
- covered 209 pages for HPE AOS 10.x (60 versions + 149 sub-pages: features/resolved/known/regulatory)
- cumulative: 2.5MB markdown output, all sub-page sections parsed
2026-07-24 18:12:02 +08:00
IT Dog 0d3e40f797 v1.0.0: URL-to-PDF + Doc Site Crawler
- Single URL to PDF via Puppeteer (Chrome headless)
- Doc Site Crawler: crawl entire documentation sites
  - Auto-extract all pages from TOC navigation
  - 20-page batch processing with browser restart (anti-OOM)
  - Output: PDF + Markdown
- Flask-style HTTP server on port 8099
- Deployed at https://pdf.donton.cloud/url2pdf
2026-05-22 14:24:05 +08:00