IT狗 1a451681ee IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2) ...

- crawl_hpe.js: v1 single-phase (Phase 1 only)
- crawl_hpe_v2.js: v2 two-phase (discover versions + sub-pages)
- v2: auto-detects Chrome across Mac/Linux, sets fake UA, handles cloudflare-like Access Denied
- covered 209 pages for HPE AOS 10.x (60 versions + 149 sub-pages: features/resolved/known/regulatory)
- cumulative: 2.5MB markdown output, all sub-page sections parsed

2026-07-24 18:12:02 +08:00

.gitignore

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

convert.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

crawl_fast.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

crawl_hpe_v2.js

IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)

2026-07-24 18:12:02 +08:00

crawl_hpe.js

IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)

2026-07-24 18:12:02 +08:00

crawl_md_batch.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

crawl_md.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

crawl.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

find_links.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

package-lock.json

IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)

2026-07-24 18:12:02 +08:00

package.json

IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)

2026-07-24 18:12:02 +08:00

pdf.js

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

server.py

v1.0.0: URL-to-PDF + Doc Site Crawler

2026-05-22 14:24:05 +08:00

S

Description

Local dev scripts (crawl_hpe.js + v2 + cleaners)

67 KiB