ir/url2pdf-crawler-local
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

IT狗 2026-07-24: HPE AOS 10.x doc crawler (v1 + v2)

Browse Source 
- crawl_hpe.js: v1 single-phase (Phase 1 only)
- crawl_hpe_v2.js: v2 two-phase (discover versions + sub-pages)
- v2: auto-detects Chrome across Mac/Linux, sets fake UA, handles cloudflare-like Access Denied
- covered 209 pages for HPE AOS 10.x (60 versions + 149 sub-pages: features/resolved/known/regulatory)
- cumulative: 2.5MB markdown output, all sub-page sections parsed
This commit is contained in:
IT狗
2026-07-24 18:12:02 +08:00
parent 0d3e40f797
commit 1a451681ee
4 changed files with 616 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
package.json
+2 -1
View File
@@ -10,6 +10,7 @@
"author": "",
"license": "ISC",
"dependencies": {
"puppeteer": "^25.0.4"
"puppeteer": "^25.0.4",
"puppeteer-core": "^25.3.0"
}
}