What's Changed
- improvements to support pausing: by @ikreymer in #919
- Fix typo 'runInIframes' by @HexagonWin in #918
- Add option to respect robots.txt disallows by @tw4l in #888
- Add downloads dir to cache external dependency within the crawl by @ikreymer in #921
- deps: update to browsertrix-behaviors 0.9.7, puppeteer-core 24.31.0 by @ikreymer in #922
- fix connection leaks in aborted fetch() requests by @ikreymer in #924
- crash page on prompt dialog loop to continue: by @ikreymer in #929
- sitemapper refactor to fix concurrency: by @ikreymer in #930
- Rename robots flag to --useRobots, keep --robots as alias by @tw4l in #932
New Contributors
- @HexagonWin made their first contribution in #918
Full Changelog: v1.9.3...v1.10.0
Contributors
ikreymer, tw4l, and HexagonWin