I created a project at https://davidclews.com/article/158.html and the robots.txt for https://www.homebase.co.uk/robots.txt appears a parse correctly but in node 20 when running canCrawl on a url the function stalls with no exception. What could this be?