An Apify actor that crawls web pages from a list of provided domains and analyzes them. For example, it checks whether pages have HTTPS version, saves their HTML content and screenshot, HTTP response headers, SSL certificate information, text body, outgoing links, emails, phone numbers, social handles and more.
Home Page: https://apify.com/jancurn/analyze-domains
License: Apache License 2.0
Hi there,
I tried to analyze this url : http://www.timelinetravel.co.za/
It seems to be an error on the url parsing as the domain extension .co.za becomes only .co. Then, the website is wrongly requested !
Instead of http://www.timelinetravel.co.za it goes on http://www.timelinetravel.co the end extension.za is missing !!
How can I fix this ??
Here is the ERROR message below:
ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"http://www.timelinetravel.co","retryCount":1} 2020-01-23T14:07:35.958Z Error: net::ERR_NAME_NOT_RESOLVED at http://www.timelinetravel.co 2020-01-23T14:07:35.959Z at navigate (/home/myuser/node_modules/puppeteer/lib/FrameManager.js:107:37) 2020-01-23T14:07:35.960Z at <anonymous> 2020-01-23T14:07:35.961Z at process._tickCallback (internal/process/next_tick.js:189:7) 2020-01-23T14:07:35.962Z -- ASYNC -- 2020-01-23T14:07:35.964Z at Frame.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:144:27) 2020-01-23T14:07:35.965Z at Page.goto (/home/myuser/node_modules/puppeteer/lib/Page.js:624:49) 2020-01-23T14:07:35.966Z at Page.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:145:23) 2020-01-23T14:07:35.967Z at PuppeteerCrawler.gotoFunction (/home/myuser/node_modules/apify/build/puppeteer_crawler.js:26:14) 2020-01-23T14:07:35.968Z at PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/puppeteer_crawler.js:320:35) 2020-01-23T14:07:35.969Z at <anonymous> 2020-01-23T14:07:35.970Z at process._tickCallback (internal/process/next_tick.js:189:7)
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
