Comments (2)
lewisdonovan
commented on September 3, 2024
how to make it work to download past 5 years data for particular search word ??
The Google News search results page allows filtering by URL query params, so I could add a command line option to pass this into the URL.
That said, it looks like there's a limit to the number of results it will serve in a single page, even after scrolling for lazy-loaded results, so I'm not sure there's a programmatic way of pulling everything for such a long time period.
This tool isn't intended as a deep application integration, but rather a quick way to pull latest news for a given topic. You might be better off subscribing to an API such as The Press Association and pulling results that way.
from google-news-scraper.
lewisdonovan
commented on September 3, 2024
Solved in latest commit
d25ab90#diff-1fdf421c05c1140f6d71444ea2b27638
from google-news-scraper.
Related Issues (20)
- Heroku empty results HOT 2
- pretty urls not working. HOT 2
- TypeError: UnhandledPromiseRejectionWarning on requesting of news inside Express App HOT 7
- Add Actual date object to response HOT 1
- News Sorted HOT 1
- import of node-fetch throws an error [ERR_REQUIRE_ESM] while during runtime HOT 3
- Premature close HOT 5
- Import module error with NestJS HOT 1
- Issue on Pupppeteer HOT 1
- Package no longer returns news HOT 2
- ERROR REJECTING COOKIES: Error: No element found for selector: [aria-label="Reject all"] HOT 2
- Image fundamental change HOT 3
- Enhancements HOT 2
- Issue when hosted on vercel. HOT 9
- Faster - PrettyURL HOT 2
- Error: Could not find Chrome HOT 1
- Config ignored? HOT 2
- No 'subtitle' property in output HOT 2
- Vercel Support HOT 1
- Deploying on Heroku - app crashed HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from google-news-scraper.