g-glitch404 / investing.com-scraper

scrape news articles from investing.com as much as you want

What does Investing.com News Scraper do?

Investing Scraper will enable you to get all the news Articles you want from Investing.com since they have no API.

This Investing Scraper will let you scrape and extract large datasets as often as you need to. The structured data can be downloaded as XML, JSON, CSV, HTML, and Excel, so that you can use it in your own applications, spreadsheets, reports, or other tools.

Investing Scraper will scrape:

• Image - The title of the article
• Title - The title of the article
• Category - The Category that the article belongs to
• Publisher - Name of the Publishing agency.
• Date - Publishing date of article and the website might replace it with last article update date
• Link - The url of scraped articles
• Comments - Amount of comments and All the comments and replies on the article
• Paragraph - All text of the article body, and it is filtered to perfection "almost" ;)

Why should I use Investing Scraper ?

• Investing.com has 150Million visits per month and is a great data source for Finance and Investing news articles.
• Saves time if You have no time to build your own scraper from scratch
• It doesn't need any proxies.
• 1000 articles took 190 seconds for date range "anytime", so you can scrape at a rate of 330/min.
• The first 30 - 45 seconds the docker is building your image so this is why it might be slow sometimes

Here are just some of the ways you could use that data:

• Having a grate and fast daily news about finance
• Market research and marketing camping's targeting finance or worldwide news
• Analyzing Articles and extract keywords for marketing opportunities
• Juicy Burgers for machine learning and AI modules
• Generating content about finance and news

If you would like more inspiration on how scraping Investing.com Will help your business or organization, check out our industry pages.

How to scrape Investing.com

It's easy to scrape Investing.com with Investing Scraper. Just follow these steps to get your data at the speed of light.

1. Click on Try for free.
2. Use the default start URLs or customize them to only scrape a section or category on Investing.com.
3. Select the maximum number of items you want to scrape default is 100.
4. Click on Run.
5. preview or export your data from the Dataset tab.

How much will it cost to use my Investing Scraper?

• You get 3 days trial to try the scraper
• This Scraper is 10$ a month plus the Apify platform usage.
• 1000 articles could potentially cost $0.1 of platform usage
  • with the free apify account you can scrape around 50,000 daily news and archived Articles
  • Investing.com has around 250K articles and archived news and alot of daily data gets uploaded every single day

A sample of the results that will be provided by the Scraper

[
    {"Image": "ARTICLE_IMAGE", "link": "ARTICLE_URL", "title": "ARTICLE_TITLE", "category": "ARTICLE_CATEGORY", "PUBLISHER": "PUBLISHING_AGANCY", "date": "ARTICLE_DATE", "comments": "ALL_ARTICLE_COMMENTS_AND_REPLIES", "paragraph": "All_ARTICLE_TEXT"},

    {
        "image": "https://i-invdn-com.investing.com/news/LYNXMPEE0214A_L.jpg",
        "title": "'Ripple Is Wrong' Claims SEC In New Filing, Shibarium Announces New Era in SHIB Burns, Arthur Hayes Predicts Crucial BTC Bottom to Watch: Crypto News Digest by U.Today",
        "category": "cryptocurrency news",
        "publisher": "Reuters",
        "date": [
          "Published Jan 31, 2024 02:57PM ET",
          "Updated Jan 31, 2024 06:00PM ET"
        ],
        "comments": [
          1,
          [
            [
              "Johnny Crash",
              "2024-02-01 03:40:09",
              "Burn all the SHIB you like, it's still a 💩coin",
              "https://www.investing.com/members/229823066"
            ]
          ]
        ],
        "link": "https://www.investing.com/news/cryptocurrency-news/ripple-is-wrong-claims-sec-in-new-filing-shibarium-announces-new-era-in-shib-burns-arthur-hayes-predicts-crucial-btc-bottom-to-watch-crypto-news-digest-by-utoday-3289076",
        "paragraph": "U.Today - U.Today presents the top three news stories over the past day.\nXRP case: \"Ripple is wrong\" claims SEC in new filingFollowing Ripple's objection to the SEC's recent request to provide audited financial statements and contracts related to XRP sales, the regulatory agency has fired back. In its latest filing, the SEC refutes Ripple's argument that the SEC's motion is \"untimely,\" asserting that seeking remedies-related discovery is not time-barred and is the standard course of action for securities law violations. The regulator also stressed the importance of post-complaint facts in determining remedies, refuting Ripple's claim that such information does not affect the court's decisions. The SEC concluded that the discovery requests are both procedurally proper and highly relevant, stating that Ripple's procedural objections lack validity.Shibarium announces new era in SHIB burns with transformative burning mechanismLucie, prominent Shiba Inu team member, announced in her recent X post that Shibarium is entering a new era with a transformative new mechanism for SHIB burning. As stated in an article of the latest issue of the SHIB Magazine, the mechanism will transfer tokens to unspendable blockchain wallets, aiming to reduce the current circulating supply of Shiba Inu. Per the article, the mechanism is “designed to reduce token supply strategically” in order to potentially increase SHIB’s value and benefit the Shibarium ecosystem. This innovative burn method will be tested on the Shibarium testnet, also known as Puppynet. Instead of operating in manual mode like it did previously, it will now operate automatically. While testing the new mechanism, the SHIB team will be making several improvements to \"enhance efficiency and reliability.\" Only after that, it will be launched on the Shibarium mainnet.Arthur Hayes predicts crucial Bitcoin (BTC) bottom to watchIn a recent Substack post, Arthur Hayes, BitMEX cofounder and former CEO, has shared a major Bitcoin price prediction as to when the largest crypto will test its bottom. Drawing conclusions from the world economic situation, Hayes noted how susceptible the abated inflationary pressures are to returning in no time. Based on this, he forecasted a 30% correction from the spot Bitcoin Exchange Traded Fund (ETF) high of $48,000. If this prediction comes true, Hayes sees BTC dropping to the $30,000 and $35,000 price range. The price of Bitcoin has plummeted since the SEC approved the 11 spot BTC ETFs that now trade on the market. At the time of writing, Bitcoin is changing hands at $39,795, down 0.70% over the past 24 hours, per CoinMarketCap.This article was originally published on U.Today"
    }
]

Tips for scraping Investing.com using Investing Scraper for the best results

• Date Range is an excellent feature you should try it to scrape all the articles that pleases you
• Date Range Feature has a huge positive effect on the performance
• Choose you specified startUrls to the best results

Is it legal to scrape Investing.com?

• Webscraping is legal and scraping any publicly available data is legal
• You might want to review the terms of service for any website you want to scrape in general
• Note that personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. We also recommend that you read our blog post: is web scraping legal?

Contact me

• I would love to hear from you in the issues tab for any Suggestions or Errors
• Feel free to contact me on my GitHub

More Scrapers and More News and More and More Data

• The Ultimate News scraper
• investopedia.com scraper