Coder Social home page Coder Social logo

linvo-io / linvo-scraper Goto Github PK

View Code? Open in Web Editor NEW
589.0 589.0 65.0 143 KB

Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io

Home Page: https://linvo.io

License: MIT License

TypeScript 100.00%
automation hacktoberfest hactoberfest-accepted linkedin puppeteer scraper

linvo-scraper's Introduction

logo

Welcome to the Linvo organization

Website | Linkedin | Facebook Group

Here you can find secure scraping using Puppeteer for different Linkedin actions

  • Login
  • Scrape profiles: Sales Nav / Normal
  • Connection Request
  • Follow message
  • Endorse Profile
  • Visit Profile
  • Like posts
  • Random Engagement

Who made this project

This project was made by Linvo - The Safest Linkedin Automation Tool, and being maintained by Nevo David Any contribution is welcomed!


We accept contribution with great love! Show your interest! Contribute!

linvo-scraper's People

Contributors

arjun31415 avatar codingis4noobs2 avatar emalton avatar kailashchoudhary11 avatar nevo-david avatar shashankbhatgs avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

linvo-scraper's Issues

Send a message without connect

There is a trick to sending a message without a connect message.
You go to group members:
https://www.linkedin.com/groups/6519652/members/

You will find out a "message" button.
If you click on the button, it will write a message to that persona without connecting.

We need to create a process that gets the group id, prospect name, and message searches for that prospect name in the group and sends a message.

Readme.md example code triggers error

System Information:

  • OS: Windows 11 Home
  • Processor: x64-based processor
  • Node version: v16.15.1

Issue

In the Readme.md, there is the following code:

import * as LinvoScraper from 'linvo-scraper';
import * as puppeteer from 'puppeteer';

(async () => {
    const browser = await puppeteer.launch({
        headless: false
    });
    const page = (await browser.newPage());
    const cdp = await page.target().createCDPSession();

    // that's the res Linvo is working in production
    await page.setViewport({
        width: 1440,
        height: 900,
    });

    // add ghost-cursor for maximum safety
    await LinvoScraper.tools.loadCursor(page, true);

    // Login with Linkedin
    const {token} = await LinvoScraper.services.login.process(page, cdp, {
        user: '[email protected]',
        password: 'superStrongPass!!%'
    })

    // set cookies
    await page.setCookie({
        name: "li_at",
        value: token,
        httpOnly: true,
        secure: true,
        sameSite: "None",
        priority: "Medium",
        path: "/",
        domain: ".www.linkedin.com",
    });
   //BELOW FUNCTION TRIGGERS ERROR
    await LinvoScraper.services.connect.process(page, cdp, {
        message: 'Hi Nevo! Let\'s connect!',
        url: 'https://www.linkedin.com/in/nevo-david/'
    })
})();

Code block that triggers error (line 38):

   //BELOW FUNCTION TRIGGERS ERROR
    await LinvoScraper.services.connect.process(page, cdp, {
        message: 'Hi Nevo! Let\'s connect!',
        url: 'https://www.linkedin.com/in/nevo-david/'
    })

Error Message

const gotSelector = "[Got Selector]".cyan() + " " + selector.blue();
TypeError: "[Got Selector]".cyan is not a function

[OTHER] Sponsorship

What would you like to share?

Hi love your repo and product. Would like to explore possible collaboration. Please get in touch.

Additional information

No response

Scrape comments

Scrape people comments
Please keep the same format like the global scraper

I can't use search filter from Linvo-scraper

Description

I'm not able to use the LinvoScraper.services.scraper.process() because a url generated from functions it's invalid. The result shows an invalid url.

Screenshots

image

Additional information

I openned a pull request solving the problema.

Hacktoberfest issues

Hi, just stumbled into this repo from reddit and noticed it was tagged with the hacktoberfest tag. I saw there's an issue to add a contributing template. Is there any low-hanging fruit or feature requests that you might want people to contribute towards? I'm interesting in lending a hand.

[DOCS] <description>

Description

Add README.md file.

Screenshots

No response

Additional information

No response

[DOCS] Add URL examples for scraping services

Description

I have been trying to use Linvo's scraping library found in the linkedin.global.page.service.ts . Unfortunately, in the required parameters section it doesn't specify which URLs are acceptable for scraping.

interface RequiredData {
  page: number;
  url: string; //WHAT DOES THE URL LOOK LIKE
  remove_overlapping: boolean;
}

It would be very helpful to provide one or more of the following:

  • TypeScript URL checking
  • A descriptive URL related comment in the linkedin.global.page.service.ts file
  • A descriptive error message that outlines which webpages are appropriate
  • Documentation that specifies which webpages can be scraped

Right now, when I provide the following URL as an argument

https://www.linkedin.com/search/results/all/?keywords=DATA%20SCIENCE%20JOBS&origin=GLOBAL_SEARCH_HEADER&sid=Q~M

I receive the warning:

originalMessage: 'Cannot navigate to invalid URL'

Unfortunately, for less experienced users like myself, this error message is not informative enough to be actionable.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.