Comments (6)
Thanks, @cullenwatson ! It's working now and it's soo fast, really appreciate the work you have done!
This is one issue, it is not scraping the "Salary" from indeed. Previous scraper used to scrap that (Min and Max amount). Although the salary is mentioned on the website. Please try with "Dubai, United Arab Emirates" as country. Once again, thank you for prompt responses and fixes! :)
from jobspy.
Stay tuned for release later tonight, will fix this
from jobspy.
pip install -U python-jobspy
should be good
from jobspy.
Hi, @cullenwatson
Seems like issue still persists, if I try to scrap for past 24 hours it will scrap 1 job. If I do 48 hours, it scrapes 2 jobs and for 72 hours it scrapes 3 jobs. Seems like it is scraping only first job of each page or something similar.
Please, try with location "Dubai" and country "United Arab Emirates" because I tried with US it works fine. Issue is based on location I guess.
Output for past 72 hours:
2024-03-11 10:11:51,320 - JobSpy - INFO - Indeed search page: 1
2024-03-11 10:11:51,679 - JobSpy - INFO - Indeed search page: 2
2024-03-11 10:11:52,010 - JobSpy - INFO - Indeed found no jobs on page: 2
2024-03-11 10:11:52,010 - JobSpy - INFO - Indeed finished scraping
Found 3 jobs
site ... ceo_photo_url
0 indeed ... NaN
1 indeed ... NaN
2 indeed ... https://d2q79iu7y748jz.cloudfront.net/s/_ceoph...
[3 rows x 26 columns]
Process finished with exit code 0
I have latest version of the package (1.1.48).
from jobspy.
fixed. try version 1.1.50. I'm getting 1k jobs now for 72 hours in Dubai
from jobspy.
for some reason the backend api doesnt give salary as often as the frontend method did
from jobspy.
Related Issues (20)
- Jobs' description is not scraped HOT 2
- scrape_jobs fails if any one of the sites has no results HOT 2
- Enhancement - Scrap data when status code 429, instead of exiting scraping - Linkedin HOT 2
- Segmentation fault HOT 3
- Not able to fetch job description from Linkedin HOT 1
- pip install -U python-jobspy returns error in VS Code HOT 1
- can search_term allows more key words as input HOT 3
- site_name parameter not working
- Please help with scraping linkedin job_url_direct HOT 6
- "job_url_direct" is returning null for Linkedin HOT 2
- Improve LinkedIn scraper robustness HOT 1
- ModuleNotFoundError: No module named 'distutils' HOT 1
- Unable to scrape jobs from multiple locations HOT 1
- Indeed USA is fetching only full-time jobs.
- Identifier of JOB is missing
- Fetch Job function from LinkedIn HOT 1
- Allowed List of Proxies, instead of only one.
- LinkedIn Scraper Fix - Increase offset by number of jobs pulled
- Ziprecruiter scraper partial descriptions
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jobspy.