Comments (3)
@abhinavm24 major updates were pushed, do check out.
Ucdriver is integrated now
from educative.io_scraper.
@abhinavm24 not possible at the moment, reason:
- session is stored locally using chrome user-data-dir, manages login system and stays logged in forever if the account is not authenticated in another device.
- the browser also helps in calling the api's that are auth protected so only logged in user can request and get an response
- single-file is integrated and it is well designed to scrape HTML data without any data loss and also removes js code, also the images are saved in base64 format so they are not linked to educative's servers.
- request-html also does the same thing by loading a browser and generating a response but doesn't help in obtaining the first 2 objectives that are mandatory
- also request-html is only created for python3.6, and not sure if the response if generated as good as singlefile.
from educative.io_scraper.
great work @anilabhadatta, will get scrapping then
from educative.io_scraper.
Related Issues (20)
- THE CHROME BROWSER DOES NOT WORK HOT 1
- ERROR - StartScraper - start: 20: ExtensionScraper:start: 50: ExtensionScraper:scrapeCourse: 91: ExtensionScraper:scrapeTopic: 152: QuizUtility:downloadQuizFiles: 25: QuizUtility:downloadQuiz: 69: 'explanation' HOT 4
- Error: CourseCollectionsJson and CourseTopicUrlsList Urls are not equal HOT 9
- failure HOT 4
- unable to proceed due to captcha HOT 3
- ERROR CourseCollectionsJson and CourseTopicUrlsList Urls are not equal HOT 4
- Can't get full source code files HOT 9
- Unable to run in Macos Apple silicon HOT 9
- [Feature request] Support category in viewer HOT 7
- I am getting this error HOT 5
- Error: ShowUtility:showCodeSolutions: 59: Message: javascript error: Cannot read properties of null (reading 'click') HOT 3
- Exception when get course has Cloud lab inside HOT 2
- Cant Run in Linux Server HOT 7
- [Minor Bug] [MacOS] Scraper fails to run if path has space in it HOT 1
- looking for Educative course downloader HOT 1
- Group Downloaded Topics by "Modules" or "Sections" HOT 1
- Reduce Downloaded File Size for PDF HOT 1
- Create one PDF for full course, with Contents HOT 1
- iframe elements not saved correct HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from educative.io_scraper.