yoonwaiyan / stackskills-dl

Simple Ruby script to download all StackSkills tutorials.

🚨NOT MAINTAINED🚨

This script has not been maintained for some time due to personal reasons and I don't actively use StackSkills. Since they has tightened up their security access and using cookies doesn't seem to work for me, I'm putting off the maintenance of this for good.

stackskills-dl

• stackskills-dl
  • Information
  • Usage
  • Change Log

Information

❗️ This is a non-official Ruby script to download all StackSkills tutorials. Login email and password is required to get your list of subscribed courses. ❗️

Being inspired by some popular downloader libraries(youtube-dl, udemy-dl etc.) and no downloader library available for StackSkills(or SkillWise) courses, I've decided to put on this small scraping library to help you download the courses to your machine for offline viewing and take it as part of my Ruby learning and contributing to open source community.

This library will by default get all your subscribed courses and download them all into your local filesystem, structured into folders of course sections in each course and folders of lectures of each course section. The courses will be available in your /downloads folder within this repo. Extra options are available to download only one course based on the course ID or slug.

Usage

Check out the wiki page to get started.

Change Log

Change log is available in CHANGELOG.md.

stackskills-dl's Issues

Issue downloading

Good Day

I have gotten this to work but now i get this error

`C:/stackskills-dl/lib/lecture.rb:49:in ``': No such file or directory - youtube-dl --restrict-filenames https://fast.wistia.net/embed/iframe/7is59k8vtk (Errno::ENOENT)
        from C:/stackskills-dl/lib/lecture.rb:49:in `download_video'
        from C:/stackskills-dl/lib/lecture.rb:33:in `block in download'
        from C:/stackskills-dl/lib/utilities.rb:11:in `block in mkchdir'
        from C:/stackskills-dl/lib/utilities.rb:10:in `chdir'
        from C:/stackskills-dl/lib/utilities.rb:10:in `mkchdir'
        from C:/stackskills-dl/lib/lecture.rb:32:in `download'
        from C:/stackskills-dl/lib/course.rb:18:in `block (2 levels) in download'
        from C:/stackskills-dl/lib/course.rb:17:in `each'
        from C:/stackskills-dl/lib/course.rb:17:in `block in download'
        from C:/stackskills-dl/lib/utilities.rb:11:in `block in mkchdir'
        from C:/stackskills-dl/lib/utilities.rb:10:in `chdir'
        from C:/stackskills-dl/lib/utilities.rb:10:in `mkchdir'
        from C:/stackskills-dl/lib/course.rb:16:in `download'
        from C:/stackskills-dl/lib/course_finder.rb:10:in `block in run'
        from C:/stackskills-dl/lib/course_finder.rb:37:in `block in execute'
        from C:/stackskills-dl/lib/course_finder.rb:32:in `each'
        from C:/stackskills-dl/lib/course_finder.rb:32:in `execute'
        from C:/stackskills-dl/lib/course_finder.rb:9:in `run'
        from stackskills_dl.rb:8:in `<main>'
`

What does this mean?I have youtube-dl also in main directory but am stuck now.It does actually create folders but then that error.

"Unable to find this course: [...] from your list of courses."

Hello,
I've got the suspicion that the whole script is ignoring the pagination of the "my courses" page.
One page only displays 36 courses. I can't download courses that are on page 2.

Any solution for this? How can I help resolving the issue?
Thanks a lot in advance.

Not working

Looks like something broke, exit
xxxxxxx@yyyyyy:~/stackskills-dl-master$ ruby stackskills_dl.rb -c https://stackskills.com/courses/enrolled/36717
Login Email: [email protected]
Login password: *********
Traceback (most recent call last):
10: from stackskills_dl.rb:11:in <main>' 9: from /home/icarian/stackskills-dl-master/lib/course_finder.rb:11:in run'
8: from /home/icarian/stackskills-dl-master/lib/utilities.rb:12:in mkchdir' 7: from /home/icarian/stackskills-dl-master/lib/utilities.rb:12:in chdir'
6: from /home/icarian/stackskills-dl-master/lib/utilities.rb:13:in block in mkchdir' 5: from /home/icarian/stackskills-dl-master/lib/course_finder.rb:12:in block in run'
4: from /home/icarian/stackskills-dl-master/lib/course_finder.rb:28:in execute' 3: from /var/lib/gems/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in get'
2: from /var/lib/gems/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:321:in fetch' 1: from /var/lib/gems/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:998:in response_redirect'
/var/lib/gems/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:329:in `fetch': 503 => Net::HTTPServiceUnavailable for https://sso.teachable.com/secure/1453/users/sign_in?clean_login=true&reset_purchase_session=1 -- unhandled response (Mechanize::ResponseCodeError)

Problems with running the script.

I am really new at this and want to get this script running, so please bear with me :D.
I did the following:
-> Installed Bundler
-> Installed Mechanize gem.
On git bash when i run ruby stackskills_dl.rb i get the following:

C:\Ruby23-x64\bin\ruby.exe: No such file or directory -- stackskills_dl.rb (LoadError)

If i drag the file i get the following:

C:/Ruby23-x64/lib/ruby/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require': cannot load such file -- ./lib/input (LoadError)       
from C:/Ruby23-x64/lib/ruby/site_ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'       
from F:/Documents and Settings/User/My Documents/Downloads/stackskills-dl-master/stackskills_dl.rb:1:in `<main>'

What em i doing wrong ?

Not working

this comes when i try to run script
im using kali linux

./stackskills_dl.rb: line 1: require: command not found
./stackskills_dl.rb: line 2: require: command not found
./stackskills_dl.rb: line 3: require: command not found
./stackskills_dl.rb: line 4: require: command not found
./stackskills_dl.rb: line 5: require: command not found
./stackskills_dl.rb: line 7: input: command not found
./stackskills_dl.rb: line 8: syntax error near unexpected token `input'
./stackskills_dl.rb: line 8: `CourseFinder.run(input)'

Login works but course can't be found

Hi,

I'm trying your script which seems like it be very cool, but I get this error when trying to download a course: https://stackskills.com/courses/enrolled/33308

This happens for any course listed within My Courses.

Any thoughts?

I installed on my mac and try download course, but it seems doesn't work

attachment is log, please have a look and help on this, thanks
log.pdf

Not working,

undefined local variable or method `dashboard_page'

Getting the following error when trying to download one course:

stackskills_dl.rb:50:in find_course': undefined local variable or method dashboard_page' for main:Object (NameError)
from stackskills_dl.rb:76:in `

'

Net::HTTPInternalServerError

Receiving the following error when trying to d/l stackskills course:

/home/dmiller/.gem/ruby/gems/mechanize-2.7.4/lib/mechanize/http/agent.rb:316:in `fetch': 500 => Net::HTTPInternalServerError for https://stackskills.com/courses/116320/lectures/1707277 -- unhandled response (Mechanize::ResponseCodeError)
        from /home/dmiller/.gem/ruby/gems/mechanize-2.7.4/lib/mechanize.rb:464:in `get'
        from /home/dmiller/.gem/ruby/gems/mechanize-2.7.4/lib/mechanize.rb:373:in `click'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:121:in `block (2 levels) in analyze_course'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:190:in `block in each'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `upto'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `each'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:119:in `block in analyze_course'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:190:in `block in each'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `upto'
        from /home/dmiller/.gem/ruby/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `each'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:114:in `each_with_index'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:114:in `analyze_course'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:38:in `block in execute'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:36:in `each'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:36:in `execute'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:12:in `block in run'
        from /home/dmiller/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from /home/dmiller/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from /home/dmiller/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from /home/dmiller/stackskills-dl/lib/course_finder.rb:11:in `run'
        from stackskills_dl.rb:11:in `<main>'

This appears to be a new error as I just downloaded a course several days ago. Please advise. Thank you

Support PDF courses

Hey, good job on this.

However, the reason I wanted this is to download PDF based courses, not the mp4 ones. Some of these courses are really just a PDF of an E-book. I'd like that as a pdf file instead of embedded in the website.

Any way you could add this?

Thanks

Error in downloading videos

Downloading Course_Objective
/home/username/Videos/stackskills-dl/lib/lecture.rb:44:in ``': No such file or directory - youtube-dl (Errno::ENOENT)
   from /home/username/Videos/stackskills-dl/lib/lecture.rb:44:in `download_video'
   from /home/username/Videos/stackskills-dl/lib/lecture.rb:29:in `block in download'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:11:in `block in mkchdir'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:10:in `chdir'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:10:in `mkchdir'
   from /home/username/Videos/stackskills-dl/lib/lecture.rb:28:in `download'
   from /home/username/Videos/stackskills-dl/lib/course.rb:18:in `block (2 levels) in download'
   from /home/username/Videos/stackskills-dl/lib/course.rb:17:in `each'
   from /home/username/Videos/stackskills-dl/lib/course.rb:17:in `block in download'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:11:in `block in mkchdir'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:10:in `chdir'
   from /home/username/Videos/stackskills-dl/lib/utilities.rb:10:in `mkchdir'
   from /home/username/Videos/stackskills-dl/lib/course.rb:16:in `download'
   from /home/username/Videos/stackskills-dl/lib/course_finder.rb:10:in `block in run'
   from /home/username/Videos/stackskills-dl/lib/course_finder.rb:37:in `block in execute'
   from /home/username/Videos/stackskills-dl/lib/course_finder.rb:32:in `each'
   from /home/username/Videos/stackskills-dl/lib/course_finder.rb:32:in `execute'
   from /home/username/Videos/stackskills-dl/lib/course_finder.rb:9:in `run'
   from stackskills_dl.rb:8:in `<main>'

What could be the reason? I run it in sudo. Ruby version 2.3.1

Thanks!

Last-190620-stack

Manage Course Content by Course Sections

As mentioned in issue #20 :`

So it looks like that fixed the issue. Is there a way to download multiple
videos and keep them within a single folder for that section? See example
below.

Downloading fails with a "No such file or directory" from youtube-dl

I'm trying to download this lecture: https://stackskills.com/courses/sparkwords/lectures/1496358

Here's the full error dump:

Downloading I_HAVE_A_SECRET_TO_TELL_YOU
/home/beerend/stackskills-dl-master/lib/lecture.rb:57:in ``': No such file or directory - youtube-dl (Errno::ENOENT)
	from /home/beerend/stackskills-dl-master/lib/lecture.rb:57:in `download_video'
	from /home/beerend/stackskills-dl-master/lib/lecture.rb:37:in `block in download'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:13:in `block in mkchdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `chdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `mkchdir'
	from /home/beerend/stackskills-dl-master/lib/lecture.rb:36:in `download'
	from /home/beerend/stackskills-dl-master/lib/course.rb:24:in `block (2 levels) in download'
	from /home/beerend/stackskills-dl-master/lib/course.rb:23:in `each'
	from /home/beerend/stackskills-dl-master/lib/course.rb:23:in `block in download'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:13:in `block in mkchdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `chdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `mkchdir'
	from /home/beerend/stackskills-dl-master/lib/course.rb:22:in `download'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:13:in `block (2 levels) in run'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:41:in `block in execute'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:36:in `each'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:36:in `execute'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:12:in `block in run'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:13:in `block in mkchdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `chdir'
	from /home/beerend/stackskills-dl-master/lib/utilities.rb:12:in `mkchdir'
	from /home/beerend/stackskills-dl-master/lib/course_finder.rb:11:in `run'
	from stackskills_dl.rb:11:in `<main>'

I can send you the HTML source via e-mail for further debugging if this can help you, just send me an e-mail at [email protected].

Last-190620-stack

Docker build fails

Apparently the SSL certificates have changed since this project started, which causes Docker builds to fail when grabbing youtube-dl. Making the following change allows build to complete successfully.

--- a/Dockerfile
+++ b/Dockerfile
@@ -16,6 +16,8 @@ RUN apk add --no-cache git vim build-base wget
 # https://github.com/rg3/youtube-dl
 RUN set -x \
   && apk add --no-cache ca-certificates curl ffmpeg python gnupg \
+  && curl --remote-name --time-cond cacert.pem https://curl.haxx.se/ca/cacert.pem \
+  && export SSL_CERT_FILE=cacert.pem \
   && curl -Lo /usr/local/bin/youtube-dl https://yt-dl.org/downloads/latest/youtube-dl \
   && curl -Lo youtube-dl.sig https://yt-dl.org/downloads/latest/youtube-dl.sig \
   && gpg --keyserver keyserver.ubuntu.com --recv-keys '7D33D762FD6C35130481347FDB4B54CBA4826A18' \

File Name too Long

/usr/lib/ruby/2.3.0/fileutils.rb:253:in mkdir': File name too long @ dir_s_mkdir - 04. Class_#4-_VC_Part_2-_Security-Legal_Structures_to_Protect_You_+_Make_You_More_$_-Due_diligence_and_how_to_assess_a_management_team._Security_structures._Legal_information_to_help_protect_you_and_your_investments-company._Venture_capital_history_is_very_important_to_understand.Due_diligence_and_how_to_assess_a_management_team._Security_structures._Legal_information_to_help_protect_you_and_your_investments-company._Venture_capital_history_is_very_important_to_understand-. (Errno::ENAMETOOLONG) from /usr/lib/ruby/2.3.0/fileutils.rb:253:in fu_mkdir'
from /usr/lib/ruby/2.3.0/fileutils.rb:227:in block (2 levels) in mkdir_p' from /usr/lib/ruby/2.3.0/fileutils.rb:225:in reverse_each'
from /usr/lib/ruby/2.3.0/fileutils.rb:225:in block in mkdir_p' from /usr/lib/ruby/2.3.0/fileutils.rb:211:in each'
from /usr/lib/ruby/2.3.0/fileutils.rb:211:in mkdir_p' from /stackskills-dl-master/lib/utilities.rb:11:in mkchdir'
from /stackskills-dl-master/lib/lecture.rb:40:in download' from /stackskills-dl-master/lib/course.rb:24:in block (2 levels) in download'
from /stackskills-dl-master/lib/course.rb:23:in each' from /stackskills-dl-master/lib/course.rb:23:in block in download'
from /stackskills-dl-master/lib/utilities.rb:13:in block in mkchdir' from /stackskills-dl-master/lib/utilities.rb:12:in chdir'
from /stackskills-dl-master/lib/utilities.rb:12:in mkchdir' from /stackskills-dl-master/lib/course.rb:22:in download'
from /stackskills-dl-master/lib/course_finder.rb:13:in block (2 levels) in run' from /stackskills-dl-master/lib/course_finder.rb:41:in block in execute'
from /stackskills-dl-master/lib/course_finder.rb:36:in each' from /stackskills-dl-master/lib/course_finder.rb:36:in execute'
from /stackskills-dl-master/lib/course_finder.rb:12:in block in run' from /stackskills-dl-master/lib/utilities.rb:13:in block in mkchdir'
from /stackskills-dl-master/lib/utilities.rb:12:in chdir' from /stackskills-dl-master/lib/utilities.rb:12:in mkchdir'
from /stackskills-dl-master/lib/course_finder.rb:11:in run' from stackskills_dl.rb:11:in

'

Download location

Is there an option to define a different download location? If not, could it be added?

Invalid Login Credentials

Hi,
I just wanted to use your script to prepare me for a longer off-line stay
However, when replacing the example e-mail and password with my login credentials, and then running docker-compose run stackskills_dl the outcome is "Invalid Login Credentials"
I traced it back to the login_user! function, but am not fluid in Ruby, so cannot adapt the script. My guess would be that current_page_forms.first is not the login form? However, I do not
I checked the login credentials by copy pasting them from the docker script to stackskills - they are correct.
Any ideas on what may cause this?

I am using git-bash on Windows

SSL error on OS X Sierra

Hi,

I can't get past the login phase, getting this error:

/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/net/http.rb:921:in `connect': SSL_connect returned=1 errno=0 state=SSLv2/v3 read server hello A: sslv3 alert handshake failure (OpenSSL::SSL::SSLError)

Trying to connect to the site via openssl yelds this:

> openssl s_client -host stackskills.com -port 443 -ssl3
CONNECTED(00000003)
78674:error:1408F10B:SSL routines:SSL3_GET_RECORD:wrong version number:/BuildRoot/Library/Caches/com.apple.xbs/Sources/OpenSSL098/OpenSSL098-64.50.6/src/ssl/s3_pkt.c:300:

Switching to -tls works.

I've tried setting the ssl_version to TLSv1, downloading the wget certs and adding a store to mechanize, but to no avail.

Any ideas?

Issue using the script

Hello there. I'm trying to use your script on Mac but I get the following error

/Users/user/.rvm/rubies/ruby-2.4.0/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:55:in `require': cannot load such file -- highline/import (LoadError)

Could you help please

Cant find downloaded files

Hi, I'm using Docker to download some courses and I'm having two issues:
First issue is I can't seem to find the downloaded files. I've looked in the /downloads directory where I have the code stored and this remains empty despite docker appearing to be successfully downloading videos.
Second issue is I'm now getting an "unable to write data: no space left on the device" error. The disk I have shared with docker definitely has room left on it. In fact it doesnt seem to change size at all despite the appearance of successful downloads..

Everything else appears to be working fine. I get prompted with login details, it returns the correct number of courses etc.
Running windows 10.

Any ideas?

Failing to download using Docker-Compose

Hello,

Looks like I am finding the following error after taking the following steps:

1. downloaded the master branch .zip

2. copied, edited, and renamed the docker-compose.yml

3. edited docker-compose.yml to add email and passwd.

4. $ docker-compose build

5. $ docker-compose run stackskills_dl

Creating network "stackskills-dl-master_default" with the default driver
Loaded login credentials from environment variables.
/usr/app/lib/course_finder.rb:52:in `login_user!': undefined method `click' for nil:NilClass (NoMethodError)
        from /usr/app/lib/course_finder.rb:29:in `execute'
        from /usr/app/lib/course_finder.rb:12:in `block in run'
        from /usr/app/lib/utilities.rb:13:in `block in mkchdir'
        from /usr/app/lib/utilities.rb:12:in `chdir'
        from /usr/app/lib/utilities.rb:12:in `mkchdir'
        from /usr/app/lib/course_finder.rb:11:in `run'
        from stackskills_dl.rb:11:in `<main>'

I suspect it has something to with line 32 in course_finder.rb, but I do not know.
More likely, something changed on the site.
It is also worth noting the same behavior was observed on the Docker branch.

This is my first attempt using this project and it looks like you have a lot of good work put into it.
I cant wait to try it.

No such file or directory

Hello. I am new to ruby, could you please help me out with the following issue? Thanks!
The first folder is being created, but that's about it.

youtube-dl is installed.

ruby stackskills_dl.rb
Login Email: *****@gmail.com
Login password: **********
Login Successfully.
Downloading Course: ********
Downloading What_is_Python-
01. What_is_Python-
C:/Users/*****/Desktop/Programming/Resources/stackskills-dl-master/lib/lecture.rb:50:in """: No such file or directory - youtube-dl --restrict-filenames https://fast.wistia.net/embed/iframe/********* (Errno::ENOENT)

Download single/list of courses with docker

Hey,
Thank you for the script
By default docker method downloads all courses. Can you include arguments to specify list of course urls

How to serialize to maintain lesson order?

I was wondering if you had any ideas on how to keep the lessons downloaded in order? I tried to download a course and the course titles were not helpful nor were the creation times. Any thoughts? Appreciate this project though. I'm using it to take my courses offline on my iPad!

Courses Listed As Downloading But Then Stops

I can login and it will show the list of courses but the script ends right after that. Doesn't seem like it even made a attempt to begin downloading.

System: Windows 10
Ruby: ruby 2.4.4p296 (2018-03-28 revision 63013) [x64-mingw32]

WARN: Unresolved specs during Gem::Specification.reset:
unf_ext (>= 0)
WARN: Clearing out unresolved specs.
Please report a bug if this causes problems.
Login Email:
Login password:
Login Successfully.
Number of courses found: 1
Downloading Course: CourseName
Downloading 00a._CourseName_1
Downloading 00b._CourseName_2
Downloading 00b._CourseName_etc...

Download in lower quality

Is there any possible to download videos in another resolution ? ex: 640p

undefined local variable or method `folder_name' for main:Object (NameError)

static:stackskills-dl-master xxx$ ruby stackskills_dl.rb -c https://stackskills.com/courses/internet-of-things-with-arduino-blueprints
Login Email: ********@gmail.com
Login password: ********
Login Successfully
Finding https://stackskills.com/courses/internet-of-things-with-arduino-blueprints from your list of courses
stackskills_dl.rb:78:in <main>': undefined local variable or method folder_name' for main:Object (NameError)

courses failing to be downloaded as it cannot identify them

Apologies for the generic subject
When I run this command under linux:
ruby stackskills_dl.rb
it requests the login and password, and says that login was successful, but then just terminates.
I assumed this meant it wanted the course to be downloaded. I then ran this:
ruby stackskills_dl.rb -c https://stackskills.com/courses/certified-information-systems-security-professional-cissp/
similar to your example in the readme.md file.

It throws this error:
Login Successfully.
Finding https://stackskills.com/courses/certified-information-systems-security-professional-cissp/ from your list of courses
/opt/15_green/stackskills-dl-master/lib/course_finder.rb:33:in block in execute': undefined method text' for nil:NilClass (NoMethodError)
from /opt/15_green/stackskills-dl-master/lib/course_finder.rb:32:in each' from /opt/15_green/stackskills-dl-master/lib/course_finder.rb:32:in execute'
from /opt/15_green/stackskills-dl-master/lib/course_finder.rb:9:in run' from stackskills_dl.rb:8:in

'

I've never made any ruby code, but I've done a bunch of perl code, especially with the WWW:mechanize module so my assumption was that they're at least related. I added a require for 'pp' in the main script (stackskills_dl.rb) and then on line 32 of lib_course_finder.rb, I added
pp current_page
to do some debugging.

The resulting output showed that it saw my courses(including the one entitled above) and gave URL's. However the URL's were not the named ones:
"/courses/enrolled/83416"

On a hunch, I guessed to just try using the number to download the course videos and it worked fine:
ruby stackskills_dl.rb -c 83416

So this may be an opportunity for the documentation, or may require a bit of a modification to the code to resolve to search for the title and not the URL, or to try loading the URL if specified, because that URL did open the course for me.

Unable to download videos without "Download" button

I am downloading videos using stackskills-dl ruby app. But it downloaded only one course and after that it is creating only directories with no error. Am I doing something wrong?

Any ideas?

So i'm an absolute newbie when it comes to this stuff. I bought some courses from Stackskills and i was warned they're scam and the courses will be gone in a few days so i'm trying to download them.
I went as far as this. Any way it can be fixed, i'd really appreciate it c:

Add Ruby header files to the prerequisites

While running bundle install on the latest version, I get

Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

    current directory: /tmp/bundler20170731-6771-1na1uuounf_ext-0.0.7.2/gems/unf_ext-0.0.7.2/ext/unf_ext
/usr/bin/ruby2.3 -r ./siteconf20170731-6771-14yzuwa.rb extconf.rb
mkmf.rb can't find header files for ruby at /usr/lib/ruby/include/ruby.h

extconf failed, exit code 1

Gem files will remain installed in /tmp/bundler20170731-6771-1na1uuounf_ext-0.0.7.2/gems/unf_ext-0.0.7.2 for inspection.
Results logged to /tmp/bundler20170731-6771-1na1uuounf_ext-0.0.7.2/extensions/x86_64-linux/2.3.0/unf_ext-0.0.7.2/gem_make.out

Solution

Turns out you need the Ruby header files for this: https://stackoverflow.com/questions/4304438/gem-install-failed-to-build-gem-native-extension-cant-find-header-files

In Ubuntu: sudo apt-get install ruby-dev

--help arguments need to be rectify

Dear @yoonwaiyan ,

the "help" arguments need to be rectify as -c and -cs is missing.

as shown below:

ruby stackskills_dl.rb --help
Usage: ruby stackskills_dl.rb [options]
-u, --email NAME # Email
-p, --password PASSWORD # Password
--course COURSE_URL # Course URL in ID.
-c, --course-slug COURSE_SLUG # Course URL in slug.

thanks and best regards,

Can't download any file - Sorry, this lecture is not available to download.

I recently install this application on Ubuntu 16.04.01 and am getting the error message
"Sorry, this lecture is not available to download."

When attempting to download a course. This happens for every file in the course. Is there any way to get more verbose information? I think maybe they changed the website and the way you scrape might not be compatible, but I could be totally wrong.

Thanks a lot

Error with download of zip-file

Hi, at first: thanks for this awesome skript.

I get an error at one of my course. The lecture has a video and a zip file.

This is the error message:

C:/Dev/stackskills-dl/lib/lecture.rb:70:in ``': No such file or directory - wget https://d2vvqscadf4c1f.cloudfront.net/FiBez5MlSLysyVqYYhJf_Project-Files.zip -c -O Project-Files.zip (Errno::ENOENT)
        from C:/Dev/stackskills-dl/lib/lecture.rb:70:in `download_zip'
        from C:/Dev/stackskills-dl/lib/lecture.rb:39:in `block in download'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/lecture.rb:36:in `download'
        from C:/Dev/stackskills-dl/lib/course.rb:24:in `block (2 levels) in download'
        from C:/Dev/stackskills-dl/lib/course.rb:23:in `each'
        from C:/Dev/stackskills-dl/lib/course.rb:23:in `block in download'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/course.rb:22:in `download'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:13:in `block (2 levels) in run'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:41:in `block in execute'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:36:in `each'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:36:in `execute'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:12:in `block in run'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:11:in `run'
        from ./stackskills_dl.rb:11:in `<main>'

Hope you can help me, will provide more information if needed.

EDIT: Now also had a problem with a video... seems like I have problems with wget.

C:/Dev/stackskills-dl/lib/lecture.rb:55:in ``': No such file or directory - wget https://d2vvqscadf4c1f.cloudfront.net/51ZRMiRFyCgP2BrGXJ6g_1001%20Course%20Conclusion.mp4 -c -O Course_Conclusion.mp4 (Errno::ENOENT)
        from C:/Dev/stackskills-dl/lib/lecture.rb:55:in `download_video'
        from C:/Dev/stackskills-dl/lib/lecture.rb:37:in `block in download'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/lecture.rb:36:in `download'
        from C:/Dev/stackskills-dl/lib/course.rb:24:in `block (2 levels) in download'
        from C:/Dev/stackskills-dl/lib/course.rb:23:in `each'
        from C:/Dev/stackskills-dl/lib/course.rb:23:in `block in download'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/course.rb:22:in `download'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:13:in `block (2 levels) in run'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:41:in `block in execute'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:36:in `each'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:36:in `execute'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:12:in `block in run'
        from C:/Dev/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from C:/Dev/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from C:/Dev/stackskills-dl/lib/course_finder.rb:11:in `run'
        from ./stackskills_dl.rb:11:in `<main>'

stackskills-dl not working for multi-page lists of courses.

Hello,

I am regular user of the stackskills-dl script, but recently I have run into a problem. When downloading courses I have purchased all works well if the course can be found on 'https://stackskills.com/courses/enrolled'. But I noticed that courses on the second page of courses 'https://stackskills.com/courses/enrolled?page=2' can't be downloaded.

Would it be possible to implement this feature?

Regards,

Daniel

Unable To Download Any Videos

I am unable to download any videos when running, ruby stackskills_dl.rb on windows, here is the error:

C:\Users\MyUser\Downloads\Stackskills Downloader>ruby stackskills_dl.rb
Login Email: [email protected]
Login password: mypassword
C:/Ruby22-x64/lib/ruby/2.2.0/net/http.rb:923:in connect': SSL_connect SYSCALL returned=5 errno=0 state=SSLv2/v3 read server hello A (OpenSSL::SSL::SSLError) from C:/Ruby22-x64/lib/ruby/2.2.0/net/http.rb:923:in block in connect'
from C:/Ruby22-x64/lib/ruby/2.2.0/timeout.rb:73:in timeout' from C:/Ruby22-x64/lib/ruby/2.2.0/net/http.rb:923:in connect'
from C:/Ruby22-x64/lib/ruby/2.2.0/net/http.rb:863:in do_start' from C:/Ruby22-x64/lib/ruby/2.2.0/net/http.rb:858:in start'
from C:/Ruby22-x64/lib/ruby/gems/2.2.0/gems/net-http-persistent-2.9.4/lib/net/http/persistent.rb:700:in start' from C:/Ruby22-x64/lib/ruby/gems/2.2.0/gems/net-http-persistent-2.9.4/lib/net/http/persistent.rb:631:in connection_for'
from C:/Ruby22-x64/lib/ruby/gems/2.2.0/gems/net-http-persistent-2.9.4/lib/net/http/persistent.rb:994:in request' from C:/Ruby22-x64/lib/ruby/gems/2.2.0/gems/mechanize-2.7.4/lib/mechanize/http/agent.rb:267:in fetch'
from C:/Ruby22-x64/lib/ruby/gems/2.2.0/gems/mechanize-2.7.4/lib/mechanize.rb:464:in get' from stackskills_dl.rb:68:in

'

Unable to download some courses

Hi,

first of all, i would like to thank you for all the efforts you have put to build/write this script that we all thankfully use.

back to the issue; I tried to download two different courses both are failing with use of both option:
-c and -cs

the error return are as following:

• using -c

• input: ruby stackskills_dl.rb -cs https://stackskills.com/courses/enrolled/77462

• error:
  Login Email: ###############
Login password: *******
Login Successfully.
Finding https://stackskills.com/courses/enrolled/77462 from your list of courses
Unable to find this course: https://stackskills.com/courses/enrolled/77462 from your list of courses.

• using -cs

• input: ruby stackskills_dl.rb -cs https://stackskills.com/courses/red-hat-linux-centos-rhcsa/lectures/788977

• error:
  Login Email: ################
Login password: *******
Login Successfully.
/var/lib/gems/2.3.0/gems/mechanize-2.7.5/lib/mechanize/http/agent.rb:656:in 'resolve': absolute URL needed (not s) (ArgumentError)
from /var/lib/gems/2.3.0/gems/mechanize-2.7.5/lib/mechanize/http/agent.rb:234:in 'fetch'
from /var/lib/gems/2.3.0/gems/mechanize-2.7.5/lib/mechanize.rb:464:in 'get'
from /home/trng/Downloads/stackskills-dl-master/lib/course_finder.rb:84:in 'get_course_link_from_slug'
from /home/trng/Downloads/stackskills-dl-master/lib/course_finder.rb:96:in 'get_course_links'
from /home/trng/Downloads/stackskills-dl-master/lib/course_finder.rb:27:in 'execute'
from /home/trng/Downloads/stackskills-dl-master/lib/course_finder.rb:10:in 'run'
from stackskills_dl.rb:8:in '<main>'

I did install all the required gem sudo bundle install --gemfile=Gemfile (Gemfile that included on the same folder of the script.

my apology for making this to long but I want to make it easy for troubleshooting.

thanks and best regards,

Help

Hello my friend
I am trying to run your stackskills-dl on windows.
I installed ruby on windows and downloaded the stackskills-dl zip file.
what shall i do next ?
I have 0 knowledge in programming
Please help

Finds course then doesn't download

I'm able to find courses and in some cases download probably 20-30% of them before the script just stops dead and throws this error. What`s going on here?

Downloading Node.js_Security-Pentesting_and_Exploitation-_Overview
/Users/testuser/ruby/stackskills-dl-master/lib/lecture.rb:47:in download_video: undefined local variable or method video for #Lecture:0x007f9b2bc6ff48 (NameError)
Did you mean? video_url
from /Users/testuser/ruby/stackskills-dl-master/lib/lecture.rb:33:in block in download
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:11:in block in mkchdir
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:10:in chdir
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:10:in mkchdir
from /Users/testuser/ruby/stackskills-dl-master/lib/lecture.rb:32:in download
from /Users/testuser/ruby/stackskills-dl-master/lib/course.rb:18:in block (2 levels) in download
from /Users/testuser/ruby/stackskills-dl-master/lib/course.rb:17:in each
from /Users/testuser/ruby/stackskills-dl-master/lib/course.rb:17:in block in download
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:11:in block in mkchdir
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:10:in chdir
from /Users/testuser/ruby/stackskills-dl-master/lib/utilities.rb:10:in mkchdir
from /Users/testuser/ruby/stackskills-dl-master/lib/course.rb:16:in download
from /Users/testuser/ruby/stackskills-dl-master/lib/course_finder.rb:11:in block in run
from /Users/testuser/ruby/stackskills-dl-master/lib/course_finder.rb:32:in block in execute
from /Users/testuser/ruby/stackskills-dl-master/lib/course_finder.rb:27:in each
from /Users/testuser/ruby/stackskills-dl-master/lib/course_finder.rb:27:in execute
from /Users/testuser/ruby/stackskills-dl-master/lib/course_finder.rb:10:in run
from stackskills_dl.rb:8:in <main>

Error while trying to download single course

I am having issues while trying to download single course. I receive the following error:
ruby stackskills_dl.rb -u "username" -p "password" -c https://stackskills.com/courses/enrolled/51763

/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require': cannot load such file -- mechanize (LoadError)
	from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
	from /tmp/stackskills-dl/stackskills-dl-master/lib/course_finder.rb:1:in `<top (required)>'
	from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
	from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
	from stackskills_dl.rb:4:in `<main>'

Also, I have built the project from scratch on a Fedora 27 box and receive this error:
ruby stackskills_dl.rb -u "username" -p "password" -c https://stackskills.com/courses/enrolled/339711
Loaded login credentials from environment variables.
Login Successfully.
Finding https://stackskills.com/courses/enrolled/339711 from your list of courses
Unable to find this course: https://stackskills.com/courses/enrolled/339711 from your list of courses.
Number of courses found: 1

/home/user/stackskills-dl/lib/course_finder.rb:37:in `block in execute': undefined method `href' for nil:NilClass (NoMethodError)
	from /home/user/stackskills-dl/lib/course_finder.rb:36:in `each'
	from /home/user/stackskills-dl/lib/course_finder.rb:36:in `execute'
	from /home/user/stackskills-dl/lib/course_finder.rb:12:in `block in run'
	from /home/user/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
	from /home/user/stackskills-dl/lib/utilities.rb:12:in `chdir'
	from /home/user/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
	from /home/user/stackskills-dl/lib/course_finder.rb:11:in `run'
	from stackskills_dl.rb:11:in `<main>'

Can you provide any insight on why I can't download single courses? I have tried several variations using the -c and the -s switches. I was able to just start stackskills-dl and download the first page of my enrolled courses. Then it stopped and would not proceed to the second or third page of courses. Any help you can provide would be fantastic. Thank you.

Problem after starting script.

So i fire up the script - and after successfully downloading a few videos, It gets stuck with the following:

[download] 100% of 24.17MiB
C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/lecture.rb:62:i
n ``': No such file or directory - wget https://d2vvqscadf4c1f.cloudfront.net/bS
60NpY9QUKuZZ18Tb32_871bc3d8-7e2a-4dca-b5fb-1b85583f3b45.zip -c -O 871bc3d8-7e2a-
4dca-b5fb-1b85583f3b45.zip (Errno::ENOENT)
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/le
cture.rb:62:in download_zip' from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/le cture.rb:35:in block in download'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:11:in `block in mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `chdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/le
cture.rb:32:in `download'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse.rb:19:in `block (2 levels) in download'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse.rb:18:in `each'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse.rb:18:in `block in download'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:11:in `block in mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `chdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse.rb:17:in `download'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:12:in `block (2 levels) in run'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:36:in `block in execute'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:31:in `each'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:31:in `execute'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:11:in `block in run'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:11:in `block in mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `chdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/ut
ilities.rb:10:in `mkchdir'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/lib/co
urse_finder.rb:10:in `run'
from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/stackskills-dl-master/stacks
kills_dl.rb:8:in `

'

-=-=What am i missing here?

Receiving following errors: Permission denied @ dir_chdir - Enrolled (Errno::EACCES)

Just started to received the following error attempting to download course:

[user@dockerf stackskills-dl]$ ruby stackskills_dl.rb -u "[email protected]" -p "pass" -c https://stackskills.com/courses/enrolled/107858
Loaded login credentials from environment variables.
Login Successfully.
Finding https://stackskills.com/courses/enrolled/107858 from your list of courses
Number of courses found: 1
Downloading Course: Enrolled
/home/user/stackskills-dl/lib/utilities.rb:12:in `chdir': Permission denied @ dir_chdir - Enrolled (Errno::EACCES)
        from /home/user/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from /home/user/stackskills-dl/lib/course.rb:22:in `download'
        from /home/user/stackskills-dl/lib/course_finder.rb:13:in `block (2 levels) in run'
        from /home/user/stackskills-dl/lib/course_finder.rb:41:in `block in execute'
        from /home/user/stackskills-dl/lib/course_finder.rb:36:in `each'
        from /home/user/stackskills-dl/lib/course_finder.rb:36:in `execute'
        from /home/user/stackskills-dl/lib/course_finder.rb:12:in `block in run'
        from /home/user/stackskills-dl/lib/utilities.rb:13:in `block in mkchdir'
        from /home/user/stackskills-dl/lib/utilities.rb:12:in `chdir'
        from /home/user/stackskills-dl/lib/utilities.rb:12:in `mkchdir'
        from /home/user/stackskills-dl/lib/course_finder.rb:11:in `run'
        from stackskills_dl.rb:11:in `<main>'

Let me know if you need more info. Thanks.

.bin files?

Many of the courses are resulting in the download of .bin files rather than the video file. Any idea why? It does not happen to all courses, but it seems it might be courses that use Vimeo.

Script doesn't find courses on page 2 onwards.

I'm able to download courses on the first page :
https://stacksocial.usefedora.com/courses/enrolled

but not from page 2 onwards:
https://stacksocial.usefedora.com/courses/enrolled?page=2

WARN: Unresolved specs during Gem::Specification.reset:
      unf_ext (>= 0)
WARN: Clearing out unresolved specs.
Please report a bug if this causes problems.
Login Successfully.
Finding https://stackskills.com/courses/enrolled/22936 from your list of courses
Unable to find this course: https://stackskills.com/courses/enrolled/22936 from your list of courses.

Login issues

$ docker-compose run stackskills_dl
Loaded login credentials from environment variables.
/usr/local/bundle/gems/mechanize-2.7.4/lib/mechanize/http/agent.rb:316:in `fetch': 503 => Net::HTTPServiceUnavailable for https://sso.teachable.com/secure/1453/users/sign_in?clean_login=true&reset_purchase_session=1 -- unhandled response (Mechanize::ResponseCodeError)
        from /usr/local/bundle/gems/mechanize-2.7.4/lib/mechanize/http/agent.rb:986:in `response_redirect'
        from /usr/local/bundle/gems/mechanize-2.7.4/lib/mechanize/http/agent.rb:308:in `fetch'
        from /usr/local/bundle/gems/mechanize-2.7.4/lib/mechanize.rb:464:in `get'
        from /usr/app/lib/course_finder.rb:28:in `execute'
        from /usr/app/lib/course_finder.rb:12:in `block in run'
        from /usr/app/lib/utilities.rb:13:in `block in mkchdir'
        from /usr/app/lib/utilities.rb:12:in `chdir'
        from /usr/app/lib/utilities.rb:12:in `mkchdir'
        from /usr/app/lib/course_finder.rb:11:in `run'
        from stackskills_dl.rb:11:in `<main>'

Any suggestions what to try?