leagify / historical-nfl-draft-data

A place to store data about historical NFL draft classes

leagify

Leagify - complete with new name!

Most of the code is in the repository with the old name Leagueify

historical-nfl-draft-data's Issues

Update State filtering

I noticed some Schools are not joining properly:

Here's the output with issues:

Some Schools need to be renamed to properly join with SchoolStatesAndConferences.csv.

They appear to be:

• Arizona State (Arizona St.)
• Ole Miss (Mississippi)
• Louisiana-Lafayette (Louisiana)
• UCF (Central Florida)
• and some others.

1,3,JAX,Blake Bortles,BortBl00,QB,22,2018,0,0,5,44,44,75,1561,2632,17646,103,75,281,1775,8,1,20,1,2,,,Central Florida,2014,,
3,82,CHI,Will Sutton,SuttWi00,DT,22,2016,0,0,0,9,9,36,0,0,0,0,0,0,0,0,0,0,0,39,,,Arizona St.,2014,,
3,90,IND,Donte Moncrief,MoncDo00,WR,21,2018,0,0,3,18,15,69,0,0,0,0,0,5,16,0,200,2543,21,3,,,Mississippi,2014,,
4,121,GNB,Carl Bradford,BradCa01,LB,22,2016,0,0,0,0,0,6,0,0,0,0,0,0,0,0,0,0,0,2,,,Arizona St.,2014,,
6,198,NWE,Zach Moore,MoorZa00,DE,24,2018,0,0,0,3,1,26,0,0,0,0,0,0,0,0,0,0,0,8,,4.0,Concordia-St.Paul,2014,,
6,200,KAN,Laurent Duvernay-Tardif,DuveLa00,OL,23,2018,0,0,3,21,21,46,0,0,0,0,0,0,0,0,0,0,0,,,,McGill,2014,,
6,201,SDG,Marion Grice,GricMa00,RB,23,2014,0,0,0,0,,10,0,1,0,0,0,15,41,1,7,29,0,,,,Arizona St.,2014,,
7,222,JAX,Storm Johnson,JohnSt03,RB,22,2014,0,0,0,0,0,6,0,0,0,0,0,29,86,2,1,-4,0,,,,Central Florida,2014,,
7,234,MIA,Terrence Fede,FedeTe00,DE,22,2017,0,0,0,6,6,51,0,0,0,0,0,0,0,0,0,0,0,30,,1.0,Marist,2014,,
1,26,BAL,Breshad Perriman,PerrBr02,WR,21,2018,0,0,0,6,4,37,0,0,0,0,0,5,4,0,59,916,5,,,,Central Florida,2015,,
1,30,GNB,Damarious Randall,RandDa00,S,23,2018,0,0,2,18,12,54,0,0,0,0,0,0,0,0,0,0,0,196,14,,Arizona St.,2015,,
2,56,PIT,Senquez Golson,GolsSe00,CB,22,,0,0,0,,,,,,,,,,,,,,,,,,Mississippi,2015,,
3,70,HOU,Jaelen Strong,StroJa01,WR,21,2017,0,0,0,2,2,20,0,0,0,0,0,0,0,0,31,330,4,,,,Arizona St.,2015,,
4,109,IND,Clayton Geathers,GeatCl00,S,23,2018,0,0,2,9,9,41,0,0,0,0,0,0,0,0,0,0,0,137,,,Central Florida,2015,,
4,114,MIA,Jamil Douglas,DougJa00,G,23,2016,0,0,0,3,3,17,0,0,0,0,0,0,0,0,0,0,0,,,,Arizona St.,2015,,
4,135,CIN,Marcus Hardison,HardMa00,DE,23,,0,0,0,,,,,,,,,,,,,,,,,,Arizona St.,2015,,
6,210,GNB,Christian Ringo,RingCh00,DE,23,2018,0,0,0,1,0,20,0,0,0,0,0,0,0,0,0,0,0,10,,1.5,Louisiana,2015,,
7,232,MIN,Edmond Robinson,RobiEd00,OLB,23,2017,0,0,0,2,2,22,0,0,0,0,0,0,0,0,0,0,0,4,,,Newberry,2015,,
7,255,IND,Denzelle Good,GoodDe01,T,24,2018,0,0,1,12,11,30,0,0,0,0,0,0,0,0,0,0,0,,,,Mars Hill,2015,,
1,13,MIA,Laremy Tunsil,TunsLa00,T,22,2018,0,0,3,18,18,44,0,0,0,0,0,0,0,0,0,0,0,,,,Mississippi,2016,,
1,23,MIN,Laquon Treadwell,TreaLa00,WR,21,2018,0,0,0,4,4,40,0,0,0,0,0,0,0,0,56,517,1,,,,Mississippi,2016,,
1,29,ARI,Robert Nkemdiche,NkemRo00,DT,21,2018,0,0,0,6,6,27,0,0,0,0,0,0,0,0,0,0,0,26,,4.5,Mississippi,2016,,
4,120,NOR,David Onyemata,OnyeDa00,DT,23,2018,0,0,0,8,8,48,0,0,0,0,0,0,0,0,0,0,0,52,,6.5,Manitoba,2016,,
5,161,CIN,Christian Westerman,WestCh02,G,23,2018,0,0,0,2,2,16,0,0,0,0,0,0,0,0,0,0,0,,,,Arizona St.,2016,,
5,174,SFO,Fahn Cooper,CoopFa00,T,23,,0,0,0,,,,,,,,,,,,,,,,,,Mississippi,2016,,
6,180,MIN,Moritz Boehringer,BoehMo00,WR,22,,0,0,0,,,,,,,,,,,,,,,,,,,2016,,
6,199,CIN,Cody Core,CoreCo00,WR,22,2018,0,0,0,3,3,35,0,0,0,0,0,0,0,0,30,360,1,2,,,Mississippi,2016,,
7,225,NWE,Devin Lucien,LuciDe00,WR,23,,0,0,0,,,,,,,,,,,,,,,,,,Arizona St.,2016,,
1,23,NYG,Evan Engram,EngrEv00,TE,23,2018,0,0,2,10,10,26,0,0,0,0,0,4,50,0,109,1299,9,,,,Mississippi,2017,,
3,90,SEA,Shaquill Griffin,GrifSh00,DB,22,2018,0,0,2,11,11,31,0,0,0,0,0,0,0,0,0,0,0,104,3,1.0,Central Florida,2017,,
4,144,IND,Grover Stewart,StewGr00,DT,23,2018,0,0,0,3,3,30,0,0,0,0,0,0,0,0,0,0,0,20,,,Albany State (GA),2017,,
6,188,NYJ,Elijah McGuire,McGuEl00,RB,23,2018,0,0,0,6,6,24,0,0,0,0,0,180,591,4,36,370,2,,,,Louisiana,2017,,
6,198,SFO,D.J. Jones,JoneD.01,DT,22,2018,0,0,0,3,3,19,0,0,0,0,0,0,0,0,0,0,0,19,,,Mississippi,2017,,
6,204,NYJ,Derrick Jones,JoneDe02,CB,22,2018,0,0,0,0,0,4,0,0,0,0,0,0,0,0,0,0,0,3,,,Mississippi,2017,,
7,224,CLE,Zane Gonzalez,GonzZa00,K,22,2018,0,0,1,2,1,23,0,0,0,0,0,0,0,0,0,0,0,,,,Arizona St.,2017,,
7,253,DEN,Chad Kelly,KellCh00,QB,23,2018,0,0,0,0,0,1,0,0,0,0,0,1,-1,0,0,0,0,,,,Mississippi,2017,,
1,30,MIN,Mike Hughes,HughMi00,CB,21,2018,0,0,0,2,2,6,0,0,0,0,0,0,0,0,0,0,0,19,1,,Central Florida,2018,,
2,46,KAN,Breeland Speaks,SpeaBr00,DE,22,2018,0,0,0,3,3,16,0,0,0,0,0,0,0,0,0,0,0,15,,1.5,Mississippi,2018,,
3,82,DET,Tracy Walker,WalkTr01,S,23,2018,0,0,0,1,1,16,0,0,0,0,0,0,0,0,0,0,0,18,1,,Louisiana,2018,,
3,91,NOR,Tre'Quan Smith,SmitTr03,WR,22,2018,0,0,0,5,5,15,0,0,0,0,0,0,0,0,28,427,5,,,,Central Florida,2018,,
3,98,HOU,Jordan Akins,AkinJo00,TE,26,2018,0,0,0,2,2,16,0,0,0,0,0,0,0,0,17,225,0,,,,Central Florida,2018,,
4,131,MIA,Kalen Ballage,BallKa00,RB,22,2018,0,0,0,2,2,12,0,0,0,0,0,36,191,1,9,56,0,3,,,Arizona St.,2018,,
4,136,CAR,Marquis Haynes,HaynMa01,OLB,24,2018,0,0,0,0,0,4,0,0,0,0,0,0,0,0,0,0,0,1,,,Mississippi,2018,,
5,141,SEA,Shaquem Griffin,GrifSh01,OLB,23,2018,0,0,0,2,2,16,0,0,0,0,0,0,0,0,0,0,0,8,,,Central Florida,2018,,
5,169,IND,Jordan Wilkins,WilkJo01,RB,24,2018,0,0,0,3,3,16,0,0,0,0,0,60,336,1,16,85,0,,,,Mississippi,2018,,
6,178,NWE,Christian Sam,SamxCh00,ILB,22,,0,0,0,,,,,,,,,,,,,,,,,,Arizona St.,2018,,
6,183,DEN,Sam Jones,JoneSa00,G,22,2018,0,0,0,0,0,5,0,0,0,0,0,0,0,0,0,0,0,,,,Arizona St.,2018,,
6,188,CLE,Simeon Thomas,ThomSi00,CB,24,,0,0,0,,,,,,,,,,,,,,,,,,Louisiana,2018,,
7,233,PHI,Jordan Mailata,MailJo00,T,21,,0,0,0,,,,,,,,,,,,,,,,,,,2018,,
7,243,NWE,Keion Crossen,CrosKe00,CB,22,2018,0,0,0,1,1,11,0,0,0,0,0,0,0,0,0,0,0,14,,,West. Carolina,2018,,
7,252,CIN,Rod Taylor,TaylRo01,G,23,,0,0,0,,,,,,,,,,,,,,,,,,Mississippi,2018,,

Add 2020 Draft

https://www.pro-football-reference.com/years/2020/draft.htm

You will need OpenRefine locally installed. More information is available here.
https://openrefine.org/

CSVKit is installed on GitPod, so you could do that work in GitPod.

Allow for easier editing of draft year compilation.

Currently the draftGetter notebook manually puts together the drafts that have been acquired. It would be nice to indicate what years of draft to compile.

• One idea is to use a configuration file for this information. I'd prefer to use ScrapySharp.
• Another idea would be to obtain this information programmatically inside the notebook.

I think I prefer the first idea to the second.

Streamline the process of getting draft data from pro-football-reference

For example, the 2018 draft information is located here:
https://www.pro-football-reference.com/years/2018/draft.htm

Here's what I currently do to get draft information:

1. Go to the relevant draft page in a web browser.
2. Go to the menu and select get table as CSV (for Excel)
   
3. Copy the raw CSV starting at the bottom heading row:
   
4. Paste the data into the appropriate CSV in the repo, such as this file for the 2018 draft: https://github.com/Leagify/historical-nfl-draft-data/blob/master/notebook/drafts/2018Draft.csv
5. Change the heading.

• The initial heading is:
  Rnd,Pick,Tm,Player,Pos,Age,To,AP1,PB,St,wAV,DrAV,G,Cmp,Att,Yds,TD,Int,Att,Yds,TD,Rec,Yds,TD,Solo,Int,Sk,College/Univ,,-9999
• You should change the heading to:
  Rnd,Pick,Tm,Player,Pos,Age,To,AP1,PB,St,wAV,DrAV,G,PassCmp,PassAtt,PassYds,PassTD,PassInt,RushAtt,RushYds,RushTD,Rec,RecYds,RecTD,SoloTkl,Int,Sk,College/Univ,Statlink,PlayerID

6. Save the data in this repo so that we can run the notebook to compile and compute information.

New way to get information:

• It would be nice if the steps were shortened, or could be performed using the notebook that I have created here: https://github.com/Leagify/historical-nfl-draft-data/blob/master/notebook/draftGetter.ipynb

Responsible use of the data:

Here is the sports reference Data Use and Scraping policy pages.