amandabee / cuny-data-skills

This semester we will work together to gather, analyze and visualize numbers you need to understand your audience and to tell interactive data-driven stories.

This should really only be the index page. The rest migrated to "talks".

cuny-data-skills's Issues

gist workflow

Hi all,

To follow up the last class, here's a workflow from gist to a web page. Let me know if you need other clarifications on GitHub/gist or markdown, or any aspect of this process.

1. Edit your pitch gist with Markdown

2. Paste everything you have there in http://dillinger.io/ (or Mou, if you have it, either is fine), and export the file as html. In dillinger.io the export it's on the top-right corner:

   

3. Open the html export in your text editor. Copy the whole thing.

4. Go to your gist, replace your markdown with the html you just copied.

5. Save the gist with the name index.html:

   

6. To view your gist on blocks: replace https://gist.github.com with bl.ocks.org

7. Click on open in a new window. That's your web page.

@sfdevlin
@BurgosNY
@riogringa
@JuliaJRH
@cristinafurlong
@sihemsf
@jwasserman
@AdrieleParker
@Emily-Goldblum
@ericalucia
@DeronDalton
@lmechegaray
@aaronsimon
@BetsyBagel

installing csvkit error

Do I need to install something else before I try to install csvkit? I don't have Python installed, and I'm getting this error when I follow the instructions (from http://csvkit.readthedocs.org/en/latest/install.html) to install csvkit:

Julias-MacBook-Pro:~ juliahaslanger$ pip install csvkit
-bash: pip: command not found

And if I do need to install python, do you want me to install Python 2 or 3? (Both options are listed on [the python install page https://www.python.org/downloads/mac-osx/)

Add Data Visualization tools list to CUNY-data-skills/hands-on/visual_encoding.html

Add Data Visualization Tools list: http://inspire.blufra.me/big-data-visualization-review-of-the-20-best-tools/

To this page: https://amandabee.github.io/CUNY-data-skills/hands-on/visual_encoding.html

Making maps: a few general concepts

@ericalucia stopped by my desk today and brought up a few good points about making maps. Ah, maps. You probably realized there're a lot of layers of information packed into this one single concept. This thread might fill in some knowledge gaps when you are dealing with geographic data.

READ THIS

http://mapschool.io/

What the heck goes into a map? Read at least the bolded titles from the linked page above, a crash course in maps. Know the difference between an image and a shape, and pay attention to how data is associated with geometries.

Shapefiles

1. What is a shapefile? When you download a shapefile and unzip the folder, you will find a bunch of things besides the .shp. For now, just know that the .shp is dependent on the other stuff (.shx, .dbf, etc etc,) and you will probably never interact with these other stuff directly individually. Read more
2. How to use a shapefile in CartoDB? Upload your zipped shapefile (as opposed to the unzipped one) to CartoDB, as a table.

Geo reference

You have data. You need to associate data to geometries. And then you symbolize the geometries in some way according to a data value. You might have heard of the term, visualization? Yeah, that's the last part -- the symbolization. For example, put a dot on it.

Getting your data in shape (no pun intended) takes 90% of the time when you try to make a map, and the rest is just to make it appear.

Here's a tutorial from CartoDB in terms of georeferencing your dataset.

Data join

Some of you might be dealing with dataset that share a common column with a shapefile, such as zipcode. I'll pass on a metaphor from my GIS professor back in the days: think of that common column as a hook. You need to hook two datasets together -- one with geometries, one without.

In that case you would want to join the column of two tables, please consult this tutorial.

More mapping concepts?

If you are confused by any of these concepts and/or how to do them in CartoDB, please let me know. To be honest I haven't used CartoDB's interface that much, so I might not know where the button is immediately, but I'll sit with you and figure out how you would go about a problem and unpack some dense processes for you. Hope it helps!

Carry on y'all 👟 👟

@sfdevlin
@BurgosNY
@riogringa
@JuliaJRH
@cristinafurlong
@sihemsf
@jwasserman
@AdrieleParker
@Emily-Goldblum
@DeronDalton
@lmechegaray
@aaronsimon
@BetsyBagel

NYC data resource + Code Across NYC this weekend (feb 21/22)

Hey all,

Here're some great data resources if you are dealing with NYC data. The civic hacker group, http://betanyc.us/, curated it.

This weekend is the Code Across NYC hackathon -- there will be open data and data skills workshop and unconferences. If any of you are going, you can find me there.

PS1. Can anyone forward this to @cristinafurlong? Apparently it's not a valid github handle...
PS2. @BetsyBagel said I should give a shout to my website. (Thx!) Here it is. http://goodlemons.com

@sfdevlin
@BurgosNY
@riogringa
@JuliaJRH
@sihemsf
@jwasserman
@AdrieleParker
@Emily-Goldblum
@ericalucia
@DeronDalton
@lmechegaray
@aaronsimon
@BetsyBagel

Prep for summer product dev class

Hey folks,

I'll be in the class today to get a sense of what you have/need for the summer class on product development. If you have a sec before class to answer some questions regarding your idea and current state with the community you are working with, it'd be great! Otherwise we'll chat in class.

Questions are here: https://jue.typeform.com/to/DGUP52

@sfdevlin
@BurgosNY
@riogringa
@JuliaJRH
@sihemsf
@jwasserman
@AdrieleParker
@Emily-Goldblum
@ericalucia
@DeronDalton
@lmechegaray
@aaronsimon
@BetsyBagel
@cristinafurlong

Chartbuilder only exports part of the chart.

From @cristinafurlong @cristinafurlong:

I can't export my chart in chart builder. When I click export, I only see half the chart -- the text labels
and no bars. Screenshots:

Half the chart

Questions:
Can you paste the numbers you were using, here or in a pastebin?