mnky9800n / eclass-report-generator

Cleans data and generates a report for the ECLASS survey.

ECLASS-Report-Generator

This is made to be used with the E-CLASS survey. You can read more about it here:

1. Epistemology and expectations survey about experimental physics: Development and initial results

A command line utility that:

1. cleans E-CLASS data from Qualtrics
2. generates static web page reports on student E-CLASS performance

Tested in Python 3.4.

How To Use

Currently this application runs on the command line and be run by typing the following:

python main.py <location of pre-historical ECLASS data> <location of post-historical ECLASS data> <location of instructor survey data>

eclass-report-generator's Issues

jquery, bootstrap not in proper location

jquery-2.1.4.min.js and bootstrap.min.js are being pulled from the wrong location, these should be moved to a location on the ECLASS host server.

doesn't add up to 1

• The integrated fraction of students for each major is currently greater than 1 on some reports

differences between previous plots and current plots

• The values and shift that I am seeing on this AppState report and the one Ben sent before are not the same. Do you know why this might be?

plots without confidence intervals are plotting incorrectly

When we decided to remove all confidence intervals from non-ECLASS survey plots it introduced a bug that makes all the charts plot white and out of the figure frame so I will fix this bug today

personal pre/post shifts

• Why are some of the arrows green and some red? Is it direction (i.e., positive shifts are green and negative are red)? This might be somewhat confusing as some of the dots are red, but none of the dots are green. For sure, if we keep it, it should be put in the caption.

formatting of web content

Introduction:

• 3rd sentence, main page: 'the' rather than 'he'
• 2nd contact option: the email should be '[email protected]'

grades plot axis issue

originally submitted via email:

• There is a spacing issue with the caption overlapping the axis title on the bottom

grades plot axis issue

originally submitted via email:

• There is a spacing issue with the caption overlapping the axis title on the bottom

personal pre/post shifts suggestion

• Can we take the discard question out of the report (top of 'what do you think (part2)')? I am not even sure how to interpret this point (e.g., why is it not 100% in the final report?)

Extra column on the 'Questions List' tab

Can we add another column on this page that indicates the direction of the expert response (e.g., agree or disagree). I think you have this list already, but if not, you can also get it from Ben's original publication: http://journals.aps.org/prstper/abstract/10.1103/PhysRevSTPER.10.010120

I don't understand what is going on here

in main.py, line 56, why is there a string starting with three quotes?

note: this is an example issue.

table 1 issue

originally submitted via email:

Overall Results table:

• Not currently populated. Is this related to the issues you have been having connecting the instructors survey to the individual courses?

phone interface

originally submitted by email:

It looks great on the phone, with one small issue: only the main tab seems to appear. The other tabs (how to read and how it was analyzed) don't seem to be showing up.

axis change is different

• Here again, I am seeing meaningfully different things on these graphs than what Ben originally sent out. For example, the axis on the 'change in interest in physics' graph is reversed, but the trend is not

how to read this report

Originally submitted via email

How to read this report page and How this report was analyzed:

• None of the figures are showing up.
• We should also think about figure numbering since this is now two different pages rather than a single document

needs to push reports to webhost instead of storing them locally

eom

get rid of confidence intervals for non-itemized questions

For the extra questions:

• I think I agree that confidence intervals are not really needed on most of these. I can't really think of a reason why an instructor would need them since there are no inferences being made based on these data.

grades plot

originally submitted via email.

• The caption says 'An ordered plot', but the plot is not currently ordered

experimental physicist vs you plot

For the experimental physicist vs you graphs:

• The caption says green vs. red in the plots, but the points are still red and blue (and now potentially even more confusing with the green arrows)