enram / case-study Goto Github PK

The reason for this is that data package is a subdirectory of this repository. Existing viewers expect data package = repository. I recorded this issue at:

• frictionlessdata/frictionlessdata.io#106
• theodi/git-data-viewer#78

Use IDs from World Meteorological Organization (WMO), which can be found here: http://www.eumetnet.eu/radar-network

• Update radar file
• Update bird_migration_altitude_profiles
• Update datapackage.json
• Update query
• Update reflectivity ppi data (by @leijnse, see also #16 )

• Add data
• Remove one radar
• Rename fields
• Add radar_id field
• Create JSON
• Describe fields

The hackathon participants discovered that ground_speed is not always equal to the root of u_speed² + v_speed². These differences appear in the decimals.

Maybe we should recalculate the values using CartoDB?

• Upload data
• Title
• Introduction
• Description
• Data link
• License
• Contact

Datasets

• From night of 6-7 april 2013
• From night of 7-8 april 2013

Scope

• From WIER radar: 100 birds spawning for 4 half hours
• From GLONS radar: 100 birds spawning for 4 half hours
• From particles over NW Europe: 2000 particles spawning for 1 half hour
• From sunset to sunrise (17h - 6h: 13hours)
• Time interval: every 5 minutes

Fields

• track_id: won't be used by Torque, but could be useful for other visualizations
• date_time: YYYY-MM-DD HH:MM:00Z
• latitude
• longitude
• start_time_id: a number, to group particles spawned at the same time
• radar_id: could be text

https://github.com/enram/data-challenge/blob/master/documentation/story.md

The current description for bird_density is:

Calculated number of birds per cubic kilometer. Based on a bird with a cross section of 11cm^2 and a C-band wave length type radar. For methodology, see 10.1098/rsif.2010.0116.

The current values are not those. They should be divided by 11.

• Divide by 11
• Upload to repository
• Update affected visualization

UTC?

Add to /images folder

@hvangasteren

7 days * 24 hours * 3 times per hour (20 min) = 504. Two radars have less data however:

• Rationale
• Index
• Visualizations
• Contributors
• License

Describe this file in a datapackage.json.

Structure

• Folder per radar/date
• File per time interval (e.g. 5min)
• In file: raster of 120 on 120
• Each raster point: reflectivity in dBZ

Values

-32: no data
-30 / 30: birds + insects, light precipitation
30+: heavier precipitation, ground echos

Interval

• De Bilt / Den Helder / Jabbeke / Zaventem: 5 min
• Wideumont: 15 min

Methodology

by @leijnse

Positions

120 x 120, latitude
120 x 120, longitude

BY @jshamoun : I am now organizing the wind data for you, what is the spatial extent that you would like, or let’s say the spatial extent of your map?

• Gifs
• Matlab script
• Height profiles

File name is composed of:

txt = to indicate it is ascii
BE = Belgium
61 = Zaventem
VOL = ?
NA = ?
201304052202 = datetime

@leijnse can you figure out if this complies with OPERA file name practice and if we should rename files (e.g. drop txt_ at beginning).

This was originally recorded here, but now defined in this file.

There are a couple of questions/issues remaining:

• Please review the definitions
• Is bird_reflectivity directly measured by the radar, or did any transformations/filtering/cutoffs happen?
• How is radial_velocity_std calculated? Should we provide radial_velocity (defined as: "the general movement speed in the direction of the radar")?
• I now use "general movement" as the thing that has the characteristics radial velocity, u/v_speed, direction and ground speed, to indicate that this is not just birds. Is this OK?
• What is w_speed exactly? Is it also about general movement? Negative = towards the ground?
• Do you have a publication reference for the calculation of bird_density? A DOI is preferred.

Input needed from @jshamoun tomorrow.