Comments (4)
just a couple FYIs
sending to the datastore will already be disabled by not defining the datstore_url env var. we do lack any way of doing this on a per request basis though, so its important to note that this is to be added to the request.
the code already does report everything it reports to the datastore verbatim. it needs to do this so that the kafka worker can trim the batch windows accordingly. so we dont need to add this so much as keep doing it.
from reporter.
Design discussion: Datastore does not need all fields in the data (shape indexes) and needs to add next segment logic (merging across internal segments, etc.). Trimming logic perhaps only needs to know the shape index (index into the reported trace) that can be trimmed - might be best to put that logic in the Python code. Where to decide whether to report on local segments (and local next segments)? Could be cone with logic in the Reporter (based on config) or could be done at Datastore (or both). Doing in Reporter could keep sensitive(privacy) concerns of residential areas within the TNC and would reduce amount of data sent to the Datastore. Doing at Datastore would allow easier future updates to handle local roads reporting (since centralized at the Datastore rather the distributed across different TNCs).
from reporter.
Debug flag is not needed since other Reporter stages will now aggregate and send to Datastore. One can simply call the Python report method to test individual traces and receive results about segment matches, next segment transitions, queue_lengths, etc.
from reporter.
closed by #71
from reporter.
Related Issues (20)
- readme: list and describe outputs from Reporter
- Accumulate Configurable Number of Segment Pair Observations for Privacy
- Accumulate Privatized Segment Pairs by Tile
- Batch Tiles to Datastore
- Turn Channel Transitions HOT 1
- push histograms to file or s3
- Bug: Timestamps with -1 HOT 1
- Use confidence score to improve "pruning" of GPS trace
- Emission Heuristics to Maximize Ability to Measure Variance in Duration HOT 3
- Set default map-matching config to optimal values found in Reporter Quality Testing Rig HOT 20
- cannot connect to container based on latest dockerhub build of reporter HOT 8
- start versioning releases
- Need to reject invalid times
- requests to reporter cause segfault HOT 1
- why hardcoded planetfile HOT 2
- Error while testing the reporter python http service with a trace.
- Http Host Connection Exception , Connection refused.
- Problem while running docker-compose
- Unable to access / view reporter tiles on s3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from reporter.