leocamus / tsanalysis Goto Github PK
View Code? Open in Web Editor NEWEvasión-Codes
Evasión-Codes
The purpose of this issue is to document how 'perfiles' databases are evolving and what was found when comparing two different runs of ADATRAP for same days.
Consider the complete evasion database by door == 1. There are rows with exactly the same attributes except for the number of people boarding and not validating
Check example.loc[1140:1141] in TEST_MatchingUsers > it is a problem of the original database. Consider getting rid of duplicated rows, having only rows with useful information.
Consider to check the order in which df are filtered and how it affects the results
Concatenation of pandas data frames duplicate rows.
It was found that taking mid-times in time windows built with TIEMPO from evasion database do not assign correctly trx from etapas. Check example.head(10) and clean_filtered_df.loc[182388:182395] in TEST_MatchingUsers
Merging idExpedicion from 'perfiles' to 'etapas' represents a critical step if information from 'paraderos' needs to be gathered. As a bus operating a particular service pass through same stops many times in a day, it becomes necessary to distinguish the different expeditions when computing, at least, t_min and t_max in trx. for a particular 'paradero'
There is an issue respective the name of services:
Etapas database 'servicio_subida' column contains TS names of the services.
Evasion database 'SERVICIO' column contains USER names of the services.
Consider converting all the names to a common one before merging in EvasionPlotter_ByBusByService.ipynb
Consider to enhance the etapas-database builder to take into account the 'idExpedicion' attribute present in perfiles-database in https://github.com/leocamus/TSAnalysis/blob/master/BuildingHistograms.ipynb
It is highly probable to be omitting some trxs because they were not founded in codes dictionary -> low priority
This represents a problem to:
(1) Time-interval between transaction for 19th of July of 2017, since it is possible for some buses with turnstiles already installed to be omitted (complete day and by period analysis, check https://www.overleaf.com/read/qzkqjmckxztw), low priority
(2) Evasion vs. mean intervals, since it is possible for some buses with turnstiles already installed to be omitted, low priority
(3) Number of transactions by day, high priority
This issue should be analyzed in deep when new information about turnstile installations dates are available.
There are some outliers that should be analyzed better:
2017-04-10: high means for data in the with and without turnstiles condition. A low number of observations in the with-turnstiles condition. A low number of transactions although it corresponds to a normal working day (see Out[10]) SOLVED.
2017-04-17: Extremely high means for data in the with and without turnstiles condition. An extremely low number of transactions (see Out[11]) SOLVED
They were detected when plotting means
2017-06-05: low number of transactions (see Out[24]) SOLVED
2017-06-13: low number of transactions (see Out[24]) VERIFIED IN AGUILA
2017-06-14: low number of transactions VERIFIED IN AGUILA
They were detected when plotting the total number of transactions over time.
When 'perfiles' databases were analyzed, it was noticed that the minimum time between different expeditions for same buses and services is about 30 seconds. This has some consequences mainly to compute mean time intervals for same buses, services, and stops (i.e. in MatchingUsers.py, function groupByEtapasDatabase).
The questions are,
The utility of this issue is to document the up-to-date state of etapas datasets in terms of number of transactions.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.