Remove duplicate urls by the same user within a short timespan about eyebrowse-server

[amyxzhang]

@joshblum could there possible be some code that you haven't merged in to master? I can't find a folder common/commands. I can't find commands defined anywhere actually.

[joshblum]

https://github.com/haystack/eyebrowse-server/tree/master/common/management/commands
On Nov 9, 2013, at 5:20 PM, Amy Zhang [email protected] wrote:

@joshblum could there possible be some code that you haven't merged in to master? I can't find a folder common/commands. I can't find commands defined anywhere actually.

—
Reply to this email directly or view it on GitHub.

[amyxzhang]

ok the various feeds should now look a whole better! The raw data is still being stored in EyeHistoryRaw, an append-only table not used in any views. EyeHistory is now a more condensed list of views, with the same url visited within a 5min timespan by a user being collapsed as 1 view in the feed.

Still need to:
investigate why we are getting some bad raw data. Seems to be much more prevalent in Firefox, where we will get many hits for a single action - manifesting in near duplicate EyeHistoryRaw items (everything exactly the same except slightly different end_times).

[amyxzhang]

this is done.