haystack / eyebrowse-server Goto Github PK

Currently only male default, want to do similar to google docs with a random avatar assigned to each user by default

Like FB or twitter or github - be able to do @___ in your comment or chat. it would show up as a link that links to that person's profile. ideally, a dropdown bar would show that suggests your friends when you do @ but this can come later maybe.
That person would ideally get a notification (email(?) and little flag on the notification link in the nav bar).

When you are browsing the history a request for an MIT certificate appears, presumably when a webpage behind MIT certificates is requested. We should figure out a way to fail silently and not prompt the user for the cert

Right now a little pop-up in the upper-right corner shows up every time a person has been there or a bulletin or chat message has been posted anytime in the last two months. Change that to 1 week.

Rip out google code and replace with d3. Make the pie charts responsive to the filters. Buttons for embedding pie chart and save as PNG should be there (on viz page)

Within 5 minutes or so, collapse duplicate views to the same page into 1 view. For help, look at code in common/commands/remove_duplicate.py

something like a thin rectangle at the top saying 'posting to eyebrowse' followed by a link that says 'Cancel'. kind of like gmail's. box disappears after some seconds (5?)

...to check their email or resend the email.

in the user's account settings, don't allow duplicate whitelists.

Syntax error from js reformatting when trying to view visualizations on profile page

Popup shouldn't show myself in list of previous visitors to a page.

We need homegrown analytics because Google Analytics just isn't really cutting it.

Ideally I would want to store:

• visits to every page on the Eyebrowse website, including timestamp and user (if logged in), ip otherwise
• track clicks on any link that leaves Eyebrowse, including the page that the user was on, the user (if logged in) and ip otherwise, and timestamp
• if someone is using the visualization widgets - so I would want to track the viz API calls too, including timestamp and ip address, and in this case referrer.
• how often do people delete things? what do people choose to delete?

Also what about extension analytics?

• How often do people turn Eyebrowse on and off? Do they even use this feature?

Anything else?

Don't forget to still have the links open in a new window on click.
Be careful not to log pings
Need to rip out old Google Analytics code

Never allow or ask a user to eyebrows google.com, gmail.com, or facebook.com. Anything else?

I'm a bit tired of the grey on grey (nav/background) and think the site would look a lot cleaner by making it white/something brighter. I think github style is a good example that we can maybe follow

Problem is visits to the same page often look like visits to different pages bc of the params set by the website. Every website does it differently so we're going to go case-by-case and hardcode some rules.

For NYTimes, it's ok to remove everything after the ? in url.

For BuzzFeed, it's ok to remove everything after the # in url.

Notice any others?

Do this at save time.

Need to fix going back too.

Chrome seems to be ignore the target="_blank" attribute. Link will open in the current tab instead of a new one.

like the github issues search bar.
little dropdown to the left of search bar that says [Search by]. clicking on one repopulates the search bar with something like "tag:" to teach people how to search by tag for instance.

some other fun things to search by:
things i've whitelisted
things I've seen
things I haven't seen

also dropdown by date filter to suggest common filters - ex:
last week
last month
last year
(can you do date ranges for a different time in the past)? - if so add a template to help users write this.

Should have info on your browsing behavior in the last week (would be great if it were natural language. would also be great to have this be a part of the website as well (visible only to yourself)). Infographic also?

Should also have top links from the last week from your friends and from the firehose.

Top recommended people to follow maybe?

Would be cool if it were easy to tweet or share on fb from email but idk if this is possible.

you must press enter for the search to complete, can't click on the suggestions. This is for the search box at the top of the page. Also when searching, code often shows up in the results.

ability to toggle everyone/followees only?

a superficial combining of the three repos. keep parent dir for deployment and build scripts, folders for the specific projects.

allow this to be expandable to see more details.

Added a flake8 linting in the branch getting-started. There are lots of PEP8 complaints with the code (mostly my fault for not doing this before). It would be good to fix these issues in one PR so new diffs can be much cleaner. We need to add jshint support as well but for some reason I have problems installing the module right now.

don't make the user be inundated with eyebrowse requests right after registering. Perhaps add a rate-limit and limit how many times a minute a user can receive an eyebrowse request?

at the top of the page. HTML code appears in the search box.

notifications don't work right now really.

I'm imagining

• a new database table to store notifications, timestamp, and when they've been seen. Can store heterogeneous notifications (new follower, bump into someone, someone tags you in a comment)
• A flag in the corner of Notifications in the nav bar with a number when you have a notification. clicking takes you to a page with a list of your last ~15 notifications.
• you get an email for every notification by default (right now you get an email only when someone follows you). Ability to turn this off partially in settings.
• notifications include - when someone follows you. when you "bump" into someone on the same page (they join page within 5 minutes of you joining). when someone tags you in a comment or chat. when someone comments or chats on a page that you have been to in the past.

query would be like "tag:tagname"

clicking on a tag should automatically search for it also.

A bunch of files have executable permissions. I think I was having issues getting the server running at some point and went a bit chmod crazy. Its just bad practice and also should be a quick fix..

turn off eyebrowsing but still stay logged in. no data is being collected, no one knows you're online. (but perhaps (looking forward) you can still see whether other ppl are online?) would be cool if this manifested as a closed eye button on the browser bar.

Right now, when clicking to mute something via the modal, clicking again does not unmute.

Also just get rid of Refresh button. Just have a Cancel and Close button. Close button will refresh the page (so will clicking X or clicking away) if something has been muted. Cancel undos all the mutes added.

The modal could also look prettier.

Like a customizable twitter widget of a feed. Could be a person's feed or a particular query or domain or even the top firehose feed.

If this gets done after analytics, would want analytics to capture usage of this as well.

the login page and tracker page gets pulled from eyebrowse-server every time. this breaks for ex when the page is an https page (and thus the eyebrowse popup which is http doesn't work). can we generate these pages on the client side?

right now a whitelist item of 'cnn.com' is not the same as 'www.cnn.com'. Fix this by stripping all whitelist items of 'http/s' and 'www'. then when searching, don't include 'www' or 'http/s' as part of the search.

I've seen this error a few times:

DatabaseError: (1267, “Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='”)

Following this post do you guys think the best option is to alter the DB tables?

Just wanted to open this for discussion :)

make it as if it was just 1 one item.

This should be done once we've added better email integration (like weekly updates)

Still want it to work ok for a text-only email reader though.

want analytics for opening an email (via a pixel or some other image)

also analytics for links they click on in the email

After fixing the favicons the bas64 images are stretched when displayed in my activity. Need some javascript for resizing:
http://stackoverflow.com/questions/20958078/resize-base64-image-in-javascript-without-using-canvas

suggested whitelists after creating an acct. also put in settings page.

python populate_popular_history.py (in scripts folder) is run manually by me on occasion at this point. needs to be a cron job set to once an hour or once every 30 min.

occasionally, popups don't load for various reasons. this should either not happen (don't show the popup if the iframe doesn't load) or disappear immediately so the user doesn't see it.

Steps to launch server

In the extension you should be able to remove a domain from being whitelisted by clicking a button in the same spot as the "whitelist this domain button"

sync is written but not friend suggestion. add to getting started too.

This was working at some point, I think it will help reduce page load time significantly.

Previous user leaves a message, bulletin pops up, disappearing too fast.