d4t4x / data-selfie

Data Selfie - a browser extension to track yourself on Facebook and analyze your data.

Data Selfie

Work in progress. Some information might not apply.

---

How to use

monitor your monitoring

• open console in any Facebook tab (by pressing Alt+Cmd+J on a Mac)
• you can see logs of what is happening in the background with Data Selfie

fix for most errors

• "Have you tried turning it off and on again?" - refresh the Facebook tab or close and open a new one

short cuts

• url bar, type "ds" + tab
• available commands reset db, delete db, init db

access local data

tracked data

• open console in background page or Data Selfie Me page (Alt+Cmd+J on a Mac)
• go to the "Application" tab
• Storage > IndexedDB
• click triangle to expand the subitems
• "DataSelfieLocalDB" contains all tracked data (this is not saved anywhere else(!), so be careful before clearing this storage)

chrome local storage

• you can access settings, your general user data and the prediction

  • open console in background page or Data Selfie Me page (Alt+Cmd+J on a Mac)
  • copy chrome.storage.local.get(function(data){console.log(data)})
  • press Enter

• you can delete your prediction results to start new

  • open console in background page or Data Selfie Me page (Alt+Cmd+J on a Mac)
  • copy chrome.storage.local.remove(["alchemy", "applymagicsauce", "personality"])
  • press Enter

---

How to run (locally) and pack

• npm install
• to make a build (folder) from src npm run build
• to make a build and watch for changes npm run buildw
• to make a build and minify etc (see webpack.config.js) npm run buildprod
  • use this to reproduce the code submitted to Chrome Web Store and Firefox Add-ons
  • for both Chrome and Firefox the content of the build folder is compressed and submitted to the developer platform

Chrome extension

• in your Chrome browser go to chrome://extensions/ and tick the box that says "Developer mode"
• now click "Load unpacked extension..." and choose the build folder you just created
• you can now use Data Selfie, the extension icon (the eye) should now appear in your toolbar
• it is tracking if the eye is black (instead of gray) and if you can see a clock at the bottom left in your facebook window

Firefox add-on

• go to about:debugging and and click on "Load Temporary Add-on"
• choose manifest.json from the build folder and hit enter

Difference Chrome and Firefox

• background.persistent: Event pages are not currently supported in Firefox. Background page has to be persistent

---

Known bugs

• posts like friendship anniversaries and memories are not considered, which sometimes leads to time being added to the previously looked at post
• when Facebook tab has been in the background for a while and you go back the clock might not show up again
• exporting your data can result in an invalid json file (that you can't import), when URLs contain double quotes " that are not escaped, you can do that manually by adding \ before the "
• more bugs commented in source code marked with "// FIX"

To Do List

• refine the limit of data sent to IBM (Alchemy and Personality Insights), now only last 300 rows - add date (e.g. last 5 days from last time active)
• make tracking more stable (we need your help, please report any problems you run into)
• improve Your Data Selfie (Me) page front end code (responsive, handlebars or similar instead of jquery append - I know horrible)

---

Disclaimer

This project is maintained by one developer (Hang aka 01fade) as of now. Email [email protected] to get involved. Email [email protected] to report any issues you might have.

Last tested with:

• Chrome Version 61.0.3163.100 (64-bit) with macOS High Sierra 10.13 with Facebook in English (US)
• Firefox Nightly 58 with macOS High Sierra 10.13 with Facebook in English (US)

License

Data Selfie is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or any later version.

Data Selfie is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

For more info see http://www.gnu.org/licenses/.

data-selfie's Issues

no data collected

"If you have, but the counter for the seconds you look at posts (see demo video) is not shown in the bottom left, then your browser/Facebook account might not be compatible with Data Selfie. We are very sorry for this!"

What is not compatible?

Package addon for Firefox

Firefox also supports webextensions, it would be great if you can also package for it:

https://developer.mozilla.org/en-US/Add-ons/WebExtensions/Porting_a_Google_Chrome_extension

It feel weird that this extension is only available for Chrome and not a more privacy aware browser ;-)

'No tracking on this page' on every facebook page

The code $("#pagelet_bluebar a[data-testid='blue_bar_profile_link']") returns nothing and data selfie fails to track the page.

I have only the ID "fb2k_pagelet_bluebar" on the DOM.

My profile is set to male but data selfie reports that I'm female ;-)

I haven't looked into the code yet to see how it came up with that. I think it's still an interesting piece of data, even if it's "incorrect". I.e., my Facebook use most closely resembles a female's?

Users should not be displayed in Top Friends

Keep counting in the background

• open facebook
• keep the tab open
• use another Chrome window
• Time on a post keep running

Not working in Yandex Browser.

Hi,
I'm using Yandex browser which was built using chromium. The data Selfie extension is not working for this browser.
Yandex browser supports all chrome extensions and I regularly use many chrome extensions and all the extensions are working fine apart from this Data Selfie extension.
Please go through the attached image.

Thanks
Sampath | Web Developer

Point to https version of dataselfie.it

Nice project. I've added it to awesome humane tech list in new 'Awareness' section.

One remark: Have the link at the top of the repo point to the https version of your site: https://dataselfie.it

Please add license information.

Please add license information, because showing the code in itself does not make Data Selfie a Free Software.

Sync database across Chrome instances

It would be nice to have the extension (optionally) synchronize tracked data between browser instances.
I, for one, tend to use Facebook on multiple computers and it seems that the extension have still gathered too little data to analyze on any one of them. Merging all the data might result in better predictions.

Error when importing consumption data

Hi, I tried exporting and importing my data selfie (consumption data). Upon importing it on a new pc I get the following error: There has been error. Please make sure your file is a valid json and try importing again.

I checked that it is valid JSON. Could it be that my data is simply too big? It is around 350kB.

I am using Data Selfie 0.1.1 updated 20 March '18 on Firefox 59.0.3 (64-bit) on Windows 10.

Not collecting data again

Looks like the extension has stopped collecting data again. I'm beginning to wonder if a person at Facebook is watching this repo and intentionally breaking it.

Update to manage the new FB interface?

Ciao,
In first place i wanted to thank you for this amazing project that I keep using for collecting all of my data and make analysis.

I wanted to ask you if it has been planned an update of the plugin to make it work with the new FB interface that is going to replace the old one soon.

Thanks in advance for letting me know!
I wish you the best :)

"Your local database is empty. You have to use Facebook"

I receive this error everytime i try to use the extension even though i can see that my local db is populated with data

D3 package is missing.

ERROR in ./js/views/me.js
Module not found: Error: Cannot resolve module 'd3' in $HOME/Source/data-selfie/src/js/views
@ ./js/views/me.js 10:9-22