cyber-punk-me / vizzero

Tool for collection of neural data related to conscious activity. Draws data from Brainflow using PySide2 & http://vispy.org library.

Tool for collection of neural data related to conscious hand activity

Install

Tool requires python3.

• cd src
• python3 setup.py install

Run

• python3 main.py

Record gestures dataset

Instruction

1. Open "fixed" plugin
2. Select the folder in which dataset should be written
3. Select and configure sensor (can be simulated for testing)
4. Configure filters for hand activity signal
5. Record each gesture, follow the tips
6. Select the new folder to record the next dataset

Each gesture can be recorded more than 1 time for the session, but the file will be rewritten.

Gestures

1. Nothing
2. Rock
3. Scissors
4. Paper
5. Ok
6. Horns
7. Shaka
8. Gun
9. Thumb up

Output

File with sEMG signal is recorded for each gesture in csv format. Each row contains signal values from sensors at the same time.

vizzero's Issues

Fix start and stop buttons.

at any moment button "Start data" should start neuro data stream and "Stop data" should stop it.

Make a tab to record fixed motion classes analogous to android learning

• User selects a movement class (0-5)
• User presses button "record"
• User sees countdown from 5 to 1
• We record neural data into a file. File will contain N values representing neural activity
• File will be closed after 4 seconds of recording
• We add a json file nearby with content {"start":0, "end":N, "class":$UserSelectedClass}

Fix application closing

app should exit after the window is closed

research now to make 3d hand pose predictions with openpose and two cameras

research how to make 3d hand pose predicions with openpose and one camera

Data should be fed into drawing all the time after start button was pressed and before stop button was pressed. Writing to file should be optional and determined from app logic.

We need to write to file while we are recording hand movements from tabs logic. We don't need to write to file right after "start data" button (outside of tabs) was pressed.

make a tab that records a hand video simultaneously with EMG