Coder Social home page Coder Social logo

hanbuck30 / pytorch_esn Goto Github PK

View Code? Open in Web Editor NEW
1.0 1.0 1.0 944 KB

Pytorch version of ESN. Learning algorithms include FORCE, inverse matrix, and Gradient Descent. Unlike traditional ESNs, large storage nodes can be used using memory much more efficiently.

License: GNU General Public License v3.0

Jupyter Notebook 95.95% Python 4.05%
esn mackey-glass pytorch time-series efficiency variable-task echo-state-networks

pytorch_esn's Introduction

Hi there, I'm Hanbeot ParkπŸ‘‹

Profile Views

I'm a dedicated Researcher in the fields of Bio-Plausible Neural Networks, Brain-Computer Interfaces (BCI), and Financial Data Analysis. Currently pursuing my Master's degree in Data Engineering at Pukyong National University, my research focuses on the prediction of nonlinear time series data in BCI and financial applications. I’m also deeply engaged in developing next-generation neural networks to enhance the efficiency and performance of existing models.

πŸš€ Technical Skills

Languages

Python Java C MATLAB

Specializations

Bio-Plausible Neural Networks BCI Nonlinear Time Series Prediction Financial Data Analysis

Tools & Frameworks

PyTorch TensorFlow Scikit-learn NumPy Pandas MATLAB

Databases

Oracle

DevOps

Docker Git GitHub

πŸ’Ό Research Experience

πŸ”¬ Ongoing Research

  • BXAI Lab, Pukyong National University - Graduate Researcher
    • Conducting research on interpolation methods from low-channel to high-channel EEG data, aiming to enhance the precision of BCI systems.
    • Developing encoding techniques for Spiking Neural Networks (SNNs) to explore their potential in high-performance computing.
    • Enhancing Word Recognition in Imagined Speech Using Non-Invasive EEG for Improved BCI Applications
    • Engaged in predictive modeling of nonlinear time series data for financial and BCI applications, utilizing state-of-the-art neural networks.

🧠 Past Research & Studies

  • Multi-modal Learning (CV, NLP) - Dacon Project

    • Conducted research on improving image classification by analyzing and enhancing how text within images can be better utilized for classification purposes. This involved developing techniques to effectively integrate the visual and textual components of images to improve overall model performance.
  • Deep Reinforcement Learning (DeepRL) - NeuroMatch Project

    • Conducted research aimed at advancing bio-plausible neural networks by applying deep reinforcement learning techniques. The project involved training an Ant agent within the OpenAI Gym environment to perform desired actions using bio-plausible learning rules. The goal was to enhance the performance of bio-plausible neural networks by incorporating biologically inspired learning mechanisms.
  • Computer Vision (CV) Applications - Capstone Project

    • Conducted research on ICT technology that detects umbrellas using computer vision, enabling automatic door closure during rainy weather. This project aimed to integrate real-time weather responses into smart home systems, enhancing convenience and safety.
  • Stress Prediction - Previous Study

  • Neuromorphic Computing Research - Previous Study

  • Inner Speech Decoding - Previous Study

  • ESN Research - Previous Study

  • Stock Prediction - Previous Study

  • Explainable-AI-Design-ESN-Based-Model-for-Depression-Diagnosis -Previous Study

πŸ”§ Notable Projects

Traditional invasive methods have often achieved high performance in decoding. However, decoding using non-invasive methods like EEG is very challenging, especially for imagined speech, where understanding a user's intent through mere thoughts is particularly difficult. To address this, we developed a method that achieved high performance.

  • Tech Stack: Python, PyTorch, NumPy, MATLAB, Pandas
  • Features:
    • Achieved a high F1 score
    • Plan to further develop this method not only for decoding but also for language processing
    • It takes about 7 Hours for training.

This project investigates the use of advanced neural network models for predicting nonlinear time series data, specifically focusing on applications in BCI and financial markets.

  • Tech Stack: Python, Scikit-learn, Pandas, Pytorch
  • Features:
    • Optimized the hyperparameters of the ESN and the TA using a heuristic optimization technique, GA (Genetic Algorithm)
    • Aimed for higher profits by utilizing optimized algorithms and TA tailored to each stock
    • Achieved stable and high returns by considering not only the profitability but also the Maximum Drawdown (MDD)

Pytorch version of ESN. Learning algorithms include FORCE, inverse matrix, and Gradient Descent. Unlike traditional ESNs, large storage nodes can be used using memory much more efficiently.

  • Tech Stack: Python, NumPy, Pytorch
  • Features:
    • When using many nodes, you can effectively manage and utilize memory
    • By using batch processing, tasks can be performed at high speed through parallelization
    • It can be utilized as needed through various learning algorithms

πŸ“ˆ GitHub Stats

Hanbuck's GitHub stats

πŸ“Š Most Used Languages

Top Langs

🌱 What I'm currently learning

  • Meta-Reinforcement Learning (Meta-RL)
  • Latest state-of-the-art neural networks architectures for time series data
  • Neuroscience and its intersection with AI
  • Quantum Computing (Future Interest)

πŸ“« How to reach me

Feel free to reach out if you want to collaborate on research projects, discuss neural networks and their applications, or explore the exciting fields of BCI and financial data analysis!

🌟 Fun Fact

I'm fascinated by the idea of replicating the human brain within a computer, and I'm closely following the developments in Spiking Neural Networks (SNNs) to make this a reality. I'm also deeply interested in EEG encoding and decoding, and how these can be applied to cutting-edge AI systems.


"Research is formalized curiosity. It is poking and prying with a purpose." – Zora Neale Hurston

pytorch_esn's People

Contributors

hanbuck30 avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.