pooya-mohammadi / deep_utils

An open-source toolkit which is full of handy functions, including the most used models and utilities for deep-learning practitioners!

Hi there, I'm Pooya Mohammadi 👋

• my LinkedIn
• my YouTube Account

I'm an AI Researcher & Developer

• 🔭 I love research topics in Deep Learning, Medical science, and Deep Reinforcement Learning
• 🌱 I'm currently learning about GNN, GAN, and Diffusion models
• 🔨 I’m currently working on chatbots, voice assisstance systems, reinforcment learning models for optimization and also making youtube videos about python and AI.
• 👯 I'm looking for a PhD position in Medical Science fields.
• 📫 How to reach me:
  • Email: [email protected]
  • LinkedIn: www.linkedin.com/in/pooya-mohammadi
• Follow me on Youtube: www.youtube.com/PooyaMohammadiKazaj

Keywords: Speech, Deep Learning, CV, AI, NLP, Reinforcement Learning

Projects:

Deep Utils

This repository contains the most frequently used deep learning models and functions. In mainly constists utilities for:
1. vision:
  1. yolov5
  2. mtcnn
  3. ultralight
  4. deepsort
  5. torchvision-image-classification
2. nlp
  1. ner
    1. ner-stratify
    2. ner-augmentation -> replacement and removal augmentation
3. utils
  1. box-utils 
  2. point-utils
4. augmentation
  1. Cutmix-classification
  2. Cutmix-segmentation
...
Deep_Utils is still under heavy development...

Yolov5-gradcam

Visualizing Yolov5's layers using GradCam 

deep_utils's Issues

Import Error

Cannot import name 'download_file' from 'deep_utils' in colab. Below is the error info:

• ImportError: cannot import name 'download_file' from 'deep_utils' (/usr/local/lib/python3.10/dist-packages/deep_utils/init.py)

a function for easy arg parser is needed

Hi sir, can you teach me how to use your cutmix method?

Appending face-detection-examples.ipynb notebook

Tensorflow loads in MTCNN directly

Add torch augmentation modules

@dornasabet

Converting landmarks' list of tuples to a dictionary

examples codes does not work

This issue is about the latest version 1.3.10
in the examples code , many import statements no longer work . For example

import cv2
from deep_utils import Box, show_destroy_cv2, Point
from deep_utils import face_detector_loader

it will fail to import show_destroy_cv2 , and also it will fail to import face_detector_loader .

also in one of your example , it try to load the jpeg from "https://raw.githubusercontent.com/pooya-mohammadi/deep_utils/master/examples/vision/data/movie-stars.jpg" . This url return "not found" .

To run your examples , I need to install deep_utils version 0.10.7

Can you update example codes that can use the latest version ?

facial_land_marks_to_dict

[Possible Bug?] Newer Versions Lead to Segmentation Fault under Certain Conditions on Ubuntu22.04

System: Ubuntu22.04lts
Task: Starting to train a yolov5 model with deep_utils being one of the imported modules (that doesn't do anything during training).
Symptom: When trying to import deep_utils, an error message is thrown before any other console output: Process finished with exit code 139 (interrupted by signal 11: SIGSEGV).

Package Version

---

absl-py 1.4.0
albumentations 1.3.0
apturl 0.5.2
astunparse 1.6.3
bcrypt 3.2.0
blinker 1.4
Brlapi 0.8.3
cachetools 5.3.0
certifi 2020.6.20
chardet 4.0.0
charset-normalizer 3.0.1
click 8.0.3
cmake 3.25.2
colorama 0.4.4
command-not-found 0.3
contourpy 1.0.7
cryptography 3.4.8
cupshelpers 1.0
cvms 0.1.1
cycler 0.11.0
dbus-python 1.2.18
deep-utils 0.9.5
defer 1.0.6
distro 1.7.0
distro-info 1.1build1
duplicity 0.8.21
fasteners 0.14.1
filelock 3.9.0
flatbuffers 23.3.3
fonttools 4.39.0
future 0.18.2
gast 0.5.3
google-auth 2.16.2
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
grpcio 1.51.3
h5py 3.8.0
httplib2 0.20.2
idna 3.3
imageio 2.26.0
importlib-metadata 4.6.4
jeepney 0.7.1
joblib 1.2.0
keras 2.8.0
Keras-Preprocessing 1.1.2
keyring 23.5.0
kiwisolver 1.4.4
language-selector 0.1
launchpadlib 1.10.16
lazr.restfulclient 0.14.4
lazr.uri 1.0.6
lazy_loader 0.1
libclang 15.0.6.1
lit 15.0.7
lockfile 0.12.2
louis 3.20.0
macaroonbakery 1.3.1
Mako 1.1.3
Markdown 3.4.1
MarkupSafe 2.1.2
matplotlib 3.7.1
monotonic 1.6
more-itertools 8.10.0
mpmath 1.2.1
netifaces 0.11.0
networkx 3.0
numpy 1.24.2
oauthlib 3.2.0
olefile 0.46
opencv-python 4.5.5.64
opencv-python-headless 4.7.0.72
opt-einsum 3.3.0
packaging 23.0
pandas 1.5.3
paramiko 2.9.3
pexpect 4.8.0
Pillow 9.0.1
pip 22.0.2
protobuf 3.12.4
psutil 5.9.0
ptyprocess 0.7.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycairo 1.20.1
pycups 2.0.1
PyGObject 3.42.1
PyJWT 2.3.0
pymacaroons 0.13.0
PyNaCl 1.5.0
pyparsing 2.4.7
pyRFC3339 1.1
python-apt 2.4.0+ubuntu1
python-dateutil 2.8.1
python-debian 0.1.43ubuntu1
pytorch-triton 2.0.0+b8b470bc59
pytz 2022.1
PyWavelets 1.4.1
pyxdg 0.27
PyYAML 5.4.1
qudida 0.0.4
reportlab 3.6.8
requests 2.28.2
requests-oauthlib 1.3.1
rsa 4.9
scikit-image 0.20.0
scikit-learn 1.2.1
scipy 1.10.1
screen-resolution-extra 0.0.0
seaborn 0.12.2
SecretStorage 3.3.1
setuptools 59.6.0
six 1.16.0
ssh-import-id 5.11
sympy 1.11.1
systemd-python 234
tensorboard 2.8.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorflow 2.8.0
tensorflow-io-gcs-filesystem 0.31.0
termcolor 2.2.0
tf-estimator-nightly 2.8.0.dev2021122109
thop 0.1.1.post2209072238
threadpoolctl 3.1.0
tifffile 2023.2.28
timm 0.6.7
torch 2.0.0.dev20230301+cu118
torchaudio 2.0.0.dev20230305+cu118
torchvision 0.15.0.dev20230305+cu118
tqdm 4.64.0
typing_extensions 4.5.0
ubuntu-advantage-tools 8001
ubuntu-drivers-common 0.0.0
ufw 0.36.1
unattended-upgrades 0.1
urllib3 1.26.5
usb-creator 0.3.7
wadllib 1.3.6
Werkzeug 2.2.3
wheel 0.37.1
wrapt 1.15.0
xdg 5
xkit 0.0.0
zipp 1.0.0

The last usable version is 0.9.5.

Extract the name of file from url and show it in the output

deep_utils/deep_utils/utils/download_utils/download_utils.py

Line 70 in e0d437f

sys.stdout.write("\rDownloading: [{}{}]".format("█" * done, "." * (50 - done)))

Right now the output is like the following:
Downloading: [██████████████████████████████████████████████████]
It would be great to have the downloading file name after Downloading

Downloading image.png: [██████████████████████████████████████████████████]

Showing percentage of the downloaded file would be great as well

@MenuaB Thanks in advance

Box Types are case sensitive its better to be case insensitive

TF MTCNN config file has a problem

The config.py file of MTCNN TF has a wrong directory for saving h5 models.

Ultralight TF and Pytorch models print unnecessary prior nums

Face detection tensorflow models will crash without using GPU.

Fix Typo in Readme.md

install Error

This installation command in Windows is accompanied by an error

pip install git+https://github.com/pooya-mohammadi/deep_utils.git

ERROR: Command errored out with exit status 1:
ppData\Local\Temp\pip-req-build-r1tldw6i\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('
"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\moradi\AppData\Local\Temp\pip-pip-egg-info-i6z1fedb'
cwd: C:\Users\moradi\AppData\Local\Temp\pip-req-build-r1tldw6i
Complete output (5 lines):
----------------------------------------
WARNING: Discarding git+https://github.com/pooya-mohammadi/deep_utils.git. Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Torch loads in MTCNN directly

Automatically checking changes to the code

Hi,

Is there a way to make sure that changes to the main repo's code when opening a PR does not disrupt the functionality of the project?
Can you add this feature to your CI/CD pipeline?

MTCNN Tensorflow get_nets.py uses older version of tensorflow for importing layers.

It uses keras.layers it should be tensorflow.keras.layers.

Appending MTCNN Tensorflow

Ultra light is missing in models