r4ghu / ios-coreml-mnist

Real-time Number Recognition using Apple's CoreML 2.0 and MNIST -

iOS-CoreML-MNIST

This is the implementation of Number recognition using Keras-MNIST model on Apple's CoreML Framework.

The app fetches image from your hand writing and perform number recognition in real-time.

Requirements

• Xcode 12.0
• iOS 14.0
• For training: Python 3.6 (Keras 2.1.6, TensorFlow 1.5.0, CoreMLTools 2.0b1)

Usage

To use this app, open iOS-CoreML-MNIST.xcodeproj in Xcode 12 and run it on a device with iOS 14. (You can also use simulator)

Training

If you want to train your own custom model, follow the tutorial given below to create an anaconda environment. Enter the environment and run the following commands in terminal with ./nnet as master directory.

(coreml) $ python train.py
(coreml) $ python convert.py

I also included a jupyter notebook for better understanding the above code. You need to use it with root permissions for mainly converting the keras model to CoreML model. Initialise the jupyter notebook instance with the following command:

(coreml) $ jupyter notebook --allow-root

Tutorial

If you are interested in training your custom MNIST model from scratch, a step-by-step tutorial is available at - Link

Results

These are the results of the app when tested on iPhone 7.

Author

Sri Raghu Malireddi / @r4ghu

ios-coreml-mnist's Issues

digit detected event when I don't write anything

multiple digit support with decimal points

@r4ghu Your demo is very helpful. I have follow your step by step article as well.

Can you please provide me some hint / suggestion that how can I detect multiple digits with decimal points ?

Thanks in Advance.