shu223 / ios-10-sampler

Code examples for new APIs of iOS 10.

iOS-10-Sampler

Code examples for new APIs of iOS 10.

How to build

Just build with Xcode 8.

It can NOT run on Simulator. (Because it uses Metal.)

Contents

Speech Recognition

Speech Recognition demo using Speech Framework. All available languages can be selected.

Looper

Loop playback demo using AVPlayerLooper.

Live Photo Capturing

Live Photo Capturing example using AVCapturePhotoOutput.

Audio Fade-in/out

Audio fade-in/out demo using setVolume:fadeDuration method which is added to AVAudioPlayer.

Metal CNN Basic: Digit Detection

Hand-writing digit detection using CNN (Convolutional Neural Network) by Metal Performance Shaders.

Metal CNN Advanced: Image Recognition

Real-time image recognition using CNN (Convolutional Neural Network) by Metal Performance Shaders.

PropertyAnimator: Position

Animating UIView's center & backgroundColor using UIViewPropertyAnimator.

PropertyAnimator: Blur

Animating blur effect using fractionComplete property of UIViewPropertyAnimator.

Preview Interaction

Peek & Pop interactions with 3D touch using UIPreviewInteraction.

Notification with Image

Local notification with an image using UserNotifications framework.

Sticker Pack

Example of Sticker Pack for iMessage.

Core Data Stack (Created by nolili)

Simple Core Data stack using NSPersistentContainer.

TabBar Customization

Customization sample for UITabBar's badge using text attributes.

New filters

New filters of CIFilter in Core Image.

New Fonts

New Fonts gallery

Proactive: Location Suggestions

This sample demonstrates how to use new mapItem property of NSUserActivity to integrate with location suggestions.

Attributed Speech

Attributed Speech demo with AVSpeechSynthesisIPANotationAttribute for AVSpeechUtterance.

Haptic Feedback

Haptic Feedbacks using UIFeedbackGenerator.

Author

Shuichi Tsutsumi

Freelance iOS programmer in Japan.

• PAST WORKS: My Profile Summary
• PROFILES: LinkedIn
• BLOGS: English / Japanese
• CONTACTS: Twitter / Facebook

Special Thanks

The icon is designed by Okazu

ios-10-sampler's Issues

Inception3Net crashes on create

When I create the Inception3Net object from the commandQueue it says:

fatal error: unexpectedly found nil while unwrapping an Optional value

Any idea why this happens?

Update AttributedSpeechViewController to leverage correct attributedSpeechString attributes.

To answer your question "Anyone, please let me know how to use this new API.":

In AttributedSpeechViewController.swift, change the following lines:

attributedStr.addAttributes([NSFontAttributeName: UIFont.systemFont(ofSize: 14)], range: rangeAll)
attributedStr.addAttributes([NSForegroundColorAttributeName: UIColor.black], range: rangeAll)
attributedStr.addAttributes([NSFontAttributeName: UIFont.boldSystemFont(ofSize: 20)], range: rangeBold)

to something like:

// Speak punctuation out loud
attributedStr.addAttributes([UIAccessibility​Speech​Attribute​Punctuation: 1], range: rangeAll)
// English as spoken in UK/Great Britain
attributedStr.addAttributes([UIAccessibilitySpeechAttributeLanguage: "en-GB"], range: rangeAll)
// Speak in a deeper voice
attributedStr.addAttributes([UIAccessibility​Speech​Attribute​Pitch: 0.8], range: rangeAll)

See documentation here:

https://developer.apple.com/reference/uikit/uiaccessibility/speech_attributes_for_attributed_strings

Can not build code.

Thanks for providing nice sample codes. It's very helpful. But I could not build on Xcode8. Here is error msg from Xcode. Any ideas?

None of your accounts are a member of 'XXXXXXXXX':  An unexpected error occurred. Xcode cannot find a team matching 'XXXXXXXXX'.
No profiles for 'YYYYYYYYYYYYYYYY' were found:  Xcode couldn't find a provisioning profile matching 'YYYYYYYYYYYYYYYY'.
Code signing is required for product type 'App Extension' in SDK 'iOS 10.3'

Blur property disappear on app resign active

After some time blur effect is disappearing on Blur Property animator screen. The best way to reproduce is to hide app (resign active) then activate in again - blur disappears and you see clear image. Further blur value change not working anymore.

Error: MetalPerformanceShaders is not supported on current device

I used Iphone 5s to test "Image Recognition" and appear a error "not support this device". What can i do, tell me how to resolve with this. Thank you so much.

Metal Performance Shaders not Supported on iPhone 5S

Digit and Object recognition crashes on my 5S stating "Metal Performance Shaders not Supported on current Device" but I haven't found any info on Apple and other forums stating this.

Convert Tensor flow model (.pb) to .dat

https://medium.com/@shu223/model-format-of-mpscnn-on-ios-metal-performance-shaders-94b653a3dcc8
I flow this tutorial of you but can not convert

Dear @shu223

I want to

1. Trained 1 more flower using : https://www.tensorflow.org/tutorials/image_retraining
2. then using your guide to import model from step 1 to use but I can not convert and import
3. please support if you have time

Thanks

CNN image position

Hello,

in the image recognition sample, an improvement could be to highlight the image on the screen when it is recognized. Is it possible with the current APIs?

how to retrain inceptionv3?

I have a .pb file from Tensorflow and I would like to implement it into the metal image recognition. I am very new to Swift so any help would be great. thanks.

MetalPerformanceShaders not Found

I have downloaded this project, In MetalCNNBasicViewController "MetalPerformanceShaders" module not Found error comes

MPSCNNConvolutionのinitがInvoke出来ません。

現在研究室でiPhoneXを使いリアルタイムで画像処理をしたいということになり、このサンプルを見つけさせて頂きました。ありがとうございます。
そこでビルドをしたのですが、SlimMSCNN.swiftの88行目にて

Cannot invoke 'MPSCNNConvolution.init' with an argument list of type '(device: MTLDevice, convolutionDescriptor: MPSCNNConvolutionDescriptor, kernelWeights: UnsafePointer<Float>, biasTerms: UnsafePointer<Float>, flags: MPSCNNConvolutionFlags)'

といったエラーでビルドが失敗します。このプロジェクトは現在のXcode9,swift4で実行することは不可能なのでしょうか？もしくはios11ではできないのでしょうか？
よろしくお願いします。