brminnick / faceoff

An iOS, Android and UWP app created in Xamarin.Forms that uses Microsoft's Cognitive Emotion API Services to compare facial expressions

FaceOff

FaceOff pits two players against eachother to see who can reflect an emotion best!

The app provides a random emotion that both players will portray. It then uses the facial recognition technology to determine who exhibited the emotion best!

About

This is an Android, iOS and UWP app created using Xamarin.Forms. The facial recognition uses Microsoft's Coginitive Services Face API.

ToDo

To use Microsoft's Coginitive Services Face API from this app, sign up for a free API Key and insert it to the code here. After adding your API Key, remove the diagnostic directive located here.

Author

Brandon Minnick

Xamarin Customer Success Engineer

faceoff's Issues

Move PCL to Netstandard

Implement String Builder

https://github.com/brminnick/FaceOff/blob/master/FaceOff/ViewModels/PictureViewModel.cs#L242

Change iOS Icon Background to White

Add iOS 10 Privacy Permission Settings

https://blog.xamarin.com/new-ios-10-privacy-permission-settings/

FileLoadException Could not load file or assembly 'Plugin.Media.Abstractions, Version=2.6.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)

https://insights.xamarin.com/app/faceoff/issues/1537

Add UWP Support

Remove Debug Insights API Key

Unify the Insights API Keys

Refactor ExecuteTakePhotoWorkflow

Modulaize this method using events

Crash On UI Animations

Configure Button Animations with Device.BeginInvokeOnMainThread

Replace EmotionAPI with FaceAPI

As Face API now integrates emotion recognition capability in general availability, we’ll be deprecating Emotion API preview on February 15, 2019 for existing customers. Try the emotion recognition capabilities of Face API now. Learn More

https://azure.microsoft.com/en-us/services/cognitive-services/emotion/

Make Entry Keyboard Next/Done Button

On the Welcome Page, have the entry's return Button either go to the next Entry or tap the enter button

Add Insights Tracking To Results Buttons

Verify Layout on iPhone 4s Screen Size

Throw Error If 2+ Faces Detected

If the app detects multiple faces, display an alert to the user and do not provide any analysis

problem xamarin.android @ face api

dll doesnt works properly can you look it

FileLoadException The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)

https://insights.xamarin.com/app/faceoff/issues/1539

Android Photos are Saved Horizontally

The fix will require forking the Xamarin.Media plugin and updating the Android source.

It is currently listed as a future enhancement to the Xamarin.Media plugin

There is a Xamarin forum post on how to fix it

Change Score Text to a Button

Show the score text as a button that the user can click to show their other emotion scores

Place Welcome Page inside Scroll View

Place the Welcome Page inside of a scroll view to prevent the keyboard from covering the entry

Upgrade to Xamarin.Forms 3.0

Confirm Media Plugin 2.6.0

https://github.com/jamesmontemagno/MediaPlugin/blob/master/CHANGELOG.md

Exception Method 'StoreCameraMediaOptions.set_OverlayViewProvider(Func<object>)' was not included in compilation, but was referenced in PictureViewModel.<GetMediaFileFromCamera>d__138.MoveNext(). There may have been a missing assembly.

https://insights.xamarin.com/app/faceoff/issues/1538

Add Flag That Denotes A Network Time-Out

If the Cognitive APIs can't be reached, it returns null, but it also returns null if there is no face detected in the image.

It'd be nice to return two different states, one that notifies of a network time-out and another that notifies if no face was detected.

Ensure iOS App Transport Security Compliance

Update Error Message

Shorten error message to "No Face"

Display Alert When User Clicks "Take Photo"

Display an alert that tells the user to

"Make A Face Showing [Emotion]!"

Add Official Cognitive Services SDK

Follow Jim Bennet's blog to implement the FaceAPI via the official SDK

https://www.jimbobbennett.io/face-identification-with-azure-faceapi/