apollozhu / augma

My iPhone is just not a Hololens... or so I thought--

Augma

This is an ambitious project that implements Augma, an imaginary device depicted in Sword Art Online The Movie: Ordinal Scale which integrates augmented reality into everyday life activities. There already exists such devices like Google Glass and Microsoft HoloLens, however too expensive for normal customers. The goal of this project is to achieve similar functionalities as a software running on ARKit compatible iPhones (iOS 11, A9 or later processor) alone, without the help of any external sensors.

License

Augma - Transforming your iPhone to a HoloLens like device.
Copyright (C) 2018 Zhiyu Zhu <[email protected]>

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program.  If not, see <http://www.gnu.org/licenses/>.

App Icon Components

Part of the icon, made by Pixel perfect from www.flaticon.com, is licensed by CC 3.0 BY

Another part of the icon is licensed by DEVELOPER ARTWORK LICENSE AGREEMENT FOR ARKIT of APPLE INC..

---

<script type="text/javascript"> window.onload = function () { document.getElementById("augma").style.display="none"; } </script>

augma's Issues

[Game] Ordinal Scale

Cyclomatic Complexity

Augmented Reality - ARKit/ARCore

AR Experiments

• https://github.com/HalfdanJ/ofxARCore
• https://github.com/googlecreativelab/ar-drawing-java
• https://github.com/bjarnel/arkit-occlusion
• https://github.com/YoneChen/WebVR-helloworld

https://github.com/olucurious/awesome-arkit

Marketing

Augmenting Reality to Inspire Exploration

Porting to Objective-C++

[Important] Legal and Ethical Concerns

1. Rename Augma to a more descriptive name, but what? Suggested candidates:

• Hologma
• Minilens
• Augmium
• ...

2. Why Google Glass didn't work out? We should try to avoid those.
3. Disclaimer. Just in case if someone walk into a tree, feel sick, or whatsoever.

Shared Coordinate System/Reference Frame

Needs accuracy

Hands Free - Google Cardboard

Google Cardboard, from $15
Cardboard For iOS

Interop

https://github.com/hanleyweng/iOS-ARKit-Headset-View
https://github.com/scottfinkelstein/MixedRealityKit
https://github.com/NickAtGit/ARKit-VRMixedRealityExample

Implement native iOS UI

Extract hand skeleton

Extract hand image

Recognize Hand Gestures

System Controls

We should support adding these additional elements on top of SceneKit and SpriteKit ones:

• Button
  • Keypad
    • TextField
    • TextView
  • Stepper
  • Switch
• Slider
• Some sort of container, like a general View/Layer/Controller

System Apps

Find on GitHub

• Paint
• Ruler
• Maps
• Photos (Girls' Last Tour, episode 12, my other project)

Needs Implementation

• Notification Center

• Weather

• Music

• + Core ML + HealthKit, Nutrition Facts

• Other apps appeared in "Sword Art Online The Movie: Ordinal Scale"

Accessibility

• Voice Over/Dictation support
• Detecting feet instead of hands

Identify hand position

Recognize gesture