deeparsdk / quickstart-ios-swift Goto Github PK

Open DeepAR camera view to record the video close the deepAR camera and put the app in background while 10-15 min and tap on app icon to open the app from background and app is crashing in deepAR SDK. I am going to share the crash report which are reported on xcode -> organizer -> crash

s

Camera preview not showing if i present second time to the camera recording screen.Right now i am using the testing license key.I have already purchased the basic plan but still getting same issue with paid sdk key.
Help me.

Usually this is the way we set the parameters for the deepAR instance. Can we customize the video save url path or with some other approach?

" let videoQuality = 0.1
let bitrate = 1250000
let frame = 30
let videoSettings:[AnyHashable : AnyObject] = [
AVVideoQualityKey : (videoQuality as AnyObject),
AVVideoAverageBitRateKey : (bitrate as AnyObject),
AVVideoExpectedSourceFrameRateKey : (frame as AnyObject)
]

let rect = CGRect(x: (isSolo ? 0.0 : 0.15), y: 0, width: (isSolo ? 1.0 : 0.5), height: 1)

deepAR?.startVideoRecording(withOutputWidth: width, outputHeight: height, subframe: rect, videoCompressionProperties: videoSettings, recordAudio: true)"

Thanks in advance

Hi! Thank you for the amazing product 🙌 .
I have my own implementation of CameraManager and CameraController.
I tried to use processFrameAndReturn method of DeepAR class instance. However, the following error always occurs:

2020-12-22 20:45:24.167526+0300 APPNAME [18884:12654410] Invalid image format!

extension CameraController: CameraManagerDelegate {
  func cameraManager(_ cameraManager: CameraManager, didOutputSamplePixelBuffer samplePixelBuffer: CVPixelBuffer?, withPresentationTime presentationTime: CMTime) {
      guard let samplePixelBuffer = samplePixelBuffer else { return }
      guard let deepAR = deepAR else { return }
      if !deepAR.renderingInitialized {
          print("Rendering is not initialized")
          return
      }
      // ERROR:
      self.deepAR.processFrame(samplePixelBuffer, mirror: false)
  }
}

samplePixelBuffer has the following PixelFormatType (which is a kCVPixelFormatType_420YpCbCr8BiPlanarVideoRange) :

var type: OSType = CVPixelBufferGetPixelFormatType(samplePixelBuffer)
print(type)
>>> 875704438

and resolution

var width = 720
var height = 1280

The same error is also for:

self.deepAR.processFrameAndReturn(samplePixelBuffer, outputBuffer: deepARPixelbuffer, mirror: false)

I already have a camera preview working and i want to add this DeepAR over what i already have, how do i go about it?

It says that it's in the ViewController.swift view, commented on line 90 in the Swift example.

I got this error on first run..

'-[quickstart_ios_swift.ViewController didFinishShutdown]: unrecognized selector sent to instance 0x108024000'
terminating with uncaught exception of type NSException

Also, I could not see my license key on the dashboard. Where it is? Is it a API key?

_Dear Developer,

We identified one or more issues with a recent delivery for your app, 2.3.6 (1). Your delivery was successful, but you may wish to correct the following issues in your next delivery:

ITMS-90381: Too many symbol files - These symbols have no corresponding slice in any binary [83ABD6C0-B3C4-3480-8F6C-C87CF6E741D8.symbols, 6D1414A6-058B-3D1D-9953-120ECF076A75.symbols, 6AB5714A-96D4-39DE-ADDE-D9AD8D5968D6.symbols, DBC91688-8207-33C8-B0A9-45299E5C08D5.symbols, 2AE16579-8F02-3A3B-9D81-A2CE4F9618AE.symbols, 4AF708C6-6BD1-357C-9798-DA7C245F3FED.symbols, A09703A9-F3F6-33D6-A79D-A40A83C3848C.symbols, 7140A383-5337-3B0D-8D52-2F464378C247.symbols, C1D8ADCE-F60F-399C-B4B2-3B444D779D83.symbols, F4070764-4F2E-341C-A019-4D8282578AE4.symbols, 51F300CA-FAA3-396E-B3D6-E5396104086D.symbols, 116A3BED-E675-3113-B054-9A7CE17B0DC7.symbols, 66300A0E-A306-3145-9B2B-F9EEA0CD7508.symbols, 31FF930D-B494-3D8C-9A3E-3A606CAF9050.symbols, 29F60EE2-2184-3216-BD86-8567A46DA631.symbols, 15E0D46C-73A1-3AA3-865A-C54FDF2ACD90.symbols, F567D394-4790-3C6D-B575-135A4B45AEC0.symbols, 8DF641BA-011E-31C1-93EE-56C19B74E256.symbols, 2383583F-B908-34CA-93D2-734AF6D010EB.symbols, FB938BE9-E57A-302A-A4CC-E7E57EAAF39F.symbols, 9AC9D7F4-61FC-3502-A958-B594AAACD655.symbols, D924B71D-BDDC-34EA-A86E-28E64F1417AC.symbols, C0EEC424-31A8-3243-9B98-C1DDCBEB6BB6.symbols, B2904D79-582C-32FE-97C4-7541389F1416.symbols, 70F7BDD1-6317-3615-AA7B-624C3B266DC7.symbols, A16D7FEE-9FEB-3429-A649-63DB806DBE03.symbols, 41A58309-09B7-32D5-853E-ED680346F161.symbols, 294416E2-86C6-32E1-AB17-6A5DF56EE73F.symbols, BFF55201-696F-3686-A991-0452FC8E12E4.symbols, 18886C13-C121-3841-B0FF-BC2E9DE7CC4F.symbols, 0C1D7155-A1FB-3EC7-A44F-83986EE2AA1B.symbols, 2652C152-4C09-39EA-A1C7-5AEBA0459BBB.symbols, 0BE6D64E-A6E0-3B42-822E-61CE2B5EFFE1.symbols, 0F46E9BA-5E67-340C-A49A-F60BCB7162A2.symbols, C8181BD9-F157-3F57-AF31-76222AC3625E.symbols, 6910142B-BED1-38DC-BE64-4DED4D92D60C.symbols, 72627BAA-8405-3A54-AABA-86CA3C1A1D14.symbols, 662DFB6F-09D0-38CB-A99F-A37D76474331.symbols, F56BDF8F-7037-3439-A628-905DA5181034.symbols, 627E532F-5E0F-353E-8033-4EFDD0565DE4.symbols, 0D143851-DA0B-3234-BF1D-75BFD2429995.symbols, FB2B12BD-E4E5-3A1D-9735-7F6AD394FDCC.symbols, 1E902086-9389-39D2-89AE-931607E04A47.symbols, 4ACAF4C3-BF37-31D4-9404-DDA809DB20CC.symbols, 4A2EB5CF-5A68-3D27-A9C8-88AD676C22C7.symbols, AB09743B-E429-3FA6-87DE-3846481E5ECF.symbols, 344711B5-5766-3278-9F65-DCAE52B2D92E.symbols, 6890D8AB-7086-3BF5-AFBD-B746F55AF52A.symbols, FCB16EC5-5448-3F09-A73C-4648C9EAA5B1.symbols, 41DD267A-F4D8-3AD8-BDEA-F363DAF693C1.symbols, AB0CA433-6A78-3563-A1A8-CB63BAC9A0E7.symbols, 65A7BF93-A91F-3259-9445-88CA4ADBFB98.symbols, 8704031B-ECD6-3AC1-912F-25D913E11F1D.symbols, 3F7F1A84-FF1B-3B1C-A803-3A20956089B5.symbols, EC580F32-FC5D-3F94-8E9B-F4E14046D077.symbols, 6A915D59-29F7-3006-B8D2-C8E8FABFA43F.symbols, D48BD0E1-5F77-3E93-A4DF-D825FF5CC5C2.symbols, BA4312D5-E482-3824-A646-C2B5C94EE6C7.symbols, C48AC131-AF11-391A-BD61-D62399B8BFBE.symbols, 23B527F9-0BF8-3C21-9FE9-7FB4828F716C.symbols, 888C9864-B908-359A-AC2B-9690DD7A96A2.symbols, E69C963F-FBD0-3CAF-8C5F-8CCA1383169C.symbols, C94D1AAF-BE8D-316E-8B6C-2B503727D9EE.symbols, 2CF5364A-6A3C-32DD-9101-8324D0BA8668.symbols, 51AAA3D4-FA28-3B21-8877-1A6888884358.symbols].

After you’ve corrected the issues, you can upload a new binary to App Store Connect.

Best regards,

The App Store Team_

// path - The absolute path to the effect file.

• (void)switchEffectWithSlot:(NSString*)slot path:(NSString*)path;

I load a slot MASK with an effect - now I want to unload it? how can I?

Description:

I've encountered a memory leak issue when creating and creating instances of ARView provided by the DeepAR framework in my iPadOS application. This leak persists even after explicitly removing the view from its superview and setting the reference to nil.

Steps to Reproduce:

• Initialize a new ARView instance using deepAR.createARView(withFrame:)
• Add the view to a superview.

Environment:
DeepAR SDK version: 5.5.2
iPadOS version: 16.4.1
Device: iPad pro gen 3
Xcode version: 15.1

I appreciate your assistance in addressing this issue. Please let me know if you require any further information or clarification.

Stacktrace:

I am using DeepAR sdk v2.4.1 now, and it shows blink before start video recording. I can't see it in Android, but it shows only in iOS now. Because of the blink, the result video blinks at the first second.
How to fix this?

we need for live mode camera take a picture and small video url

Error Message:
Thread running at QOS_CLASS_USER_INTERACTIVE waiting on a lower QoS thread running at QOS_CLASS_DEFAULT. Investigate ways to avoid priority inversions

• Reproducer:

1. Run Quickstart-ios-swift on Xcode 14(.3)
2. After initialisation you get this error

• Console log:

2023-05-24 14:44:14.458667+0200 quickstart-ios-swift[40795:2725925] Metal API Validation Enabled
Thread Performance Checker: Thread running at QOS_CLASS_USER_INTERACTIVE waiting on a lower QoS thread running at QOS_CLASS_DEFAULT. Investigate ways to avoid priority inversions
PID: 40795, TID: 2725925
Backtrace
=================================================================
3   DeepAR                              0x00000001052207ac _ZN2bx9Semaphore4waitEi + 64
4   DeepAR                              0x0000000105223a40 _ZN2bx6Thread4initEPFiPS0_PvES2_jPKc + 124
5   DeepAR                              0x000000010504f798 _ZN2ar10Controller10initializeENS_20DeepARInitParametersE + 448
6   DeepAR                              0x000000010505c588 _ZN2ar10DeepARImpl10initializeENS_20DeepARInitParametersE + 116
7   DeepAR                              0x000000010500232c -[DeepAR initializeWithWidth:height:window:] + 456
8   DeepAR                              0x0000000104ffda04 -[ARView initialize] + 564
9   DeepAR                              0x0000000105002638 -[DeepAR createARViewWithFrame:] + 92
10  quickstart-ios-swift                0x000000010422998c $s20quickstart_ios_swift14ViewControllerC20setupDeepARAndCamera33_1E468D19DB432620BB2613983BF78858LLyyF + 1340
11  quickstart-ios-swift                0x000000010422875c $s20quickstart_ios_swift14ViewControllerC11viewDidLoadyyF + 140
12  quickstart-ios-swift                0x0000000104228a00 $s20quickstart_ios_swift14ViewControllerC11viewDidLoadyyFTo + 36
13  UIKitCore                           0x000000018a94fdc4 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3681732
14  UIKitCore                           0x000000018a5e7e40 179501B6-0FC2-344A-B969-B4E3961EBE10 + 110144
15  UIKitCore                           0x000000018a5e7b58 179501B6-0FC2-344A-B969-B4E3961EBE10 + 109400
16  UIKitCore                           0x000000018a7d41a4 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2126244
17  UIKitCore                           0x000000018a7d4098 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2125976
18  UIKitCore                           0x000000018a7d393c 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2124092
19  UIKitCore                           0x000000018a9276dc 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3516124
20  UIKitCore                           0x000000018a927034 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3514420
21  UIKitCore                           0x000000018a925f88 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3510152
22  UIKitCore                           0x000000018a925bd4 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3509204
23  UIKitCore                           0x000000018a66b600 _UIScenePerformActionsWithLifecycleActionMask + 108
24  UIKitCore                           0x000000018a9ad918 179501B6-0FC2-344A-B969-B4E3961EBE10 + 4065560
25  UIKitCore                           0x000000018a85dfa4 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2690980
26  UIKitCore                           0x000000018a85ddcc 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2690508
27  UIKitCore                           0x000000018a85d97c 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2689404
28  UIKitCore                           0x000000018a85d848 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2689096
29  UIKitCore                           0x000000018af3ffa8 179501B6-0FC2-344A-B969-B4E3961EBE10 + 9908136
30  UIKitCore                           0x000000018afd8f98 _UISceneSettingsDiffActionPerformChangesWithTransitionContextAndCompletion + 224
31  UIKitCore                           0x000000018a709958 179501B6-0FC2-344A-B969-B4E3961EBE10 + 1296728
32  UIKitCore                           0x000000018ab7c7a8 179501B6-0FC2-344A-B969-B4E3961EBE10 + 5961640
33  UIKitCore                           0x000000018a7dc0b8 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2158776
34  UIKitCore                           0x000000018a7dbf28 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2158376
35  UIKitCore                           0x000000018a7db47c 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2155644
36  UIKitCore                           0x000000018a7db208 179501B6-0FC2-344A-B969-B4E3961EBE10 + 2155016
37  FrontBoardServices                  0x000000019e035500 65E92D01-137F-3E16-98A6-A33706699695 + 13568
38  FrontBoardServices                  0x000000019e07451c 65E92D01-137F-3E16-98A6-A33706699695 + 271644
39  FrontBoardServices                  0x000000019e039294 65E92D01-137F-3E16-98A6-A33706699695 + 29332
40  FrontBoardServices                  0x000000019e074154 65E92D01-137F-3E16-98A6-A33706699695 + 270676
41  libdispatch.dylib                   0x000000010466e05c _dispatch_client_callout + 20
42  libdispatch.dylib                   0x0000000104671ad8 _dispatch_block_invoke_direct + 368
43  FrontBoardServices                  0x000000019e0433b0 65E92D01-137F-3E16-98A6-A33706699695 + 70576
44  FrontBoardServices                  0x000000019e042f4c 65E92D01-137F-3E16-98A6-A33706699695 + 69452
45  FrontBoardServices                  0x000000019e04572c 65E92D01-137F-3E16-98A6-A33706699695 + 79660
46  CoreFoundation                      0x00000001884e5f54 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 876372
47  CoreFoundation                      0x00000001884f232c 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 926508
48  CoreFoundation                      0x0000000188476210 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 418320
49  CoreFoundation                      0x000000018848bba8 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 506792
50  CoreFoundation                      0x0000000188490ed4 CFRunLoopRunSpecific + 612
51  GraphicsServices                    0x00000001c178e368 GSEventRunModal + 164
52  UIKitCore                           0x000000018a96f3d0 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3810256
53  UIKitCore                           0x000000018a96f034 UIApplicationMain + 340
54  quickstart-ios-swift                0x0000000104231b44 main + 64
55  dyld                                0x00000001a6af8960 CB3FF411-4762-34D2-86A4-ECA13F9FB6C3 + 88416
Thread Performance Checker: Thread running at QOS_CLASS_USER_INTERACTIVE waiting on a lower QoS thread running at QOS_CLASS_DEFAULT. Investigate ways to avoid priority inversions
PID: 40795, TID: 2725925
Backtrace
=================================================================
3   DeepAR                              0x00000001052207ac _ZN2bx9Semaphore4waitEi + 64
4   DeepAR                              0x000000010537d854 _ZN4bgfx7Context11renderFrameEi + 292
5   DeepAR                              0x000000010537d61c _ZN4bgfx11renderFrameEi + 52
6   DeepAR                              0x000000010504fd10 _ZThn8_N2ar10Controller6renderEv + 24
7   QuartzCore                          0x0000000189ac6f9c 046338BF-09CF-3414-BC93-31296B97EB2D + 167836
8   QuartzCore                          0x0000000189ad88a4 046338BF-09CF-3414-BC93-31296B97EB2D + 239780
9   CoreFoundation                      0x000000018848b820 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 505888
10  CoreFoundation                      0x00000001884a8d00 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 625920
11  CoreFoundation                      0x00000001884aa908 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 633096
12  CoreFoundation                      0x000000018848c13c 5CDC5D9A-E506-3740-B64E-BB30867B4F1B + 508220
13  CoreFoundation                      0x0000000188490ed4 CFRunLoopRunSpecific + 612
14  GraphicsServices                    0x00000001c178e368 GSEventRunModal + 164
15  UIKitCore                           0x000000018a96f3d0 179501B6-0FC2-344A-B969-B4E3961EBE10 + 3810256
16  UIKitCore                           0x000000018a96f034 UIApplicationMain + 340
17  quickstart-ios-swift                0x0000000104231b44 main + 64
18  dyld                                0x00000001a6af8960 CB3FF411-4762-34D2-86A4-ECA13F9FB6C3 + 88416

Need to change String extension as follows:

extension String {
var path: String? {
return Bundle.main.path(forResource: self, ofType: nil, inDirectory: "Effects")
}
}

The didFinishShutdown()
delegate method never gets called. Reported this issue to @matej a year ago, still causing problems.

arm64
Undefined symbols for architecture x86_64:
"OBJC_CLASS$_ARView", referenced from:
objc-class-ref in ARViewController.o
(maybe you meant: OBJC_CLASS$_ARViewController)
ld: symbol(s) not found for architecture x86_64

I ripped out the production sdk
and threw in the simulator sdk

I'm not clear how to use together - sometimes I need to build to device
right now I need to build to simulator for other things...

are there some settings to check?
above it seems embed frameworks uses sim folder
link with uses the link library....

XCode V12.0 beta 4. Error happened on line 334 of ViewController.swift. Please help check.

Hi, thank you for your SDK! It's really cool, it seems a lot of work has been done. ✌️✌️✌️
Today I am interested in creation a new effect based on manly face, but can't understand how to extract and modify it's shape.

My actions are:

• Firstly, I open manly_face.fbx in blender and add some changes: change the shape of the eyes
  
• Then, I resave it as .fbx
• Then, I open it in DeepAR Studio: File -> Import FBX, but the results seems quite interesting 😀
  • Firstly, I don't have the same scale and form of geometry as the original effect has
  • Secondly, I can't select hidden shader
    
    

Can you please give me some advice to overcome this difficulties. Thank you in advance for your response!😊

The camera feed does not appear the second time the deepAR instance is accessed in the app. Please let me know how to resolve this issue. https://github.com/Zulqurnain24/DeepARSample.git

Hi,

If define faceTracked in ViewController in the default quickstart-ios-swift project

extension ViewController: DeepARDelegate {
    func faceTracked(_ faceData: MultiFaceData) {
        print("Face Tracked")
    }
}

This method is always executed, even if there is no person in the camera (see. screenshot)
It looks like it's wrong behavior according to documentation:

...
(void)faceTracked:(MultiFaceData)faceData
Called on each frame where at least one face data is detected.
...

Screenshot example (faceTracked is executed on this frame)

Hello,

I'm creating a morph filter which morphs specific facial features individually (eyes, nose, mouth, etc.). In DeepAR studio, I can select each individual "Blend Shape", and adjust the weight of the specific feature (for example, to make the eyes larger and nose smaller). I would like to extend this capability to my end users. I would like to propose a feature in your SDK (iOS please :)) that recognizes and exposes specific blend shapes in a .fbx and allows the developer to input the weight of each blend shape. This will allow my end users to customize the size/shape of their individual facial features while using my application.
Here's a screen capture of the controls I'm using in DeepAR studio that I would like to have control over in the SDK:
https://www.youtube.com/watch?v=dJgawAiTnJE

Thanks for all of the awesome work you're doing!

on flutter iOS(Swift) it gives the following messages

[ViewportSizing] maximumViewportInset cannot be larger than frame
[ViewportSizing] minimumViewportInset cannot be larger than frame

and after hot reloading, the view is not rendered anymore

calling shutdown() to close the software gives this error. DeepAR engine (API thread) (1): "-[Runner.DeepArCameraView didFinishShutdown]: unrecognized selector sent to instance 0x282b64210"