mz2 / carpaccio

A fast Swift library for decoding images (including the usual formats + RAW files) + EXIF metadata.

Carpaccio

Pure Swift goodness for RAW and other image + metadata handling

Carpaccio is a Swift library for macOS and iOS that allows fast decoding of image data & EXIF metadata from file formats supported by CoreImage (including all the various RAW file formats supported, using the CoreImage RAW decoding capability).

• thumbnails
• metadata
• full sized image

Carpaccio uses multiple CPU cores efficiently in parallel for all of metadata, thumbnail and image data decoding.

There are no 3rd party dependencies (CoreImage filter is used for RAW decoding).

INSTALLATION

Swift Package Manager

Add Carpaccio to your Swift package as a dependency by adding the following to your Package.swift file in the dependencies array:

.package(url: "https://github.com/mz2/Carpaccio.git", from: "<version>")

If you are using Xcode 11 or newer, you can add Carpaccio by entering the URL to the repository via the File menu:

File > Swift Packages > Add Package Dependency...

USAGE

For usage examples, consult the unit tests under Tests/CarpaccioTests.

TODO

Carpaccio is still a very fresh and raw (har har) library and there are many tasks to make this a more generally useful library.

• Add tests for RAWs from a number of different camera vendors.
• GitHub action CI support.
• iOS support.
• Working xcframework support (when Xcode / SPM toolchain permits?) An xcframework build is already made available, but at least with Xcode 12.5.1 this results in build fails of the following kinds:
  • 'where' clause cannot be applied to a non-generic top-level declaration
  • 'Iterator' is not a member type of type 'Self'
  • 'Iterator' is not a member type of type 'Self'
  • Covariant 'Self' can only appear as the type of a property, subscript or method result; did you mean 'Collection'?
  • 'Index' is not a member type of class 'Carpaccio.Collection'

carpaccio's Issues

Cannot select "Carpaccio.xcodeproj" in "Embedded Binaries"

Couldn't select "Carpaccio.xcodeproj" in "Embedded Binaries" so i added "Carpaccio.frameworkiOS".
When i added code given in the document to process RAW file it throws error ---> Use of unresolved identifier 'RAWImageLoader'.
Help me to solve this problem.
Thanks!!

Xcode 13 Beta

Hello, and I'd like to echo others in saying thank you for this project. It has been really helpful.

I found when using it in Xcode 13 Beta (on macOS 12.0 beta) I needed to make this change to Sources/Carpaccio/CIImage+Extensions.swift:

thejimmyg@2d0078c

+       // This is deprecated in XCode 13 Beta and causes the code not to build. What should be used instead?
+       // https://developer.apple.com/documentation/coreimage/cirawfilteroption/3334940-ciinputenableedrmodekey
        
        // Preserve pixel values beyond 0.0 … 1.0, which wide colour images will have
-       rawFilter.setValue(true, forKey: kCIInputEnableEDRModeKey)
+       // rawFilter.setValue(true, forKey: kCIInputEnableEDRModeKey)

Without it I get this error and the project won't build:

Cannot convert value of type 'CIRAWFilterOption' to expected argument type 'String'

I'm not sure what the correct thing to do is rather than just commenting that line out but with this change the code builds and seems to work OK to my eyes but I thought I'd ask if you knew a better solution?

See https://developer.apple.com/documentation/coreimage/cirawfilteroption/3334940-ciinputenableedrmodekey

Thanks!

Separate `exifdump` into its own Package.swift

Separate exifdump into its own Package.swift to allow running tests on iOS via xcodebuild -scheme … test for the SPM package (in short this is because there's no per-target platform choice in SPM).

See https://github.com/mz2/Carpaccio/pull/18/files#diff-3d7541c3a88f4d8bdbea8d2243071fa83c337cf991bb3c3e48b8f240861b19d7R37 for more info

Make Podspec working

Hi,

I was trying to update your Podspec, unfortunately it's still not working (see my branch), but I think together we can figure out this problem.

Currently, I have the following problems:

- ERROR | file patterns: The `preserve_paths` pattern did not match any file.
- ERROR | file patterns: The `vendored_libraries` pattern did not match any file.
- ERROR | xcodebuild: Returned an unsuccessful exit code.
- ERROR | xcodebuild:  Carpaccio/Carpaccio/RAWConverter.h:27:46: error: unknown type name 'NSImage'
- NOTE  | xcodebuild:  Carpaccio/Carpaccio/RAWConverter.mm:11:9: fatal error: 'Cocoa/Cocoa.h' file not found

Support for more metadata fields?

First off, thanks for making this project! It's been really helpful for loading and grabbing thumbnails of photos, especially RAW photos!

I'm wondering if there are plans to add more metadata fields in the future? Ones that come to mind are lens info, exif data like Title, Description, etc. If this should be in user-land, maybe just exposing the metadata dict in either the ImageLoader or ImageMetadata structs?

I'm happy to take a first pass at a PR, but wanted to check if there was a reason they were left out from the project.

Make build pass on Xcode 13 beta 5

ImageMetadata loaded with loadFullSizeImage doesn't contain valuable information

ImageMetadata doesn't contain valuable information when you call
loadFullSizeImage(options: FullSizedImageLoadingOptions, handler: @escaping PresentableImageHandler, errorHandler: @escaping ImageLoadingErrorHandler)

because the handler is run with empty ImageMetadata: handler(nonNilNakedImage, ImageMetadata(nativeSize: nonNilNakedImage.size))

I think this should be changed to handler(nonNilNakedImage, metadata)

CIImage creation out of Sony ARW from iOS

Hi! Thank you for the great work!

Did you notice by any chance that Sony ARW photos are not getting processed on iOS? (The same exact snippet working on macOS M1).

I'm joining an example image.

sony_a7s_iii_20.arw.zip

And the example code.

let loader = ImageLoader(imageURL: fileItem.url, thumbnailScheme: ImageLoader.ThumbnailScheme.decodeFullImage)
let (ciImage, metadata) = try loader.loadCIImage(options: ImageLoadingOptions(allowDraftMode: true), cancelled: nil)
// On iOS, the line above throws the exception "Failed to decode image at [...]" while it completes correctly on macOS.

Thank you!

Not working with Fuji RAF files

I've tried using your library with Fuji .RAF files and it failed to load the image metadata.

Adding "raf" to the list of RAWImageFileExtensions seems to fix the problem.

Any chance you can add this?

Image size related test failure

@markuspiipari I noticed after your recent changes, Travis is complaining regarding one of the EXIF metadata / image size related tests:

[CarpaccioTests_iOS.CarpaccioTests testSonyRAWConversion] : XCTAssertEqual failed: ("1078.0") is not equal to ("1080.0") -