Cant direct upload raw files about cloudinary_gem

[igy]

Hi Miguel,

Thanks for contacting us.

I hate to ask a potentially silly question, but are you certainly using v1.21.0 of the SDK in both your production and development environments?

I ask because v1.19.0 of the Ruby SDK included a bugfix to resolve an issue that's very similar to what you've described here, and earlier versions can be expected to have this error in the scenario you've described.

The code that was added and an accompanying note can be seen here:

cloudinary_gem/lib/active_storage/service/cloudinary_service.rb

Lines 75 to 85 in b6f084b

	# Provide file format for raw files, since js client does not include original file name.
	#
	# When the file is uploaded from the server, the request includes original filename. That allows Cloudinary
	# to identify file extension and append it to the public id of the file (raw files include file extension
	# in their public id, opposed to transformable assets (images/video) that use only basename). When uploading
	# through direct upload (client side js), filename is missing, and that leads to inconsistent/broken URLs.
	# To avoid that, we explicitly pass file format in options.
	options[:format] = ext_for_file(key) if options[:resource_type] == "raw"
	options[:context] = {active_storage_key: key}
	options.delete(:file)
	payload[:url] = api_uri("upload", options)

If you do have v1.21.0 (or some other version above 1.19.0), were you able to identify any common factor for the requests that fail? Is the upload filename, including the extension, certainly available to your frontend code, for it to be passed to our SDK and from there to our API?

Thanks,
Stephen

[Mrodrides]

Hello @igy thanks for your answer,

I tried to even lock the version in the gemfile gem 'cloudinary', '~> 1.21.0' but it didn't work It does not detect.
Ive unpacked the gem and debugged using byebug, i found the following results:

Here content_type is '' as io is nil and the key is just a string, this method is called here

thus when calling content_type_to_resource_type with content_type as empty string it returns an image

[Mrodrides]

Ive done a couple of modifications to sort this issue:

Ive modified the resource_type method to accept a third argument

Also moved the guard clause in the ext_for_file method

It works for me but I dont know if I break any other uses of this gem

[d-mendoza]

If you open rails console in that project, what version do you get?

[Mrodrides]

It's 5.2.2

[d-mendoza]

My apologies, I meant to say, can you do this:

rails c
require 'cloudinary'
Cloudinary::VERSION

I just want to make sure the cloudinary version is right.

[Mrodrides]

[Mrodrides]

Ive been reviewing the code of active storage to check differences between 5.2 and 7.0

5.2 activestorage/app/controllers

Same folder in 7.0

Differences are massive, it is probably the cause of the issue.

[momoip]

I'm checking internally and will keep you posted.

[momoip]

I've opened an internal ticket for this issue and will keep you posted.

[Mrodrides]

Thank you @momoip

[momoip]

@Mrodrides Of course. Will for sure let you know when the issue is fixed and deployed.

[tommyg-cld]

@Mrodrides apologies for the delay, so we tested with csv files and cannot replicate on Rails 7.0.4
We got valid upload URLs and everything works as expected. We always saw the file content type detected right.

Are you still having this issue? If so, is it with specific CSV files and can you send us this file? Does upgrading to rails 7.0.4 help as well?

[Mrodrides]

Previously we had to vendorize the gem and modify it there but now we have upgraded raise and teared down all the internal hacks, so is back to normal.
Everything works correctly with the images and pdfs, but the raw files are still problematic, and worst of all the bugs are not consitent.

When for example i upload a csv, docx or a txt file, sometimes the url has the extension and sometimes it does not.
So when for example it is displayed in the app through the 'attachment.url(secure: true)' it leads to a 404, removing or adding .csv, .txt or .docx on the file solves the issue.

I have to remark here that we only use direct uploads.

On the other side, i notice that when in the console i do

As you can see, one has the format and the other not

[tommyg-cld]

@Mrodrides thanks for getting back. How often are you seeing extensions not being included for raw files? Do you see any pattern in them? And is it happening on random raw files?

[const-cloudinary]

@Mrodrides cloudinary_url() is a generic SDK function for building URLs.
For Active Storage integration please only use .url function. The difference between them is that it uses content type to identify file extension when needed (for raw files in this case).
Can you please provide an example of a csv/docx/txt file that leads to 404? so we can investigate it further?
Thank you!

[austenmadden]

We were experiencing this same problem. We were on v1.23.0 and the fix included in v.1.24.0 found here resolved it.