Static .txt files are not served with utf-8 encoding about agoo

[ohler55]

That's a reasonable request. I'll make the change.

[ohler55]

Please try the "mime-txt-utf8" branch.

[odinhb]

I took a peek at changes and I spotted the .rb file ending which I imagine should default to utf8 too, but this suits my needs as is. Every ruby source file I work on is in utf8 at least. 🤷

[ohler55]

I think for Ruby files the receiver decides although for display it might make sense. I was hesitant to get too carried away and cause issue by over specifying. Ruby is probably safe though. Can you try a ruby file and see how the browser handles it?

[odinhb]

Firefox seems to not handle .rb with emojies without the charset:

# hax.rb
puts "get hacked! >:D"

puts "emojiii: 🚀🚀🚀"

I can appreciate you wanting to be careful, so I took a look at what github does when you request an .rb file:

I don't know if you happen to have any .rb files with emoji in them 😅

I think the absolute safest thing to do here would be to run charset detection on the file before deciding what to put in the header, and defaulting to utf8 since it is so ubiquitous and backwards compatible with ascii.

This kind of detection is probably overkill though.

[ohler55]

The issue isn't emoji but other unicode characters for languages such as Japanese. I'll add to Ruby and other language files on the list.

[ohler55]

Pushed the changes for the other text file types.

[ohler55]

Released