awesome list about API, image, mtPaint tutorial

awesome API

Kikobeats/awesome-api: A curated list of awesome resources for design and implement RESTful API's.
abhishekbanthia/Public-APIs: 📚 A public list of APIs from round the web.
toddmotto/public-apis: A collective list of public JSON APIs for use in web development.
marmelab/awesome-rest: A collaborative list of great resources about RESTful API architecture, development, test, and performance

awesome images

heyalexej/awesome-images: A curated list of amazingly awesome free (stock) photo resources inspired by all the other awesomes.
AkarshSatija/awesome-images: A curated list of awesome free stock images sites
ravisuhag/stockfree: A curated list of awesome stockfree resources
myinnos/AwesomeImagePicker: Awesome Image Picker library will pick images/gifs with beautiful interface. Supports image or gif, Single and Multiple Image selection.
GitHub 釋出開放原始碼免費圖示 Octicons，開發者可自由下載或用於商業專案

automatic image annotation 圖片自動標示

mtPaint

D lang

awesome-d

how to remove https CSP headers

為什麼要處理這個議題？

寫了些自己常用的 bookmarklets，但總不能在 github 的網頁運行，是因為裡面有 CSP: Content Security Policy 政策，讓 chrome, firefox 看到這些 headers: content-security-policy, strict-transport-securitystrict-transport-security，而造成 bookmarklet 無法執行。

找了這些方案無效

Doesn't work because of Content Security Policy - Greasy Forum -- 這招在 firefox 有解決

CSP Tester -- 來測試

Content Security Policy -- github 一直解決不了的原因所在！

javascript - Does Content Security Policy block bookmarklets? - Stack Overflow -- 不是很有效，可參考

HomeMarks - Bookmarklet Fixed For Sites With Strict CSP Policies -- 號稱可解決？

homemarks: HomeMarks is a web based GUI to build HTML start pages -- 其github裡原始碼值得看

_bookmarklet.html.erb

試過調整 squid cache 來移除 response header，無效。

以上是透過既有的軟體設定無效的過程。

從 ruby 來解決

將用 torsten/proxy.rb 來改寫可移掉 Content-Security-Policy 的 header 的簡單 proxy。但只能處理 port 80, SSL 無法處理。

參考：
ruby SSL proxy (MITM) - Stack Overflow

ssl - How do I write a simple HTTPS proxy server in Ruby? - Stack Overflow

利用 rack-proxy 試試能不能如願，但不確認是否能做成給一般 browser 用的 proxy，而沒再試。

以 webrick 來建立 proxy

fedux.org – Setting up an HTTP proxy with ruby
Creating a Forward Proxy with WEBrick | Independent Software
根據這兩篇，再看 webrick/lib/webrick/httpproxy.rb 來寫了這個：

# encoding: utf-8
# https://www.fedux.org/articles/2015/04/11/setup-a-proxy-with-ruby.html
# http://www.independent-software.com/creating-a-forward-proxy-with-webrick/
#
require 'webrick'
require 'webrick/httpproxy'
require 'logger'

#logger = Logger.new($stderr)
#logger.level = Logger::DEBUG

def handle_resquest(req, res)
  #puts "[REQUEST] " + req.request_line
  #res.header.delete('Content-Security-Policy')
end

handler = proc do |req, res|
  puts res['content-type']
  puts res.body.class
  if res['content-type'] == 'text/html'
    res.body = res.body.upcase
  end
  #res.body << "\nCHANGED\n"
end

#proxy = WEBrick::HTTPProxyServer.new Port: 3128
#proxy = WEBrick::HTTPProxyServer.new Port: 3128, Logger: logger
proxy = WEBrick::HTTPProxyServer.new(
  :Port => 3128,
  #:Logger => logger,
  :ProxyContentHandler => handler)
trap 'INT' do proxy.shutdown end
trap 'TERM' do proxy.shutdown end

proxy.start

結果是 http 可以，https 不行，原來若 https ， header, body 都是空的。
試著把 $HOME/.rvm/rubies/ruby-2.5.0/lib/ruby/2.5.0/webrick/httpproxy.rb 直接接抓改 header，結果也是 http 可以，但 https 的 headers, body 都是空的。

最終解決方案 evil-proxy

bbtfr/evil-proxy: A ruby http/https proxy to do EVIL things. 是對 https 的正解

改body：

# encoding: utf-8
# change http body
require 'evil-proxy'

proxy = EvilProxy::MITMProxyServer.new Port: 3128

proxy.before_response do |req, res|
  #puts res.inspect
  body = res.body << "\nCHANGED\n"
  res.header['content-length'] = body.length
  res.body = body
end

proxy.start

改 header：

# encoding: utf-8
# remove https header
# import CA certificate (./certs/CA/cacert.pem) into browser
# https://github.com/bbtfr/evil-proxy/blob/master/lib/evil-proxy/quickcert.rb
#
require 'evil-proxy'

proxy = EvilProxy::MITMProxyServer.new Port: 3128

proxy.before_response do |req, res|
  res.header.delete('content-security-policy')
  res.header.delete('strict-transport-security')
  #puts res.header.inspect
end

proxy.start

但 browser 要先匯入 CA certificate (./certs/CA/cacert.pem)