mozilla-services / kinto-amo

DEPRECATED - Plugin for AMO-style views of Kinto data

Kinto AMO View

Return an XML views of the blocklists buckets compatible with the previous AMO one.

Install

pip install kinto-amo

Setup

In the Kinto project settings

kinto.includes = kinto_amo

# kinto.amo.addons = /buckets/blocklists/collections/addons
# kinto.amo.plugins = /buckets/blocklists/collections/plugins
# kinto.amo.gfx = /buckets/blocklists/collections/gfx
# kinto.amo.certificates = /buckets/blocklists/collections/certificates

You can setup other blocklists for preview for instance using a prefix:

kinto.includes = kinto_amo

kinto.amo.preview.addons = /buckets/blocklists-preview/collections/addons
kinto.amo.preview.plugins = /buckets/blocklists-preview/collections/plugins
kinto.amo.preview.gfx = /buckets/blocklists-preview/collections/gfx
kinto.amo.preview.certificates = /buckets/blocklists-preview/collections/certificates

kinto.amo.staging.addons = /buckets/staging/collections/addons
kinto.amo.staging.plugins = /buckets/staging/collections/plugins
kinto.amo.staging.gfx = /buckets/staging/collections/gfx
kinto.amo.staging.certificates = /buckets/staging/collections/certificates

You can then access their blocklist from the prefixed URL:

• /v1/blocklist/3/{3550f703-e582-4d05-9a08-453d09bdfdc6}/47.0/
• /v1/preview/3/{3550f703-e582-4d05-9a08-453d09bdfdc6}/47.0/
• /v1/staging/3/{3550f703-e582-4d05-9a08-453d09bdfdc6}/47.0/

kinto-amo's Issues

Last update and non deterministic order of records

Merge amo2kinto into this repo?

Now that the first phases of this project are done and complete, I think we can merge the amo2kinto into this project.

The blockpage generator is the only piece that is used elsewhere, ie. in the lambda.

See mozilla-services/remote-settings-lambdas#27

CODE_OF_CONDUCT.md file missing

As of January 1 2019, Mozilla requires that all GitHub projects include this CODE_OF_CONDUCT.md file in the project root. The file has two parts:

1. Required Text - All text under the headings Community Participation Guidelines and How to Report, are required, and should not be altered.
2. Optional Text - The Project Specific Etiquette heading provides a space to speak more specifically about ways people can work effectively and inclusively together. Some examples of those can be found on the Firefox Debugger project, and Common Voice. (The optional part is commented out in the raw template file, and will not be visible until you modify and uncomment that part.)

If you have any questions about this file, or Code of Conduct policies and procedures, please reach out to [email protected].

(Message COC001)

Add ETag / If-Modified-Since headers support

Client will want to add conditional requests on the server and obtain a 304 if nothing changed.

See https://bugzilla.mozilla.org/show_bug.cgi?id=1377542

Travis CI free usage ends Dec 3; mozilla repos should switch to other CI platforms

We're opening this issue because your project has used Travis CI within the last 6 months. If you have already migrated off it, you can close and ignore this issue.

Travis CI is ending free builds on public repositories. travis-ci.com stopped providingthem in early November, and travis-ci.org will stop after December 31, 2020. To avoid disruptions to your workflows, you must migrate to another CI service.

For production use cases, we recommend switching to CircleCI. This service is already widely used within Mozilla. There is a guide to migrating from Travis CI to CircleCI available here.

For non production use cases, we recommend either CircleCI or Github Actions. There is a guide to migrating from Travis CI to Github Actions available here. Github Actions usage within Mozilla is new, and you will have to work with our github administrators to enable specific actions following this process.

If you have any questions, reach out in #github-admin:mozilla.org on matrix.

Add a way to generate the blocklist file from a preview collection.

In the review process, we want to be able to review the generated blocklists XML file.

Add the kinto-amo capability

See https://github.com/Kinto/kinto-changes/pull/10/files

Run functional test with travis.

As asked in #3

We could do a functional test that:

• Runs kinto with plugin enabled
• Download blocklists.xml from prod
• Loads with prod data with json2kinto
• For each combination of (api_ver, version, app_version) test that verifier has no difference

Return 400 is app_ver, app_id, version are invalid

Spawned from #3

Dependabot couldn't authenticate with https://pypi.python.org/simple/

Dependabot couldn't authenticate with https://pypi.python.org/simple/.

You can provide authentication details in your Dependabot dashboard by clicking into the account menu (in the top right) and selecting 'Config variables'.

View the update logs.

Crash with KeyError `blockId`

write_addons_items(xml_tree, addons_records, api_ver=api_ver, app_id=app)\n  File \"\/data\/kinto-dist\/lib\/python2.7\/site-packages\/amo2kinto\/exporter.py\", line 95, in write_addons_items\n    blockID=item['blockID'])\nKeyError: 'blockID'","uid":null,"errno":null,"querystring":"{}","agent":"Amazon CloudFront","method":"GET","path":"\/v1\/preview\/3\/%7Bec8030f7-c20a-464f-9b0e-13a3a9e97384%7D\/47.0\/"