timble / openpolice-platform Goto Github PK

Update our Capistrano deployment scripts, v3 has been released: http://www.capistranorb.com/2013/06/01/release-announcement.html

Maybe interesting read: https://medium.com/p/ba896a142ac

There seems to be an issue with the @ operator on staging. A generated warning is still being thrown although we suppress it using the at operator.

Example : editing attachment cropping in administrator/news fails and will throw this error

message: "Exception 'Nooku\Library\ExceptionError' with message 'file_get_contents(/var/www/v2.lokalepolitie.be/capistrano/releases/20140403110356/application/admin/component/attachments/resources/language/nl-NL.ini): failed to open stream: No such file or directory' in /var/www/v2.lokalepolitie.be/capistrano/releases/20140403110356/vendor/joomla/language/language.php:358", code: 500, data: { file: "/var/www/v2.lokalepolitie.be/capistrano/releases/20140403110356/vendor/joomla/language/language.php", line: 358, function: "Nooku\Library\{closure}", class: "", args: [ ], info: "" }

file_get_contents() is being called using @ so this warning shouldn't be a problem, but it still bubbles up.

We experienced the same issue in the #658 ticket, where fsockopen in DatabaseRowUrl throws warnings when adding attachments (it fails but the warning is legit. It should be suppressed.)

Tip from Ercan: Sync KExceptionHandlerAbstract

Column count is not supported on IE9 and lower so you get a long list of categories in questions.

Requested by:

• 5314
• 5408
• 5324

Show the current status in support notification e-mails.

Make sure the staging server gets its Nginx config from a staging branch, instead of master. Avoiding any "tests" going wrong!

• Improve responsiveness
• Implement mechanism to translate the page based on the domain name (lokalepolitie.be, policelocale.be, …)

Previous reference: #722

The following error has been popping up regularly in New Relic:

E_ERROR: Aborting! The New Relic imposed maximum PHP function nesting level of '5000' has been reached. This limit is to prevent the PHP execution from catastrophically running out of C-stack frames. If you think this limit is too small, adjust the value of the setting newrelic.special.max_nesting_level in the newrelic.ini file, and restart php. Please file a ticket at https://support.newrelic.com if you need further assistance.

This error is being logged into /var/log/newrelic/php_agent.log

Judging by incoming ticket request, this is happening during one of these two actions:

• Creating a support ticket (http://p.pol-nl.be/manager/support/ticket?id=56426b4f9f8909a332502602f987fdd5)
• Editing existing article (http://p.pol-nl.be/manager/support/ticket?id=4fba4bcaa9531cfee5e51b8dba05f54a)

Try to debug this locally be setting a very small limit for the callstack in xdebug and then see where xdebug fails?

• 50x.html
• 403.html
• 404.html

Disable the HTML view for non-'super administrators'.

The number of open connections keeps growing until the limit has been reached. For now, the wait_timeout has been decreased to make sure connections are being cleaned up automatically.

Todo:

• Remove the ATTR_PERSISTENT setting in DatabaseAdapterMysql where the mysql connection is being made
• Reset the server's configuration (wait_timeout + max_connections back to default)
• Follow-up. If the situation has improved, apply the same change to Nooku Platform.

See: http://www.percona.com/blog/2006/11/12/are-php-persistent-connections-evil/
Also see: https://groups.google.com/forum/#!topic/comp.databases.mysql/SuaL7-G0iOc

Automatically import Walloon streets together with the CRAB data.

1. Get a list of the postcodes by NIS/INS http://geoservices.wallonie.be/geolocalisation/doc/ws/index.xhtml#getListeLocalitesByIns
2. Get a list of all the streets using postcode: http://geoservices.wallonie.be/geolocalisation/doc/ws/index.xhtml#getListeRuesByCp

Ticket for all custom components during initial development, including the custom themes.

• Districts, manage districts officers
• News, manage news
• Police, manage cities and local police zones
• Questions, manage frequently asked questions
• Streets, manage streets within a police zone
• Traffic, manage traffic related information (controls, constructions, measures, public events)
• Trafficinfo, manage national traffic information

One zone have reported that the page cannot be loaded when saving something, we can reproduce the issue depending on the network and OS.

Reported by:

• 5421 - ticket 2
• 5385 - ticket 4

See if we can push the activity streams into elasticsearch so we can aggregate the data in the /manager application.

The support component currently indexes every comment and ticket in Elasticsearch, but attachments are still missing. It would be great if we could open up attachments directly from the centralised /manager application as well.

Initial development of a Forms component, the form should be emailed to the zone and requester and stored as a fail save.

An ID should be generated and provided to the user as a fail save if he does not receive his email.

Store data in one JSON-fied column since searching the data is not required, and this allows to create different forms easily.

Requested by

• 5449
• 5445
• 5443
• 5407
• 5340
• 5297
• 5428
  • http://www.lokalepolitie.be/5428/aanvraag-fietsregistratie.html
  • http://www.lokalepolitie.be/5428/aanvraag-bewijs-goedzedelijk-gedrag.html
• 5358
  • http://www.politiemechelen.be/5358_support_joomla/formulieren/melding_aan_intern_toezicht/html-contact-form.php
• 5336-13

Why we are not using CAPTCHAs: https://www.gov.uk/service-manual/user-centred-design/resources/captcha.html

http://www.dobt.co/screendoor/

Add a 'planned' status for tickets that reference upcoming feature requests.

• news (see custom components #1)
• who is who, manage all employees
• company wide communications
• calendar, manage events
• daily reports, manage focus points
• scheduler, manage employee availability
• forum
• procedure and forms repository
• basic search engine

5904 is a fusion of 5430 (Beveren) & 5431 (Sint-Gillis-Waas/Stekene).

Need to disable the streets limitation temporary until we can change the police_zone_id for the cities of 5430 & 5431 in streets_cities to the new zone number.

Previous reference: #940

From Google Analytics:
View lokalepolitie.be is receiving hits from multiple pages that might serve the same content. Some examples are: /5342/fr/, /5342/fr/home.html. If your website serves the same content on these URLs, this content will have its hits split between multiple rows in reports.

Maybe we should add a redirect on the server? Redirecting home.html to the root.

Sites are also available with and without trailing slash, should look into a redirect for this as well.

Resources:

• http://www.alfresco.com/news/press-releases/alfresco-contribute-microsoft-sharepoint-open-source-integration-apache

Compare the results of http://tools.pingdom.com/fpt/#!/b27uci/http://www.policelocale.be/5318 with http://tools.pingdom.com/fpt/#!/BHGK/http://www.lokalepolitie.be/5318

You clearly see a redirect happen on the dutch domain (from lokalepolitie.be to policelocale.be) which takes up about 300ms. We should try to minimize the time it takes to do the redirect.

https://github.com/madebymany/sir-trevor-js

Send email notifications to everyone who took part in a support ticket.

To make our data available through our Open Data API, we can start by replicating our databases to an external server:

1. Setup replication to external server
2. Serve JSON data via a separate Nooku app at data.openpolice.be

Inspiration:

• http://dat-data.com/
• http://www.wired.com/2014/08/dat/?mbid=social_twitter
• http://apiumbrella.io/

Requested by:

• 5419-7
• 5455-16 (district officers, see #220)

At the moment each city ID (streets_city_id) has one linked zone (police_zone_id).

When zones are bundling forces we need the ability to temporary connect two zone numbers to one city.

Suggestion: create a streets_city_zones one-to-many table.

See also #20.

We should still look into backing up the Elasticsearch cluster. This is not high prio for now as we can easily rebuild the entire support index using the import script (application/manager/component/support/controller/import.php), only takes a couple of seconds for now.

Instructions: http://www.elasticsearch.org/blog/introducing-snapshot-restore/

Recommended : setup the Knapsack plugin to easily copy data back and forth for testing purposes. See https://github.com/jprante/elasticsearch-knapsack

Add an apc clear command to capistrano.

Add override option. To empty or not to empty, that's the question.

Run all traffic through HTTPS.

Contacted Shared Services on 20-11-2014.

Resources:

• https://18f.gsa.gov/2015/02/09/the-first-gov-domains-hardcoded-into-your-browser-as-all-https/
• http://open.blogs.nytimes.com/2014/11/13/embracing-https/
• http://googlewebmastercentral.blogspot.co.uk/2014/08/https-as-ranking-signal.html
• http://googlewebmastercentral.blogspot.com/2015/12/indexing-https-pages-by-default.html

TMG related links:

• https://technet.microsoft.com/en-us/library/cc995087.aspx
• https://technet.microsoft.com/en-us/library/cc995200.aspx

Related:

• http://datanews.knack.be/ict/ssl-beveiliging-belgische-overheidssites-niet-in-orde/article-normal-561737.html

Files with dots in the names are broken on the centOS servers. Example: http://www.lokalepolitie.be/5396/downloads/Politieraad%2FNotulen

Could be two things:

• either pathinfo() on this platform (centOS) is implemented differently and we need a workaround for it,
• the url encoding is creating this problem somewhere.

Or we can extend filename filter during upload. Don’t allow files with weird characters in the filename or rewrite the filename. Also, we should replace spaces in filenames with ‘-‘ or ‘_’ during the upload.

Update this support ticket once solved: http://www.lokalepolitie.be/manager/support/ticket?id=a3f4b4244853c95b0001046cb4f96e21

• Currently streets relations are saved across multiple tables (districts_relations & traffic_streets), implement a centralised table 'streets_releations' similar to 'attachments_relations' (this will make streets future proof too)
• Create a script to check if all streets in 'streets_relations' still exist since we are now weekly updating from AGIV and streets can be removed

Previous reference: #807

Make sure when running the "police reinstall" command on vagrant box/demo site to setup sample Elasticsearch data as well.

To deal with regions that have multiple languages, we want to make sure we can lookup the streets in all languages and still display them correctly according to the chosen language.

• Create a separate table called streets_streets_islps (street id, islp id)
• Remove language2, title2, language3 and title3 fields from streets table
• On importing, create a new row in streets for every available language

Previous reference: #914

HTML output is causing issues on older browsers.

New template and information architecture.

Develop from the ground up and heavily inspire it on the best practices of GOV.UK.

Implement responsive images.

Development of an com:wanted MVP.

Previous reference: #938

Create a new fora component for the belgian police

• Improve the pagePath filter, https://regex101.com/r/mF0aU0/1 (pagePath should start with a slash followed by the site number and can end with or without a slash)
• Add description for each graph
• Add legend

Update the README with more information.

Relations view doesn't show district name.
Relation view doesn't show streetname.

Enable Pagespeed on the demo site at https://internet.openpolice.be.

Add com:files gallery support to the theme.

Requested by 5303.

We need to add a minimum height/width setting for attached images. They need to be big enough so fit nicely in our responsive design, Twitter, Facebook, etc.

Need to figure out if we can do this before upload or we process the picture first then showing a message and remove the image again.

Max resolution
Check for the max resolution, we're having issues with 300 DPI images. See http://stackoverflow.com/questions/14358524/is-there-a-way-when-uploading-images-jpeg-to-check-the-dpi

See https://developer.chrome.com/multidevice/android/installtohomescreen

Check for duplicate information.

Break out of an iframe, if someone shoves your site into one of those silly top-bar URL shortener things.

iFrames break our responsiveness.

1. Go to the districts at /administrator/5445/districts
2. Make sure one of the items is checked out
3. Click on the checked out zone
4. You get "500 - An error has occurred, Call to undefined method Nooku\Library\Date::getObject()" error

Adding multiple coordinators to one neighbourhood.

Requested by 5369.

Thumbnails get stretched to full height.