inslav / polesian-archive Goto Github PK

• create full text searcher
• add full text search filter

• add keywords filter
• add terms filter
• add collectors filter
• add year filter
• add question filter
• add program filter

Add an ability to download selected cards in a variety of formats

• add form support of checkboxes (checkboxes, "download button")
• add an ability to disable pagination (via filter)
• add .txt download option

When migrating to SF 4.2 (see symfony/symfony#27075)

• update config/services.yaml:

  App\:
    resource: '../src/*'
    exclude:
      - '../src/{Entity,Migrations,Tests,Kernel.php}'
      - '../src/Import/Alpha/{Entity}'

• add links to the terms
• add links to the keywords
• add links to the informants
• add links to the collectors
• add link to the question
• add link to the village

• create import command
• add .xls(x) importer
• create export command
• add .xls(x) exporter

Two cards are considered duplicates if they have the same "dialect text" field values.

• add information from the programs (question texts)
• import all alpha-entities
• publish database on Zenodo

http://site.local/filterable-table/download/txt?rowIdentifiers=%5B%7B%22id%22%3A4457%7D%2C%7B%22id%22%3A4458%7D%2C%7B%22id%22%3A4459%7D%2C%7B%22id%22%3A4808%7D%2C%7B%22id%22%3A4809%7D%2C%7B%22id%22%3A4810%7D%2C%7B%22id%22%3A4811%7D%2C%7B%22id%22%3A4930%7D%2C%7B%22id%22%3A5182%7D%2C%7B%22id%22%3A5411%7D%2C%7B%22id%22%3A5455%7D%2C%7B%22id%22%3A5456%7D%2C%7B%22id%22%3A11233%7D%2C%7B%22id%22%3A11264%7D%2C%7B%22id%22%3A11265%7D%2C%7B%22id%22%3A11266%7D%2C%7B%22id%22%3A11412%7D%2C%7B%22id%22%3A11539%7D%2C%7B%22id%22%3A11540%7D%2C%7B%22id%22%3A11541%7D%2C%7B%22id%22%3A11545%7D%2C%7B%22id%22%3A11729%7D%2C%7B%22id%22%3A11730%7D%2C%7B%22id%22%3A11731%7D%2C%7B%22id%22%3A11761%7D%2C%7B%22id%22%3A11762%7D%2C%7B%22id%22%3A11763%7D%2C%7B%22id%22%3A11971%7D%2C%7B%22id%22%3A11976%7D%2C%7B%22id%22%3A14297%7D%2C%7B%22id%22%3A22235%7D%2C%7B%22id%22%3A22246%7D%2C%7B%22id%22%3A22280%7D%2C%7B%22id%22%3A22330%7D%2C%7B%22id%22%3A22331%7D%2C%7B%22id%22%3A22445%7D%2C%7B%22id%22%3A22468%7D%2C%7B%22id%22%3A22516%7D%2C%7B%22id%22%3A22801%7D%2C%7B%22id%22%3A33309%7D%2C%7B%22id%22%3A33534%7D%2C%7B%22id%22%3A34661%7D%2C%7B%22id%22%3A34711%7D%2C%7B%22id%22%3A34712%7D%2C%7B%22id%22%3A34752%7D%2C%7B%22id%22%3A34754%7D%2C%7B%22id%22%3A34764%7D%2C%7B%22id%22%3A34778%7D%2C%7B%22id%22%3A34781%7D%2C%7B%22id%22%3A34811%7D%2C%7B%22id%22%3A34814%7D%2C%7B%22id%22%3A34815%7D%2C%7B%22id%22%3A34840%7D%2C%7B%22id%22%3A34841%7D%2C%7B%22id%22%3A34842%7D%2C%7B%22id%22%3A34906%7D%2C%7B%22id%22%3A34908%7D%2C%7B%22id%22%3A34919%7D%2C%7B%22id%22%3A34927%7D%2C%7B%22id%22%3A48145%7D%2C%7B%22id%22%3A48146%7D%2C%7B%22id%22%3A48147%7D%2C%7B%22id%22%3A48954%7D%2C%7B%22id%22%3A48955%7D%2C%7B%22id%22%3A48956%7D%2C%7B%22id%22%3A48969%7D%2C%7B%22id%22%3A49177%7D%2C%7B%22id%22%3A57407%7D%2C%7B%22id%22%3A57438%7D%2C%7B%22id%22%3A57439%7D%2C%7B%22id%22%3A57615%7D%2C%7B%22id%22%3A57618%7D%2C%7B%22id%22%3A57704%7D%2C%7B%22id%22%3A57705%7D%2C%7B%22id%22%3A57706%7D%2C%7B%22id%22%3A57733%7D%2C%7B%22id%22%3A59164%7D%2C%7B%22id%22%3A59302%7D%2C%7B%22id%22%3A59303%7D%2C%7B%22id%22%3A59652%7D%2C%7B%22id%22%3A59655%7D%2C%7B%22id%22%3A65650%7D%2C%7B%22id%22%3A65651%7D%2C%7B%22id%22%3A65659%7D%2C%7B%22id%22%3A65662%7D%2C%7B%22id%22%3A65840%7D%2C%7B%22id%22%3A65845%7D%2C%7B%22id%22%3A65892%7D%2C%7B%22id%22%3A66841%7D%2C%7B%22id%22%3A66915%7D%2C%7B%22id%22%3A66920%7D%2C%7B%22id%22%3A67011%7D%2C%7B%22id%22%3A67131%7D%2C%7B%22id%22%3A67189%7D%2C%7B%22id%22%3A67190%7D%2C%7B%22id%22%3A67409%7D%2C%7B%22id%22%3A67410%7D%2C%7B%22id%22%3A67568%7D%2C%7B%22id%22%3A67579%7D%2C%7B%22id%22%3A67580%7D%2C%7B%22id%22%3A67581%7D%2C%7B%22id%22%3A67582%7D%2C%7B%22id%22%3A72886%7D%2C%7B%22id%22%3A72888%7D%2C%7B%22id%22%3A72889%7D%2C%7B%22id%22%3A73118%7D%2C%7B%22id%22%3A73676%7D%2C%7B%22id%22%3A73677%7D%2C%7B%22id%22%3A73682%7D%2C%7B%22id%22%3A73690%7D%2C%7B%22id%22%3A73748%7D%2C%7B%22id%22%3A73887%7D%2C%7B%22id%22%3A73890%7D%2C%7B%22id%22%3A73891%7D%2C%7B%22id%22%3A73936%7D%2C%7B%22id%22%3A73937%7D%2C%7B%22id%22%3A81350%7D%2C%7B%22id%22%3A82359%7D%2C%7B%22id%22%3A82361%7D%2C%7B%22id%22%3A82806%7D%2C%7B%22id%22%3A82851%7D%2C%7B%22id%22%3A82864%7D%2C%7B%22id%22%3A82962%7D%2C%7B%22id%22%3A82967%7D%2C%7B%22id%22%3A82969%7D%2C%7B%22id%22%3A82972%7D%2C%7B%22id%22%3A82973%7D%2C%7B%22id%22%3A83099%7D%2C%7B%22id%22%3A84382%7D%2C%7B%22id%22%3A84383%7D%2C%7B%22id%22%3A85191%7D%2C%7B%22id%22%3A85325%7D%2C%7B%22id%22%3A85326%7D%2C%7B%22id%22%3A85328%7D%2C%7B%22id%22%3A85336%7D%2C%7B%22id%22%3A85376%7D%2C%7B%22id%22%3A85711%7D%2C%7B%22id%22%3A85812%7D%2C%7B%22id%22%3A85813%7D%2C%7B%22id%22%3A85815%7D%5D

Add .doc, .docx and/or .odt download buttons

• run composer require --dev nikic/php-parser
• add the following task to grumphp.yml when phpro/grumphp#508 is resolved:

phpparser:
  visitors:
    declare_strict_types: ~
    forbidden_function_calls:
      blacklist:
      - 'var_dump'
    no_exit_statements: ~
  metadata:
    priority: -85

checkboxes under the card list

Use choices instead of sortValues or setSortValuesCallback in term, keyword, informer and collector filters.

Make Roman numerals correctly sorted in program and question filters.

• use collector name instead of id
• use keyword name instead of id
• use term name instead of id
• use village name instead of id

For example, this search fails: http://site.com/card/list?sortBy=id&sortOrder=asc&page=1&requestId=&text=%D0%BF%D0%BE%D0%B4%D0%BE%D0%BB%D1%8F%D0%BD%D0%BA%D0%B0&dataColumn=description

Make keywords filter larger and year smaller.

Something like this: https://select2.org/getting-started/basic-usage#multi-select-boxes-pillbox

Now filter reset button restore the initial state of form. The expected behavior of this button is to make all the filter values empty.

Add .xls, .xlsx and/or .ods download buttons

• take into account duplicated term names appeared after the fix
• take into account the line breaks in the term name (apparently, on both sides of the line break is the same string, but it is better to check this in the database; cut line breaks and the repetition of string)
• check line breaks in keywords, collectors, informers

Make it possible to apply new filter values only to previous search result.

Applying filter with values IX.3 (id 113) and IX.4 (id 114) gives a result including card having question set as V.1б (id 303).

Url:

/card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&text=&dataColumn=description

If add a program IX (id 9) filter to this query, the result is empty:

/card/list?sortBy=id&sortOrder=asc&page=1&program%5B%5D=9&questions%5B%5D=113&questions%5B%5D=114&text=&dataColumn=description

In CardsFilterConfigurator use CustomChoiceParameter.

2018/11/27 23:17:38 [error] 19515#19515: *38 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 36864 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 32768 bytes) in /path/to/project/vendor/symfony/debug/Exception/OutOfMemoryException.php on line 1" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost", referrer: "http://somehost/card/list"
2018/11/27 23:35:23 [error] 19516#19516: *142 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/symfony/debug/ErrorHandler.php on line 596" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost"
2018/11/28 11:36:49 [error] 1111#1111: *2868 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&keywords%5B%5D=761&dataColumn=description HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost", referrer: "http://somehost/card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&dataColumn=description"
2018/12/01 23:17:15 [error] 1110#1110: *47072 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&village%5B%5D=1&village%5B%5D=2&village%5B%5D=3&village%5B%5D=4&village%5B%5D=5&village%5B%5D=6&village%5B%5D=7&keywords%5B%5D=580&text=&dataColumn=description HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost", referrer: "http://somehost/card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&text=&dataColumn=description"
2018/12/01 23:18:30 [error] 1111#1111: *47096 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&village%5B%5D=1&village%5B%5D=2&village%5B%5D=3&village%5B%5D=4&village%5B%5D=5&village%5B%5D=6&village%5B%5D=7&keywords%5B%5D=580&text=&dataColumn=description HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost", referrer: "http://somehost/card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&text=&dataColumn=description"
2018/12/02 23:09:11 [error] 1111#1111: *54796 FastCGI sent in stderr: "PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107
PHP message: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /path/to/project/vendor/monolog/monolog/src/Monolog/Formatter/NormalizerFormatter.php on line 88" while reading response header from upstream, client: clientip, server: servername, request: "GET /card/list?sortBy=id&sortOrder=asc&page=1&questions%5B%5D=113&questions%5B%5D=114&village%5B%5D=1&village%5B%5D=2&village%5B%5D=3&village%5B%5D=4&village%5B%5D=5&village%5B%5D=6&village%5B%5D=7&keywords%5B%5D=580&text=&dataColumn=description HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php7.2-fpm.sock:", host: "somehost"