dalenewman / orchardcore.transformalize

a transformalize module for orchard core

Transformalize in Orchard Core

This is an Orchard Core module that uses Transformalize arrangements to create:

• Reports: Browse and Search for data.
• Tasks: Validate & transform parameters for use in data modification statements.
• Forms: Validate & transform form data for data collection.
• Bulk Actions: Tasks run on records selected from reports.

Reports

Reports read, filter, search, export, and page over data. You may transform records using Razor , Liquid, and built-in transforms. If the records have coordinates, you may display them on a map.

TODO: Explain example arrangement and show GIF.

Tasks

Tasks accept, transform, and validate parameters before running traditional transformalize or simple data modification processes.

TODO: Explain example arrangement and show GIF.

Forms

Building off the ability to validate parameters, forms collect valid user supplied input and store it in a relational provider (a specified table).

TODO: Explain example arrangement and show GIF.

Bulk Actions

Bulk Actions combine reports and tasks. You may select records on a report, and send them to a task for processing.

Five configurable tasks must be defined in order to run bulk actions:

1. batch-create: create and return a batch identifier
2. batch-write: write batch values.
3. batch-summary: gather review and result summary for a batch.
4. batch-run: indicate the task is running (not yet implemented)
5. batch-success: indicate the task succeeded
6. batch-fail: indicate the task failed

A recipe named "Transformalize Batches SQLite" provides an example set of the above tasks.

---

Putting it all together, here is a GIF showing a report (with map) that has a bulk action to change color associated with the record.

TODO: Link to arrangement here.

---

Development

• Visual Studio 2019 with ASP.NET Core related workloads:
  • ASP.NET and Web Development
  • .NET Core Cross-Platform Development
• Relies on nuget source https://www.myget.org/F/transformalize/api/v3/index.json
• Caution: This project is still under development.

orchardcore.transformalize's Issues

addQueryParam

Add a transform that takes a URL as input and adds a query string parameter to it (considering whether it's the first or a subsequent parameter).

timezone

timezone transform doesn’t run on Linux

Use as an importer for content items ?

Hello,
I have a scenario where I have an excel file with data and want to import into orchard as content items.
For instance in excel I have 2 columns (Title , Content) and records under these columns.
In Orchard core I have a contentype named Policy with a titlePart and a html body part.

Can I create a scenario with transformalize to get the data from the excel file (source) and import into orchard (Target) as Policy Content Items ?

Orchard can already import content in json format (using the recipes feature) so I guess it would be enough for transformalize to convert into the correct json format and then use orchards recipe import feature to do the rest.

Is this possible with transformalize ?
Thanks.

Is it ready for trial?

This looks like a cool project.
Is it possible to replicate the example shown here :
https://www.youtube.com/watch?v=CCTvjsrUtHk&feature=youtu.be
Are there any steps we could follow?
Thanks
Giannis

Form warning

Users need to be warned if they are leaving a form without submitting it.

Allow Forms to use Common Connections

The forms are not using common connections (when referenced). They are only using explicit connections this leads to having to keep full connections (with credentials) in each form.

Can forms be made to use common connections? In addition, can they re-use the common connections for different forms by allowing us to specify only the name, and table-name in the connection in the form?

Thanks

multilple and size

multilple and size and size are not implemented in OCT

Input Validation for Uploading Files

https://cheatsheetseries.owasp.org/cheatsheets/File_Upload_Cheat_Sheet.html
https://cheatsheetseries.owasp.org/cheatsheets/Input_Validation_Cheat_Sheet.html

• When storing files, use something random in the file names, per advice here:
• Ensure the file name provided doesn't attempt path navigation (e.g. ../..)
• White-list acceptable extensions.

Add mail output to transformalize providers.

Convert the legacy Transformalize.Provider.Mail to .NET Standard and add to this module. Match Orchard's MailKit dependency.

length validator

Looks like the length validator always returns false.

Cached transforms (i.e. razer, fluid, jint) are not being invalidated when the content item is updated.

(see title)

Hide submit button

Hide submit button on a form if there are no fields with prompt="true"

when you enable transformalize, you can no longer delete content items.

Task and Form Parameters Auto Complete Setting

It would be nice to have an auto-complete="true|false" in parameter - and then have the orchard module respect it, by adding property HTML attribute to form.

GetDisplayUrl and GetEncodedUrl Shorthand Bug

It appears the shorthand for getDisplayUrl and getEncodedUrl transforms are flip-flopped. These should be fixed.

Mapbox pop up description does not work on mobile browsers

Clicking on the dot does not display description and logs this error to console :
Unable to preventDefault inside passive event listener invocation.

Transformalize Task Scheduling

It would be handy to have the ability to schedule Transformalize Task.

Provide a Way for Forms to Collect Coordinates

The older version of this used to have a way to indicate you wanted to collect coordinates (latitude, longitude, and perhaps altitude) via HTML 5 (the browser). See if you can enable that here.

Might use an special input-type values to indicate what you want to collect latitude, longitude, or altitude from the browser.

Requested by @vlad2kgithub.

Resources:

• What browser can get: https://developer.mozilla.org/en-US/docs/Web/API/GeolocationCoordinates
• To see if location is allowed: https://stackoverflow.com/questions/14862019/check-if-location-setting-has-been-turned-off-in-users-browser

Notes:

• Browsers only do this over https

Is it posssible to validate a record before posting the update ?

I have a scenario to update lead records in an sql database from one marketing campaign to another.
But i have to check for specific business rules to each lead if it is eligible to move.
Business rules are if form of predicates (true/false) might be like :

• A lead with existing child records in table x cannot be updated.
• A lead in status y cannot be updated .

Is it possible to express these rules and have the system notify me in the log the records that violate rules and cannot be updated ?

Report using Elasticsearch Exports 10 Records

When I tried to export the results from the report created in the Readme (with Elasticsearch provider), it only downloaded/exported 10 records. The relational providers do not seem to have this problem.

Upgrade to Orchard Core 1.0

Browser Tab Description

Browser Tab description is not displaying page Title.

Support Built in Connections

It would be useful for arrangements to reference a built in connection (without knowing the provider or credentials).

e.g.

<connections>
   <!-- the connection below references the Orchard Core's site database which was determined at setup -->
   <add name="orchard" />
</connections>

In the same way that common connections are referenced by name, the orchard core's site connection could be used for reports, forms, or tasks. Side benefits are better security and less configuration.

Links

• https://docs.orchardcore.net/en/dev/docs/reference/core/Data

Notes

• You'll have to be able to get the connection and know the provider (sqlite, mysql, postgresql, or mssql) and pass it in where it's needed. Perhaps this can be done in in the way we are able to wrap connections with mini-profiler.

Tagged: @vlad2kgithub

Bulk Action failed to run an ADO command against an "output" connection.

Switching the "output" connection to "target" allowed it to run. Couldn't access logs to see if anything was logged, it just didn't do anything. The "story" is you should be able to use a connection named anything you want. Tagging @vlad2kgithub

Package not found.

Hi ，I have change the nuget url to : https://www.myget.org/F/transformalize/api/v3/index.json
but the package still not found.

Did I lost something?