User story

As a user, I want to run data transformations independently, so I can more easily manage this step. For example, using the necessary hpc resources for this step. It will also make it easier to test and deploy if this is isolated from the other parts of the data workflow.

Acceptance criteria

• When a user builds this project, a .sif container will be copied over to a folder on the VAST drive
• A user can log into the hpc login node and run the compress data job on a directory (run compression and basic data transformations) that will save the data to a folder in the staging directory.
• The model on how to define a job should be consistent and able to be imported in other repos.

Sprint Ready Checklist

• 1. Acceptance criteria defined
• 2. Team understands acceptance criteria
• 3. Team has defined solution / steps to satisfy acceptance criteria
• 4. Acceptance criteria is verifiable / testable
• 5. External / 3rd Party dependencies identified
• 6. Ticket is prioritized and sized

Notes

Add any helpful notes here.

User story

As a user, I want to pull the singularity image from a remote registry, so I can use it where I need to.

Acceptance criteria

• When a PR is merged into main, then an updated singularity image will published as a github package

Sprint Ready Checklist

• 1. Acceptance criteria defined
• 2. Team understands acceptance criteria
• 3. Team has defined solution / steps to satisfy acceptance criteria
• 4. Acceptance criteria is verifiable / testable
• 5. External / 3rd Party dependencies identified
• 6. Ticket is prioritized and sized

Notes

Add any helpful notes here.

Is your feature request related to a problem? Please describe.
We'd like to use this as the abstract class that users will import into their own repos

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.