jhatler / janus

Just Another Neural Utility System

Just Another Neural Utility System

Join the Community

• Code of Conduct
• Copyright Guidelines
• Contributor Guidelines
• Changelog

Resources

• Repository License
• Security Policy

Credits

Thank you to our Contributors and Authors.

But most importantly, thank you to all the Adopters!

janus's Issues

dependabot pip updates use wrong directory

Dependabot was configured to use the project root instead of lib/pyjanus for pip updates in #9.

release-please is using JSON instead of Generic updater in extra-files

Per: https://github.com/googleapis/release-please/blob/main/docs/customizing.md#updating-arbitrary-files

Default updaters are applied depending on the file extension. If you want to force the Generic updater, you must use type "generic".

{
  "extra-files": [
    {
      "type": "generic",
      "path": "path/to/file.yml"
    }
  ]
}

This needs applied to the repo to fix the most recent workflow failures.

Container builds are not caching properly

I believe this is due the use of a timestamp in the janus container to mock more proper testing.

container digest is not being passed to attest step

This broke the v0.1.1 releases.

Devcontainer test should not run post-install steps

Besides being unnecessary to test, they break the tests due to race conditions in the GitHub Actions runner environment.

Downgrade Janus.js to Typescript 5.1.x

This is needed to support integrating release-please into the monorepo.

Upgrade release-trigger for node 22

This was confirmed to be possible in #124

Chores should show in release notes

This shouldn't be too onerous based on this project's dev workflow and release cycle.

initial release should be for 0.1.0

The current configuration is for 0.0.1.

Add github.io project site

This is needed for OpenSSF best practices.

It should be setup with Jekyll.

Attestations fail due to using wrong digest

The (dev)container image ID is being used instead of the digest.

Remove nx and lerna

They are not providing enough value over only using NPM workspaces to justify in terms of upkeep/complexity. This is especially after adding release-trigger, a legacy codebase.

super-linter should only validate changed files

This will be needed once release-trigger is merged in (or otherwise the codebase grows substantially from here).

Add devcontainer for release-trigger

This continues the work started for #122.

The new devcontainer will need to be based on node 18.

GitHub Security check API rate limits have been hit

Bulk creation of PRs from Renovate is the culprit.

The check need disabled and the re-enabled for these to all merge in.

Add OSSF Scorecard action

https://github.com/marketplace/actions/ossf-scorecard-action

Common node dev dependencies should be moved to top-level package.json

This will make them easier to maintain and keep consistent with the development environment.

pyjanus is named incorrectly in release-please config

It's named janusjs instead of pyjanus.

update release-please action to new repo

The action has moved and has a newer version available.

A security policy should be added

This will enable the GitHub security integration and make it easier to use this project as the foundation for a template repo in the future.

A CODEOWNERS file should be added

This is to make it easier to use this repo as a foundation for a template repo in the future.

release-trigger name in release-please config is invalid

This is breaking the release process.

Janus.js needs automated testing

It should output code coverage, among other things yet to be defined.

release-trigger CHANGELOG needs marked as @generated

This is breaking the builds.

Add renovate support

This will complement dependabot and is supported by some of the Google Probots.

Google's release-trigger tool can be forked to support this project

Reference: https://github.com/googleapis/repo-automation-bots/tree/main/packages/release-trigger

With minimal effort, it should be possible to update this tool to support both Jenkins and GitHub Actions in addition to the current Kokoro tool.

Consider using GHA cache backend for containers

More info: https://docs.docker.com/build/cache/backends/gha/

Container images should be signed.

An example on how to do this is here: https://github.com/actions/starter-workflows/blob/main/ci/docker-publish.yml

The README should include relevant badges.

Current list:

• Codacy
• Conventional Commits
• Semantic Versioning
• OSSF Scorecard
• SLSA
• https://www.bestpractices.dev/

release-please uses unknown release type

A docker release type was erroneously added to the release-please config in #9.

devcontainer/codespace user misconfigured

Latest Codespace prebuild log contained:

docker: Error response from daemon: unable to find user vscode: no matching entries in passwd file.

Project needs devcontainer support

A devcontainer created for this repo supporting:

• Docker
• Devcontainers
• Shell Scripting
• Python
• TypeScript
• bash-completion (needed for the git completions)
• release-please
• super-linter

This will make it easier to maintain and more accessible for those looking to fork it for their own uses.

The underlying docker image should be built separate from the devcontainer and stored in GHCR. The devcontainer itself should also be stored there for caching.

Acceptance Criteria:

• Dockerfile moved to separate path from .devcontainer
• Dockerfile built as part of PRs when it has changed
• Dockerfile built and image pushed to GHCR upon release
• Devcontainer setup to use explicit version of released Dockerfile
• Devcontainer cached to GHCR for CI purposes
• Devcontainer can be used to develop itself (docker-in-docker)
• Devcontainer includes upstream Python & TypeScript Support
• bash-completion packaged added to Dockerfile
• Only trigger workflows when meaningful files are changed
• Testing of the container should occur in a different stage than final image
• Container builds cache to GHCR
• Core of workflows should be implemented in composite GitHub Actions
• Devcontainer includes needed JSON schemas
• Includes super-linter support as PR and within devcontainer

docker inspect fails during attestations

This occurs in the container action, but probably the devcontainer action too.

pyJanus needs documentation

It should be created with Sphinx and published to either GitHub.io or ReadTheDocs.

Project needs high-level documentation

This should be in a docs folder within the project root and also published to github.io or ReadTheDocs.

The project MUST provide reference documentation that describes the external interface (both input and output) of the software produced by the project.

The project SHOULD provide documentation in English and be able to accept bug reports and comments about code in English.

A CONTRIBUTING guide should be added

This will make it easier to use this project as the foundation for a template repo in the future.

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Repository problems

These problems occurred while renovating this repository. View logs.

• WARN: Package lookup failures

Rate-Limited

These updates are currently rate-limited. Click on a checkbox below to force their creation now.

• chore(deps): update dependency flake8 to v7.1.1
• chore(deps): update dependency jaraco-functools to v4.0.2
• chore(deps): update dependency keyrings-alt to v5.0.2
• chore(deps): update dependency nock to v13.5.5
• chore(deps): update dependency protobuf to v5.27.3
• chore(deps): update dependency pylint to v3.2.6
• chore(deps): update dependency smee-client to v2.0.3
• chore(deps): update dependency @types/node to v20.16.1
• chore(deps): update dependency awslambdaric to v2.2.1
• chore(deps): update dependency black to v24.8.0
• chore(deps): update dependency cffi to v1.17.0
• chore(deps): update dependency gcp-releasetool to v2.1.0
• chore(deps): update dependency google-api-python-client to v2.142.0
• chore(deps): update dependency google-auth to v2.34.0
• chore(deps): update dependency idna to v3.8
• chore(deps): update dependency importlib-metadata to v8.4.0
• chore(deps): update dependency keyring to v25.3.0
• chore(deps): update dependency mocha to v10.7.3
• chore(deps): update dependency more-itertools to v10.4.0
• chore(deps): update dependency pip to v24.2
• chore(deps): update dependency pyjwt to v2.9.0
• chore(deps): update dependency pytest to v8.3.2
• chore(deps): update dependency zipp to v3.20.0
• chore(deps): update ossf/scorecard-action action to v2.4.0
• chore(deps): update sigstore/cosign-installer action to v3.6.0
• chore(deps): update terraform spacelift to v1.15.0
• chore(deps): update dependency attrs to v24
• chore(deps): update dependency cryptography to v43
• chore(deps): update dependency jaraco-context to v6
• chore(deps): update super-linter/super-linter action to v7
• chore(deps): update typescript-eslint monorepo to v8 (major) (@typescript-eslint/eslint-plugin, @typescript-eslint/parser)
• 🔐 Create all rate-limited PRs at once 🔐

---

Warning

Renovate failed to look up the following dependencies: Failed to look up docker package ghcr.io/jhatler/janus-devcontainer, Failed to look up terraform-module package spacelift.io/jhatler/github-oidc/aws, Failed to look up terraform-module package spacelift.io/jhatler/runner-template/aws.

Files affected: .devcontainer/devcontainer.json, terraform/stacks/auth/main.tf, terraform/stacks/runners/main.tf

---

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• chore(deps): update actions/upload-artifact digest to 834a144
• chore(deps): update dependency pyright to v1.1.377
• chore(deps): update dependency boto3 to v1.35.5
• chore(deps): update dependency cachetools to v5.5.0
• chore(deps): update dependency openai to v1.42.0
• chore(deps): update github/codeql-action action to v3.26.5
• chore(deps): update super-linter/super-linter action to v6.9.0
• chore(deps): update terraform aws to v5.64.0
• chore(deps): update dependency lru-cache to v11
• chore(deps): update docker/build-push-action action to v6
• Click on this checkbox to rebase all open PRs at once

Ignored or Blocked

These are blocked by an existing closed PR and will not be recreated unless you click a checkbox below.

• chore(deps): update dependency eslint to ~8.57.0
• chore(deps): update dependency prettier to ~3.3.0
• chore(deps): update dependency typescript to ~5.5.0
• chore(deps): update typescript-eslint monorepo to ~6.21.0 (@typescript-eslint/eslint-plugin, @typescript-eslint/parser)
• chore(deps): update dependency c8 to v10
• chore(deps): update dependency eslint to v9
• fix(deps): update dependency @octokit/core to v6

Detected dependencies

cloudbuild

packages/release-trigger/cloudbuild.yaml

devcontainer

.devcontainer/devcontainer.json

• ghcr.io/jhatler/janus-devcontainer v0

dockerfile

containers/github-webhook/Dockerfile

containers/janus/Dockerfile

• mcr.microsoft.com/devcontainers/typescript-node 22-bookworm

containers/ubuntu/artful/Dockerfile

containers/ubuntu/bionic-minimal/Dockerfile

containers/ubuntu/bionic/Dockerfile

containers/ubuntu/cosmic-minimal/Dockerfile

containers/ubuntu/cosmic/Dockerfile

containers/ubuntu/disco-minimal/Dockerfile

containers/ubuntu/disco/Dockerfile

containers/ubuntu/eoan-minimal/Dockerfile

containers/ubuntu/eoan/Dockerfile

containers/ubuntu/focal-minimal/Dockerfile

containers/ubuntu/focal/Dockerfile

containers/ubuntu/groovy-minimal/Dockerfile

containers/ubuntu/groovy/Dockerfile

containers/ubuntu/hardy/Dockerfile

containers/ubuntu/hirsute-minimal/Dockerfile

containers/ubuntu/hirsute/Dockerfile

containers/ubuntu/impish-minimal/Dockerfile

containers/ubuntu/impish/Dockerfile

containers/ubuntu/jammy-minimal/Dockerfile

containers/ubuntu/jammy/Dockerfile

containers/ubuntu/kinetic-minimal/Dockerfile

containers/ubuntu/kinetic/Dockerfile

containers/ubuntu/lucid/Dockerfile

containers/ubuntu/lunar-minimal/Dockerfile

containers/ubuntu/lunar/Dockerfile

containers/ubuntu/mantic-minimal/Dockerfile

containers/ubuntu/mantic/Dockerfile

containers/ubuntu/maverick/Dockerfile

containers/ubuntu/natty/Dockerfile

containers/ubuntu/noble-minimal/Dockerfile

containers/ubuntu/noble/Dockerfile

containers/ubuntu/oneiric/Dockerfile

containers/ubuntu/precise/Dockerfile

containers/ubuntu/quantal/Dockerfile

containers/ubuntu/raring/Dockerfile

containers/ubuntu/saucy/Dockerfile

containers/ubuntu/trusty/Dockerfile

containers/ubuntu/utopic/Dockerfile

containers/ubuntu/vivid/Dockerfile

containers/ubuntu/wily/Dockerfile

containers/ubuntu/xenial-minimal/Dockerfile

containers/ubuntu/xenial/Dockerfile

containers/ubuntu/yakkety/Dockerfile

containers/ubuntu/zesty/Dockerfile

packages/release-trigger/Dockerfile

• node 22-bookworm
• node 22-bookworm

packages/release-trigger/Dockerfile.frontend

• node 22-bookworm
• node 22-bookworm

github-actions

.github/actions/container/action.yml

• docker/setup-qemu-action v3
• sigstore/cosign-installer v3.5.0
• docker/setup-buildx-action v3
• docker/login-action v3
• docker/build-push-action v5
• actions/attest-build-provenance v1

.github/actions/devcontainer/action.yml

• docker/setup-qemu-action v3
• sigstore/cosign-installer v3.5.0
• docker/setup-buildx-action v3
• docker/login-action v3
• actions/setup-node v4
• actions/cache v4
• actions/attest-build-provenance v1

.github/workflows/aikido.yml

• actions/checkout v4
• AikidoSec/github-actions-workflow v1.0.13

.github/workflows/codeql.yml

• actions/checkout v4
• github/codeql-action v3
• github/codeql-action v3

.github/workflows/containers.yml

• actions/checkout v4
• codacy/git-version 2.8.0
• actions/checkout v4
• codacy/git-version 2.8.0

.github/workflows/lint.yml

• actions/checkout v4
• actions/setup-node v4
• actions/setup-python v5
• actions/cache v4
• super-linter/super-linter v6.6.0

.github/workflows/packer.yml

• actions/checkout v4

.github/workflows/release-please.yml

• googleapis/release-please-action v4
• actions/checkout v4

.github/workflows/release-trigger-ci.yml

• actions/checkout v4
• actions/setup-node v4
• actions/cache v4

.github/workflows/scorecard.yml

• actions/checkout v4.1.7@692973e3d937129bcbf40652eb9f2f61becf3332
• ossf/scorecard-action v2.3.3@dc50aa9510b46c811795eb24b2f1ba02a914e534
• actions/upload-artifact v4@65462800fd760344b1a7b4382951275a0abb4808
• github/codeql-action v3.25.11@b611370bb5703a7efb587f9d136a52ea24c5c38c

.github/workflows/tfsec.yml

• actions/checkout v4
• aquasecurity/tfsec-sarif-action v0.1.4
• github/codeql-action v3

.github/workflows/ubuntu.yml

• actions/checkout v4
• actions/cache v4
• actions/checkout v4
• aws-actions/configure-aws-credentials v4
• aws-actions/amazon-ecr-login v2
• docker/login-action v3
• actions/attest-build-provenance v1
• actions/upload-artifact v4
• actions/upload-artifact v4
• actions/download-artifact v4
• aws-actions/configure-aws-credentials v4
• aws-actions/amazon-ecr-login v2
• docker/login-action v3
• actions/download-artifact v4
• actions/attest-build-provenance v1
• actions/attest-build-provenance v1

npm

package.json

• @tsconfig/node22 ^22.0.0
• @typescript-eslint/eslint-plugin ~6.15.0
• @typescript-eslint/parser ~6.15.0
• eslint ~8.56.0
• eslint-plugin-jsonc ~2.16.0
• prettier ~3.1.0
• typescript ~5.2.0
• node >=18.0.0

packages/janus.js/package.json

• @types/mocha ^10.0.0
• @types/node ^20.14.8
• mocha ^10.5.2
• typescript ~5.2.0
• ts-node ^10.9.2

packages/release-trigger/package.json

• @google-automations/bot-config-utils ^7.0.0
• @google-automations/datastore-lock ^5.0.0
• @google-automations/issue-utils ^3.0.0
• @octokit/core ^4.2.4
• gcf-utils ^15.0.1
• jsonwebtoken ^9.0.1
• @types/mocha ^10.0.0
• @types/node ^20.14.8
• @types/sinon ^17.0.0
• c8 ^9.0.0
• cross-env ^7.0.3
• gts ^5.3.1
• lru-cache ^7.14.0
• mocha ^10.5.2
• nock ^13.2.9
• sinon ^18.0.0
• smee-client ^2.0.0
• typescript ~5.2.0
• node >= 18

pip_requirements

containers/github-webhook/requirements.txt

• PyGitHub ==2.3.0
• boto3 ==1.34.139
• awslambdaric ==2.0.12

dev-requirements.txt

• black ==24.4.2
• cookiecutter ==2.6.0
• flake8 ==7.1.0
• isort ==5.13.2
• pylint ==3.2.5
• pyright ==1.1.371
• pytest ==8.2.2

lib/pyjanus/requirements.txt

• appdirs ==1.4.4
• ffmpeg-python ==0.2.0
• openai ==1.35.13
• codaio ==0.6.12
• boto3 ==1.34.143
• google-api-python-client ==2.137.0
• google-auth-httplib2 ==0.2.0
• srt ==3.5.3

packages/release-trigger/requirements.txt

• attrs ==23.2.0
• backports-tarfile ==1.2.0
• cachetools ==5.3.3
• certifi ==2024.7.4
• cffi ==1.16.0
• charset-normalizer ==3.3.2
• click ==8.1.7
• cryptography ==42.0.8
• gcp-releasetool ==2.0.1
• google-auth ==2.32.0
• idna ==3.7
• importlib-metadata ==8.0.0
• jaraco-classes ==3.4.0
• jaraco-context ==5.3.0
• jaraco-functools ==4.0.1
• jeepney ==0.8.0
• jinja2 ==3.1.4
• keyring ==25.2.1
• keyrings-alt ==5.0.1
• markupsafe ==2.1.5
• more-itertools ==10.3.0
• packaging ==24.1
• protobuf ==5.27.2
• pyasn1 ==0.6.0
• pyasn1-modules ==0.4.0
• pycparser ==2.22
• pyjwt ==2.8.0
• pyperclip ==1.9.0
• python-dateutil ==2.9.0.post0
• requests ==2.32.3
• rsa ==4.9
• secretstorage ==3.3.3
• six ==1.16.0
• urllib3 ==2.2.2
• zipp ==3.19.2

requirements.txt

• pip ==24.1.2

terraform

terraform/control/providers.tf

terraform/control/versions.tf

• aws 5.57.0
• spacelift 1.14.0

terraform/modules/github_oidc/versions.tf

• aws 5.57.0

terraform/modules/runner_template/versions.tf

• aws 5.57.0

terraform/stacks/admin/providers.tf

terraform/stacks/admin/versions.tf

• aws 5.57.0

terraform/stacks/auth/main.tf

• spacelift.io/jhatler/github-oidc/aws 0.2.2

terraform/stacks/auth/providers.tf

terraform/stacks/auth/versions.tf

• aws 5.57.0

terraform/stacks/crypto/providers.tf

terraform/stacks/crypto/versions.tf

• aws 5.57.0

terraform/stacks/janus/providers.tf

terraform/stacks/janus/versions.tf

• aws 5.57.0

terraform/stacks/network/providers.tf

terraform/stacks/network/versions.tf

• aws 5.57.0

terraform/stacks/runners/main.tf

• spacelift.io/jhatler/runner-template/aws 0.2.2
• spacelift.io/jhatler/runner-template/aws 0.2.2

terraform/stacks/runners/providers.tf

terraform/stacks/runners/versions.tf

• aws 5.57.0
• tls 4.0.5

terraform/stacks/scratch/providers.tf

terraform/stacks/scratch/versions.tf

• aws 5.57.0

terraform/stacks/ssm/providers.tf

terraform/stacks/ssm/versions.tf

• aws 5.57.0

terraform/stacks/ubuntu_cloudimg/providers.tf

terraform/stacks/ubuntu_cloudimg/versions.tf

• aws 5.57.0

terraform/stacks/webhooks/providers.tf

terraform/stacks/webhooks/versions.tf

• aws 5.57.0

---

• Check this box to trigger a request for Renovate to run again on this repository

A COPYRIGHT and license policy should be added

This will make it easier to use this project as the foundation for template repo in the future.

A CODE_OF_CONDUCT needs added

The Contributor Covenant should be joined by adding it to the project in a CODE_OF_CONDUCT file.

Aikido should be integrated with the PR process

This will help to gate/secure the resources managed by Spacelift.

Remove unneeded vscode extension: valentjn.vscode-ltex

It was erroneously added.

Codespace should be downgraded to node 20

This will make upgrading release-trigger easier.

Project needs licenses

The MIT license should be used for code and the Create Commons Attribution 4.0 Internal license should be used for creative works.

AUTHORS and CONTRIBUTORS files should be added

This is to make it easier to use this project as a foundation for a template repo in the future.

Update super-linter to 6.6.0 and enable GitHub Actions linting

Actions linting was disabled in #9 due to the introduction of the attestations permission. This isn't supported on actionlint prior to 1.7. Super-Linter has merged in the actionlint 1.7 upgrade, but it is unreleased at the time of this writing. The 6.6.0 release will include it.

Once 6.6.0 is release, super-linter can be updated and the actions linting re-enabled.

Changelogs headers are footers

release-please had trouble with the changelogs that were predefined. The original contents are at the bottom instead of the top.

Add setup and usage documentation

This should be in the form of SETUP.md and USAGE.md files in the root of the repo.

Janus.js needs documentation

It should be created programmatically and published to either GitHub.io or ReadTheDocs.

Spacelift Support

Spacelift should be integrated with this repo, along with Infracost.

Documentation to the desired features:

• https://docs.spacelift.io/vendors/terraform/terraform-provider#proposed-workflow
• https://docs.spacelift.io/vendors/terraform/infracost
• https://docs.spacelift.io/vendors/terraform/state-management
• https://docs.spacelift.io/vendors/terraform/module-registry
• https://docs.spacelift.io/concepts/stack/
• https://registry.terraform.io/providers/spacelift-io/spacelift/latest/docs

release-trigger workflow should only run on relevant PRs

This will reduce the number of actions runs and PR merge latency.