xsyourpal / examples

Fast and flexible reference benchmarks

MosaicML Examples

This repo contains reference examples for using the MosaicML platform to train and deploy machine learning models at scale. It's designed to be easily forked/copied and modified.

It is structured with four different types of examples:

• benchmarks: Instructions for how to reproduce the cost estimates that we publish in our blogs. Start here if you are looking to verify or learn more about our cost estimates.
• end-to-end-examples: Complete examples of using the MosaicML platform, starting from data processing and ending with model deployment. Start here if you are looking full MosaicML platform usage examples.
• inference-deployments: Example model handlers and deployment yamls for deploying a model with MosaicML inference. Start here if you are looking to deploy a model.
• third-party: Example usages of the MosaicML platform with third-party distributed training libraries. Start here if you are looking to try out the MosaicML platform with non-MosaicML training software.

Please see the README in each folder for more information about each type of example.

Tests and Linting

To run the lint and test suites for a specific folder, you can use the lint_subdirectory.sh and test_subdirectory.sh scripts:

bash ./scripts/lint_subdirectory.sh benchmarks/bert
bash ./scripts/test_subdirectory.sh benchmarks/bert

Other MosaicML repositories and documentation

• MosaicML platform sign up
• LLM-foundry
• Diffusion
• Composer
• Streaming
• MosaicML docs
• MosaicML blog