CLIP training in Jax. about open_clip

[BobMcDear]

I would be interested in contributing to this - are there any guidelines, a roadmap, etc. I need to follow, or should I begin with a simple baseline in a separate repository and gradually expand it?

[mitchellnw]

Ya at a high level we were just thinking this would be something beneficial for the community, but no concrete plans -- an open_clip_jax repo would be great!

[BobMcDear]

Okay, thank you for clarifying that. I will implement a baseline and keep you up-to-date.

[BobMcDear]

The past few months have been quite busy for me, but I've been slowly chipping away at an open_clip_jax project here as a starting point. It is very much a work in progress and likely to be riddled with bugs but supports basic functionalities such as inference with pre-trained models and training (single- and multi-worker), with more features planned for the near future.