Data PreProcessing for Fine-Tuning.
-
Install pyenv to manage your Python versions and virtual environments:
curl -sSL https://pyenv.run | bash
- If you are on MacOS and experiencing errors on python install with pyenv, follow this comment
- Add these lines to your
~/.bashrc
or~/.zshrc
to be able to activatepyenv virtualenv
:eval "$(pyenv init -)" eval "$(pyenv virtualenv-init -)" eval "$(pyenv init --path)"
- Restart your shell
-
Install the right version of
Python
withpyenv
:pyenv install 3.11.7
- Install Poetry to manage your dependencies and tooling configs:
If you have not previously installed any Python version, you may need to set your global Python version before installing Poetry:
curl -sSL https://install.python-poetry.org | python - --version 1.5.1
pyenv global 3.11.7
Create your virtual environment and link it to your project folder:
pyenv virtualenv 3.11.7 fine-tune-article
pyenv local fine-tune-article
Now, every time you are in your project directory your virtualenv will be activated thanks to pyenv
!
poetry install --no-root