chungimungi / generation-of-colors-using-bilstms

A prompt based model that is trained to generate colors.

Color Prediction

This model implements a Bidirectional Long Short Term Memory that uses a custom dataset created by me. The model is trained on this dataset to predict colors based on a user inputted query. The model is trained on a relation between color names and their respecitve RGB values. A function is then called upon utilizing a dataset of english adjectives and a list of primary and secondary colors. Each color in the list is mapped to adjectives present in the dataset and then prompted through the intially trained model. It is then added back to the colors.csv file and then trained again to predict colors.

Model Hyperparameters

The model has 1.3M trainable parameters. The model is initially trained for 350 epochs on a batch size of 512 and for the Active Learning step a batch size of 1024 and 15 epochs. The first training loop the model achieves 73% training accuracy with 67% validation accuracy and the second training loop after the active learning step it achieves 75% training accuracy with 85% validation accuracy

Results

Prompt : Red

Prompt : Deep Purple

Prompt : Olive Green

Prompt : Bubblegum Pink

Prompt : Sunset

Possible Applications

• Create realistic visual effects in movies and video games.

• Develop new ways to design and manufacture products.

• Improve the accuracy of medical imaging.

@misc{sinha2023generation,
      title={Generation Of Colors using Bidirectional Long Short Term Memory Networks}, 
      author={A. Sinha},
      year={2023},
      eprint={2311.06542},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

generation-of-colors-using-bilstms's Issues

too good