![image](https://private-user-images.githubusercontent.com/97181397/335783562-4ddab2a2-cf41-43d4-86d7-710a85dc56a4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4OTk2NjksIm5iZiI6MTcxODg5OTM2OSwicGF0aCI6Ii85NzE4MTM5Ny8zMzU3ODM1NjItNGRkYWIyYTItY2Y0MS00M2Q0LTg2ZDctNzEwYTg1ZGM1NmE0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjIwVDE2MDI0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFlOTlhNmJhMzMzYzI5NzM0MTgwOWFkYjc4ZTE2MGJhYjExODUyNGU4ZjVhNDA2YWE5ZmY0MGQ0YjI1ZDU2ZjYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.rkEDtAWVFc30fKyoQ2cZKqfdlqKM4fbt5n3a9HZpf08)
![image](https://private-user-images.githubusercontent.com/97181397/335783249-abb16bf1-1d91-4b07-beff-17a1092256d2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4OTk2NjksIm5iZiI6MTcxODg5OTM2OSwicGF0aCI6Ii85NzE4MTM5Ny8zMzU3ODMyNDktYWJiMTZiZjEtMWQ5MS00YjA3LWJlZmYtMTdhMTA5MjI1NmQyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjIwVDE2MDI0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI4MzQ2N2RmZjBhMzc4ZWI1MzQ5OTgwNmY5NTEzNmFiOTY1YjEwMWI3MTE5NjQ0MjJiZGMwZWE1NThjYmE0YjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.mONkEhJb6uzqbRsGKISEDilkpVgtj-AGNUlvDkeOyXA)
-
νκ΅μ΄μ νΉνλ Saltlux/Ko-Llama3-Luxia-8B νμ©
-
GPT-4oλ₯Ό μ΄μ©ν Q & A datasetμμ± (νμ¬ μμ± μ©λ: 16.76MB)
- input: Relevant Document, output: Q & A
- Q&A dataset (train: 4269κ°, validation: 1641κ°)
-
Fintuning Method
- QuantizedLoRA + FSDP(Fully Shared Data Parallel) λ°©λ² νμ©
- Instruction Tuning on μ¬μΆμ±ν (Injection Molding) dataset
- {Question: Relevant Document } -> Answer
-
νκ° μ§ν : μ½μ¬μΈ μ μ¬λ
- μ§λ¬Έμ΄ μ£Όμ΄μ‘μ λ, GPT-4oκ° μμ±ν λ΅λ³ (A)μ κ° λͺ¨λΈμ΄ μμ±ν λ΅λ³(B) κ°μ μ μ¬λ μΈ‘μ
-
νμΈνλ κ²°κ³Ό
![image](https://private-user-images.githubusercontent.com/97181397/335784093-cb1c8557-bac2-4b42-9af0-9cfef61c1f49.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg4OTk2NjksIm5iZiI6MTcxODg5OTM2OSwicGF0aCI6Ii85NzE4MTM5Ny8zMzU3ODQwOTMtY2IxYzg1NTctYmFjMi00YjQyLTlhZjAtOWNmZWY2MWMxZjQ5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjIwVDE2MDI0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVhMmY4NzgyZDk2NDQ2YmNjY2QwMTA5MmZiM2IzYjc2ZTIzMDYwYTE0NmRhYjU2ZDA0YzBmOWIwOWQyYWYyYTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.bbuh9G23j3305uPd4FDjbvJcgIatqGt5jnFtsKlubZ0)