AkaLlama: Korean Specialized 70B LLM Construction

May. 2024 – Dec. 2024

• Released a 70B LLaMA-based LLM full fine-tuned with curated data to be specialized in Korean
• Curated Korean training dataset gathering open-source instruction-following samples through quality analysis and deduplication, and evaluated performance on major Korean benchmarks showing results comparable to leading models