LLM360 Introduces K2: A Absolutely-Reproducible Open-Sourced Giant Language Mannequin Effectively Surpassing Llama 2 70B with 35% Much less Computational Energy
K2 is a cutting-edge giant language mannequin (LLM) developed by LLM360 in collaboration with MBZUAI and Petuum. This mannequin, generally known as K2-65B, boasts 65 billion parameters and is absolutely reproducible, which means all artifacts, together with code, knowledge, mannequin checkpoints, and intermediate outcomes, are open-sourced and accessible to the general public. This stage of…