Don't stop at local control.
Covenant-72B scored 67.1 on MMLU zero-shot, beating LLaMA-2-70B’s 65.6 under identical test conditions. SparseLoCo reduced communication overhead by 146x using ...