← Back to discoveries

#MoE

1 discovery tagged “MoE”.

NVIDIA-Backed Reflection Used 10,500x GB300 GPUs And 46.4 Million Sandboxes Per Day For 4 Weeks To Train Beam, A 501B Open-Weight Model That Is Insanely Efficient

Wccftech
Reflection, backed by NVIDIA, has developed Beam, a 501-billion-parameter AI model that is highly efficient, utilizing only 23 billion parameters at a time through a sparse…
Insights: Beam represents a significant advancement in AI efficiency, making it a noteworthy development for industries reliant on large-scale AI models, such as natural language processing…
AINVIDIAMoE