reference
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean published 'Outrageously large neural networks: The sparsely-gated mixture-of-experts layer' in 2017.
Authors
Sources
- Unlocking the Potential of Generative AI through Neuro-Symbolic ... arxiv.org via serper
Referenced by nodes (2)
- artificial neural networks concept
- Mixture of Experts (MoE) concept