Awesome Open Source

Programming Languages

Search results for artificial intelligence mixture of experts

artificial-intelligence x

mixture-of-experts x

4 search results found

Mixture Of Experts ⭐ 347

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

St Moe Pytorch ⭐ 160

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

Soft Moe Pytorch ⭐ 153

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

Mixture Of Attention ⭐ 74

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

Related Searches

Python Artificial Intelligence (6,553)

Machine Learning Artificial Intelligence (5,750)

Deep Learning Artificial Intelligence (2,964)

Jupyter Notebook Artificial Intelligence (2,712)

Artificial Intelligence Neural Network (1,732)

Java Artificial Intelligence (1,340)

Artificial Intelligence Tensorflow (1,225)

Artificial Intelligence Chatgpt (1,141)

Artificial Intelligence Computer Vision (1,009)

Artificial Intelligence Openai (997)

1-4 of 4 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.