Inspiration
Venus-120b, MegaDolphin, MergeKit
What it does
It's mistral-7b - but big.
How we built it
Charles Goddard's MergeKit
Challenges we ran into
None
Accomplishments that we're proud of
Making something useful
What we learned
None
What's next for bigstral-12b
Mixture of Experts
Built With
- huggingface
- mergekit
Log in or sign up for Devpost to join the conversation.