-
-
A quick view at the dashboard
-
A quick test in the playground
Inspiration
The inspiration was that big companies earn money hosting llms, while normal users have no way to earn money with their own hardware they already got.
What it does
FenayAI connects consumer machines with llm users. this way any user can become a provider and host llms they like, and get paid by the usage.
How we built it
Using C for the client and rust for the node, we built this using ai like gpt-oss and chatgpt to get a well functioning error-minimized system running. by now we already got 826 active providers and 34 registered users.
Challenges we ran into
Ran into challenges like the direct connection with provider selection if you prefer one, without leaking the ip addresses, which led to connecting all via one global node.
Accomplishments that we're proud of
We managed to drop this within a few days/hours, releasing a huge improvement on ai networks by connecting hundreds of providers with many users.
What's next for FenayAI
We're working on an update for shared-inference, meaning llms will run on two machines at the same time, speeding the generation.
Log in or sign up for Devpost to join the conversation.