Inspiration
I am preparing for JEE (Join Entrance Exam). we Have 2 tests every weekend and on monday and what I observed is that many of my friends and even me to a certain degree don't have a clear path to start studying. So I developed a website to solve this problem.
What it does
It bascially takes in a deadline and a bunch of topics to create a blue print for studying using Mixtral 8x7B LLM. It also creates mock tests with high quality JEE questions for you which you can give to figure out your level of readiness to appear for the actual test. It not only creates a test for you it also guides you to improve in the areas that you're weak at.
How we built it
We built the frontend in react.js in the form of a website. the backend is in node.js and express.js. the database is hosted on firebase firestore.
Challenges we ran into
we had the challenge of finding the perfect model weights to use to implement a model ourselves but it was taking too long to run on my local machine, so I switched to just fine tuning the model. Hooking firestore with the model to validate questions and responses was a bit tedious but we figured out a way around it.
Accomplishments that we're proud of
once we trained the model on pretrained data, the next task was to use Adverserial probing to find the limitations of the output of the model. then we just did a bit of supervised fine tuning of the parameters to get better responses against diverse responses and find weak points. finally we made 3 working models to use.
What we learned
we Learnt fine tuning LLMs and using pretrained weights to make your own custom LLM agent.
What's next for PNJ
We aim for making this as an actual service which is none other like other services out there.
Log in or sign up for Devpost to join the conversation.