Employee Onboarding Assistant

Wubba Lubba Dub Dub

Inspiration

This app takes complex documents like employee handbooks and helps them understand it by breaking it down into the important topics and then quizzing them about those topics. It then grades the employees on important point from the text giving them a score and explaining if their answer was lacking in any way and informing them what those points were.

It also after the test tells the user what points they need to study on.

This was made in the context of employee onboarding but it has many real world applications other than that as well.

What it does

You can enter in a text file of an employee handbook (this is the first use case we started off with this for), and it will return back to you the important topics.
On the backend it creates a series of questions and answers to those questions.
When the user is ready, they are quizzed on the questions.
When the user replies, his answer is compared to the answer generated by the llm and they are graded based on completeness and accuracy.
Along with the grade, the missing points as well as an explanation for the grade is given to the user.

This is an example of it :

Question 2: 'question': 'When is on-call time considered compensable?', 'answer': 'On-call time is considered compensable if the employee is required to remain on the employer\'s premises or nearby, and cannot effectively use the time for their own purposes.' 'user answer': 'It is upto the employee to decide'

COMPLETENESS: 2 ACCURACY: 1 Explanation and Missing Points: Your answer is incomplete and inaccurate. According to the Fair Labor Standards Act (FLSA), travel time to and from the worksite is generally not compensable for on-call employees. However, there are exceptions to this rule. For example, if the on-call employee is required to perform work-related tasks during their travel time, such as answering calls or responding to emails, that time may be compensable. Additionally, if the on-call employee is required to travel a significant distance to reach the worksite, that travel time may also be compensable. Missing Points: - The FLSA generally does not require compensation for travel time to and from the worksite for on-call employees. - Exceptions to this rule include performing work-related tasks during travel time or traveling a significant distance to reach the worksite. Your answer does not provide any explanation or mention any exceptions to the general rule. Therefore, it is incomplete and inaccurate.

How we built it

We used .txt files as the data sources, chunked the,, made them into vector embeddings and stored them in pinecone. When we generated the questsions and answers for the users we used similarity search for our search and returned the closest 4 arguments so the llm could summarise an answer competently. For grading we changed the context to the answer generated by the llm and used similarity search once again to allow the llm to give the user more info on the missing points.

There are many more things we would like to have tried but were short on time.