Inspiration

Not a lot of people have knowledge on what to watch out when trying to sign a contract. There are some cases where some people have been through trouble due to signing bad contracts, whether it is to start a business or even for employment. Added to that, the cost needed to hire a professional lawyer who could review the contract for you is quite high.

What it does

It answers some pre provided checklist to then be reviewed by the user. This could help cut down the mental effort down when faced with a multi-page document.

How we built it

We built it as a web application using the Nuxt3 Framework and deployed it via Firebase. We used TailwindCSS and DaisyUI as the UI library.

Challenges we ran into

We initially built it using the transformers.js library but then realized that not a lot of people actually have the hardware to run the large LLMs. We then pivoted to build it with the naver-clova-ix/donut-base-finetuned-docvqa model using the HuggingFaceAPI.

Accomplishments that we're proud of

We are proud that we are at least able to realize the potential of using this type of validation to important documents. This realization means that we could apply other supporting technologies such as Retrieval Augmented Generation and Agent with Self Reflection to help improve the performance of the model in validating documents.

What we learned

We learned that the process of making llm accessible to all people are still limited especially due to the lack of integration of AI/ML that could run from the browser. We are interested in exploring the potential of training a smaller model (<100M parameters) so that regular people and small business could use it.

What's next for checkmy.xyz

  1. Train a smaller model that is ONNX runtime compatible so that it is compatible with transformers.js
  2. Setup an agentic pipeline using Langchain
  3. Setup a vector database using ChromaDB
  4. Expand use case to other documents other than legal printed documents or formal documents

Built With

Share this project:

Updates