RAFT for dataset and inference

Inspiration

See the potential of RAFT. Finding the way to incorporate RAFT to create complete LLM application.

What it does

Incorporate RAFT to create complete LLM application.

How we built it

Define problems, requirements, specs, data architecture then coding every necessary components. Create infrastructure at the end.

Challenges we ran into

Many tasks to do and most tasks are difficult to implement.

Accomplishments that we're proud of

Complete application including infra and touching details of both high level and low level.

What we learned

How to create full pipeline of LLM application.

What's next for RAFT for dataset and inference

Enhancing and fully utilizing RAFT for the world's best AI applications, competing with top companies in advanced software fields.

Built With

• docker
• flask
• helm
• huggingface
• kuberntes
• oci
• openshft
• openvivo
• python
• qdrant
• qwen
• yugabyte