Inspiration

I like the aws-news.com webpage, but have many different use-cases for it as well. As an entrepeneur, I'd like to stay up to date on the latest tax news, as a data/cloud engineer on the latest snowflake, AWS and maybe open source. This is a gap in the market I see to get NEW information faster, better and more personalized.

What it does

The app helps you stay up date on the latest topics you find relevant, without having to read ALL the news. Just query directly against the news feeds, or summarize individual articles to see if they are worth reading. Cool right?

How we built it

We built it using snowflake arctic models and the snowflake embedding model for RAG.

Challenges we ran into

Summarizing text on large text is difficult. Sometimes summaries of articles need to be split due to the limited token window.

Also performance can be greatly optimized by preloading or lazy loading articles and embedding them in advance for commonly accessed articles.

Accomplishments that we're proud of

It kinda works and I am actually using it myself to stay up to date on the latest Dutch tax laws as an independent contractor.

What we learned

I learned about RAG and arctic models and their limitations, like for example token windows.

What's next for What's new in Snowflake

I'm going to extend it and share it with other independent contracters in the netherlands to stay up to dat on dutch regulations.

Built With

  • arctic
  • rss
  • snowflake
Share this project:

Updates