NYC_Taxi_OpenAI_Hackathon

• 

  Data Load

• 

  Transformation

• 

  Config

• 

  Result

Inspiration

Inspired to collaborate Gen-AI in Fabric to be able to utilize LLMs in work context more efficiently.

What it does

It provides accurate responses based on the natural language query passed as a context. It is also does the arithmetical calculation as part of its response.

How we built it

Transformed and trained the NYC taxi open datasets. Using Pyspark modules to filter and feed to the Azure OpenAI model to answer the user's questions.

Challenges we ran into

Challenges in incorporating Vector based model in the available dataset.

Accomplishments that we're proud of

Successful integration of Azure OpenAI model with Fabric Data Engineering Workload.

What we learned

How to prompt engineer the Gen-AI model.

What's next for NYC_Taxi_OpenAI_Hackathon

Data Vectorization

Built With

• copilot
• msfabric
• openai
• pyspark