Second Step Towards Interactive Drama

Inspiration

At the beginning of the 21st century, NLP researchers explored using agents to create interactive drama experiences. It worked to a certain extent, but needed a more advanced technology to truly flourish. That technology is ChatGPT. Today I aim to advance that interactive drama framework to build believable characters that will act in dynamic environments.

What it does

This project creates a character that acts and talks like "Cersei Lannister" from "The Game of Thrones"

How I built it

I built it by fine-tuning a small language model to speak like Cersei Lannister.

Challenges I ran into

• Performance unpredictability of small language models
• Capacities of a Macbook for fine-tuning models
• Lack of raw data

Accomplishments that I'm proud of

• A collection of 1200+ samples used for fine-tuning
• A streamlit app where the language model can be directed to speak in Cersei's tone.

What I learned

• Relying on raw data is not enough
• A 3B model may not be powerful enough to perform consistently

What's next for Second Step Towards Interactive Drama

• Use data synthesis to create more samples
• Experiment with training parameters
• Experiment with different small models and on different platforms
• Find ways to different models interact

Built With

• mlx
• python
• streamlit