Malaya (Co-Director Creative Agent)

Malaya: Membuka Imajinasi

Comment 3

Inspiration

What inspired me to create malaya - The Co-Director Creative Agent is all the AI Content Creator who made his project that is very intent, taste and attention into detail and also maximizing the capabilities of the AI Generator Model. Also specifically i see the youtube video on Higgsfield Account that the capabilities of Seedance 2.0 and GPT Image 2.0, Nano Banana and Higgsfield Cinema Soul Studio can made a video that really good. The remaining gap is our taste as a human and also i have been experimenting creating a video generation but i feel we as a human is too much babysitting wait for the generation and every project we need to explore and start from zero again to make a concepts that works through the model.

What it does

Malaya (The Co-Director Creative Agent) present to close the gap between our vision , connecting our concept through the scripts, creating detail of character, arena, detail prompts of each scene (image and video) and do the heavy task for generating every assets of the projects and every check point and process we can review it to get approval for the next step of the projects

How we built it

  1. The Foundation I built this agent with local hardware (mac mini) using hermes as a personal agent, with GPT 5.5 as a model on hermes.

  2. The workflow : I create a workflow using LLM-Wiki as a persistent memory that connected to Soul.md so everytime we go to a new session we have a persistent memory and creating deterministic workflow for creating the idea/concept, creating a script , workflow for using the tools of AI Studio, workflow for creating an assets (character , arena, image scenes and video scenes) , So all of the workflow is deterministic to make the AI Agent persistent every time. Also we have a compounding knowledge that everytime we have a wrong approach we can store it to our LLM Wiki so in the future we know what is the things that not works and what is the things that works. That is our vision to make Malaya capabilities compound during the time

  3. Tools uses

  4. AI Studio Collaboration

  5. Printing Press for create a CLI for AI Studio Collaboration for AI Agent

  6. Deterministic Stack Protocol and Deterministic Workflow (md files)

  7. LLM Wiki Concept (already built on Hermes Agent)

  8. Github CLI

  9. Cloudflare Tunnel (Temporary URL)

  10. Higgsfield CLI

  11. Claude API Model - Opus 4.5 on AI Studio Collaboration (To breakdown the script from malaya into detailed character, world, image and video prompts)

Challenges we ran into

  1. Challenge i ran into is i hope within this agenthon i can create a mock up video by the deadline of the time , but because we have so much trouble on AI Studio Collaboration and waiting for image and video generation taking too long , so we don't have enough time to make it happen

Accomplishments that we're proud of

Accomplishments that i am proud is when you have the idea to creating any story, with this Malaya Agent now we are not babysitting in front of the laptop/computer we just control and monitor it via telegram and we can do another task rather than babysitting to wait the generation to be completed

What we learned

What we learned after we create this Malaya Agent is there is so much space to develop this agent to give him a better tools, deterministic workflow and procedures, compounding knowledge through LLM Wiki, and also we can give him a tools like x-url so we can find a content creator who share his workflow and prompts then we can implement it using our agent. The idea is human role is to give a taste, grand concept of the stories and reviewing every process of the generation from scripts , character generation, scenes generation, image and video generation

What's next for Malaya (Co-Director Creative Agent)

What's next for Malaya i think , she can have a skills or tools to editing by herself and can promote / drafting into the social media so the human can approve and have a final decision to post the content

Main Goals

  1. To make the agent that has compounding knowledge of creating a content or creative assets with AI Model
  2. To make the plan better
  3. To reduce the costs of the projects (compounding aspect) so people who have limited credits still can make his project complete

Notes : for "try it out" links AI Film Studio merupakan tool yang saya gunakan untuk review hasil dari malaya agent, tapi hasil dari script, character, world building , story board , image generation are by malaya ai agent creation

Built With

  • claude
  • gptimage
  • hermes
  • higgsfield
  • printingpress
  • seedance
Share this project:

Updates