Sketch2Latex.

• 

Inspiration

As a CPGE student, I work with mathematics, physics, and engineering almost every day. I often needed to convert my handwritten notes into clean PDFs so that AI tools could analyze them more accurately and help me study.

At first, I used GPT-5.4 to convert my notes into LaTeX, but the results were not always accurate. I then tried learning LaTeX myself, but creating diagrams with TikZ was slow and difficult.

When GPT-5.6 was released, I felt it was the right moment to build the tool I had always needed: an accessible platform that helps STEM students and teachers turn handwritten notes, diagrams, and sketches into editable LaTeX.

What It Does

Sketch2LaTeX is designed for:

• Students creating mathematical, scientific, and engineering diagrams.
• Teachers preparing worksheets, lessons, and technical documents.
• Learners turning visual ideas into editable technical notation.

The platform has two main features.

Interactive Canvas

Users can draw and edit diagrams using different tools, including shapes, formulas, and physics-related elements. Once the drawing is complete, Sketch2LaTeX generates LaTeX code that can be copied directly into another project.

The canvas also includes a formula editor and specialized tools for creating physics and engineering diagrams.

Draw Over PDF

Users can upload an existing PDF and draw directly over it.

This makes it easier to preserve the dimensions, scale, and positioning of a diagram. Users can also trace over handwritten sketches, improve them, and convert the final result into LaTeX.

This feature is especially useful when reproducing diagrams from lessons, worksheets, or handwritten notes.

How We Built It

Sketch2LaTeX was built using GPT-5.6 throughout the development process.

We first used ChatGPT to design the general architecture, define the core features, and organize the development process.

We then used Codex with GPT-5.6 Terra and Sol to implement the interface, tools, canvas system, PDF workflow, and LaTeX generation features.

Challenges We Ran Into

One of our first challenges was making the platform easy to understand while still providing the tools and keyboard shortcuts expected from a serious design application. We studied platforms such as Adobe Illustrator and Canva for inspiration.

Another challenge was handling the differences between European and international conventions in physics and chemistry diagrams.

We also needed to make every generated element easy to select, move, resize, and edit after it had been placed on the canvas.

The most difficult technical challenge was generating LaTeX code that preserves the dimensions and positions of elements drawn over an uploaded PDF.

Accomplishments We Are Proud Of

The feature we are most proud of is Draw Over PDF.

Our original idea was to let users upload a .tex file, compile it into a PDF, and automatically update the source code whenever something was drawn on the document.

However, implementing a reliable version of that system was too complex to complete one day before the deadline, especially while working with only one Plus subscription.

Instead, we developed a simpler and more practical workflow: users can upload an already compiled PDF, draw over it, and generate LaTeX code that preserves the placement and dimensions of their additions.

This became one of the strongest and most useful parts of the project.

What We Learned

As our first hackathon, this was a unique and valuable experience.

We learned how to use GPT-5.6 more efficiently for planning, coding, debugging, and product design. We also improved our understanding of LaTeX, TikZ, and the wider TeX ecosystem.

Most importantly, we discovered how powerful LaTeX can be for STEM students and teachers when it is combined with an intuitive visual interface.

What Is Next for Sketch2LaTeX

We plan to continue developing the ideas we brainstormed during the hackathon.

Our next goals include:

• Improving the overall user experience.
• Adding more pre-built physics and engineering models.
• Supporting both European and international scientific conventions.
• Creating specialized tools to help teachers prepare lessons and worksheets.
• Allowing users to create complete multi-page PDFs directly inside the platform.
• Adding professional document templates and layouts.
• Improving LaTeX generation accuracy and editability.
• Expanding support for chemistry, geometry, circuits, and technical diagrams.

Our long-term goal is to make Sketch2LaTeX a complete visual workspace for creating professional STEM documents without requiring advanced LaTeX or TikZ knowledge.

Built With

• codex
• typescript