DataForge

Group Information
All Groups Listed
Landing Page
Add new API to the group or delete existing API
Create New Group
Response from a Group of APIs rendered in form of table for preview, with utilities to copy or download in CSV or JSON formats
Test an API endpoint (we check before adding an API to group dynamically)

Inspiration

I was inspired to build this project after seeing a friend struggle with integrating multiple APIs. The inconsistencies and failures made development slow and frustrating. This motivated me to create a solution that simplifies API integration. When i posted about it on twitter, i got to know that a lot of developers face this problem and spend a lot of time juggling with multiple APIs.

What it Does

This project acts as an integration layer that aggregates multiple APIs into one unified endpoint. It normalizes different data formats, handles errors gracefully, and provides a clean, merged dataset with performance and success metadata.

How I Built It

I built the backend with Node.js, Express, and Prisma for database operations. The aggregator service concurrently calls active APIs, merges their data, and collects detailed metadata. For the frontend, I used Next.js with React and TypeScript, styled with Tailwind CSS, and integrated Shadcn UI.

Challenges I Ran Into

Handling varying API response formats and failure modes was challenging.
Managing concurrent API calls and ensuring the frontend state stays consistent required careful asynchronous programming and error handling.
Handling type-safety in TypeScript

Accomplishments That I’m Proud Of

I’m proud of delivering a fully functional end-to-end system that transforms multiple unreliable APIs into a single dependable data source with insightful metadata, streamlining data consumption for users.

What I Learned

This project deepened my skills in asynchronous concurrency, API design, full-stack TypeScript development, and advanced error management in distributed systems. Also, i got to know my weaknesses in some areas i need to work on.

What’s Next for This Project

Next, I plan to add caching and real-time streaming features, implement user authentication, and enable richer data transformations and integrations with third-party tools to broaden usability. The Normalization has a lot of scope for improvements and enhancements.