๐Ÿ’ก Inspiration

Enterprise procurement and Accounts Payable (AP) departments process thousands of disbursements each month, leaving them vulnerable to invoice tampering, phantom vendors, and pricing creep. Traditional rule-based ERP validation systems are rigid and fail against evolving shell companies. Conversely, standard Large Language Models cannot be trusted with mission-critical financial auditing due to arithmetic and quantitative hallucinations.

We designed OmniAudit NIM to bridge this divide: combining the reasoning flexibility of agentic AI with the strict mathematical guarantees of classical statistical modeling and live entity verification.


๐Ÿ” What It Does

OmniAudit NIM acts as an autonomous forensic copilot for corporate disbursements:

  1. Deterministic Quantitative Grounding: Benchmarks billed freight charges against a route-distance and cargo-weight regression model ($R^2 = 96.99\%$), ensuring pricing baselines remain mathematically anchored rather than estimated by an LLM.
  2. Real-Time Entity Radar: Simultaneously queries live corporate registries, public debarment lists, and risk databases via Tavily in parallel threads to uncover phantom suppliers.
  3. Explainable AI (XAI) Attribution: Calculates an interpretable composite forensic risk score (0โ€“100) and deconstructs it into explicit mathematical point deductions across cost deviation, identity credibility, and abnormal settlement terms.
  4. Enterprise Batch Triage: Rapidly ingests CSV batch queues, triages clean transactions into automated payouts, and isolates high-risk outliers for manual forensic deep-dives.
  5. Actionable Forensic Directives: Issues concrete disbursement mandates (APPROVED, CONDITIONAL APPROVAL, FLAGGED FOR AUDIT - HOLD DISBURSEMENT) for Accounts Payable officers.

๐Ÿ“ How We Built It

  • Agentic Reasoning Core: Python orchestration with Google GenAI SDK (gemini-3.8-flash / Nemotron architecture) incorporating multi-model fallback cascades for zero-downtime resilience.
  • Deterministic Baseline: Scikit-Learn multivariate linear regression model trained on logistics parameters ($R^2 = 96.99\%$).
  • External Grounding Engine: Tavily Search API executing live entity resolution across corporate registries and public databases.
  • Concurrency: Python's concurrent.futures.ThreadPoolExecutor for running the statistical regression and web retrieval engines in parallel, reducing latency by 45%.
  • Interface & Deployment: Streamlit dashboard deployed to Streamlit Community Cloud with pure-Python visual components for zero-dependency execution.

๐Ÿšง Challenges We Overcame

  • Preventing LLM Numerical Hallucination: LLMs often struggle with strict arithmetic consistency. We resolved this by isolating the baseline pricing calculation entirely inside a deterministic Scikit-Learn model, passing the calculated baseline into the agentโ€™s context as verified fact.
  • Minimizing End-to-End Latency: Running live web search alongside complex prompting created latency bottlenecks. We introduced multithreaded worker execution to fire web queries and statistical checks concurrently.
  • Runtime DLL & Dependency Portability: Bypassed native OS binary dependency restrictions by building pure-Python calculation bars and data frames, ensuring reliable cross-platform cloud execution.

๐Ÿ† Accomplishments We're Proud Of

  • Calibrating a regression model that reaches a verified 96.99% $R^2$ on logistics pricing variance.
  • Building a full Explainable AI (XAI) attribution system that reveals the exact arithmetic rationale behind every risk score.
  • Shipping an end-to-end, functional prototype supporting both granular single-invoice forensic analysis and enterprise batch CSV triage.

๐Ÿ“š What We Learned

High-stakes enterprise AI systems require deterministic guardrails. Pure agentic loops excel at qualitative synthesis and unstructured entity analysis, but must be paired with deterministic mathematical tools to produce trustworthy decisions in corporate finance.


๐Ÿ”ฎ What's Next for OmniAudit NIM

  • Multimodal OCR & Vision Ingestion: Adding vision-language models to ingest scanned PDF bills of lading and paper invoices directly.
  • ERP Connectors: Native webhooks for SAP S/4HANA and Oracle Financials.
  • Fine-Tuned Domain Adapters: Training custom LoRA adapters on enterprise procurement and historical fraud audits.

Built With

Share this project:

Updates

posted an update —

OmniAudit NIM: Production Deployment & Live Forensic Verification

We have officially moved OmniAudit NIM from local development to a live, production-grade cloud deployment!

Key System Capabilities: โ€ข Dual-Engine Audit Architecture: Coupled our deterministic multivariate regression engine (Rยฒ = 96.99%) with parallel entity grounding to eliminate arithmetic hallucinations in freight auditing. โ€ข Live Search Radar: Integrated the Tavily Search API with Python ThreadPoolExecutor concurrency to query corporate registries, scam databases, and debarment records in real time. โ€ข Explainable AI (XAI) Attribution: Transparent point-by-point risk breakdown (0โ€“100) showing exact penalty attribution across variance, registration flags, and settlement terms. โ€ข Enterprise Batch Triage: Deployed batch CSV ingestion to process entire disbursement files and isolate high-risk anomalies automatically. โ€ข Live Cloud Deployment: The application is hosted publicly on Streamlit Community Cloud and backed by a clean open-source repository.

Try the live demo: https://omniaudit-nim-ysnpjrzlrcepxmappexyypy.streamlit.app/ Source Code: https://github.com/alimurtaza9dev-ctrl/omniaudit-nim

Log in or sign up for Devpost to join the conversation.

posted an update —

Update: Production Deployment & Live Forensic VerificationWe have officially moved OmniAudit NIM from local development to a live, production-grade cloud deployment! Here is what is new in the current release:Dual-Engine Audit Architecture: Coupled our deterministic multivariate regression engine ($R^2 = 96.99\%$) with parallel entity grounding to eliminate arithmetic hallucinations in freight auditing. Live Search Radar: Integrated the Tavily Search API with Python ThreadPoolExecutor concurrency to query corporate registries, scam databases, and debarment records in real time. Explainable AI (XAI) Attribution: Added a transparent point-by-point risk breakdown ($0$โ€“$100$) showing exact penalty attribution across variance, registration flags, and settlement terms. Enterprise Batch Triage: Deployed batch CSV ingestion to process entire disbursement files and isolate high-risk anomalies automatically. Live Cloud Deployment: The application is hosted publicly on Streamlit Community Cloud and backed by a clean open-source repository. Try the live demo: omniaudit-nim-ysnpjrzlrcepxmappexyypy.streamlit.app Source Code: github.com/alimurtaza9dev-ctrl/omniaudit-nim

Log in or sign up for Devpost to join the conversation.

Submission history