Inspiration

Mobility is an integral part of everyone's life. According to statistics, there is one death in four minutes due to a road accident in India. This situation worsens during winters.

Our app solution will enable effective design, engineering and delivery of UD DID Resolver, TBD, Trinsic, Ethereum, Chainlink, Polygon, AWS and IPFS/Filecoin aided solution to make roads safer and better using predictive analytics and automation for incident reporting and reduction in hazardous transportation with capabilities pluggable and extendable to 5 different personas: Driver, Police, Citizen, Dispatcher, Admin.

Our solution will benefit: Police Force - 360 degrees access of the incidents to the action/ administration team. They can manage the complete lifecycle of incident reporting, overall status, traffic monitoring, managing police teams. Using machine learning they can also predict the incident occurrence at any area. This will help in taking necessary actions in advance to control the traffic. They can also use the solution for effective utilization of staff members and provide road safety counselling.

Ministry of Road and Transportation: Endeavor to change the car accident scenario by use of car technology to make driving safer and monitored for drivers, authorities, as well as other 3rd parties. With a mix of hardware and software, we will provide intelligent feedback about drive quality and help analyze past incidents, as well as predict future incidents.

Citizens and Cab aggregators: Reduction in the number of road accidents.

Insurance Companies: Aggregated/ anonymized driving data and incident data will be helpful to car insurance companies.

OEMs and Dealerships: Vehicle diagnostics and in-car service consumption will be helpful for OEMs and Dealerships.

Smart Cities Policy Makers/ Government: Real time traffic flow, incident alert and parking data will be enable safer roads.

Advertisers: Customers/driver demographics will be available.

Fleet customers: fleet performance, compare against competition.

What it does

Our solution offers an Artificial Intelligence-based object detection system that utilizes UD Did Resolver, TBD, Trinsic, Polygon ID, Ethereum and Chainlink blockchain protocol, IPFS/Filecoin blockchain solutions using fluence p2p infrastructure for sorting information obtained from a variety of cameras. With just a cell phone, users are offered a serverless solution that can detect objects in real time and more object types for better accuracy.

DID, TBD, Trinsic, PolygonID and Ontology Demos and Usage in Transport DAO: https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV (please visit Demo 1-4 and "DID Usage in DID Transport DAO.pptx" and "Brief DID Architecture - Digital Identity, Personas and Capabilities.pptx" )

DID and TBD Solution deployment at Vercel: https://aspiring-road-safety-zksync-deploy.vercel.app/

Design Specs: https://www.youtube.com/watch?v=wBDXdz3m_Z4&t=18s

Mobile Demo: https://www.youtube.com/watch?v=Un1Z3ZnvpXQ

Deck: https://youtu.be/Jh_AFWc_kKI

  • Monitoring and Incident Detection workflow using DID Transport DAO:

Camera Management: Add/edit/delete cameras with a front end application

Object Detection using open source solutions and Pytorch/Tensorflow deep learning library using CNN neural networks.

Video analytics configuration

Live streaming with Object Detection Video Analytics

Alarm storage

Alarm Viewer: Add alarms with a single touch. Open the Alarm Settings menu from the home page. Add an alarm, set the wallpaper or choose an alarm tone. You can also delete an existing alarm.

  • Enablement: Our technical solution enables driver monitoring, incident management and collision avoidance: Incident-based reporting & Collision detection (even when a vehicle is parked) and video footage associated with it. Video footage for abnormal driver behaviour (complete view of the car with 2 cameras – front and back and open source video streaming), real-time alert and live streaming using open source solutions and ASDI OpenAQ dataset along with the Near blockchain. We are also utilizing Near Protocol to receive road incident feedback reports by citizens, store feedback details from both users and government officials on the incident reports so that they can prevent incidents.

Any abnormal behaviour/activity can be displayed on the smart dashboard in the vehicle.

Built-in GPS technology useful in fleet management and tracking. Black box car tracking to be able to pre-empt and diagnose breakdowns more quickly. Recognition area built in the central control to pick up your body movements, GAIT analysis Vehicles become IoT devices which can connect to smartphones, take voice commands, change the user interface.

The decentralized Cloud-Connected Car Drives IoT Monetization. Real-time access to car availability and mobile connectivity enables better decisions making systems.

Amazon ASDI OpenAQ initiative: This project utilizes AirQualityQuotient (AQQ) Tool build using "Amazon ASDI OpenAQ" dataset and maps it with road incident manager for early detection and prediction of road incidents, reduce traffic congestion in areas of low visibility

How we built it

We have developed a road incident management system using UD DID Resolver, Chainlink, SxT Javascript, HTML5, NFT.Storage, Polygon, SAP's UI5 on the front end, Tron DAO, using open source video streaming system and crowdsourcing marketplace using Zora's auction house template for enabling sharing of government assets like toll prepaid card, car details information for interstate travel, driving license management and quarterly pollution check and control powered by Ethercalc (SocialCalc), Zora, Polygon, NFT.Storage, Tron DAO, Litprotocol for security and neume for data retrieval and live peer for online video streaming at the road incident spot for better coordination and immediate action.

DID Architecture, Demo and Usage in Transport DAO: https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

DID, TBD, Polygon ID, Ontology blockchain Modules & Magic SDK dapp module

DID and TBD Blockchain Modules with aggregator and analytics tooling (DID Calc) for tabulation, organization and visualization of on-chain data.

DID Calc: Analytics and Aggregator tooling with a Ledger Pro (hardware wallet) dapp module. Onyx Calc is also used for storing a variety of offchain data like incident snapshots, alarm metadata and object types at the time of incident in a spreadsheet type interface. Please visit demos at https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

  • Alarm Viewer dapp using Magic SDK module: Add alarms with a single touch. Open the Alarm Settings menu from the home page. Add an alarm, set the wallpaper or choose an alarm tone. You can also delete an existing alarm. Web3 template for NFT marketplace of alarm clock wallpapers and background ringtones purchase and auction. We are also extending and adapting Turtle Music using NFT Experiments for music curators for alarm clock. Please visit Demo 3 at https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

DID, Trinsic and Biconomy blockchain Modules & Web3 ecosystem tools

# DID, TBD, Lens and Biconomy integration, Polygon ID, Web3 ecosystem tools

Spare Parts Lens is a Social graph for Defi. It will take user's transactions, trades, positions or any defi activity on the spare parts Defi marketplace. And Suggests users to put on social graph lens.

Once transaction on lens, It will be available to everyone as a POST. POST like social post. Biconomy SDK used for perform batch txs to post data on Lens.

By making available to everyone:

  • Other users can discuss on that transaction/post.
  • Other users can copy that spare parts trade and create same spare parts trade for them. and post will available for them too.
  • Many more mobility and vehicle service usecases can be made by making defi open discussion platform.
  • We can create awareness about defi by showing post in a way so new web3 users can learn from it.

Lens Protocol and Neume: We are using Lens and neume recording audio based incidents where video is not possible to record. This will enable us to develop a socially scalable and open-source metadata retrieval, indexing, and management infrastructure for decentralized road incident management. Bandwidth is a major issue in India and neume protocol fits right at the spot for quick data retrieval where video is not possible due to high latency or unavailability of network for video streaming.

Please visit Demo 3 at https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

zksync Era and TBD, DID Web3 ecosystem tools

  • DID and zksync Paymasters: Giving free transactions to citizen developers, journalists, volunteers sharing anonymized report or incident data. This improves better outcomes for monitoring, incident reporting, precision logistics. We wish to enable 0 transaction fees for volunteers sharing anonymized report data using PyTorch or Scikit libraries.

-DID and zksync Era Wallet dapp for for handling toll ticket payments for vehicles and maintenance/service payments on top of expenses claimed for getting the requisite driving licenses. It is our go to wallet for handling interstate payments and third party payments like payments to government license regulators, repair providers: https://github.com/aspiringsecurity/De-Transport-Monitor/tree/main/zksync-Web3-Modules

We also plan to integrate QuickSwap with wallet to ensure that the vehicle owners or drivers can swap the tokens if needed at the time of service/repair or even getting license from regulators.

  • DAOs tracker tool for road incident management: https://github.com/aspiringsecurity/De-Transport-Monitor/tree/main/electronicincidentmanagement

  • Account Abstraction plugins for DID Transport DAO using zksync Era: Account Abstraction Plugins for Transport DAO enables customization of verification logic via plugins with a rule/logic setting, tabulation, organization, visualization tool namely SocialCalc spreadsheet. This allows users to set up rules which their account has to abide by when executing transactions while being able to reconfigure them in the future. The process improves account security by restricting permissions certain keys have while remaining adaptable to the user's changing needs.

zksync era deployment at Vercel: https://aspiring-road-safety-zksync-deploy.vercel.app/

Please visit Demo 1 and 4 at https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

Implementation areas of Account Abstraction plugins in Onyx Transport DAO:

Enforcing a spending limit for vital transport assets based on the key used for the transaction.

Restricting interaction with a certain citizen wallet or DAO dApp to a specific key.

Defining session keys, which are allowed to initiate service or repair transactions for only a limited period of time.

DID wallet and Visa Payments Integration and Web3 ecosystem tools

We are bootstrapping Visa payments implementation in Typescript to connect with our ionic apps which uses typescript as the core for handling application logic. We also wish to use Visa as the Web3 payments cloud computing provider.

DID Transport DAO: Blockchain and Web3 ecosystem tools enabled user security, payments and on-chain analytics

DID, TBD, Ontology, Trinsic and PolygonID; Biconomy, zksync Era Smart Contracts, Lens Protocol and Magic SDK: We are using Onyx, Biconomy, zksync Era Smart Contracts, Lens Protocol and Magic SDK for solving multiple challenges in investigative case management of road incidents for the admin role: sentiment analysis of a particular road incident for the admin role, social media text mining for a road incident and classification and severity of the incidents, early-stage incident response and prevention.

zksync Paymasters, TBD and Biconomy SDK enable us to have a DAO infrastructure with minimal gas fees. That is very important both from the privacy and cost-effectiveness front.

Offchain interoperability with Ethereum-like blockchains. Also, the ability to use decentralized NFT voting for incident investigative systems.

Ability to generate NFT and ease of identity management.

We are generating an NFT for NFC tags for vehicles and spare parts at the time of service and repair workflows.

Identity management, the ability to extend the solution, and reducing misinformation at the time of Incident analysis and reporting.

TBD analytics and aggregator tooling: investigative case management and incident reporting, identity management at the time of allocation of a case to a police officer, and incident severity analysis based on the decentralized voting at the TBD blockchain.

We are extending and adapting the Chainlink project "Link My Ride" to develop a decentralized first aid and ambulance platform by using Chainlink External Adapter to connect a Tesla Vehicle API to a Chainlink oracle for a peer-to-peer vehicle rental app. We wish to use it for Maruti Vehicle API and Hyundai Vehicle API.

We are utilizing Chainlink VRF, Chainlink DAO tooling and Services as follows:

Chainlink Blockchain for renting ambulances at the road incident sites: Borrowing funds by private and public sector mobility organizations and cab aggregators for community ambulances using collaterals. We allow community or civic organizations to set up an account, send funds, and apply for extra ambulances or emergency vans using collaterals.

We are further utilizing a data analytics OSS tool powered by SocialCalc for managing information and payments to emergency service providers, maintenance and repair servicemen and also insurance and cab aggregator providers for availing their services on Chainlink blockchain.

We wish to enable tabulation, data organization and management, in an easy-to-use analysis tool that summarizes core data and features of a Token or NFT such as chains used, origin, issuer, energy consumption, and minting method. We also wish to enable private payments for vehicle repair. We will utilzing DAOtooling modules using Chainlink blockchain along with SocialCalc spreadsheet module.

We utilized Chainlink VRF (Verifiable Random Function) to enable provably fair and verifiable random number generator (RNG) that further enables smart contracts to access random values without compromising security or usability for transport incident reporting. For each request, Chainlink VRF generates one or more random values and cryptographic proof of how those values were determined. The proof is published and verified on-chain before any consuming applications can use it. This process ensures that results cannot be tampered with or manipulated by any single entity including oracle operators, users, or smart contract developers. At this juncture, we are planning to use only subscription supported network for Chainlink VRF.

Amazon ASDI OpenAQ initiative: This project utilizes AirQualityQuotient (AQQ) Tool build using "Amazon ASDI OpenAQ" dataset and maps it with road incident manager for early detection and prediction of road incidents, reduce traffic congestion in areas of low visibility.

How it works:

Please visit the demos and DID implementation architecture at DID Architecture, Demo and Usage in Transport DAO: https://drive.google.com/drive/u/1/folders/12pzP2fGs5B8tYVtn2qojLHSUREPPCaqV

Camera Management: Add/edit/delete cameras with integration with Livepeer, NFT.Storage for snapshots of road incident, ethpass for toll ticketing, neume for data retrieval. Object Detection using Livepeer and Pytorch/Tensorflow deep learning library using CNN neural networks. Video analytics configuration using NFT.Storage, Litprotocol for security and neume for data retrieval. Live streaming with Object Detection Video Analytics using Livepeer for streaming, Litprotocol for security and NFT.Storage for snapshots. Alarm storage using Ethereum. Save/delete alarm metadata and image to/from IPFS using NFT.Storage. Store the hash returned from IPFS to Ethereum test network using NFT.Storage, Litprotocol for security and neume for data retrieval.. Provide links to alarms and blockchain transaction details. Alarm Viewer: Add alarms with a single touch. Open the Alarm Settings menu from the home page. Add an alarm, set the wallpaper or choose an alarm tone. You can also delete an existing alarm. We are using Zora's Auction House template for NFT marketplace of alarm clock wallpapers and background ringtones purchase and auction. We are also extending and adapting Turtle Music using NFT Experiments for music curators for alarm clock. We are using DAOtooling for coordination with a social focus around community collaboration for road incidents and alarms using Tron DAO.

Challenges we ran into

AWS deployment: We were using PV (paravirtual) based classic instance. We were required to convert PV (paravirtual) instance to an HVM (Hardware Virtual Machine) and convert it from a classic instance to a VPC instance. We faced a number of challenges in converting our PV instance to an HVM instance as our instance was not reachable via ssh. We arrived at a good conclusion on the issue by doing the following: Created an ami of current classic instance. Launch a new instance from this ami after shifting to vpc as the base with new VPC security groups and updated volume. The newly launched instance is working and we are able to ssh and has the code base. We purchased the developer support plan using AWS credits and have being shared key pointers on converting our VPC based PV instance to a VPC based HVM instance. This challenge would not have been solved without the support of AWS team.

The insurance providers have to manually upload the incident and vehicle data to create the insurance based NFT. It is not a problem for a small set of vehicles where we can use csv to json conversion using open source libraries like phpexcel in ethercalc but problematic for larger number of vehicles. At this juncture, the insurance providers have to manually connect their wallet, create the insurance claim NFT.

Accomplishments that we're proud of

A greater and more seamless flow of information within a transportation infrastructure, created by electronic incident record management service (E.I.R.M.S), encompasses and leverages digital progress and can transform the way road safety can be delivered and efforts sustained.

E.I.R.M.S helps in improved coordination. E.I.R.M.S helps in making road safety ecosystem proactive and authentic. E.I.R.M.S with the help of computer aided detection will help in early prediction and prevention of incidents.

What we learned

Automated Workflow for decentralized voting for service providers and DAOs:

Vehicle DAOs create a RFP for providing service or maintenance on the dapp. Vehicle drivers can join a RFP by minting an NFT of that RFP. This NFT is created on FVM. Vehicle drivers that have a certain RFP's NFT are eligible to create proposals and vote on them. Voting is gasless and the vote is stored on IPFS and Filecoin with the most recent vote linking to one before.

What's next for DID Transport DAO

We still need to focus on key performance indicators like throughput and measure the performance of our smart contracts before moving to mainnet. We plan to utilize OSS tools for measuring and benchmarking our smart contracts and unit tests on a variety of key parameters like throughput, latency. We also wish to test our solution using AWS templates on compliance and security. We need to spend quality time learning analytics, prediction methods and utilizing and developing open source datasets.

Built With

Share this project:

Updates