Decentralized Twitter like Health platform using Blockchain
Question on Medical Advice asked by the user
Open source Orthanc Radiology PACS
Genome understanding using GenomeLink API enables diet and health
Genome understanding using GenomeLink API enables diet and health
Information sheet of Medical Counselor app built using ionic framework
Test sheet of Medical Counselor app built using ionic framework
Decentralized Twitter like health portal application using Blockchain
Prescription sheet of Medical Counselor app built using ionic framework

Inspiration

We got our inspiration to develop Medi Assist from SAP, Bengaluru, Mobile Swasthya, Sugar Labs and One Laptop Per Child, where we served in multiple capacities. Sugar Labs and One Laptop Per Child (OLPC) are organizations dedicated to create educational opportunities for the world's poorest children by providing each child with a rugged, low-cost, low-power, connected laptop (XO) with content and software designed for collaborative, joyful, self-empowered learning. As community engineers associated with this unique proposition, we have constantly evolved our skills to align ourselves with the mission statement and develop tools for educational and health purposes.

What it does

Medi Assist: Medical Counselor for Preventive Treatment, Remediation. Health and nutrition counseling and prevention from hospital acquired infections, preventive treatment and remediation over TBD, DID, Trinsic, Ontology, Chainlink blockchain, AWS, ethereum blockchain, Flow network using a decentralized Twitter application, Embark tools, Near & Theta, Dot blockchain, GenomeLink APIs for better understanding the genetic framework of the person.

Website: https://medi-assist.vercel.app/

Features:

Just in Time service Availability of patient’s medical records, genome data across different stakeholder through secure DID, Trinsic, Ontology, Chainlink VRF, XRPL and Chainlink services, and AWS cloud.

Record Management Quality documentation reduces the issues regarding prescription of incorrect medicines. Ability to plan food and nutrition using AWS Comprehend, GenomeLink API, EHR's medical report, UCSC genome browser sequence and annotations (https://github.com/awslabs/open-data-registry/blob/main/datasets/ucsc-genome-browser.yaml), statistics on air quality mapped with chest X Rays using ASDI OpenAQ (https://github.com/awslabs/open-data-registry/blob/main/datasets/openaq.yaml) and Orthanc PACS system, medical data for better healthcare delivery can be devised and implemented.

Research Research laboratories can use the data for computer-aided diagnosis of diseases, suggesting personalized care to patients. Further, food and nutrition methods could be researched and devised for speedy recovery of the patient and prevention of diseases in patients' life after successful treatment.

Web Application Cloud-based web application with OpenTok APis, a material design application linking to GenomeLink API, AWS Comprehend, UCSC genome browser sequence and annotations (https://github.com/awslabs/open-data-registry/blob/main/datasets/ucsc-genome-browser.yaml), ASDI OpenAQ (https://github.com/awslabs/open-data-registry/blob/main/datasets/openaq.yaml) and for quick medical attention.

Transparency Insurance agencies can utilize the data to provide customized health insurance plans to the customer. Personal dietary consultants can provide better food and nutrition plans for the speedy recovery of patients.

Better Cure Journal of medical records covering complete patient history and Genome data using GenomeLink API and weather conditions mapped to chest X Rays using ASDI OpenAQ (https://github.com/awslabs/open-data-registry/blob/main/datasets/openaq.yaml) to improve the cure outcomes.

Value Proposition:

Data Transparency : Availability of patient’s medical counseling records across different stakeholder through secure TBD, DID, Trinsic, Ontology and Chainlink blockchain, Ethereum and Near blockchain network. The platform utilizes TBD, DID, Trinsic, Ontology blockchain, sub-chain, Ethereum and Near blockchain, IPFS via NFT.Storage, Nucypher i.e. patients and organizations who place their data on the exchange will be able to control which consortium entities have permission to access information.

Data Uniformity : Data is processed to make it uniform and stored in PACS (Picture Archiving Communication System) so that it can be utilized by different stakeholders on verified request. Also records are encrypted to avoid any tampering of the data over course of time.

Data Analytics : With the help of computer aided detection and machine learning algorithms, data can be further used for analysis and early prediction.

A greater and more seamless flow of information within a digital health care infrastructure, created by electronic health records (EHRs), encompasses and leverages digital progress and can transform the way care is delivered and compensated. EHRs helps in improved care coordination. EHRs helps in making health care ecosystem proactive, accessible and authentic. EHRs with the help of computer aided detection will help in early prediction of diseases.

Please visit Vercel deployment link at Vercel deployment: https://medi-assist.vercel.app/ and demos at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Project and Initiative Pitch Deck: https://docs.google.com/presentation/d/1yQLsPlpd1UKhl4bUwKVlyy05bk41UDJW/edit#slide=id.p1

How we built it

We have developed the decentralized twitter application using Ethereum Blockchain framework along with TBD, DID, Trinsic, Ontology and Chainlink blockchain, AWS Comprehend APIs, ASDI UCSC genome browser sequence and annotations (https://github.com/awslabs/open-data-registry/blob/main/datasets/ucsc-genome-browser.yaml) Near and TBD, DID, Trinsic, Ontology protocol, node.js framework, nvm, Embark tools.

TBD, DID, Trinsic, Ontology,, Chainlink blockchain and DID for asset management, automation in Medi Assist: We are utilizing TBD, DID, Trinsic, Ontology, Chainlink blockchain, DID for asset management, automation and reducing transaction costs with TBD, DID, Trinsic, Ontology in Medi Assist. This is especially useful for enabling medical eco-system comprising of patients, doctors, counselors, TPAs & insurers, pharma and R&D organizations.

Feature implementation of TBD, DID, Trinsic, Ontology, Chainlink Blockchain with DID for Asset Management, Automation: Account creation, Asset transfer, asset management, Creation and management of Escrows, with support for conditions, Creation and management of Checks, Creation and management of Offers, Token creation and management, NFT creation and management.

TBD, DID, Trinsic, Ontology, Chainlink Services and Near's medical practice license NFT registration module is to enable users to register their practioner licenses as well as their clinic registration details in a decentralized manner using Theta and Near blockchain. An individual can be identified by his/her SSN and a clinic by Clinic Registry Number both of which for now are integers between 0 and 65535 (16 bit integers). Every SSN or individual is associated to an address of an individual Near account. We are developing our own NFT smart contract from the ground up following Near's NEP-171 standard and the key tutorial shared at the Near github website. We are also logging the identities of the medical practice license owners (doctors), their clinic ids using exchange of unique identifiers powered by Near blockchain protocol.

TBD, DID, Trinsic, Ontology Blockchain Implementation Modules:

TBD, DID, Trinsic, Ontology User Analytics for tabulation, organization and validation

TBD, DID, Trinsic, Ontology User Security for doctors and patients

TBD, DID, Trinsic, Ontology Medication Log dapp module

AWS: Unstructured clinical text such as physicians notes, discharge summaries, test results, and case notes can be derived using AWS Comprehend. Amazon Comprehend Medical uses natural language processing (NLP) models to detect entities, which are textual references to medical information such as medical conditions, medications, or Protected Health Information (PHI).

AWS Web Module: Web Application Cloud-based web application with OpenTok APis, a material design application linking to GenomeLink API, AWS Comprehend, UCSC genome browser sequence and annotations (https://github.com/awslabs/open-data-registry/blob/main/datasets/ucsc-genome-browser.yaml), ASDI OpenAQ (https://github.com/awslabs/open-data-registry/blob/main/datasets/openaq.yaml) and for quick medical attention.

TBD, DID, Trinsic, Ontology, Polygon ID Web3 Eco-system, Ink Smart Contract Tools and Modules

TBD - TBD Analytics and Visualization Tool: https://github.com/aspiringsecurity/Medical-Counselor/tree/main/Medical-Radiology-Data-transparency/dot-analytics%20tooling Please visit demo at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Trinsic Dapp suite and Subsocial Plugins: Medical Invoice, Medical Suite and Dose Schedule, Medication Log: please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/dapp_suite Please visit demo at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Ontology WASM smart contract for decentralized Medical Counseling: We are developing smart contracts in wasm ink for decentralized Medical Counseling, deploying on Shibuya, extending UI interaction with astar.js. Please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/Medical-Radiology-Data-transparency/wasm-medical-dao Demo available at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Ink NFT viewer for viewing the NFTs of NFC tags of medical devices and medical service personnel: We are extending the Ink NFT viewer dapp for viewing the NFTs generated for the NFC tags of medical devices and service repair personnel. Please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/Medical-Radiology-Data-transparency/ink-nft-viewer Demo link: https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Chainlink, DID and TBD Blockchain with Lens Protocol for off-chain, on-chain data analytics, Magic SDK for Medication Log dapp

Chainlink, DID, TBD and lens User Analytics for tabulation, organization and validation
Chainlink, TBD and lens User Security for doctors and patients
Chainlink, DID and Magic SDK Medication Log dapp module
Please visit demos at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

## DID, TBD and Visa B2B infrastructure

We are utilizing TBD, DID, Chainlink VRF and Visa B2B infrastructure as follows:

Medical Counselling Bill Generation: We are utilizing Chainlink Mix to work with Chainlink smart contracts. The bill script will deploy a smart contract to goerli and get a Random number via Chainlink VRF, which can used to identify a unique transaction/order number for the medical consulting bill and payments using Visa B2B infrastructure.
Parametric Insurance Solution for patients with special needs and payment using Visa B2B infrastructure. We are utilizing an existing example at chainlink github repo to develop an insurance solution for patients. Link: https://github.com/aspiringsecurity/Medical-Counselor/tree/main/Audit-Module
Interoperability with Visa Payment infrastructure, Ethereum and Filecoin eco-system.

Please visit demos at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

TBD, Optimism, Ethereum, Embark, IPFS and Filecoin

Medical Counseling, preventive treatment and remediation portal using TBD, IPFS and Filecoin, Ethereum, Optimism and Embark via decentralized Twitter like chat and messaging application.

Web5 Eco-system Tools

TBD and XDC blockchain network: We are using XDC blockchain network to enable borrowing of XDC funds using collaterals for medical counseling and preventive treatment by patients with weaker economic conditions.
Covalent End Point: Covalent-NFT-Dashboard enables us to analyze, observe all NFTs from wallet address in different networks.
TBD, Theta Sub-Chain implementation under the MetaChain Architecture

Trinsic and Ontology Blockchain

Signature workflow in Medical Documents using Trinsic, Ontology Blockchain, Biconomy, Open Text API: We are building a docusign type workflow for medical documents powered by Vue.js, flask, Trinsic, Ontology Blockchain, Biconomy, Open Text API. We are extending the core signature demo workflow solution. Please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/dapp_suite/signature-workflow-opentext-api and demo video at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG (Demo 1 and 3).

Contract Approval Workflow Application for Medical Counselor using Trinsic, Ontology: We are developing a contract approval application for Medical Counselors using Onyx Blockchain, Biconomy, OpenText Cloud Platform. We are consuming IM services from the OpenText Cloud Platform and extending the demo example. Please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/dapp_suite/demo-contract-approval-medical-counselor and demo video at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG (Demo 1 and 3)

Trinsic, Ontology and OCT SSO workflow: REST service calls required to login to OCP and access information management services (IMS) from OpenText. Please visit https://github.com/aspiringsecurity/Medical-Counselor/tree/main/dapp_suite/OCP-sso-workflow-analytics and demo video at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG (Demo 2)

DID Wallet Module

DID Wallet, zksync Era Paymasters and Ledger

DID Wallet and Ledger for for asset management, zksync Era Paymasters, automation in Medi Assist

We are utilizing DID Wallet, zksync Era Paymasters and Ledger for asset management, automation and reducing transaction costs with zksync in Medi Assist. This is especially useful for enabling medical eco-system comprising of patients, doctors, counselors, TPAs & insurers, pharma and R&D organizations.

Website for End Users, Civic Bodies: https://sites.google.com/view/zksync-medical-dao/home

DID, Vercel deployment: https://medi-assist.vercel.app/

Features:

Account creation;

ZK Asset transfer at no costs;

Security and asset management;

Creation and management of Escrows, with support for conditions;

Creation and management of Checks;

Creation and management of Offers;

Token creation and management;

NFT creation and management.

Demos and Vercel deployment link:

Please visit Vercel deployment link at Vercel deployment: https://medi-assist.vercel.app/ and demos at https://drive.google.com/drive/u/3/folders/12XyhbqvGHfTZPl_zbc9fO_rJUNvmIQHG

Project and Company Pitch Deck: https://docs.google.com/presentation/d/1yQLsPlpd1UKhl4bUwKVlyy05bk41UDJW/edit#slide=id.p1

Challenges we ran into

There were few challenges related to integration with DID wallet and secure verification related to ownership of wallet on the backend which was tricky but DID dev discord server was full of people willing to help with that.

We have been interested in building a health counseling, preventive treatment and remediation portal. We attended the first day workshop at EthIndia by Andy Tudhope, where he shared a decentralized twitter application and the utilization of Embark tools. We arrived at an idea that we could extend, adapt and utilize the example shared by Andy for building the portal using Ethereum blockchain network, IPFS for storage and Embark tools. We were able to follow the instructions with the help of Andy and fellow hacker friends at the ETHIndia. However, when we completed the entire exercise of building the portal, Embark didn’t run. We got key pointers on fixing it from Andy. We realized that Embark tools currently run at a specific version of nvm and were able to fix the issue. We felt elated and were able to resolve the issue just in time. This gave us immense confidence on completing the remaining parts of the solution and also strengthened our mission in extending, adapting and building on top of existing tools and solutions using quality mentorship and perseverance.

We also wish to mention that integrating and sending medical reports using NuCypher protocol required lot of mentorship from Bogdan Opanchuk and Dr. Michael from NuCypher. They helped us at every step of implementing NuCypher whether it was installing the correct versions of requisite libraries and tools and helping us running the re-encryption protocol. Finally, we wish to thank the EthIndia community and fellow participant hackers, who helped us learn and implement our idea in a fine way :)

Accomplishments that we're proud of

Ability to use decentralized TBD, DID, Trinsic, Ontology, Chainlink Blockchain technology like blockchain for ensuring that the data is secure and not tampered with.
Ability to learn and understand from GenomeLink API a variety of key perspectives for better delivery of nutrition and care.
Ability to ensure that the counseling is managed such that privacy of the individual is not harmed.
Improved transparency of data movement and consultancy between the doctor/nutrient consultant and patient/person.

What we learned

Our counseling platform is useful only to the extent it is used by the healthcare community. Thus, we are working with healthcare enthusiasts, educators around the world to focus on these learning challenges:

To make our counseling platform freely and readily available to users, healthcare providers, consultants everywhere.
To explore and share best practices
To provide a forum for discussion and support for technology for discussion around food and dietary requirements.
To provide mechanism for evaluation and dissemination of results.
To strengthen the efforts in utilizing GenomeLink API more effectively.

We can utilize SocialCalc, Machine Learning Models coupled with decentralized TBD, DID, Trinsic, Ontology, Chainlink, NFT.Storage, network tools, Near blockchain and ethereum based infrastructure tools for analysis and prediction of diseases to provide early stage detection and prevention of medical compliance issues. We also witnessed the great eco-system available to developers to learn and contribute in the Ethereum, TBD, DID, Trinsic, Ontology, Chainlink blockchain and Near blockchain eco-system.

What's next for Medi Assist

Community Engagement

We are here to support community innovation, entrepreneurship, and enterprise. We would like to help community members start health counseling projects that help sustain and grow the technology solution and healthcare communities:

To provide local and regional technical and pedagogical support.
To create new engagement activities and pedagogical practice.
To provide localization and internationalization of software, content, and documentation.
To provide integration and customization services.

We are evolving the solution in the following phases:

PHASE I – Requirements Analysis and Design (1 months)

Demonstrate the solution using spreadsheet and PACS software on cloud connected devices, Android phones, iPhones, first generation tablets. Procuring server hosting for storing and utilizing images and associated video data to prove that real time monitoring is viable. Set up timeline for planning the 2024 winter deployments and user training session Participate in community events organized by the incubator.

PHASE II (winter deployments and user training session) (8 months) -Create PoC based on designed specification. Complete the design of web interface.

Initial user testing, and POC refinement -Prototype Release- Start the pilot trials with 2-3 vendors. -Prototype Manufacturing at the Vendors location. -Prototype validation and assembly: Final Prototype assembly and validation; Refinements based on the mechanical prototype; Final Engineering CAD release. Manage and provide the hands-on task of exporting images and video reports from the customer to SEETA medical cloud system. Create and deploy a gateway service in the customer geo-location that will enable the continuing export of images and video reports to the SEETA medical cloud system. Completion of supporting collateral required to fulfil services and deliverables such as the equipment, supplies and other open source software tools. Continue the collection, data organization and management of images and associated video report data to improve computer aided detection using deep learning algorithms and integrate them with the platform. Survey on community’s needs, user interaction, selection of vendors and quality diagnostic centers where we could deploy full-scale pilot, possibly focused on mobile-platform organize a hardware agnostic program Enable pilot users to be developers of web based platform and contribute in improving the existing deep learning algorithms using websites like Kaggle. Focus on making the platform interoperable with a variety of vendor systems in different housing societies.

PHASE III (6 months)

Winter 2023-2024 deployment in hospitals, diagnostic labs, clinics, pharma companies and drug design and development institutions.