-
-
Onion Trove
-
Keyword Generation: In order to dork and to obtain darkweb links
-
Dorker: Uses keywords and special functions to discover onion links from the internet
-
Onion” Link Scraper: Scrapes dorked sites inorder to harvest onion Links.
-
Onion site Scraper: Specially Configured Scaper which scrapes darkweb links.
-
EXIF Extractor: This tool is to gather intelligence data from image by scanning Metadata which include place coordinates,date & time taken.
-
Report Generation: All the data will be aggreated and generate sophisticated report.
Inspiration
The rise of illicit activities flourishing within the dark web's anonymity sparked the creation of Onion Trove. By leveraging advanced technologies like AI and data scraping, Onion Trove seeks to extract, analyze, and generate comprehensive reports on information found on dark web sites. This can equip investigators with valuable insights to combat and dismantle these illegal activities
What it does
We built "Onion Trove", an innovative solution to address the challenge by investigation agencies. Onion Trove could able to Aggregate, Analyse, and Monitor Dark Web sites autonomously. It provides a detailed and actionable report for intelligence agencies that helps to track down criminals on the Dark Web.
How we built it
Our problem statement is to build a Darkweb Monitoring tool. So we have come up with the project “Onion Trove”.
The main objective of the Onion Trove project is to create a sophisticated tool that empowers investigation agencies to extract, analyze, and generate actionable intelligence reports from dark websites. The tool utilizes AI and other technologies to provide a comprehensive solution for the problem statement.
Our application could be able to collect Dark Web Links by using Dorking and scraping from a clear net. Also, our application could extract links from the Proprietary Database when it is Imported.
Using Generative AI, our application will be able to analyze the dark web site and generate a description of the site, categorize the site, do more with images present in the site, harvest contact details present in the site, and it could generate a deep and sophisticated report for individual sites.
Using Image Enhancing Algorithms, the image will be enhanced to make it clear and suitable for OCR Engines. Using OCR, the text present in the image will be automatically extracted and added to the report.
Using EXIF data from the image, the image metadata will also be extracted which would provide a great insight.
All data collected will be aggregated and a sophisticated report will be generated for individual sites.
Challenges we ran into
The Dark Web is a vast and constantly changing network of illegal sites and search engine tools, including .onion domains, which require special browsers like TOR, TAILS, and Freenet.
These domains are difficult to navigate, change frequently, and use complex encryption methods. Traditional search engines do not index the Dark Web, making it difficult to monitor and analyze. Search tools like Katana, Onion Search, Ahmia, and Darksearch work differently than standard ones like Google or Bing due to their algorithms, scanning sites, and results.
Monitoring the Dark Web requires deep understanding, advanced technical skills, and continuous learning. Expectations for these tools include crawling and searching for keywords.
Accomplishments that we're proud of
Our accomplishment lies in creating a solution that enhances online security and aids in combating illicit activities
• Provides comprehensive insights to investigative agencies.
• Offers automated and detailed reports, saving time and resources.
• Uses a sophisticated search engine for quick information retrieval.
• Stores and retrieves historical data for trend analysis and detection of emerging trends.
• Provides real-time notifications and monitoring of ongoing dark web activities.
• Offers Live Tor Relay Data & Map for real-time information on Tor network status.
• Aggregates dark web news using a centralized feed.
• Won 1st prize in Rajasthan Police Hackathon 1.0, a 36-hour hackathon held in Rajasthan, Jaipur.
What we learned
The "Onion Trove" project provided valuable insights into dark web navigation, AI integration, and cybersecurity challenges, emphasizing the importance of multidisciplinary teamwork in overcoming complex technical hurdles and enhancing our understanding of the dark web.
What's next for Onion Trove
Future iterations of Onion Trove will delve deeper, aiming to identify and track sellers across various dark web platforms like chat rooms and marketplaces. This involves expanding the tool's crawling scope and refining data gathering to capture seller information and activity. Additionally, exploring innovative tracking methods might allow monitoring of seller movement over time.
This is for Demonstration further development will be done soon. (Use Mozilla Firefox for better visuality) (https://oniontrove.techmedok.com/login)
Username : nk
Password : nk
📢 Project Explanation and Demo: https://youtu.be/t6h7mDrMrF8
⚠️Project Demo Starts at 2:06
Sample Demo Report: (For illustrative purposes only. Subject to change as the project is under development and more parameters will be added)
Built With
- ai
- coingico
- flask
- html5
- hugging-chat
- javascript
- python
- selenium
- sql
- tailwind
- virustotal
Log in or sign up for Devpost to join the conversation.