Parsing of Social Media Feeds

Diagram
code

Here's the project story formatted in Markdown:

Inspiration

The need for efficiency and accuracy in forensic investigations inspired this project. Social media holds valuable information, but manual data collection is slow and prone to errors. We aimed to create a tool that could streamline this process, helping investigators gather essential evidence from social media with greater speed and precision.

What it does

Our tool automates the extraction and documentation of social media data from platforms like Facebook, Instagram, and Twitter. It retrieves posts, messages, friend lists, and more, organizing them into detailed reports with screenshots for visual context. Additionally, it leverages AI for behavior analysis, identifying unusual patterns to assist in investigations.

How we built it

We built this project using:

Data Access: APIs (e.g., Facebook Graph API, Twitter API) with OAuth 2.0 for secure access.
Automation Frameworks: Selenium for web scraping and Appium for mobile access.
Data Processing and Analysis: Python, Java, and AI algorithms such as LSTM for time series analysis and Isolation Forest for anomaly detection.
Reporting: Automated generation of PDF reports, including screenshots.
User Interface: Windows and Android support, allowing access to data across devices.

Challenges we ran into

Key challenges included:

API Rate Limits: Managing data retrieval rates while avoiding restrictions from social media platforms.
Dynamic Authentication Protocols: Adapting to frequent changes in platform authentication.
Data Privacy: Ensuring compliance with terms of service, encrypting data, and implementing secure access controls.

Accomplishments that we're proud of

We’re proud of the robust multi-platform support we achieved, allowing seamless data access on both desktop and mobile devices. We also successfully implemented AI-powered behavior analysis, adding a layer of insight that’s both innovative and highly beneficial for investigations.

What we learned

Through this project, we gained valuable experience in API integration, secure data handling, and AI-driven analysis. We learned to navigate the complexities of authentication, privacy requirements, and developed skills in balancing automation with ethical data practices.

What's next for Parsing of Social Media Feeds

Future plans include enhancing AI capabilities to provide predictive insights, expanding platform support, and refining the user interface for better usability. We also plan to implement more data visualization tools, aiding investigators in quickly spotting patterns and anomalies.