Inspiration

As a fan of machine learning and deep learning, I like the fact that the CORTX project aims to solve the challenge of storing and accessing large amounts of data. This is a problem that is common in the Machine Learning and Deep Learning space.

What it does

My project is a Pytorch Integration for CORTX. It demonstrates a workflow that uses CORTX as a backing store for storing a dataset. We also built a Dataloader that uses CORTX buckets to store per class data. The integration eases the machine learning workflow so that you can train a deep learning model by just supplying the access information for your CORTX instance as well as the list of bucket names that contain your per-class data

Challenges we ran into

A couple of challenges with the CORTX instance on CloudShare but all were fixed by communicating on the Slack channel.

Built With

Share this project:

Updates