Classification and Segmentation for 3D points cloud

• 

  our group point conv set abstraction layer

Inspiration

The point convolution (PointConv) model (Wenxuan Wu, 2018) used to classify 3D points cloud has low accuracy when predicting rotated objects. For example, PointConv can classify the chair but it will predict a rotated chair as a stair. This problem is called the rotation equivariant problem and we are proposing a method to solve this.

What it does

Our model classifies 3D points cloud objects and segments 3D rooms. In addition, our model can solve rotation equivariant problems for 3D points cloud. The model reaches higher accuracy on the rotated dataset compared to PointConv.

How we built it

We followed the set abstraction layer in PointConv to propose a new set of abstraction layers called the group set abstraction layer (GpointconvSA). In our GpointconvSA, we used the G24 rotation subgroup to act on coordinates of all the points, which made a rotation equivariant model. Then, we used Pytorch to build a model with Python, and Flask to deploy our model.

Challenges we ran into

Building model and scarcity of facilities such as GPUs and servers to train the model. We also had difficulties in deploying the model to production because of the space complexity.

Accomplishments that we're proud of

We successfully built an AI model and improved the accuracy for point convolution on rotated 3D objects on classification and segmentation on Modelnet40.

What we learned

We learned how to improve other's work from reading their research paper and implemented an AI model. We also learned to deploy our model using Flask and other frameworks. In addition, we learned how to do research in a team and have a clear-cut destination for the future.

What's next for G-Pointconv CNN for 3D points cloud

The potential of 3D data emerges day by day, and there are a lot of tools to capture 3D objects such as Lidar and 3D cameras. The applications of 3D objects are increasing in manufacture, fashion, game industry, and self-driving industry. We want to improve this model to generate real 3D objects from the 3D points cloud and utilize the potential of the 3D points cloud to contribute to the AI industry.

Built With

• css3
• flask
• html5
• javascript
• python
• pytorch