Insight

Making NLP accessible and also demonstrating what value can be derived from it.

This is NLP as a Service.

Natural Language Processing is being used more and more in enterprise to extract information from unstructured data. With the advent of Language Models and Transfer Learning in domain of NLP this use has only accelerated.

However, it is still very niche and extremely specialized knowledge to design, train and deploy a NLP based solution by leveraging these Language Models specially the Transformers architecture based solutions.

My solution is designed to work around this challenge. Using my application and the back-end API service, the user can get inference using fine-tuned models which work at a high level of accuracy.

The solution is designed in a modular way such that the API service and the GUI can be expanded for further downstream NLP tasks, by adding language models and related files for the specific NLP task.

The solution is build using 2 different aspects:

1. Transformers and Deep Learning for NLP. Fine Tuning Language models using Pytorch for specific NLP task.
2. An API service and User Interface: To interact with these NLP models to get inference for the various tasks.

Built With

• fastapi
• python
• pytorch
• streamlit