Use Natural Language Processing

• 

Inspiration

Major League Hacking is my inspiration.

What it does

It uses Natural Language processing to determining whether a website is of Kali Linux.

How we built it

I built it using Natural Language Processing and Python.

---

import nltk

from nltk.corpus import stopwords

import urllib.request

from bs4 import BeautifulSoup

response = urllib.request.urlopen('https://www.kali.org/blog/')

html = response.read()

soup = BeautifulSoup(html,'html5lib')

text = soup.get_text(strip = True)

tokens = [t for t in text.split()]

print(tokens)

sr= stopwords.words('english')

clean_tokens = tokens[:]

for token in tokens:

if token in stopwords.words('english'):

        clean_tokens.remove(token)

freq = nltk.FreqDist(clean_tokens)

for key,val in freq.items():

       print(str(key) + ':' + str(val))

freq.plot(20, cumulative=False)

Challenges we ran into

It was a fun challenge.

Accomplishments that we're proud of

I am proud of taking this challenge.

What we learned

I learned Natural language Processing.

What's next for Use Natural Language Processing

I will use to build more projects.

Built With

• natural-language-processing
• python