Downloaded 60 times
Uploaded byAlberts Pumpurs
Python NLTK
NLTK is a leading platform for building Python programs to analyze human language data. It provides tools for tasks like tokenization, part-of-speech tagging, parsing, classification, and more. As the amount of unstructured data grows exponentially, tools like NLTK help organizations analyze text data from sources like emails, reviews, social media to discover hidden patterns and insights. NLTK features include preprocessing texts, classifying documents, clustering texts, and extracting keywords to help understand large amounts of complex unstructured data.
Python NLTK
- 1.
- 2. 90% of world'sdata generated over last two years
- 3.
- 4.
- 5. World is fullof unstructured, text-rich data. Everything from emails to customer tweets. The information buried in all that text holds the potential to deliver valuable business insights
- 6. Text analytics isthe practice of using technology to gather, store and mine textual information for hidden signals that can be used to inform smarter business decisions
- 7.
- 8. Many types oforganizations are experiencing explosive growth in their unstructured enterprise data. Same time that they have access to external sources of data such as social media, blogs, and mobile data.
- 9. Until now, muchof this information passed through the organization virtually unanalyzed. Today, new tools for handling large amounts of complex data makes it easier to squeeze value from such unlikely sources.
- 10.
- 11. sentiment analysis spam filtering textcategorization topic detection keyword frequency plagiatism detection document similarity phrase extraction
- 12. Natural Language Tool Kit leadingplatform for building Python programs to work with human language data
- 13.
- 14. sentence and wordtokenization text calsification corpora parsing clustring part of speach tagging text stemming and mutch more..
- 15.
- 16.
- 17.
- 18. Part of speech taggingexplanation CC Coordinating conjunctin CD Cardinal Number DT Determiner EX Existing “ there“ FW Foreign word IN Preposition or subordination conjuction JJ Adjective JJR Adjective- comparative JJS Adjective- superlative LS List item marker MD Modal NN Noun- singular or mass NNS Non-Plural NP Proper noun- singular nltk.help.upenn_tagset() //all tag sets
- 19.
- 20. Text clasification Algorithms in NLTK Naive Bayes MaximumEntropy Decision Tree
- 21.
- 22.
- 23. Document similarity detection Tf-idf standsfor term frequency-inverse document frequency, and the tf-idf weight is a weight often used in information retrieval and text mining. This weight is a statistical measure used to evaluate how important a word is to a document in a collection or corpus.
- 24.
- 25.
- 27. “Market and productreserch” “Social CMS” 1.97 b social network users “Costumer profiling / analytics” 70% of marketers used Facebook to gain 6.7 million people blog on blogging sites
- 28. pumpurs.alberts@gmail.com Big Data, Startups,Text Analysis, Internet of Things, Web Development