Self-containing notebooks to play simply with some particular concepts in Deep Learning
- Updated
Mar 3, 2025 - Jupyter Notebook
Self-containing notebooks to play simply with some particular concepts in Deep Learning
This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
This repository contains introductory notebooks for text mining and web scrapping.
Natural Language Precessing related notebooks (Machine Learning)
Jupyter notebooks on Natural Language Processing.
Embark on your NLP journey by learning essential techniques through a series of notebooks designed to kickstart your career in this field.
The project is a simple sentiment analysis using NLP. The project in written in python with Jupyter notebook. It shows how to do text preprocessing (removing of bad words, stop words, lemmatization, tokenization). It further shows how to save a trained model, and use the model in a real life suitation. The machine learning model used here is k-N…
In this notebook everything is done from data preprocessing to encoding
Jupyter Notebook based project that perform word-weighting and data visualization with python
This is a notebook containing a customized model for recommending what questions are best.
Extract text content from an HTML page, process it, and extract unique words from the processed text. This notebook utilizes various text processing techniques including cleaning, normalization, tokenization, lemmatization or stemming, and stop words removal.
This Jupyter notebook is an interactive tool for processing natural language text. It segments text into sentences, performs word tokenization, counts word frequencies, timestamps each entry, and saves the results in JSON format. Ideal for NLP studies and text analysis
Add a description, image, and links to the tokenization topic page so that developers can more easily learn about it.
To associate your repository with the tokenization topic, visit your repo's landing page and select "manage topics."