Research Notebooks

Open this research notebook -> Description: This notebook demonstrates how to do topic modeling. The following processes are described: Using the tdm_client to retrieve a dataset Filtering based on a pre-processed ID list Filtering based on a stop words list Cleaning the tokens in the dataset Creating a

Open This Research Notebook -> Take me to the Learning Version of this notebook -> Description: Discover the significant words in a corpus using Gensim TF-IDF. The following code is included: Filtering based on a pre-processed ID list Filtering based on a stop words list Token cleaning Computing

Open this Research Notebook ->.ipynb Take me to the Learning Version of this notebook -> Description: This notebook creates a stopwords list and exports it into a CSV file. The following processes are described: Loading the NLTK stopwords list Modifying the stopwords list in Python Saving a

Open this Research Notebook -> Take me to the Learning Version of this notebook -> Description of methods in this notebook: This notebook helps researchers generate a list of IDs and export them into a CSV file. The code below is a starting point for: Importing a CSV

Open this Research Notebook -> Take me to the Learning Version of this notebook -> Description: This notebook finds the word frequencies for a dataset. Optionally, this notebook can take the following inputs: Filtering based on a pre-processed ID list Filtering based on a stop words list Use

Open this Research Notebook -> Description: This notebook takes as input: Plain text files (.txt) in a zipped folder called 'texts' in the data folder Metadata CSV file called 'metadata.csv' in the data folder (optional) and outputs a single JSON-L file containing the unigrams, bigrams, trigrams, full-text, and

Open this Research Notebook -> Description: You may have text files and metadata that you want to tokenize into ngrams with Python. This notebook tokenizes This notebook takes as input: Plain text files (.txt) in a folder A metadata CSV file called 'metadata.csv' and outputs a single JSON-L