ML Natural Language Processing Snap Pack Examples

Identify the common words in a dataset

This example pipeline demonstrates how to calculate the frequency of common words appearing in a dataset of tokenized sentences.

• JSON Generator
• Mapper
• File Reader
• JSON Parser
• Bag of Words

Calculate common word frequency

This example pipeline demonstrates how to calculate the frequency of the most common words in a dataset using the Tokenizer and Bag of Words Snaps.

• File Reader
• JSON Parser
• Tokenizer
• Common Words

Tokenize text data

This example pipeline demonstrates how to convert sentences into an array of tokens, which can be further used in other ML NLP Snaps.

• CSV Generator
• Tokenizer