Practical Text Analytics using spaCy v3.0
Published 10/2024
Duration: 2h | .MP4 1280×720, 30 fps(r) | AAC, 44100 Hz, 2ch | 1.15 GB
How to extract information WITHOUT building custom Machine Learning models
What you’ll learn
Understand the spaCy document object
How spaCy pipelines work
How to use Rule based Matching for Information Extraction
A system for practical, iterative Text Analytics using the itables library
Requirements
Intermediate Knowledge of Python programming
Basic knowledge of the pandas dataframe library
Description
What is text analytics?
complex software rules
and
machine learning algorithms
." [Source: Lexalytics website]
In spaCy, you can use machine learning algorithms in two ways
1) pretrained models provided by spaCy and other organizations – for example the en_core_web_md, which I use in this course, is a
pretrained
model provided by Explosion, the company which created spaCy
2) custom machine learning models that you train on your data – which is often referred to in the documentation as "statistical models"
Why not statistical models?
This is what the makers of spaCy say in their documentation:
Training a model is useful if you have some examples and you want your system to be able to
generalize
based on those examples. It works especially well if there are clues in the
local context
. For instance, if you’re trying to detect person or company names, your application may benefit from a statistical named entity recognition model.
Rule-based systems are a good choice if there’s a more or less
finite number
of examples that you want to find in the data, or if there’s a very
clear, structured pattern
you can express with token rules or regular expressions. For instance, country names, IP addresses or URLs are things you might be able to handle well with a purely rule-based approach."
in fact I use only one dataset in this entire course
so it is a lot easier for the students to make this distinction.
When you combine a rules based system with the data visualization technique I describe in this course, you will also gain a very good understanding of your dataset. You can then use this understanding to improve your statistical model if you choose to build one.
In my view, most people barely scratch the surface when it comes to using spaCy rules for text analytics. I hope this course will provide them a lot of new insight into how to approach this task.
Who this course is for:
Data Science practitioners who want to use spaCy and Natural Language Processing
Anyone who has a spreadsheet where one of the columns is a paragraph of text and wants to know how to extract useful information from that text to use with the filters you can apply on the OTHER columns (sort, less than, greater than etc) in spreadsheet tools like Excel and Airtable
