Chapter 3
Improving Quality and Quantity of Training Data
When is noise in your data a good thing? When it accurately reflects real-world conditions.
For speech and voice applications, typical existing large data sets will be recorded in ways that differ from real application scenarios. If your application is supposed to recognize a spoken trigger word, then it needs to cope with poor microphones, specific types of reverberation, and background noise.
These and other effects can be added artificially to grow a training data set using established signal processing methods and domain-specific applications through:
- Data augmentation
- Data synthesis
Signals can be difficult to measure consistently or observe to build a large data set; this chapter looks at techniques to create more training data. Data synthesis can help create new signals from models or simulations, and data augmentation is a specific type of data synthesis that creates new variations of your existing data.
First, a brief overview of how deep learning works with signal data.
Data Augmentation
Starting from existing labeled samples, augmentation generates:
- Training data that is similar to your high-quality validation data
- Variations of the available data that the system may encounter in real-world scenarios
Augmentation effects are often domain specific. Common augmentation effects for audio, speech, and acoustic data include stretch time, shift pitch, control volume, and many more.
Kitchen Reverberation
![Kitchen reverberation signals with MATLAB code for augmenting data.](https://uk.mathworks.com/campaigns/offers/next/data-and-modeling-in-ai-powered-signal-processing-applications/improving-quality-and-quantity-of-training-data/_jcr_content/mainParsys/band_2102914970_copy_1262954735/mainParsys/columns_copy_copy_co_1218522089/2490b2fd-4dff-42fc-850d-a9a430696cfd/lockedsubnav/mainParsys/columns/78a831c1-8cbe-4410-9d59-89370ebe8eb6/image.adapt.full.medium.jpg/1723145192828.jpg)
Washing Machine Noise
![Washing machine noise signals with MATLAB code for augmenting data.](https://uk.mathworks.com/campaigns/offers/next/data-and-modeling-in-ai-powered-signal-processing-applications/improving-quality-and-quantity-of-training-data/_jcr_content/mainParsys/band_2102914970_copy_1262954735/mainParsys/columns_copy_copy_co_1218522089/2490b2fd-4dff-42fc-850d-a9a430696cfd/lockedsubnav/mainParsys/columns/2df9c656-75f6-4738-a503-da62eac6074e/image_copy.adapt.full.medium.jpg/1723145192864.jpg)
Synthesis
Data synthesis includes generating training data from scratch using a combination of AI generative models or simulations.
A few examples of domain-specific data synthesis include:
The text2speech
function in MATLAB can help you generate high-quality synthetic voice signals by using cloud-based services by IBM®, Microsoft®, or Google®, including via Google’s well-known WaveNet network.
![MATLAB Central File Exchange entry for the text2speech app from the MathWorks audio toolbox team.](https://uk.mathworks.com/campaigns/offers/next/data-and-modeling-in-ai-powered-signal-processing-applications/improving-quality-and-quantity-of-training-data/_jcr_content/mainParsys/band_2102914970_copy_1262954735/mainParsys/columns_copy_copy_co_1218522089/2490b2fd-4dff-42fc-850d-a9a430696cfd/lockedsubnav/mainParsys/panel_copy_copy_copy/panelParsys/tabs_copy/tabsItems/1feeea7a-3143-4604-8d58-90fbd3f61773/parsys/panel_copy_copy_copy/panelParsys/image_copy.adapt.full.medium.jpg/1723145193083.jpg)
This example shows how to classify pedestrians and bicyclists based on their micro-Doppler characteristics using a deep learning network and time-frequency analysis. The movements of different parts of an object placed in front of a radar produce micro-Doppler signatures that can be used to identify the object.
![Two graphs: one is a plot of bicyclist trajectory, represented in dots forming a person on a bike. The other is a plot of speed on the y-axis versus time on the x-axis.](https://uk.mathworks.com/campaigns/offers/next/data-and-modeling-in-ai-powered-signal-processing-applications/improving-quality-and-quantity-of-training-data/_jcr_content/mainParsys/band_2102914970_copy_1262954735/mainParsys/columns_copy_copy_co_1218522089/2490b2fd-4dff-42fc-850d-a9a430696cfd/lockedsubnav/mainParsys/panel_copy_copy_copy/panelParsys/tabs_copy/tabsItems/ef8fe1ec-aa17-4cd0-9b20-fc362e210b25/parsys/panel_146396297_copy/panelParsys/image.adapt.full.medium.jpg/1723145193184.jpg)
Communication signals are also very difficult to field-record off the air and then label. The WLAN Router Impersonation Detection example simulates realistic signals for RF fingerprinting. With the algorithm in place, you can use data collected from a software-defined radio to train and test the same system using actual data.
![The figure shows three known routers, as well as the observer that collects non-high throughput (non-H T) beacon signals and unknown router data.](https://uk.mathworks.com/campaigns/offers/next/data-and-modeling-in-ai-powered-signal-processing-applications/improving-quality-and-quantity-of-training-data/_jcr_content/mainParsys/band_2102914970_copy_1262954735/mainParsys/columns_copy_copy_co_1218522089/2490b2fd-4dff-42fc-850d-a9a430696cfd/lockedsubnav/mainParsys/panel_copy_copy_copy/panelParsys/tabs_copy/tabsItems/1d9899db-8d29-47dc-8cce-27d6c540be97/parsys/panel_1132386793_cop/panelParsys/image.adapt.full.medium.jpg/1723145193275.jpg)
Test Your Knowledge
Which of these is not a common augmentation effect for audio data?
Incorrect! Flatten tone is the only one that is not a common augmentation effect for audio data.
Correct!
Select a Web Site
Choose a web site to get translated content where available and see local events and offers. Based on your location, we recommend that you select: .
You can also select a web site from the following list
How to Get Best Site Performance
Select the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.
Americas
- América Latina (Español)
- Canada (English)
- United States (English)
Europe
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)
Asia Pacific
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)