Paired TIMIT acoustic probes

TIMIT Acoustic Analysis Demo

240 analyzed audio files

Research Question

This page uses clean Lab recordings from the four paired TIMIT speakers as references. MRI scanner noise is synthetically added to create Noisy (add), and the noisy signals are then enhanced with Denoiser, PASE, and RE-USE. The goal is to illustrate possible changes in speaker-related and acoustic cues, not only whether the output sounds cleaner.

4paired speakers
12common sentence blocks
5clean/additive conditions
100%clean-reference ABX ceiling

Summary Across The Paired Additive Subset

Condition Speaker-reference ABX proxy (%) Nearest-speaker mismatch proxy (%) F1-F3 drift (Hz) F0 drift (%) Periodicity retained (%) Amplitude-envelope r Spectral-flux r
Clean Lab 100.0 ± 0.00 0.0 ± 0.00 0 ± 0.00 0.0 ± 0.00 100 ± 0.00 1.00 ± 0.00 1.00 ± 0.00
Noisy (add) 53.5 ± 29.86 75.0 ± 25.00 532 ± 88.37 63.0 ± 22.11 81 ± 1.84 0.57 ± 0.20 0.57 ± 0.02
Denoiser (add) 66.7 ± 12.50 72.9 ± 27.08 203 ± 38.76 5.1 ± 5.16 108 ± 2.06 0.98 ± 0.02 0.60 ± 0.02
PASE (add) 80.6 ± 13.19 43.8 ± 31.25 107 ± 43.88 6.0 ± 4.28 107 ± 4.71 0.99 ± 0.00 0.71 ± 0.04
RE-USE (add) 81.2 ± 17.36 39.6 ± 37.50 167 ± 176.68 5.2 ± 3.74 102 ± 3.38 0.99 ± 0.01 0.75 ± 0.02

Values after ± are 95% speaker-cluster bootstrap CI half-widths computed with 5,000 resamples over speaker IDs.

TIMIT analysis figure
Y-axis: the speaker-reference ABX proxy is the percentage of correct same-versus-other-speaker triplets; the nearest-speaker mismatch proxy is the percentage of nearest-reference shifts. Error bars show 95% speaker-cluster bootstrap confidence intervals from 5,000 resamples.
TIMIT analysis figure
Y-axis: mean absolute F1--F3 formant drift in Hz and mean absolute F0 drift in percent, both relative to clean Lab audio.
TIMIT analysis figure
Y-axis: periodicity retained as percent of clean Lab, plus Pearson r with clean Lab amplitude-envelope and spectral-flux trajectories.

Interactive Audio Examples

Select a speaker and sentence block, then compare Clean Lab, Noisy (add), and each SE output. The spectrogram scrolls with playback for timing inspection.

Transcript

Clean Lab

Lab reference
n/aNearest clean speaker
n/aF1-F3 drift (Hz)
n/aF0 drift (%)
n/aAmplitude-envelope r

Noisy (add)

Noisy (add) probe
n/aNearest clean speaker
n/aF1-F3 drift (Hz)
n/aF0 drift (%)
n/aAmplitude-envelope r

Denoiser (add)

SE output
n/aNearest clean speaker
n/aF1-F3 drift (Hz)
n/aF0 drift (%)
n/aAmplitude-envelope r

PASE (add)

SE output
n/aNearest clean speaker
n/aF1-F3 drift (Hz)
n/aF0 drift (%)
n/aAmplitude-envelope r

RE-USE (add)

SE output
n/aNearest clean speaker
n/aF1-F3 drift (Hz)
n/aF0 drift (%)
n/aAmplitude-envelope r