Sound demos for "Denoising-and-Dereverberation Hierarchical Neural Vocoder for Statistical Parametric Speech Synthesis"

 

 

Comparsion among vocoders:

Example 1 (SNR=17.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF
Example 2 (SNR=12.5dB, Reverberation T60=300ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF
Example 3 (SNR=2.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF
Example 4 (SNR=17.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF
Example 5 (SNR=7.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF
Example 6 (SNR=2.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean        
       
Baseline-NSF' Baseline-NSF Baseline-HiNet' Baseline-HiNet DNR-HiNet DNR-HiNet w/ BF

Comparsion with SE methods:

Example 1 (SNR=17.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF
Example 2 (SNR=12.5dB, Reverberation T60=300ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF
Example 3 (SNR=2.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF
Example 4 (SNR=17.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF
Example 5 (SNR=7.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF
Example 6 (SNR=2.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean        
       
DNR-HiNet w/ BF cIRM SEGAN WaveNet T-GSA DNR-HiNet* w/ BF

 

Ablation studies:

Example 1 (SNR=17.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF
Example 2 (SNR=12.5dB, Reverberation T60=300ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF
Example 3 (SNR=2.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF
Example 4 (SNR=17.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF
Example 5 (SNR=7.5dB, Reverberation T60=593ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF
Example 6 (SNR=2.5dB, Reverberation T60=188ms)
Natural Noisy and Reverb Natural Clean   DNR-HiNet w/ BF DNR-HiNet-S w/ BF DNR-HiNet-S w/ F
 
DNR-HiNet-S w/ B DNR-HiNet-S wo/ C w/ BF DNR-HiNet-S wo/ RNI w/ BF DNR-HiNet-S wo/ Iloss w/ BF DNR-HiNet-S wo/ R w/ BF DNR-HiNet-S wo/ N w/ BF

 

SPSS experiments:

Example 1
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet      
     
Example 2
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet      
     
Example 3
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet      
     
Example 4
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet      
     
Example 5
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet      
     
Example 6
Natural Noisy and Reverb Natural Clean        
       
Pre-SE+HiNet No-SE+DNR-HiNet No-SE+HiNet