• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Perception-and-Neurodynamics-Laboratory/Matlab-toolbox-for-DNN-based-speech-sepa ...

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

Perception-and-Neurodynamics-Laboratory/Matlab-toolbox-for-DNN-based-speech-separation

开源软件地址(OpenSource Url):

https://github.com/Perception-and-Neurodynamics-Laboratory/Matlab-toolbox-for-DNN-based-speech-separation

开源编程语言(OpenSource Language):

MATLAB 99.2%

开源软件介绍(OpenSource Introduction):

Matlab toolbox for DNN-based speech separation

This folder contains Matlab programs for a toolbox for supervised speech separation using deep neural networks (DNNs). This toolbox is composed by Jitong Chen, based on an earlier version written by Yuxuan Wang. The toolbox is further improved by Yuzhou Liu.

For technical details about DNN-based speech separation see the following paper:

Wang Y., Narayanan A. and Wang D.L. (2014): On training targets for supervised speech separation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 22, pp. 1849-1858.

The toolbox is provided by the OSU Perception and Neurodynamics Laboratory (PNL).


Description of folders and files

config/
Lists of clean utterances for training and test.

DATA/
Mixtures, features, masks and separated speech are stored here.

dnn/
Code for DNN training and test, where dnn/main/ includes key functions for DNN training and test. dnn/pretraining/ includes code for unsupervised DNN pretraining.

gen_mixture/
Code for creating mixtures from noise and clean utterances.

get_feat/
Code for acoustic features and ideal mask calculation.

premix_data/
Sample data including clean speech and factory noise.

load_config.m
It configures feature type, noise type, training utterance list, test utterance list, mixture SNR, mask type, etc.

RUN.m
It loads configurations from load_config.m and runs a speech separation demo.


DEMO

(Tested on Matlab 2015b under Ubuntu 14.04, Red Hat 6.7, OS X 10.11.3 and Windows 7.)
This demo uses 600 mixtures for training and 120 mixtures for testing.
The mixtures are created by mixing clean utterances with factory noise at -2 dB.
A 4-hidden-layer DNN with sigmoid hidden activation is used for mask estimation.

To run this demo, simply execute RUN.m in matlab. This matlab script will execute the following steps:

  1. Load configurations in load_config.m:

(a) 'train_list' and 'test_list' specify lists of clean utterances for training and test.
(b) 'mix_db' specifies the SNR of training and test mixtures.
(c) 'is_ratio_mask' specifies the mask type (0: binary mask, 1: ratio mask).
(d) 'is_gen_mix', 'is_gen_feat' and 'is_dnn' indicate whether to perform different steps in speech separation.

  1. Create data folders for this demo.

  2. Perform DNN based speech separation in three steps:

(a) Generate training and test mixtures.
(b) Generate training and test features / masks.
(c) DNN training and test. To use a different network architecture, you may change the configurations ('opts.*') in ./dnn/main/dnn_train.m:
     (1) 'opts.unit_type_hidden' specifies the activation function for hidden layers ('sigm': sigmoid, 'relu': ReLU).
     (2) 'opts.isPretrain' indicates whether to perform pretraining (0: no pretraining, 1: pretraining). Note that pretraining is only supported for the sigmoid hidden activation function.
     (3) 'opts.hid_struct' specifies the numbers of hidden layers and hidden units.
     (4) 'opts.sgd_max_epoch' specifies the maximum number of training epochs.
     (5) 'opts.isDropout' specifies whether to use dropout regularization.

When DNN training and test are finished, you will find the following speech separation results:
DATA/factory/dnn/WAVE/db-2/: mixture, clean speech and resynthesized speech.
DATA/factory/dnn/STORE/db-2/EST_MASK/: estimated masks and ideal masks.
DATA/factory/log_db-2.txt: log file for this demo.


Acknowledgments

We use rastamat (http://labrosa.ee.columbia.edu/matlab/rastamat/) to extract rastaplp and mfcc features. We use STOI (http://ceestaal.nl/stoi.zip) as one of the objective speech intelligibility metrics.




鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap