论文标题

泰勒定理促使的一般展开的语音增强方法

A General Unfolding Speech Enhancement Method Motivated by Taylor's Theorem

论文作者

Li, Andong, Yu, Guochen, Zheng, Chengshi, Liu, Wenzhe, Li, Xiaodong

论文摘要

尽管深层神经网络促进了语音增强领域的显着进步,但遵循经验或相对盲目的标准,开发了大多数现有方法,缺乏管道设计中的足够指南。受泰勒(Taylor)定理的启发,我们为单渠道语音增强任务提供了一个一般展开框架。具体而言,我们将复杂的光谱恢复到噪声混合物的邻域空间中的光谱幅度映射中,其中引入了未知的稀疏项并将其应用于相位修饰。基于此,将映射函数分解为泰勒(Taylor)系列中0阶和高阶多项式的叠加,其中前者粗略地消除了幅度级域的干扰,而后者则逐渐补充了复杂频谱域中的剩余光谱细节。此外,我们研究了相邻订单项之间的关系,并揭示每个高阶项可以用其低阶项递归估算,然后提出每个高阶项,以使用具有可训练的权重的替代功能进行评估,以便可以以端到端方式对整个系统进行训练。鉴于提出的框架是根据泰勒定理设计的,因此具有提高的内部灵活性。在WSJ0-SI84,DNS-挑战,VoiceBank+需求,空间化的LibrisPeech和L3DAS22多通道语音增强挑战数据集上进行了广泛的实验。定量结果表明,根据多个客观指标,所提出的方法比现有最佳表现的方法产生了竞争性能。

While deep neural networks have facilitated significant advancements in the field of speech enhancement, most existing methods are developed following either empirical or relatively blind criteria, lacking adequate guidelines in pipeline design. Inspired by Taylor's theorem, we propose a general unfolding framework for both single- and multi-channel speech enhancement tasks. Concretely, we formulate the complex spectrum recovery into the spectral magnitude mapping in the neighborhood space of the noisy mixture, in which an unknown sparse term is introduced and applied for phase modification in advance. Based on that, the mapping function is decomposed into the superimposition of the 0th-order and high-order polynomials in Taylor's series, where the former coarsely removes the interference in the magnitude domain and the latter progressively complements the remaining spectral detail in the complex spectrum domain. In addition, we study the relation between adjacent order terms and reveal that each high-order term can be recursively estimated with its lower-order term, and each high-order term is then proposed to evaluate using a surrogate function with trainable weights so that the whole system can be trained in an end-to-end manner. Given that the proposed framework is devised based on Taylor's theorem, it possesses improved internal flexibility. Extensive experiments are conducted on WSJ0-SI84, DNS-Challenge, Voicebank+Demand, spatialized Librispeech, and L3DAS22 multi-channel speech enhancement challenge datasets. Quantitative results show that the proposed approach yields competitive performance over existing top-performing approaches in terms of multiple objective metrics.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源