Semantic Hearing This repository provides code for the binaural target sound extraction model proposed in the paper, Semantic Hearing: Programming Acoustic Scenes with Binaural Hearables , presented at UIST'23. This model helps us create systems that let you control what you want to hear in the environment, in real time, using noise cancelling earbuds & headphones. https://github.com/vb000/SemanticHearing/assets/16723254/f1b33d8c 179a 4d50 92aa 6a99dde696d0 Conda environment setup conda create name semhear python=3.8 conda activate semhear pip install r requirements.txt Training Data wget P data https://semantichearing.cs.washington.edu/BinauralCuratedDataset.tar Train python m src.training.train experiments/dc waveformer use cuda Evaluation Checkpoint wget P experiments/pre trained https://semantichearing.cs.washington.edu/39.pt Eval python m src.training.eval experiments/pre trained use cuda BibTeX
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy