MuQ & MuQ MuLan This is the official repository for the paper " MuQ : Self Supervised Mu sic Representation Learning with Mel Residual Vector Q uantization" . For more detailed information, we strongly recommend referring to https://github.com/tencent ailab/MuQ and the paper). In this repo, the following models are released: MuQ (see this link): A large music foundation model pre trained via Self Supervised Learning (SSL), achieving SOTA in various MIR tasks. MuQ MuLan (see this link): A music text joint embedding model trained via contrastive learning, supporting both English and Chinese texts. Usage To begin with, please use pip to install the official muq lib, and ensure that your python =3.8 : Using MuQ MuLan to extract the music and text embeddings and calculate the similarity: To extract music audio features using MuQ : Model Checkpoints Model Name Parameters Data HuggingFace🤗 MuQ ~300M MSD dataset OpenMuQ/MuQ large msd iter MuQ MuLan ~700M music text pairs OpenMuQ/MuQ MuLan large Note : Please note that the open sourced MuQ was trained on the Million Song Dataset. Due to differences in dataset size, the open sourced model may not achieve the same level of performance as rep…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy