SLP-RL

SLP Research Lab

The School of Computer Science and Engineering
The Hebrew University of Jerusalem

The Spoken Language Processing Research Lab (SLP-RL), led by Dr. Yossi Adi at The Hebrew University of Jerusalem, is a dynamic hub for cutting-edge research. Our diverse research interests span spoken language modeling, automatic speech recognition, speech enhancement, speech and audio generation, and machine learning for audio, speech, and language processing.

Our lab collaborates with the global research community to advance speech technology through machine learning and deep learning toolks. Our goal is to create adaptive systems that enrich spoken human communication across various languages.

If you would like to pursue graduate studies with us (Master or PhD), please send your CV, research interests, and example code projects to the following address: yossi.adi@mail.huji.ac.il.

News

Members

Faculty

Yossi Adi

Ph.D. Students

Alon Ziv
Gallil Maimon
Or Tal (co-advising with Ami Wiesel)
Arnon Turetzky
(co-advising with Shmuel Peleg)
Guy Yariv

Alumni

Textless NLP

In TextlessNLP, our goal is to build large language models that can directly process audio inputs, without accessing any textual supervision. Being able to achieve that would benefit languages that do not have large textual resources or standard orthography. It would also benefit high-resource languages where: (i) the oral and written forms often mismatch; (ii) linguistically relevant signals are absent from text (e.g., intonation)

Audio Research

The SLP Research Lab is actively involved in conducting research and advancing neural architectures to address various fundamental challenges in the domain of audio processing. This encompasses a wide range of tasks, including background noise removal, artificial bandwidth-extension (a.k.a audio super-resolution), audio compression, voice conversion, etc. For additional details, please refer to the publication section.

Hebrew Speech Technologies

Speech technology has made much progress over the past decade and has been integrated into many consumer products. Despite the progress, most of the models were developed for English and other high-resource languages. In this project, our goal is to build speech technologies (automatic-speech-recognition and text-to-speech) for the Hebrew language together with constructing a large scale Hebrew dataset.

Selected Publications

Here is a list of selected publications from our group. For the full list of publications see my Google Scholar.

2026

  1. Noam Issachar*, Guy Yariv*, Sagie Benaim, Yossi Adi, Dani Lischinski, Raanan Fattal. DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion. The 43rd International Conference on Machine Learning (ICML), 2026 [PDF, Project page].
  2. Iddo Yosha, Gallil Maimon, Yossi Adi. StressTest: Can YOUR Speech LM Handle the Stress?. Findings of The 64th Annual Meeting of the Association for Computational Linguistics (ACL), 2026 [PDF, Project page].
  3. Guy Yariv, Idan Schwartz, Yossi Adi*, Sagie Benaim*. LaMI: Augmenting Large Language Models via Late Multi-Image Fusion. The 64th Annual Meeting of the Association for Computational Linguistics (ACL), 2026 [PDF, Project page, Code].
  4. Kamil Wojcicki, Yusuf Ziya Isik, Laura Lechler, Mansur Yesilbursa, Ivana Balic, Wolfgang Mack, Rafal Laganowski, Guoqing Zhang, Yossi Adi, Minje Kim, Shinji Watanabe. Low-Resource Audio Codec (LRAC): 2025 Challenge Description. The 51st IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2026 [PDF].
  5. Alon Ziv, Sanyuan Chen, Andros Tjandra, Yossi Adi, Wei-Ning Hsu, Bowen Shi. MR-FLOWDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generation. The 51st IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2026 [PDF, Project page].
  6. Haibin Wu, Bach Viet Do, Naveen Suda, Julian Chan, Madhavan C R, Gene-Ping Yang, Yi-Chiao Wu, Naoyuki Kanda, Yossi Adi, Xin Lei, Yue Liu, Florian Metze, Yuzong Liu. T-Mimi: A Transformer-based Mimi Decoder for Real-Time On-Phone TTS. The 51st IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2026 [PDF].
  7. Michael Hassid, Yossi Adi, Roy Schwartz. Post-training is (Massive) Supervised Learning. openreview, pdf-id: 7P1VeDIY5, (2026) [PDF].
  8. Gallil Maimon, Ori Yoran, Felix Kreuk, Michael Hassid, Gal Cohen, Pierre Chambon, Yossi Adi. Self-Execution Simulation Improves Coding Models. arXiv preprint arXiv:2604.03253 (2026) [PDF].

2025

  1. Talia Sterngerg, Mickey London, David Omer, Yossi Adi. GmSLM : Generative Marmoset Spoken Language Modeling. Findings of Empirical Methods in Natural Language Processing (EMNLP), 2025 [PDF].
  2. Arnon Turetzky, Nimrod Shabtay, Slava Shechtman, David Haws, Hagai Aronowitz, Ron Hoory, Yossi Adi, Avihu Dekel. Speech Synthesis From Continuous Features Using Per-Token Latent Diffusion. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), 2025 [PDF].
  3. Robin San Roman, Manel Khentout, Tu Anh Nguyen, Yossi Adi, Emmanuel Dupoux. Benchmarking Fast Domain Adaptation for Unsupervised Speech Units. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), 2025.
  4. Gallil Maimon, Michael Hassid, Amit Roth, Yossi Adi. Scaling Analysis of Interleaved Speech-Text Language Models. The 2nd Conference on Language Modeling (COLM), 2025 [PDF, Project page].
  5. Roi Benita*, Michael Finkelson*, Tavi Halperin, Gleb Sterkin, Yossi Adi. CAFA: a Controllable Automatic Foley Artist. The IEEE/CVF International Conference on Computer Vision (ICCV), 2025 [PDF, Project page].
  6. Iddo Yosha, Dorin Shteyman, Yossi Adi. WHISTRESS: Enriching Transcriptions with Sentence Stress Detection. The 26th Annual Conference of the International Speech Communication Association (Interspeech), 2025 [PDF, Project page].
  7. Nadav Har-Tuv, Or Tal, Yossi Adi. PAST: Phonetic-Acoustic Speech Tokenizer. The 26th Annual Conference of the International Speech Communication Association (Interspeech), 2025 [PDF, Project page].
  8. Gallil Maimon*, Avishai Elmakies*, Yossi Adi. Slamming: Training a Speech Language Model on One GPU in a Day. Findings of The 63rd Annual Meeting of the Association for Computational Linguistics (ACL), 2025 [PDF, Project page].
  9. Guy Yariv, Yuval Kirstain, Amit Zohar, Shelly Sheynin, Yaniv Taigman, Yossi Adi, Sagie Benaim, Adam Polyak. Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generation. The Conference on Computer Vision and Pattern Recognition (CVPR), 2025 [PDF, Project page].
  10. Gallil Maimon*, Amit Roth*, Yossi Adi. A Suite for Acoustic Language Model Evaluation. The 50th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2025 [PDF, Code & Data].
  11. Ella Zeldes, Or Tal, Yossi Adi. Enhancing TTS Stability in Hebrew using Discrete Semantic Units. The 50th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2025 [PDF, Code & Demo].
  12. Robin San Roman, Pierre Fernandez, Antoine Deleforge, Yossi Adi, Romain Serizel. Latent Watermarking of Audio Generative Models. The 50th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2025 [PDF].
  13. Simon Rouard*, Robin San Roman*, Yossi Adi, Axel Roebel. MusicGen-Stem: Multi-stem music generation and edition through autoregressive modeling. The 50th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2025 [PDF].

2024

  1. Or Tal*, Alon Ziv*, Itai Gat, Felix Kreuk, Yossi Adi. Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation. The 25th International Society for Music Information Retrieval (ISMIR) Conference, (2024) [PDF].
  2. Simon Rouard, Jade Copet, Yossi Adi, Axel Roebel, Alexandre Defossez. Audio Conditioning for Music Generation via Discrete Bottleneck Features. The 25th International Society for Music Information Retrieval (ISMIR) Conference, (2024) [PDF].
  3. Shoval Messica, Yossi Adi. NAST: Noise Aware Speech Tokenization for Speech Language Models. The 25th Annual Conference of the International Speech Communication Association (Interspeech), 2024 [PDF, Code].
  4. Xuankai Chang, Jiatong Shi, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin. The Interspeech 2024 Challenge on Speech Processing Using Discrete Units. The 25th Annual Conference of the International Speech Communication Association (Interspeech), 2024 [PDF].
  5. Shiran Aziz, Yossi Adi, Shmuel Peleg. Audio Enhancement from Multiple Crowdsourced Recordings: A Simple and Effective Baseline. The 25th Annual Conference of the International Speech Communication Association (Interspeech), 2024 [PDF].
  6. Amit Roth, Arnon Turetzky, Yossi Adi. A Language Modeling Approach to Diacritic-Free Hebrew TTS. The 25th Annual Conference of the International Speech Communication Association (Interspeech), 2024 [PDF, Code].
  7. Arnon Turetzky, Or Tal, Yael Segal-Feldman, Yehoshua Dissen, Ella Zeldes, Amit Roth, Eyal Cohen, Yosi Shrem, Bronya R. Chernyak, Olga Seleznova, Joseph Keshet, Yossi Adi. HebDB: a Weakly Supervised Dataset for Hebrew Speech Processing. The 25th Annual Conference of the International Speech Communication Association (Interspeech), 2024 [PDF, Data].
  8. Jean-Marie Lemercier*, Simon Rouard*, Jade Copet, Yossi Adi, Alexandre Defossez. An Independence-promoting Loss for Music Generation with Language Models. The 41st International Conference on Machine Learning (ICML), 2024 [PDF].
  9. Alon Ziv, Itai Gat, Gael Le Lan, Tal Remez, Felix Kreuk, Alexandre Defossez, Jade Copet, Gabriel Synnaeve, Yossi Adi. Masked Audio Generation using a Single Non-Autoregressive Transformer. International Conference on Learning Representations (ICLR), 2024 [PDF, Code & Samples].
  10. Guy Yariv, Itai Gat, Sagie Benaim, Lior Wolf, Idan Schwartz*, Yossi Adi*. Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation. The Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), 2024 [PDF, Code & Samples].

2023

  1. Robin Algayres, Yossi Adi, Tu Anh Nguyen, Jade Copet, Gabriel Synnaeve, Benoit Sagot, Emmanuel Dupoux. Generative Spoken Language Model Based on Continuous Word-sized Audio Tokens. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023 [PDF].
  2. Gallil Maimon, Yossi Adi. Speaking Style Conversion With Discrete Self-Supervised Units. Findings of Empirical Methods in Natural Language Processing (EMNLP), 2023 [PDF, Code & Samples].
  3. Michael Hassid, Tal Remez, Tu Anh Nguyen, Itai Gat, Alexis Conneau, Felix Kreuk, Jade Copet, Alexandre Defossez, Gabriel Synnaeve, Emmanuel Dupoux, Roy Schwartz, Yossi Adi. Textually Pretrained Speech Language Models. The 37th Annual Conference on Neural Information Processing Systems (NeurIPS), 2023 [PDF, Samples].
  4. Robin San Roman, Yossi Adi, Antoine Deleforge, Romain Serizel, Gabriel Synnaeve, Alexandre Defossez. From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusion. The 37th Annual Conference on Neural Information Processing Systems (NeurIPS), 2023 [PDF, Code, Samples].
  5. Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant, Gabriel Synnaeve, Yossi Adi, Alexandre Defossez. Simple and Controllable Music Generation. The 37th Annual Conference on Neural Information Processing Systems (NeurIPS), 2023 [PDF, Code, Samples, Demo].
  6. Guy Yariv, Itai Gat, Lior Wolf, Yossi Adi*, Idan Schwartz*. Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation. The 24th Annual Conference of the International Speech Communication Association (Interspeech), 2023 [PDF, Code, Demo, Samples].
  7. Tu Anh Nguyen, Wei-Ning Hsu, Antony d'Avirro, Bowen Shi, Itai Gat, Maryam Fazel-Zarandi, Tal Remez, Jade Copet, Gabriel Synnaeve, Michael Hassid, Felix Kreuk, Yossi Adi*, Emmanuel Dupoux*. Expresso: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis. The 24th Annual Conference of the International Speech Communication Association (Interspeech), 2023 [PDF, Data].
  8. Wei-Ning Hsu, Tal Remez, Bowen Shi, Jacob Donley, Yossi Adi. ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement. The Conference on Computer Vision and Pattern Recognition (CVPR), 2023 [PDF, Samples].
  9. Moshe Mandel, Or Tal, Yossi Adi. AERO: Audio Super Resolution in the Spectral Domain. The 48th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2023 [PDF, Code, Samples].
  10. Roy Sheffer, Yossi Adi. I Hear Your True Colors: Image Guided Audio Generation. The 48th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2023 [PDF, Code, Samples].
  11. Amitay Sicherman, Yossi Adi. Analyzing Discrete Self Supervised Speech Representation For Spoken Language Modeling. The 48th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2023 [PDF, Code, Tool].
  12. Felix Kreuk, Gabriel Synnaeve, Adam Polyak, Uriel Singer, Alexandre Defossez, Jade Copet, Devi Parikh, Yaniv Taigman, Yossi Adi. AudioGen: Textually Guided Audio Generation. International Conference on Learning Representations (ICLR), 2023 [PDF, Samples].

2022

  1. Arnon Turetzky, Tzvi Michelson, Yossi Adi, Shmuel Peleg. Deep Audio Waveform Prior. The 23rd Annual Conference of the International Speech Communication Association (Interspeech), 2022 [PDF].
  2. Or Tal, Moshe Mandel, Felix Kreuk, Yossi Adi. A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement. The 23rd Annual Conference of the International Speech Communication Association (Interspeech), 2022 [PDF, Code].
  3. Shahaf Bassan, Yossi Adi, Jeffrey S. Rosenschein. Unsupervised Symbolic Music Segmentation using Ensemble Temporal Prediction Errors. The 23rd Annual Conference of the International Speech Communication Association (Interspeech), 2022 [PDF].
  4. Efthymios Tzinis, Yossi Adi, Vamsi K. Ithapu, Buye Xu, Anurag Kumar. Continual Self-Training with Bootstrapped Remixing For Speech Enhancement. The 47th IEEE International Conference in Acoustic, Speech and Signal Processing (ICASSP), 2022 [PDF].
  5. Efthymios Tzinis, Yossi Adi, Vamsi Krishna Ithapu, Buye Xu, Paris Smaragdis, Anurag Kumar. RemixIT: Continual Self-Training of Speech Enhancement Models via Bootstrapped Remixing. IEEE Journal of Selected Topics in Signal Processing, 2022 [PDF].

2021

  1. Shahar Segal, Yossi Adi, Benny Pinkas, Carsten Baum, Chaya Ganesh, Joseph Keshet. Fairness in the Eyes of the Data: Certifying Machine-Learning Models. The Forth AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES), 2021 [PDF].

Open-source

At our laboratory, we are dedicated to open source and open research principles. All our source code and pre-trained models are publicly available, and we actively gather diverse spoken datasets in multiple languages for training and evaluating speech technologies. With embracing openness, our aim is to drive innovation and collaboration in the field of speech technology globally.

Code & Datasets

All source-code, pre-trained models and datasets are available under the SLP Research Lab GitHub page and HuggingFace page.