Anuj Diwan

CS PhD Student

Computer Science Department, UT Austin

About Me

I am Anuj Diwan, a third year PhD student in the Computer Science Department at the University of Texas at Austin. I am fortunate to be co-advised by Prof. David Harwath and Prof. Eunsol Choi. I am part of the broader UT NLP group. My research interests are in the fields of Speech and Natural Language Processing. My current research focuses on multilingual speech generation and speech translation.

I received my B.Tech (with Honors) degree in Computer Science and a Minor degree in Statistics from IIT Bombay in 2021, where I had a wonderful time working with Prof. Preethi Jyothi and Prof. Sunita Sarawagi.

I have also spent some time interning at Google DeepMind (Summer 2023, with Yu Zhang and Ankur Bapna), Meta AI (Summer 2022, with Abdelrahman Mohamed, Wei-Ning Hsu and Ching-Feng Yeh), Adobe Research India (Summer 2020) and UCLouvain (Summer 2019).

In my spare time, I enjoy reading, quizzing, solving wordgames, and watching the latest movies and TV shows.

Interests

Speech Recognition
Natural Language Processing
Artificial Intelligence
Machine Learning

Education

PhD in Computer Science, 2021-present
University of Texas at Austin
B.Tech in Computer Science and Engineering with Honours, 2017-2021
Indian Institute of Technology Bombay
Minor in Statistics, 2017-2021
Indian Institute of Technology Bombay

CV

Curriculum Vitae (Last updated Jan 2024)

Publications

Anuj Diwan, Anirudh Srinivasan, David Harwath, Eunsol Choi (2023). Unit-based Speech-to-Speech Translation Without Parallel Data. Preprint.

PDF

Anuj Diwan, Eunsol Choi, David Harwath (2023). When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants. ACL 2023.

PDF Cite Poster

Anuj Diwan, Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Eunsol Choi, David Harwath, Abdelrahman Mohamed (2022). Continual Learning for On-Device Speech Recognition using Disentangled Conformers. ICASSP 2023.

PDF Cite Poster

Anuj Diwan, Layne Berry, Eunsol Choi, David Harwath, Kyle Mahowald (2022). Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality. EMNLP 2022.

PDF Cite Code Slides

Anuj Diwan, Puyuan Peng, Raymond J. Mooney (2022). Zero-shot Video Moment Retrieval With Off-the-Shelf Models. TL4NLP@NeurIPS 2022.

PDF Cite Poster

Anuj Diwan, Preethi Jyothi (2021). Reduce and Reconstruct: ASR for Low-Resource Phonetic Languages. Interspeech 2021.

PDF Cite Slides

Shreya Khare, Ashish Mittal, Anuj Diwan, Sunita Sarawagi, Preethi Jyothi, Samarth Bharadwaj (2021). Low Resource ASR: The surprising effectiveness of High Resource Transliteration. Interspeech 2021.

PDF Cite Slides

Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham (2021). Multilingual and code-switching ASR challenges for low resource Indian languages. Interspeech 2021.

PDF Cite