Takuya Yoshioka (@_ty274) header
Takuya Yoshioka (@_ty274) profile picture

Speech technology researcher/manager @AssemblyAI

Bellevue, WA
Joined November 2016
Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)Photo by Takuya Yoshioka (@_ty274)
Want to hear a friend in a noisy café? We designed deep learning-based headphones that let you isolate the speech from a specific person just by *looking* at them for a few seconds. CHI'24 honorable mention award. Paper: arxiv.org/abs/2405.06289 Code: github.com/vb000/LookOnceToH…
15
47
24
275
119,784
Takuya Yoshioka retweeted
I got an early demo of this when I visited @uwcse a couple months ago and the ability to isolate sounds in your environment was pretty great. Nice work, @b_veluri, Malek Itani, Tuochao Chen, Takuya Yoshioka, and @ShyamGollakota!
Want to hear a friend in a noisy café? We designed deep learning-based headphones that let you isolate the speech from a specific person just by *looking* at them for a few seconds. CHI'24 honorable mention award. Paper: arxiv.org/abs/2405.06289 Code: github.com/vb000/LookOnceToH…
8
33
3
361
103,315
Hi all, please let me know if you know large-scale speech data that can be used for training our Whisper reproduction (OWSM) model (arxiv.org/abs/2309.13876). We plan to move to OWSM v4.
13
27
96
14,557
Takuya Yoshioka retweeted
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer paper page: huggingface.co/papers/2308.0… Recent advancements in generative speech models based on audio-text prompts have enabled remarkable innovations like high-quality zero-shot text-to-speech. However, existing models still face limitations in handling diverse audio-text speech generation tasks involving transforming input speech and processing audio captured in adverse acoustic conditions. This paper introduces SpeechX, a versatile speech generation model capable of zero-shot TTS and various speech transformation tasks, dealing with both clean and noisy signals. SpeechX combines neural codec language modeling with multi-task learning using task-dependent prompting, enabling unified and extensible modeling and providing a consistent way for leveraging textual input in speech enhancement and transformation tasks. Experimental results show SpeechX's efficacy in various tasks, including zero-shot TTS, noise suppression, target speaker extraction, speech removal, and speech editing with or without background noise, achieving comparable or superior performance to specialized models across tasks.
4
85
5
306
74,134
To everyone booking their @IEEE_WASPAA trip: please consider attending #SANE2023, which will take place at NYU on Thursday October 26, the day after #WASPAA2023. Register at saneworkshop.org/sane2023/
Dear #WASPAA2023 authors, the review results are out now. Please go ahead and check out at cmt3.research.microsoft.com/…. We appreciate your precious contribution and kind interest regardless of the acceptance decision!
7
21
3,863
Takuya Yoshioka retweeted
Replying to @ieeeICASSP
@ieeeICASSP Are there poster printing facilities at/near the conference venue?
1
1
995
Takuya Yoshioka retweeted
WASPAA 2023 calls for papers! The traditional intimate Mohonk Mountain House with exciting changes: double-blind review, an unprecedented amount of travel grants, and more. More information: waspaa.com/call-for-papers/ #waspaa2023
15
1
34
5,695
Takuya Yoshioka retweeted
The #ICASSP2023 paper submission site is now open! Submit your papers by 19 October 2022 to be considered. Learn more about the paper guidelines and submission requirements here: hubs.la/Q01nmxt_0
5
20
Please retweet, @Lam19Tk, a young MT researcher, soon-to-be-PhD needs your help. He is looking for a job in speech/text translation. A job he already had lined-up has been revoked due to the hiring freezes in the industry. Here's his linkedin profile: linkedin.com/in/tsz-kin-lam-…
4
16
2
16
The challenge submission deadline is approaching (Sep 26). If you're interested in it, please do not hesitate to ask the CHiME Steering Group ([email protected]) or members (chimechallenge.org/current/s…) individually!
Call for proposals! We now wish to introduce a more open model, where the annual CHiME Challenge features independent tasks organized by teams who work within a schedule defined by the CHiME Steering Group. See chimechallenge.org/current/c…
5
8
Takuya Yoshioka retweeted
TTIC celebrates the life of Sadaoki Furui ttic.edu/news/#0822-3
6
8
Hi all, SLT'22 will organize a hackathon event. Please check slt2022.org/hackathon.php The application deadline is Sep. 30th! @ieee_slt
17
33
Takuya Yoshioka retweeted
We were saddened to hear of the loss of Prof. Sadaoki Furui, one of the giants of speech processing. We would like to extend our most heartfelt thoughts to Prof. Furui's family, friends and all of those who had the opportunity to work with him. (1/2)
1
48
9
51
Presenter Registration is due midnight July 10 (AoE)! Presenter Registration is separate from the Author Registration. You have to register for presentation if you're a presenter of your paper. After signing up on the official website, go to My Page and enter your Paper ID.
1
5
15
Call for proposals! We now wish to introduce a more open model, where the annual CHiME Challenge features independent tasks organized by teams who work within a schedule defined by the CHiME Steering Group. See chimechallenge.org/current/c…
7
2
14
Let's register yourself or your colleagues to make a richer reviewer pool for SLT! slt2022.org/call-for-reviewe…
10
20
Takuya Yoshioka retweeted
i-Code: An Integrative and Composable Multimodal Learning Framework abs: arxiv.org/abs/2205.01818 i-Code outperforms sota on 5 video understanding tasks and GLUE NLP benchmark, improving by as much as 11% and demonstrating the power of integrative multimodal pretraining
5
40
Takuya Yoshioka retweeted
🧵[1/9] Let's take a look at some fun Machine Learning demos 🔥 @MSFTResearch WavLM model can be used to determine if two audios are from the same speaker. You can try it yourself and see if you are identified as you 😅! huggingface.co/spaces/micros…
3
34
2
185
Takuya Yoshioka retweeted
🎙️Microsoft open-sources new models at lightning-speech at the moment 🚀 We are excited to support @MicrosoftResearch's newest speech models as of🤗Transformers 4.15: 🎤WavLM 🗨️UniSpeech-SAT 💬UniSpeech Try to get past WavLM at Speaker Verification😉 huggingface.co/spaces/micros…
4
53
1
282