Alexander Kain Assistant Professor Center for Spoken Language Understanding (CSLU) Oregon Health & Science University (OHSU) email: kaina at ohsu edu phone: (503) 748-1539 · fax: (503) 748-1306

Research Interests

• Quantitative assessment and transformation of clear and conversational speech, with the aim of advancing hearing-aid performance (without extra noise: conversational, clear prosody and conversational spectrum, conversational prosody and clear spectrum, clear; with multi-talker background noise: conversational, clear prosody and conversational spectrum, conversational prosody and clear spectrum, clear)
• Transformation of aphonic speech (aphonic speech, transformation)
• Transformation of dysarthric speech to improve intelligibility and perceived voice quality (dysarthric speech, transformation)
• Increasing spectral control in concatenative synthesizers to eliminate concatenation errors (baseline, formant + spectral-band + time-domain crossfading)
• Representing acoustic inventories of Text-to-Speech systems with an asynchronous interpolation model, allowing high rates of compression, elimination of concatenation errors, and speaker transformation (compression: original, compression with AIM coder @ 3.4kbps, compression with speex coder @ 3.4kbps for comparison; speaker transformation: transformation-1, transformation-2, transformation-3, transformation-4, transformation-5)
• Improving the accuracy and quality of speaker transformation systems and designing speaker recognizability perceptual tests (transformation of natural speech: source, transformation, target; transformation of TTS synthesis voices: source, transformation, target)
• Multi-purpose speech modification algorithms (original, resynthesis, slow to 300%, speed-up to 50%, lower pitch to 50%, raise pitch to 200%, scale formants to 80%, scale formants to 120%, mimic child, mimic man)
• Singing synthesis ("The Search is Over")

Grants

• Nancy Lurie Marks Family Foundation, "In Your Own Voice": Personal AAC Voices for Minimally Verbal Children with Autism Spectrum Disorder
• National Science Foundation, "HCC: High-quality Compression, Enhancement, and Personalization of Text-to-Speech Voices"
• National Institute of Health, "Voice Transformation for Dysarthria – Phase 1"
• National Institute of Health, "User Adaptation of AAC Device Voices – Phase 1"
• National Science Foundation, "STTR Phase 1: Small Footprint Speech Synthesis"
• National Science Foundation, "Making Dysarthric Speech Intelligible"

Education

• Ph.D. in Computer Science and Engineering, 2001
  Oregon Graduate Institute, Portland, OR
• B.A. in Computer Science and B.A. in Mathematics, 1995
  Rockford College, Rockford, IL

Professional Experience

• Assistant Professor, 2007-present
  Oregon Health & Science University, Portland, OR
• Research Scientist, 2005-present
  BioSpeech, Inc., Portland, OR
• Assistant Scientist, 2006-2007
  Oregon Health & Science University, Portland, OR
• Lead Speech Synthesis Technologist, 2001-2005
  Sensory, Inc., Santa Clara, CA
• Senior Research Associate, 2001-2005
  Oregon Health & Science University, Portland, OR
• Summer Research Intern, 1999
  AT&T Research Labs, Florham Park, NJ
• Summer Research Intern, 1998
  Fluent Speech Technologies, Portland, OR

Courses

EE 530 / EE 630 - Speech Synthesis

Credits: 3
Description: This course will introduce students to the problem of synthesizing speech from text input. Speech synthesis is a challenging area that draws on expertise from a diverse set of scientific fields, including signal processing, linguistics, psychology, statistics, and artificial intelligence. Fundamental advances in each of these areas will be needed to achieve truly human-like synthesis quality and advances in other realms of speech technology (like speech recognition, speech coding, speech enhancement). In this course, we will consider current approaches to sub-problems such as text analysis, pronunciation, linguistic analysis of prosody, and generation of the speech waveform. Lectures, demonstrations, and readings of relevant literature in the area will be supplemented by student lab exercises using hands-on tools.

CS 506 / CS 606 - Computational Approaches to Speech and Language Disorders

Credits: 3
Description: This course covers a range of speech and language analysis algorithms that have been developed for measurement of speech or language based markers of neurological disorders, for the creation of assistive devices, and for remedial applications. Topics will include introduction to speech and language disorders, robust speech signal processing, statistical approaches to pitch and timing modeling, voice transformation algorithms, speech segmentation, and modeling of disfluency. The class will use a wide array of clinical data, and will be closely tied to several ongoing research projects.

Publications

Intelligibility

• A. Kain, A. Amano-Kusumoto, and J.-P. Hosom. "Hybridizing Conversational and Clear Speech to Determine the Degree of Contribution of Acoustic Features to Intelligibility". Journal of the Acoustical Society of America, accepted for publication.
• A. Kusumoto, A. Kain, P. Hosom, and J. van Santen. "Hybridizing Conversational and Clear Speech". Proceedings of Interspeech, August 2007.
• A. Kain, J. Hosom, X. Niu, J. van Santen, M. Fried-Oken, J. Staehely. "Improving the Intelligibility of Dysarthric Speech". Speech Communication, Volume 49, Issue 9, September 2007, Pages 743-759.
• X. Niu, A. Kain, J. van Santen. "A Noninvasive, Low-cost Device to Study the Velopharyngeal Port During Speech and Some Preliminary Results". Proceedings of Interspeech, September 2006.
• X. Niu, A. Kain, J. van Santen. "Estimation of the Acoustic Properties of the Nasal Tract during the Production of Nasalized Vowels". Proceedings of EUROSPEECH, September 2005.
• A. Kain, X. Niu, J. Hosom, Q. Miao, J. van Santen. "Formant Re-synthesis of Dysarthric Speech". Proceedings of 5th ISCA Workshop on Speech Synthesis, June 2004.
• J. Hosom, A. Kain, T. Mishra, J. van Santen, M. Fried-Oken, J. Staehely. "Intelligibility of modifications to dysarthric speech". Proceedings of ICASSP, May 2003.

Text-to-Speech Synthesis

• A. Kain, Q. Miao, J. van Santen. "Spectral Control in Concatenative Speech Synthesis". Proceedings of 6th ISCA Workshop on Speech Synthesis, August 2007.
• A. Kain and J. van Santen. "Unit-Selection Text-to-Speech Synthesis Using an Asynchronous Interpolation Model". Proceedings of 6th ISCA Workshop on Speech Synthesis, August 2007.
• E. Klabbers, J. van Santen, A. Kain. "The contribution of various sources of spectral mismatch to audible discontinuities in a diphone database". IEEE Transactions on Audio, Speech, and Language Processing Journal, Volume 15, Issue 3, Pages 949-956, March 2007.
• J. van Santen, A. Kain, E. Klabbers, and T. Mishra. "Synthesis of Prosody using Multi-level Unit Sequences". Speech Communication Journal, Volume 46, Issues 3-4, Pages 365-375, July 2005.
• J. van Santen, A. Kain, and E. Klabbers. "Synthesis by Recombination of Segmental and Prosodic Information". Speech Prosody 2004, March 2004.
• A. Kain and J. van Santen. "A speech model of acoustic inventories based on asynchronous interpolation". Proceedings of EUROSPEECH, Pages 329-332, August 2003.
• J. van Santen, L. Black, G. Cohen, A. Kain, E. Klabbers, T. Mishra, J. de Villiers, X. Niu. "Applications of computer generated expressive speech for communication disorders". Proceedings of EUROSPEECH, Pages 1657-1660, August 2003.
• A. Kain and J. van Santen. "Compression of Acoustic Inventories using Asynchronous Interpolation". Proceedings of IEEE Workshop on Speech Synthesis, Pages 83-86, September 2002.
• J. van Santen, J. Wouters, and A. Kain. "Modification of Speech: A Tribute to Mike Macon". Proceedings of IEEE Workshop on Speech Synthesis, September 2002.

Speaker Transformation

• H. Duxans, A. Bonafonte, A. Kain, J. van Santen. "Including Dynamic and Phonetic Information in Voice Conversion Systems". Proceedings of ICSLP, October 2004.
• A. Kain. "High Resolution Voice Transformation". Ph.D. thesis, OGI School of Science & Engineering at Oregon Health & Science University, 2001. The data used in this thesis is available from the Linguistic Data Consortium as the VOICES Corpus.
• A. Kain and M. Macon. "Design and evaluation of a voice conversion algorithm based on spectral envelope mapping and residual prediction". Proceedings of ICASSP, May 2001.
• A. Kain and M. Macon. "Personalizing a speech synthesizer by voice adaptation". Third ESCA/COCOSDA International Speech Synthesis Workshop, November 1998, pp. 225-230.
• A. Kain and M. Macon. "Text-to-speech voice adaptation from sparse training data". Proceedings of ICSLP, November 1998, vol. 7, pp. 2847-50.
• A. Kain and M. Macon. "Spectral Voice Conversion for Text-to-Speech Synthesis". Proceedings of ICASSP, May 1998, vol. 1, pp. 285-288.

Miscellaneous

• A. Kain and Y. Stylianou. "Stochastic modeling of spectral adjustment for high quality pitch modification". Proceedings of ICASSP, June 2000, vol. 2, pp. 949-952.
• J. House, A. Kain, and J. Hines. "ESP - Metaphor for learning: an evolutionary algorithm". Proceedings of GECCO 2000, Las Vegas, NV.
• S. Sutton, R. Cole, J. de Villiers, J. Schalkwyk, P. Vermeulen, M. Macon, Y. Yan, E. Kaiser, B. Rundle, K. Shobaki, P. Hosom, A. Kain, J. Wouters, D. Massaro, M. Cohen. "Universal speech tools: the CSLU Toolkit". Proceedings of ICSLP, November 1998, vol. 7, pp. 3221-24.
• N. Malayath, H. Hermansky, A. Kain and R. Carlson. "Speaker-Independent Feature Extraction by Oriented Principal Component Analysis". Proceedings of EUROSPEECH 1997.

Patents

• J. van Santen and A. Kain, OHSU. System and Method for Compressing Concatenative Acoustic Inventories for Speech Synthesis.
• A. Kain and Y. Stylianou, AT&T Research Laboratories. Stochastic Modeling Of Spectral Adjustment For High Quality Pitch Modification.