ENEE 632: Speech and Audio Processing

Course Goals:

Course Prerequisite(s):

Topics Prerequisite(s):

Textbook(s)

Reference(s):

1. Quatieri, Discrete-time Speech Signal Processing, Prentice-Hall
2. Stevens, Acoustic Phonetics, MIT press
3. Flanagan, Speech Analysis, Synthesis, and Perception, Springer-Verlag.
4. Rabiner & Juang, Fundamentals of Speech Recognition, Prentice-Hall

Core Topics:

1. Review of DSP (Chap. 2, Quatieri or Chaps. 6 & 7, Gold and Morgan)
   • Discrete-time Fourier Transform, z Tranform and Discrete Fourier Transform
   • Upsampling, Downsampling
2. Speech Production and Acoustic Phonetics (Chaps. 3 & 4, Quatieri or Chaps. 10 & 11, Gold and Morgan)
   • Articulatory Phonetics, Acoustic Theory of Speech Production, Prosody
   • Vocal tract Modeling, Discrete-time Modeling of Speech Production
3. Music Production (Chap. 12, Gold and Morgan)
4. Auditory Perception (Chap. 14 & 15, Gold and Morgan)
   • Peripheral Auditory System
   • Psychoacoustics
5. Speech Perception (Chap. 3, Quatieri or Chap. 17, Gold and Morgan)
6. Signal Processing Techniques (Chaps. 5, 6 & 7, Quatieri or Chaps. 19, 20 and 21, Gold and Morgan )
   • Short-time Fourier Transform,
   • Linear Prediction Analysis of Speech
   • Cepstral Analysis of Speech
7. Speech Analysis Tools (Chap. 10, Quatieri or Chap. 30, Gold and Morgan)
   • Pitch Detection, Formant Tracking
8. Music Analysis
   • Pitch Detection, Feature Analysis for Recognition
9. Speech Coding (Chap. 12, Quatieri or Chaps. 31, 32 & 33, Gold and Morgan)
   • Waveform Coding, Model-Based Coding, LPC Residual
10. Speech Synthesis (Chap. 6, Quatieri or Chap. 29, Gold and Morgan)
11. Music Synthesis (Chap. 32, Gold and Morgan)

Optional Topics:

Course Structure:

Grading Method: