Spectral modeling synthesis

Spectral modeling synthesis or simply SMS is an acoustic modeling approach for speech and other signals.

SMS considers sounds as a combination of harmonic content and noise content. Harmonic components are identified based on peaks in the frequency spectrum of the signal, normally as found by the short-time Fourier transform. The signal that remains following removal of the spectral components, sometimes referred to as the residual, is then modeled as white noise passed through a time-varying filter. The output of the model, then, are the frequencies and levels of the detected harmonic components and the coefficients of the time-varying filter.

Intuitively, the model can be applied to many types of audio signals. Speech signals, for example, include slowly-changing harmonic sounds caused by vibration of the vocal cords plus wideband, noise-like sounds caused by the lips and mouth. Musical instruments also produce sounds containing both harmonic componenents and percussive, noise-like sounds when the notes are struck or changed.

See also

• Speech coding
• CELP
• Source-filter model of speech production
• FM synthesis
• SPEAR - Sinusoidal Partial Editing Analysis and Resynthesis

References

Xavier Serra (2003). "Spectral Modeling Synthesis: Past and Present" (PDF). p. 20. Retrieved May 11, 2010. {{cite web}}: Cite has empty unknown parameters: |month= and |coauthors= (help)

Xavier Serra. "Spectral Modeling Synthesis Tools". Retrieved May 11, 2010. {{cite web}}: Cite has empty unknown parameters: |month= and |coauthors= (help)

Julius O. Smith III (28). "Spectral Modeling". Retrieved April 19, 2008. {{cite web}}: Check date values in: |date= and |year= / |date= mismatch (help); Cite has empty unknown parameter: |coauthors= (help); Unknown parameter |month= ignored (help)