WWDC Notes

Advances in Speech Recognition

Show Apple's description.
Speech Recognizer can now be used locally on iOS or macOS devices with no network connection. Learn how you can bring text-to-speech support to your app while maintaining privacy and eliminating the limitations of server-based processing. Speech recognition API has also been enhanced to provide richer analytics including speaking rate, pause duration, and voice quality.
  • MacOS support
  • over 50 languages supported

Jitter, shimmer analysis

Jitter is a measure of frequency instability, while shimmer is a measure of amplitude instability.

Basically can measure if the person is chilling or panicking.

Pitch, voicing analysis

Pitch measures the frequency characteristics, voicing determine voiced regions (their wideness).

Basically can measure if the person is active or tired, length of pauses.

Missing anything? Corrections? Contributions are welcome 😃

Related

Written by

zntfdr

Federico Zanetello

Federico Zanetello is an iOS Engineer with strong passion for Swift, minimalism, and design. When he’s not busy automating things, he can be found writing at fivestars.blog and/or playing with the latest shiny toys.