Choosing representations for acoustic ML

How STFT, Mel, wavelets, and embeddings map to industrial constraints.

Last updated: 2026-01-24

Feature representation is where signal knowledge meets ML

For acoustic and sensor ML, the choice of representation affects robustness, latency, and interpretability. A common pattern is: raw signal → windowing → time–frequency transform → model.

Common representations (and when they help)

  • STFT / spectrograms: strong default for many acoustic tasks; good balance of information and compute
  • Mel spectrograms: compact; often effective when frequency resolution requirements are moderate
  • Wavelets: useful when multi-scale structure matters or transient events dominate
  • Learned embeddings: can boost performance when pretraining aligns with your domain — but require careful validation

Industrial constraints to include early

  • Latency: how quickly must a decision be produced?
  • Compute: edge device vs. cloud; power and memory limits
  • Sensor mismatch: new microphones/sensors and mounting changes are normal in real deployments
  • Noise & drift: new machines, materials, and environmental conditions change distributions

A good feasibility plan tests representation choices against these constraints, not only against a benchmark metric.

Back to InsightsHome