ok, I tried this and it works beautifully.
In addition, I found this in the manual, under VIEW Flags:
AUDIBLE
If this flag is set, the view position and orientation determines direction and distance of sound sources and entity sounds in the level. The view must be visible for this. The camera view has this flag set by default. To avoid a sound mix-up, only one view should have this flag set
Guess I should have RTFM a little closer
Still would be nice though if it was possible to set this flag on entities, not just cameras.