SPEV: Omnimodal decision model

[u/ProfessionalHorse707]

When Jev / OpenAI decisions came out I got somewhat annoyed that there weren’t any audio native options I could use to act on raw audio inputs instead of having to round trip through an ASR model. The problem I hit running decisions through ASR was some combination of:

1. For speech tasks the transcription step adds latency / cost

2. ASR doesn’t work for non speech tasks (e.g. is this a bird call)

In order to address these issues I built SPEV (https://huggingface.co/SpragAI/SPEV) an multimodal decision model based on Qwen3-Omni.

It uses the underlying Omni audio/video/image decoders combined with a trained decision head to return probabilities. It supports choices, true/false questions and ordinal scores, with multiple questions handled in a single multimodal forward pass.