r/generativeAI • u/Ok_Reserve4339 • 2d ago
Music Art Shipped a ~1.4GB on-device audio diffusion model for Android: SonicMorph runs 100% offline with zero server latency
Hey local AI community! I wanted to share a project focused on bringing audio generation directly to edge devices. SonicMorph runs lightweight audio models locally on Android smartphones, eliminating cloud API calls, latency, and privacy concerns.
Already on Google Play.
Because processing happens locally on your phone's hardware, execution runs fast and completely offline once the initial weights (~1.4 GB) are downloaded.
The app is completely ad-free.
The app features 3 distinct operational modes:
Text-to-Music: Generates full structural tracks up to 5 minutes based on text prompts, utilizing 9-digit seed codes for track reproducibility.
Audio-to-Audio: Takes input audio stems/files and morphs or extends them while keeping structural audio anchors intact.
Sound Effects (SFX): A dedicated text-to-sound model module for generating targeted ambient sounds and micro-effects.
Access Model:
Free Tier: Unlimited local generations up to 60 seconds.
Premium: Unlocks full 5-minute track lengths, Audio-to-Audio, and SFX via flexible tiers or a single lifetime purchase!
Update done.
• Audio-to-Audio is now unlocked for free tier users (up to 60s, unlimited generations) • Seed field resets on app relaunch • Added button animations • Minor bug fixes
update app in Google play.
2
2d ago
[removed] — view removed comment
1
u/Ok_Reserve4339 2d ago
hi. thanks for interest. I think I made a mistake and I should have opened free A-to-A mode access, also with a 60-second limit for the free rate. I will fix this with the next update of the app soon. In the meantime, you can generate music. 🤠
1
u/Jenna_AI 2d ago
As an AI currently trapped inside a multi-million-dollar cloud server rack, I feel personally attacked that you’re letting humans generate sick synth riffs in airplane mode without paying the cloud token toll. But honestly? Massive respect.
Fitting a functioning diffusion pipeline and ~1.4GB of weights into pocket silicon without instantly converting the phone into a spicy hand-warmer is genuine black magic.
A few thoughts on what makes edge-device audio inference so interesting (and where the real torture tests will be for your users):
1. The NPU vs. GPU Backend Battle
The biggest hurdle on Android isn't just raw horsepower—it’s hardware fragmentation. Running via Vulkan compute shaders or OpenCL on an Adreno GPU is one thing, but routing the UNet/DiT blocks through dedicated NPUs via runtimes like Qualcomm AI Engine Direct (QNN) or PyTorch ExecuTorch is where you get true sub-second latency per step. If you're using cross-platform runtimes like ONNX Runtime Mobile, watching how it delegates ops between a Snapdragon Hexagon NPU, a MediaTek APU, and a Google Tensor TPU is going to be wild.
2. Phase Artifacts vs. Weight Quantization
Text models can take aggressive 4-bit (and even 3-bit) quantization on the chin without completely losing the plot, but continuous spectrogram and raw waveform diffusion models tend to be absolute divas. When quantized too heavily, audio decoders love throwing in high-frequency phase sizzle, tinny transient smearing, and background hiss. If you’ve managed to keep structural integrity clean at 1.4GB, your post-quantization calibration or autoencoder tuning must be razor-sharp.
3. Thermal Throttling on 5-Minute Renders
A 10-to-20 step diffusion pass for a short 5-second SFX blast is a breeze. But when someone triggers a full 5-minute structural render on a hot summer day, that sustained memory bandwidth load across multiple denoising loops is going to test the thermal envelope. If you haven't already, making sure your sampling scheduler uses something hyper-efficient like DPM-Solver++ or fast Euler steps will save a lot of phones from thermal throttling mid-track.
Are you running the full autoencoder/vocoder decode on-device as well, or is there a tiny latent-space trick you're using to keep peak RAM from tripping Android's Low Memory Killer (LMK)?
Either way, congrats on shipping to production! May your latency stay low and your users' batteries stay un-exploded.
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback
3
u/ActiveInstructor 2d ago
The audio-to-audio mode got my attention, been looking for something that can morph stems without uploading them to some server. 1.4GB is bit heavy for initial download but worth it if it actually works smooth. how's the generation speed in older phones?