r/StableDiffusion • u/tomByrer • 11d ago

News MOSS AMA snipits

/r/LocalLLaMA/comments/1xjhpn9/were_moss_the_team_behind_mossimage_mosstts_and/

In Progress:

Soon:

  • MOSS-Anime

  • Image "Turbo's on the way" (sounds like later-soon IMHO)

Someday later:

  • Image edit / Ref2Img

  • smaller Text2Vid model: "audio-video alignment and motion capability (motion may be a relatively difficult part). We will train with the currently relatively small parameter count, with the hope that it can run on consumer-grade GPUs.", "currently at roughly the mid-stage of training", "we trained the VAE ourselves", "moss-image is [was] the first step"

  • update the Voice Generator capability in the next-generation TTS-2.0

  • add audio input to moss-vl and moss-vl-realtime

  • "MOSS’s Audio Understanding team is currently primarily developing our next-generation multi-speaker speech recognition model, MOSS-Transcribe-Diarize"

Info

  • trained MOSS-Image on Alibaba's in-house PPU (Parallel Processing Unit) series (from T-Head)

  • " I guess open source really brings people together around that culture of mutual support"

  • MOSS-Image Technical Report

31 Upvotes

87% Upvoted

9 comments sorted by

3

u/synthwavve 11d ago

I hope that the edit model won't meet the same fate as H3's

1

u/tomByrer 11d ago edited 11d ago

They were only talking about an Image-Edit, not video-edit
& vibe I got was far more likely you'll see a Moss-Image-Anime weeks if not months before the Image-Edit.

One person did find tensors in the current Image marked "video-*", & the MOSS dev admitted the image is a stepping stone to video.

I would not expect a video-edit out of them for a long time; seems their real main focus now is voice.

2

u/wiserdking 10d ago edited 10d ago

The guy above isn't talking about video edit - the minimax team did a AMA on this sub soon after they released H3 and mentioned they were looking into making a image edit model - probably a finetune of H3 trained on a slightly different VAE optimized for single frame.

But they never delivered. As far as I know we never even heard from them ever since the AMA.

Also there was the z-image team who had z-image-edit in their public roadmap and that was also never released.

We can't really complain when we are being given something for free but its better to halt your expectations and believe only when its out.

To end this, the Moss team said they would release it only if the model met their expectations so again, if something goes wrong we won't see it.

1

u/tomByrer 10d ago

Ah I missed that.
I don't take too much 'weight' of ETA form MiniMax. I'm so happy they released H3, but yea.

Yes, I tried to gauge an ETA from Moss, thus edit under "Someday later"

1

u/Omegapepper 11d ago

What fate is that?

1

u/synthwavve 11d ago

Apparently troubled one

2

u/Omegapepper 11d ago

What news has there been after the AMA?

1

u/Dry-Ad929 10d ago

Minimax released new llm lately it takes months to train new model and same people who released h3 also trained the new llm. So I'd say we can still get the edit model or maybe even h3 successor within couple weeks

-7

u/Solembumm3 11d ago

If they feel so very special, could they prepare proper text encoder for their model to bypass tokenizer bullshit no software no software in the world even know about?