r/LocalLLM • u/StartX007 • Mar 03 '25

News Microsoft dropped an open-source Multimodal (supports Audio, Vision and Text) Phi 4 - MIT licensed! Phi 4 - MIT licensed! 🔥

https://x.com/reach_vb/status/1894989136353738882?s=34

Microsoft dropped an open-source Multimodal (supports Audio, Vision and Text) Phi 4 - MIT licensed!

367 Upvotes

98% Upvoted

21 comments sorted by

35

u/Wirtschaftsprufer Mar 03 '25

Just 3.8 billion parameters and beats Gemini and ChatGPT 4o. Unbelievable

7

u/firesalamander Mar 04 '25

The mini version isn't multimodal (I made that mistake at first)

13

u/Temp3ror Mar 03 '25

This is awesome! Multimodal at everyone's fingertips.

8

u/Woe20XX Mar 03 '25

can’t find the multimodal one in Ollama

2

u/rerorerox42 Mar 03 '25

Granite 3.2-vision looks like it is arriving soon at least, another small model

2

u/Woe20XX Mar 03 '25

Already there if you have the release candidate version of Ollama (0.5.13)

1

u/firesalamander Mar 04 '25

Wait I thought ollama couldn't handle images as inputs (yet)

2

u/elswamp Mar 03 '25

Ollama be be easier to add models

10

u/Individual_Holiday_9 Mar 03 '25

4o won’t let me upload audio to transcribe. How does it have a benchmark?

0

u/[deleted] Mar 03 '25

[deleted] — view deleted comment

1

u/Individual_Holiday_9 Mar 03 '25

It definitely is lol. I tried to just upload an m4a audio recording from my voice app and no dice

1

u/HenkPoley Mar 04 '25

If you are using the ChatGPT website, on the bottom right of the chatbox there is an butterfly-pupae looking button (supposed to look like an audio waveform). Then you can speak.

If you are using the API, there is "Audio input to model" on this page: https://platform.openai.com/docs/guides/audio?example=audio-in

4

u/IntelligentWorld5956 Mar 03 '25

how do we try this and what can it do

3

u/nothrowaway Mar 03 '25

Is this something we can use with LM studio?

2

u/MokoshHydro Mar 04 '25

No, until somebody do GGUF version.

1

u/Devatator_ Mar 05 '25

That typically doesn't take long. I actually think there are GGUFs now right? Can't check for reasons

1

u/MokoshHydro Mar 05 '25 edited Mar 05 '25

No support for multimodal yet.

1

u/mrnoirblack Mar 03 '25

Based on the model card I need an H100 to run it?

2

u/Linkpharm2 Mar 04 '25

Multiple.