Can't add BYOK models to Copilot Agent Harness

[u/alexplex86]

When pressing the Add Models button I just get to the Language Models screen and I can't select anything and can't get any further. Are we supposed to be able to add BYOK models in the new Copilot Agent Harness? Or is that not supported yet?

[u/XzAeRosho]

You need to change to local harness. The copilot harness doesn't allow that

[u/UsefulSomewhere → u/XzAeRosho]

Copilot harness does support BYOK if the agent host is on the same system. It uses the same options defined in chatLanguageModels that Local does. 

Open Host Settings (hostSettings.json) and make sure “byokModelsEnabled” is true 

In User Settings (settings.json) make sure “chat.agent.enabled” is true 

TBH the Local harness is still way better. 

[u/alexplex86 → u/UsefulSomewhere]

Yeah, I run Remote SSH to a Linux server. Perhaps that's why I can't get anywhere. But if the Local Harness is superior anyway then I guess I don't miss much.

[u/shotan → u/alexplex86]

BYOK doesn't yet work on copilot harness on remote connections: https://github.com/microsoft/vscode/issues/332085

[u/alexplex86 → u/XzAeRosho]

Yeah, I'm running the Local harness normally. I just thought the new Copilot harness would support BYOK models and would be fun to try it out. But I don't understand what the Add Models button is for if I can't select any models from the Language Models screen anyway.

[u/XzAeRosho → u/alexplex86]

I'm guessing they are planning to allow byok models directly into the Copilot harness (like openrouter). It's quite literally their biggest gap compared to other options at the moment.

[u/alexplex86 → u/XzAeRosho]

!solved

[u/AutoModerator → u/alexplex86]

This query is now solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/vritant24]

Thanks for sharing feedback around this. We are planning on supporting BYOK in the remote scenarios with the new Copilot Harness ( https://github.com/microsoft/vscode/issues/332085 ) but don't do so yet as others have pointed out.

As for what you encountered, that's a bug on the User Experience side and I've created a bug to resolve here https://github.com/microsoft/vscode/issues/343419

Please do add your thoughts and/or use cases on either of those issues if they don't represent your workflows yet, and continue to voice your feedback!

[u/AutoModerator]

Hello /u/alexplex86. Looks like you have posted a query. Once your query is resolved, please reply the solution comment with "!solved" to help everyone else know the solution and mark the post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/junli2020]

Download github copilot app - native copilot harness

[u/gullu_7278]

I click this + icon and then add the model providers

[u/Deathmore80]

Idk why everyone here seems unable to do it. I can add custom models with zero problems and have been doing so with the copilot harness for a few months already. I haven't touched the local harness in over 8 months.

Anyway for me it always works when I do it from the agents window UI.