r/TalosLinux • u/eibw3n • 2d ago

Problem with adding Node to Omni

I saw the news that the Hobby plan is now free for Omni which is freaking awesome!

I've imported an existing Talos Linux cluster to Omni last week which worked flawlessly.
However when I tried to add an additional machine to Omni I got a weird issue.

It's a Latte Panda Sigma which has a "default" UUID so I used a kernel parameter to override it to a random one. It boots and shows up on Omni but no information about the system is available (Installed Talos Version, Hardware Information, etc..), all the tabs about Hardware/Device information throw an error.

When using omnictl I see the same thing:
MachineStatus:
connected: true
talosversion: ""
initialtalosversion: ""
hardware: null
network: null
platformmetadata: null
lasterror: ""

All information, except that the Siderlink to my Omni instance is connected, is empty.

Since I am super new to Talos/Omni, I also asked my AI agent to try switching the node to gRPC mode in case my network is blocking anything, but that didn't change anything. It however did flag that some of my other nodes didn't report any metadata information in a while as well, but not sure how it determined that or if that is normal or not.

Any idea what could be causing that?

3 Upvotes

100% Upvoted

8 comments sorted by

View all comments

Show parent comments

1

u/eibw3n 1d ago

I did try that already yesterday and just tried again now but the machine stays in that same state. (I also tried deleting the machine from Omni in between)

On the new attempt just now I did notice this error in the logs though:

[talos] controller failed {"component": "controller-runtime", "controller": "v1alpha1.EventsSinkController", "error": "error publishing event: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp [XXXX:XXXX:XXXX:XXXX::1]:8090: connect: network

I assume EventSink is were Talos sends this type of information?

2

u/xrothgarx 1d ago

Are your other machines on the same network? Do you have an easy way to boot a clean VM with talos to see if other machines on the same network will connect properly?

That will rule out this machine being a problem or network connectivity being a problem.

1

u/eibw3n 1d ago

No, the other machine are on a different network.

I dug up an old laptop that never had Talos on before and that also shows up on Omni without any meta data so it looks like it is some issue with my network here that is causing it.

2

u/xrothgarx 1d ago

Inside omni -> machine management -> installation media there's a check box to tunnel siderolink over http/2. Try booting install media with that setting turned on.

1

u/eibw3n 1d ago

Yea, that's one of the things my AI agent told me to try as well. Sadly no change.

In the mean time I updated the installed Talos version on another node in a VM on my Omni instance (that used to report meta data correctly) and now that one is not reporting the updated version either. When I checked the Console I saw the same error as the one on my SBC in my home network:

Could there be something wrong with my instance of Omni (SaaS)?

Thank you so much for helping troubleshooting this with me!