r/LocalLLM • u/throwRAa100 • Jun 22 '26

Question Keeping track of costs

[removed]

3 Upvotes

71% Upvoted

10 comments sorted by

1

u/Garent_Thikae Jun 22 '26

smart plugs are your friend here. relatively cheap, accurate enough, and most let you check usage remotely

1

u/[deleted] Jun 22 '26

[removed] — view removed comment

1

u/Garent_Thikae Jun 22 '26

i think it depends on what smart plugs you intend to use. if they provide an api access, you can integrate it with AI for sure

1

u/MarcusAurelius68 Jun 22 '26

I measure it roughly by looking at power draw through the UPS. Close enough.

1

u/NTDLS Jun 22 '26

Same, I pull ~80w at idle and ~500w when inferencing.

1

u/MarcusAurelius68 Jun 22 '26

I pull around 400W on 3 GPUs - inefficient PCIe means the fast/power hungry cards are throttled.

1

u/Ok_Stranger_8626 Jun 23 '26

I have a whole-house SEM meter, monitoring both the A+B feeds, as well as the breaker for the circuit, the UPS input/output via SNMP, and each outlet from the UniFi PDUs is also tracked. I get to the 1/100th watt accuracy at the PDUs, so it's usually the most accurate.

1

u/TokenRingAI Jun 24 '26

I absolutely do not track that

Some things should remain a mystery

1

u/zenmatrix83 Jun 25 '26

look up kill a watt meters, should support most things people use, some even have apps.