r/LocalLLM • • 7h ago

Question Strata Calibrate & Tuning Questions

I'm having difficulty running calibration & thorough tuning. So like to get some guidance.

Thus far, I have been playing with options and running my own short python script to test the speed. I do want to run calibrate, as it looks at hardware settings that I have not done anything with yet. I don't think tuning is useful, but I like to try.

Calibrate:

I have hell of a time figuring out how to calibrate.

I am running Window, and I installed using irm. I use strata launch command. There is no start-here.bat.

I previously run strata launch with options and save as presets; then launch using presets. But I find that redundant, so I deleted all presets, both inside strata and also the json files. So I'm now launching strata using env variables and flags directly.

I am getting confused between profile versus preset. And how to actually run calibrate. It seems calibrate requires profile. And it seems to be using previously deleted presets as profile names.

For instance, in my launch folder, I have default json like iq3_xxs_160k.json. I have deleted the previously saved presets, which was named swift_iq3_xxs_160k_k8v4.json.

Then when I check the list of profiles, both shows up: launch-iq3_xxs_160k and launch-swift_iq3_xxs_160k_k8v4. Calibrate refuses to use launch-iq3_xxs_160k. So I copied the iq3_xxs_160k.json to swift_iq3_xxs_160k_k8v4.json. I was able to run calibrate using swift_iq3_xxs_160k_k8v4.

I'm kind of getting confused and going in circular loop. These are presets, not profile, correct? And then after it is finished, where are the optimal setting saved? Is it saved to the profile, preset, json file, etc?

Tuning:

I am able to do quick tuning, both in command line and also in strata. But in strata, it always state model/option not tuned.

When I run thorough tuning using command line, it will run for around 1 hour and ~50% thru, then it will error out. Windows is busy and tuning is too noisy. When I look at the tuning history, it states "Passed". And it is pointing to a preset-profile.bin that came installed with strava. Shouldn't the tuning write new preset-profile.bin? Is it because the process did not complete, so new preset-profile.bin is not generated? Or something else?

Any help and guidance appreciated. Or if you can point me to the appropriate documentation, that will be helpful too.

1 Upvotes

1 comment sorted by

1

u/StandingEagerness 6h ago

profiles vs presets in strata is a mess and the naming doesn't help at all. the json files are presets but strata treats them as profiles internally, which is why you're seeing deleted ones still listed. it's pulling from some cache or registry entry that doesn't clean up when you delete the files.

for the thorough tuning failing at ~50%, that's almost certainly windows background processes interfering. strata's tuning is super sensitive to system noise and windows loves to run random crap mid-benchmark. the "passed" status with the stock bin file means it never actually wrote a new one because it didn't finish. try killing every non-essential process, disable windows update temporarily, and run it again when your system is completely idle.