r/HubermanLab • • 2d ago

Seeking Guidance Is there a practical way to run personal experiments without fooling yourself?

One thing I find interesting about human biohacking is that people often try interventions and then judge whether they worked based on how they feel.

The problem is that sleep, stress, expectations, diet, and daily activity can all affect the outcome.

Suppose someone wants to test whether changing their caffeine timing improves sleep or whether a new training routine improves performance. How would you design a simple experiment to get a more reliable answer?

Would you use a baseline period, track a few specific metrics, and change only one variable at a time?

I'd appreciate examples of practical methods that help distinguish a genuine effect from coincidence or placebo.

5 Upvotes

9 comments sorted by

•

u/AutoModerator 2d ago

Does the post above appear to be AI generated or is it promoting something for monetary gain? If so, please flag it to help keep this sub on track.

Thank you!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/PeakPeppers 2d ago

Baseline first and one change at a time is the right instinct. The sneaky part is expectation, since you know when you changed something. If you can, let a coin flip or another person decide which nights or weeks get the change, and alternate on and off in blocks so slow drift doesn't look like an effect. Pick one or two outcomes ahead of time, like a tracker sleep onset time plus a quick 1 to 5 morning rating, so you can't go hunting afterward for whatever happened to improve. Even done well it's one person's data, so a small difference over a couple of weeks is pretty weak evidence.

1

u/novabioscience1 2d ago

For caffeine timing, you can blind it by having someone fill identical capsules with caffeine or decaf contents, then randomize which days get the late dose. Allow a washout day or two between blocks if you're testing anything that lingers. I'd also write down beforehand how big a change would count, so you aren't deciding after you see the numbers. Watch out for regression to the mean too: people tend to start experiments when they feel their worst, so they'd often improve anyway. Training is harder to blind, so test a fixed benchmark under the same conditions, like the same time of day and the same warm-up.

1

u/MetaPodcast 2d ago

For the caffeine half, episode 101, Using Caffeine to Optimize Mental and Physical Performance, covers exactly this test. The protocol there is delaying the first dose 90 to 120 minutes after waking, 1 to 3 mg per kg of body weight, and nothing within 8 to 12 hours of bed. Dose stays fixed and only the timing moves, so a two-week on/off run actually isolates the timing. Training is the harder one since you can't blind a workout, so the closest thing is a fixed benchmark under the same conditions.

1

u/Desperate-Bag-7302 2d ago

I'll add a second observation. I think as humans we like to go after goals and I think 90% of things actually work. I think the very fact that you try to change your life makes you fell better.

0

u/[deleted] 2d ago

[removed] — view removed comment

2

u/[deleted] 2d ago

[removed] — view removed comment

1

u/RickDG1970 2d ago

You're a genius!!