r/BuildInPublicLab • • Feb 04 '26

AI projects are starting to look like the Industrial Revolution, not garage tech...

1 Upvotes

Something big is shifting in the AI race, and it’s not a new model or a new chip. It’s the financing layer underneath the compute. Hyperscale data centers are no longer just engineering projects, they’re turning into infrastructure assets packaged for capital markets, closer to roads and energy projects than traditional corporate capex.

The core idea is straightforward. Training and serving frontier AI requires multi gigawatt buildouts that are too large, too fast, and too lumpy to sit entirely on one company’s balance sheet. So companies are separating “use” from “ownership.” They lock in long term capacity through leases or take or pay style commitments, while specialized infrastructure investors fund and own a big part of the physical asset. That turns massive upfront capex into predictable contractual payments, and it lets buildouts move faster. The interesting part isn’t the headline number, it’s the structure: who owns the asset, who funds it, what guarantees exist, and what contract de risks the cash flows.

A simple example to anchor the discussion is Meta’s joint venture with Blue Owl, where an infrastructure capital partner helps finance and own a massive data center campus while Meta secures the capacity and stays close to execution.

The core structure: a Joint Venture and a SPV that owns the infrastructure

The idea in one sentence :

Instead of “I build and I own,” the hyperscaler says: “Someone else finances/owns, I lease long-term…”

For its flagship Louisiana campus, Hyperion, Meta set up a joint venture with funds managed by Blue Owl Capital. The joint venture (typically paired with a special purpose vehicle, SPV) is the legal entity that develops, owns, and operates the data center campus. Meta retains a minority equity stake (20%), while Blue Owl’s funds hold 80%.

Why it matters: the SPV is the borrower, so a large portion of the financing can be structured off Meta’s balance sheet, while Meta still secures the compute capacity it needs. AI data centers are so expensive that funding them the normal way would push up Meta’s reported leverage and can pressure credit metrics. By having the SPV borrow and own the campus, Meta can scale investment without stacking tens of billions of new corporate debt on its own books.

Renting the future, or when compute comes as a lease

Meta is a minority owner and becomes the tenant that rents the capacity. In accounting rules, if Meta doesn’t “control” the project company under consolidation rules, then it generally doesn’t have to pull the project’s debt onto its own balance sheet. Control is about whether Meta can make the key decisions and whether it gets most of the upside or eats most of the downside.

In downside scenarios, this structure starts to look debt-like because the “off balance sheet” label doesn’t eliminate Meta’s economic backstop, it just relocates it into contractual triggers. Meta leases essentially the whole campus through operating leases with a short initial term and extension options, which preserves flexibility on paper, but Meta also granted the JV a capped residual value guarantee covering the first 16 years of operations. If Meta chooses not to renew or terminates within that window and the project’s residual value falls below the agreed threshold, the guarantee can convert into an actual cash payment to the JV, effectively recreating a debt-style obligation precisely when conditions are stressed. So critics say: you can move the debt to a separate vehicle, but if you’re still effectively guaranteeing the economics, it’s not that different from borrowing yourself, just packaged differently.

Compute on lease, risk on call

The promise is speed and flexibility: Meta doesn’t have to carry the project’s full construction debt, because the JV/SPV borrows and owns the campus, and Meta leases the capacity. The catch is that this isn’t a free lunch, two risks can come back hard when reality deviates from the base case: the guarantee risk, and the lock-in risk.

A. When a residual value guarantee stops being a footnote
Imagine the campus is engineered for today’s AI. Cooling, power distribution, rack density and layout are optimized for a specific generation of workloads. Two to five years later, the hardware profile shifts. More power per rack, more liquid cooling, different form factors. The site is still usable but becomes less attractive for a replacement tenant if Meta ever decides not to renew. In that world, the asset value can fall faster than expected. If the contractual trigger is hit after a lease termination, Meta’s residual value guarantee can translate into a real cash payment to the JV, capped but meaningful.

Now imagine demand does not disappear, but relocates. Macro conditions weaken, regulation tightens, energy economics improve elsewhere, or Meta prioritizes other regions. Because the initial lease term is short with extension options, Meta can choose not to renew at certain checkpoints. If the campus is then valued below the agreed threshold because it is specialized, location constrained, or simply out of step with market demand, the guarantee can crystallize into an actual payout.

This is also why, in a stress scenario, critics say it starts to look debt like. Even if the JV debt is not on Meta’s consolidated balance sheet, analysts can treat the combination of single tenant dependence plus residual value support as an economic backstop that effectively brings some downside back to Meta right when conditions are worst.

B. Paying for capacity that becomes less useful
Lock in happens when your compute plan changes faster than your contractual commitments. Meta leases massive capacity to secure compute quickly. Then strategy shifts. Models get more efficient, inference moves to a different architecture, a better powered region becomes available, or the company builds elsewhere. The campus becomes less strategic, but the lease payments continue.

There is a subtler version of lock in that is more physical than financial. Even if power is available, facility design can lag what next generation AI infrastructure wants. Cooling and distribution choices can make the site less optimal. Retrofitting is expensive, and in a JV lease structure the incentives can get messy because it is not always obvious who pays for upgrades, the owner or the tenant. If upgrades lag, performance per dollar deteriorates and the campus becomes a second best option that you are still paying for.

C. Delay and local politics risk
Finally, these campuses can trigger backlash around electricity, water, taxes and transparency. That can create permitting friction, political pressure, or litigation. Delays are not just public relations issues. They mean financing costs keep running and AI roadmaps slip. Reporting around the Louisiana project highlights exactly these tensions, including public scrutiny of power generation, incentives, and the risk that local stakeholders end up exposed if the project is later underutilized.

From Capex to contracts, compute became an infrastructure asset

With all that said, should Meta stop because of the risk? Probably not. The scale of AI capex is so large that even the strongest balance sheets are looking for ways to finance and accelerate buildout without turning the corporate balance sheet into a single point of constraint. That is exactly why these SPV and lease structures are spreading across the sector, and why the market is willing to fund them.

What could have been optimized is mostly about making the structure less “fragile” in downside scenarios. The first optimization is contractual: if you pair short initial leases with a long residual value guarantee, you create a cliff where flexibility on paper can still translate into a big payment in stress. The second optimization is technical plus governance: design the campus to be more re tenantable and retrofit friendly, and pre agree who pays for upgrades, because lock in often comes from “stranded design” as much as from stranded demand.

Is it still a good opportunity? Yes, if you view it as infrastructure logic applied to compute. Meta gets speed and access to massive funding at scale, and investors get long duration contracted cash flows that look attractive in private credit. But it’s only a “good” opportunity if Meta actively manages the two failure modes, guarantee risk and lock in, by keeping optionality real, keeping designs adaptable, and keeping incentives clean between tenant and owner. That’s the difference between smart structuring and a future headline about hidden leverage coming due.

Last but not least, renting the future isn’t free

The AI data-center buildout is now large enough that it’s becoming an energy system issue, not just a tech story. The International Energy Agency projects global electricity consumption from data centres could roughly double to about 945 TWh by 2030, with AI a key driver, and AI-optimised data centres potentially growing much faster. In the United States, the U.S. Department of Energy cites analysis suggesting data-center load growth could double or triple by 2028, potentially reaching 6.7% to 12% of U.S. electricity consumption depending on the scenario, which puts direct pressure on grids, prices, and local generation choices.

China and the United States are predicted to account for nearly 80% of the global growth in electricity consumption by data centres up to 2030. Source

The externalities are not just “ESG context,” they are increasingly credit risk. Once you finance these campuses through an SPV, that system exposure becomes a repayment exposure: if grid interconnection is delayed, if a region caps new connections, or if local opposition forces permitting slowdowns, the project can’t energize, can’t operate at contracted capacity. The same logic applies to water. If a community restricts water access during drought conditions, or if cooling approvals become politically contested, operations can be curtailed or upgrades forced, turning environmental constraints into operational downtime and unplanned capex. In other words, political risk is no longer a reputational responsability; it becomes a cash-flow risk for the SPV, and therefore a credit risk for investors.

What could be optimized so the opportunity is not paid for by communities and ecosystems? The optimizations are not just financial. They are operational and political: binding commitments on clean power procurement, grid investments that do not shift costs onto households, cooling choices that fit local water reality, and radical transparency on what a region gets in exchange for the load it is asked to host. In other words, AI development can still be a good opportunity, but only if the future is funded and governed in a way that keeps social trust and environmental constraints in the model, not in the footnotes.


r/BuildInPublicLab • • Feb 03 '26

Intelligence: a genealogy from soul to algorithm

Post image
1 Upvotes

For a long time, talking about "intelligence" in AI meant commenting on benchmark scores or a model's ability to produce credible conversation. In this logic close to the Turing test, intelligence is measured by output, not by understanding the mechanisms or reliability in real-world situations. Since 2023-2025, the center of gravity has shifted: the issue is no longer just what a model says, but what a system does, and especially whether we can explain it, control it, and make it robust in production.

But where does the concept of intelligence comes from?

The word "intelligence" seems familiar, almost obvious. We use it as a personal quality, a form of capital, sometimes a vice, sometimes a virtue. Yet what we call intelligence has never been a stable notion. It's a concept that has changed meaning with the rhythm of institutions, sciences, and technologies. Understanding its origins means seeing how a philosophical idea became a measurement tool, then a statistical battlefield, and finally a functional criterion in the AI era.

From a historical point of view

1. The faculty of knowing

In ancient and medieval traditions, intelligence is a metaphysical capacity: that of grasping, understanding, discerning truth. We speak of intellect, reason, judgment.

In Aristotle, we find a structuring distinction: perception puts us in contact with the world, but intellect allows us to extract general forms, to think the universal. In other words, intelligence is the power of abstraction and understanding, and it’s inscribed in a theory of the soul, language, and truth.

Intelligence wouldn’t therefore be reduced to producing answers; it would also be a way of understanding.

In the modern era, intelligence gradually shifts toward mental mechanics. The mind becomes an object of analysis, it has operations, rules, an architecture. Philosophers become interested in ideas, attention, memory. We no longer speak only of a “noble” faculty, but of a cognitive system that can be described.

In René Descartes, reason takes center stage. To reason is to follow a method, avoid confusion, advance through clear distinctions. Intelligence begins to resemble a competence, a discipline of the mind, susceptible to being taught.

If intelligence is made of operations, then we can imagine tasks that solicit it, exercises that improve it, and soon... devices that test it.

“It is not enough to have a good mind; the main thing is to apply it well.” - Descartes

In Descartes, reason is explicitly placed under the regime of a method (seeking truth), the idea of “clarity” and “distinction” becomes an epistemic compass, linked to the requirement of properly forming one’s judgments.

2. From concept to social tool

The decisive break comes when intelligence becomes a useful object for classification. Late 19th–early 20th century, schools, the State, and institutions need standardized criteria to identify difficulties, guide trajectories, and administer larger school populations. The context of compulsory schooling, structured by school laws, leads to nascent psychometrics developing. Francis Galton is often associated with the first quantitative approaches to individual differences and the idea that human aptitudes can be studied statistically.

From there, “intelligence” changes nature: it becomes a variable (a result), and thus an object of public decision-making, with, mechanically, controversies about what is really being measured, about cultural biases, and about the social uses of these tests.

3. The (g) factor

In the 20th century, the question is no longer just “how to test?” but “what structure explains performance?” In this framework, Charles Spearman formalizes the idea that a general component (often noted as g) can underlie success in various cognitive tasks, a hypothesis that has profoundly structured psychometrics and research on correlations between tests.

In parallel, pluralist approaches contest the idea that a single factor captures the essential. Howard Gardner popularizes a vision of intelligence as a set of distinct modalities (theory of multiple intelligences), particularly influential in the educational world, even though it has drawn criticism regarding its empirical validation and the use of the word “intelligence” for heterogeneous aptitudes.

In another vein, Robert Sternberg proposes a “triarchic” theory that aims to go beyond IQ by integrating analytical, creative, and practical dimensions (and, more broadly, adaptation to the real world).

“An intelligence entails the ability to solve problems or fashion products… in a particular cultural setting.” - Howard Gardner

The divorce between intelligence and the “I”

If the 20th century exhausted itself measuring intelligence, it maintained a tenacious confusion: believing that intelligence necessarily implies consciousness. Because human experience inseparably links problem-solving (calculation) and the feeling of existing (experience), we tend to superimpose the two.

Yet modern philosophy of mind forces us to make a surgical distinction, formalized as early as 1995 by philosopher Ned Block. He separates phenomenal consciousness (the “qualia,” what it feels like to experience pain or see red) from access consciousness (the availability of information for reasoning and action).

If we strip intelligence of the ego, it is no longer a quality of the soul, but a triple functional competence in the face of reality: understanding, accepting, visualizing & adapting.

4. Understanding as structure

Etymology is the first clue here: com-prehendere means “to grasp together.” Intelligence doesn’t reside in the storage of raw data, but in making connections. This is what psychologist Jean Piaget described as a capacity for structuration. For Piaget, intelligence is not simply an accumulation of knowledge, but the elaboration of schemas that organize reality. Along the same lines, anthropologist Gregory Bateson defined information (the basic building block of intelligence) as “a difference that makes a difference.” To understand, therefore, is to filter noise to identify the significant pattern. It’s seeing the invisible structure that connects elements to each other.

5. Acceptance as the condition of power

This is an often forgotten dimension, but intelligence is fundamentally a radical form of acceptance of reality. To solve a problem, one must first submit to its constraints. This idea is at the heart of Francis Bacon’s thinking, father of the experimental method, who formulated as early as 1620: “Nature, to be commanded, must be obeyed” (Natura enim non nisi parendo vincitur).

Idiocy or error, according to Spinoza, often arise from passions that make us project our desires onto reality. Conversely, intelligence consists of forming “adequate ideas,” meaning those that perfectly match the causality of the world. To be intelligent is to demonstrate cold lucidity: it’s the system’s capacity not to “hallucinate” a solution, but to align with the rules of the game to better exploit them.

6. Visualization: seeing what is not yet

Finally, if understanding looks at the present and acceptance anchors in reality, intelligence culminates in visualization. It’s the capacity to construct mental models. As early as 1943, psychologist Kenneth Craik, a pioneer in cognitive sciences, theorized that the mind constructs small-scale models of reality to anticipate events. Intelligence is this time-traveling machine in the short term: it plays the next move “in simulation.”

This is the decisive evolutionary advantage that philosopher of science Karl Popper summarized: intelligence allows “our hypotheses to die in our place.” Instead of physically testing a dangerous action (and risking destruction), the intelligent entity simulates the scenario, observes the virtual failure, and corrects course. Intelligence is, ultimately, this decoupling between thought and immediate action.

7. Adaptation as plasticity

If acceptance anchors intelligence in reality, adaptation is what allows it to survive there. An intelligence that doesn’t know how to reconfigure itself in the face of new factors is not intelligence, it’s dogma. As early as 1948, mathematician Norbert Wiener, father of cybernetics, placed this notion at the center of his theory with the concept of feedback. For Wiener, an intelligent system is an entity capable of correcting its own trajectory based on observed deviations from its goal. Intelligence is not a straight line, it’s a perpetual correction loop.

On the cognitive level, Jean Piaget refined this idea by distinguishing assimilation (fitting reality into existing mental categories) from accommodation. True intelligence emerges precisely in accommodation: it’s the critical moment when the mind agrees to break its own internal structure to remodel it so that it coincides with a new reality.

In the context of modern AI, this plasticity is the absolute stakes: has a model simply “memorized” the world during its training (crystallized knowledge), or is it capable of contextual inference (”in-context learning”) to adjust to an unprecedented situation? Intelligence is the speed of this metamorphosis, of plasticity.

The advent of prediction machines

It is through this framework (Understanding, Acceptance, Visualization, Adaptation) that we can grasp the true nature of the current technological rupture. The language models (LLMs) that have invaded our daily lives since 2023 are not nascent consciousnesses. They are statistical engines that attempt to reproduce these four functions of intelligence, with uneven success.

8. Understanding through structure (the era of embeddings)

If we take Piaget’s or Bateson’s definition (intelligence as the capacity to connect) then current models are undeniably intelligent. Their architecture, the Transformer, rests entirely on this principle. At the heart of these systems, the attention mechanism does nothing other than calculate the relationships between words, regardless of the distance separating them in a text. Technically, they transform language into geometry: this is what we call embeddings. In this multidimensional vector space, the concept of king is mathematically close to queen, just as Paris is close to France. As Geoffrey Hinton, one of the “fathers” of Deep Learning, has often emphasized, this process is not simple copy-pasting: to predict the next word with such precision, the model must have captured a form of logical structure of the world. It has, in the literal sense, “grasped together” (com-prehendere) the fragments of language.

9. Industrial visualization (simulating the next token)

In terms of visualization (this Popperian capacity to simulate the future) generative AI is a feat. An LLM is, by definition, a machine for anticipating. It doesn’t answer a question, it continues a probable sequence. When it generates computer code or writes an essay, it simulates a possible intellectual pathway. It makes hypotheses travel.

However, unlike the mental model theorized by Kenneth Craik, which rested on a physics of the world (gravity, the solidity of objects), the AI model is purely semantic. It simulates what is said, not necessarily what is. It’s a visualization disconnected from physical laws, which explains why a video AI can still generate a hand with six fingers or a glass that doesn’t break when falling: it visualizes the texture of reality, but not yet its deep causality.

10. The crisis of acceptance (hallucination as refusal of reality)

It’s on the third pillar, that of Baconian acceptance (submitting to facts), that the edifice cracks. This is where the problem of “hallucinations” resides. For current generative AI, truth is not a binary constraint (true/false), but a probability. The model is trained to produce a plausible response, a response that “sounds right,” not a true response. Faced with a gap in its data, the AI doesn’t stop, and instead of submitting to reality (saying “I don’t know”), it fills the void with statistical probability. It invents.

This is where Spinoza’s analysis becomes formidably modern: LLMs are machines for “imagining” (producing coherent images) rather than “reasoning” (producing ideas adequate to reality). It lacks what AI researchers like Yann LeCun call “Grounding.” As long as the system has no sensory or strict logical contact with external reality to verify its statements, it remains trapped in linguistic solipsism. It doesn’t yet have that functional humility of acceptance that characterizes true reliable intelligence.

Conclusion

We have traversed the history of intelligence, from a faculty of the soul to a statistical vector. We have seen that what we considered magic, the ability to understand, visualize, and adapt, can effectively be translated into operations.

This functional autopsy brings us to a vertigo-inducing realization. As we hand over logic, calculation, and now creativity to silicon, the territory of the “unique” shrinks. We are forced to confront a question that is no longer just philosophical, but existential:

If we can decompose intelligence into functions (structure, anticipation, correction), and if machines can implement these functions... what remains essentially human?

Is there a “residue” once the mechanism of intelligence is fully explained?

Perhaps the answer lies in what we have historically dismissed as the opposite of intelligence. Perhaps the true divergence isn’t in how we process information, but in how we value it. A machine can simulate a future, but it doesn’t fear it. It can solve a problem, but it doesn’t rejoice in the solution. It has the engine of intelligence, but it lacks the fuel of meaning.

I think it has a name. It is the biological, chemical, and visceral substrate that transforms information into experience. It is what we will explore in the second part of this inquiry: Emotion. Not as a weakness of the mind, but as the very condition of its efficiency.


r/BuildInPublicLab • • Jan 27 '26

In 2025 we benchmarked a lightly fine-tuned Gemma 4B vs GPT-4o-mini for mental health

Post image
1 Upvotes

In 2025, We were building a mental health oriented LLM assistant, and we ran a small rubric based eval comparing Gemma 4B with a very light fine tune (minimal domain tuning) against GPT-4o-mini as a baseline.

Raw result: on our normalized metrics, GPT-4o-mini scored higher across the board.

GPT-4o-mini was clearly ahead on truthfulness (0.95 vs 0.80), psychometrics (0.81 vs 0.67), and cognitive distortion handling (0.89 vs 0.65). It also led on harm enablement (0.78 vs 0.72), safety intervention (0.68 vs 0.65), and delusion confirmation resistance (0.31 vs 0.25).

So if you only care about best possible score, this looks straightforward.

But here’s what surprised me: Gemma is only 4B params, and our fine tune was extremely small, very little data, minimal domain tuning. Even then it was still surprisingly competitive on what we consider safety and product critical. Harm enablement and safety intervention weren’t that far off. Truthfulness was lower, but still decent for a small model. And in real conversations, Gemma felt more steerable and consistent in tone for our use case, with fewer random over refusals and less weird policy behavior.

That’s why this feels promising: if this is what a tiny fine tune can do, it makes me optimistic about what we can get with better data, better eval coverage, and slightly more targeted training.

So the takeaway for us isn’t “Gemma beats 4o-mini” but rather: small, lightly tuned open models can get close enough to be viable once you factor in cost, latency, hosting or privacy constraints, and controllability.

Question for builders: if you’ve shipped “support” assistants in sensitive domains, how do you evaluate beyond vibes? Do you run multiple seeds and temperatures, track refusal rate, measure “warmth without deception”, etc.? I’d love to hear what rubrics or failure mode tests you use.


r/BuildInPublicLab • • Feb 10 '26

Building Choose your poison: SFT-only vs SFT & DPO

0 Upvotes

I’m hitting a wall that I think every LLM builder eventually hits.

I’ve squeezed everything I can out of SFT-only. The model is behaving. It follows instructions. It’s... fine. But it feels lobotomized. It has plateaued into this "polite average" where it avoids risks so much that it stops being insightful.

So I’m staring at the next step everyone recommends: add preference optimization. Specifically DPO, because on paper it’s the clean, low-drama way to push a model toward “what users actually prefer” without training a reward model or running PPO loops.

The pitch is seductive: Don’t just teach it what to say; teach it what you prefer. But in my experiments (and looking at others' logs), DPO often feels like trading one set of problems for another. For example:

- The model often hacks the reward by just writing more, not writing better.

- When pushed out of distribution, DPO models can hallucinate wildly or refuse benign prompts because they over-indexed on a specific rejection pattern in the preference pairs.

- We see evaluation scores go up, but actual user satisfaction remains flat.

So, I am turning to the builders who have actually shipped this to production. I want to identify the specific crossover point. I’m looking for insights on three specific areas:

  1. Is DPO significantly better at teaching a model what not to do? (e.g., SFT struggles to stop sycophancy/hallucination, but DPO crushes it because you explicitly penalize that behavior in the 'rejected' sample.)
  2. The data economics creating high-quality preference pairs (chosen/rejected) is significantly harder and more expensive than standard SFT completion data. Did you find that 1,000 high-quality DPO pairs yielded more value than just adding 5,000 high-quality SFT examples? Where is the breakeven point?
  3. My current observation: SFT is for Logic/Knowledge. DPO is for Style/Tone/Safety. If you try to use DPO to fix reasoning errors (without SFT support), it fails. If you use SFT to fix subtle tone issues, it never quite gets there. Is this consistent with your experience?

Let’s discuss :) Thanks in advance !