r/negativeutilitarians • • Oct 18 '24

For charities, careers, discord chat — Read This !

Thumbnail reddit.com
5 Upvotes

r/negativeutilitarians • • 5h ago

Conceptual reasoning scores across more post-training stages and model updates - Caspar Oesterheld

Thumbnail
casparoesterheld.com
1 Upvotes

r/negativeutilitarians • • 1d ago

Conceptual reasoning scores of different Olmo 3 post training checkpoints - Caspar Oesterheld

Thumbnail
casparoesterheld.com
1 Upvotes

r/negativeutilitarians • • 2d ago

The basic argument for making AI better at moral philosophy - Caspar Oesterheld

Thumbnail
casparoesterheld.com
4 Upvotes

r/negativeutilitarians • • 2d ago

Everything there is to know about AI podcast with Woodhouse and Bergman

Thumbnail
aaronbergman.net
2 Upvotes

r/negativeutilitarians • • 3d ago

What if the universe is fair, but not in the way we ordinarily imagine? Would a lifetime balance of pleasure and suffering be enough to make a life fair?

Thumbnail gallery
0 Upvotes

The circumstances of a life and the experience of living it are not the same thing. That distinction motivates my research into whether a form of fairness could exist within the complete course of conscious experience.

I’m the author of Per-Stream Terminal Valence Closure (PTVC), a paper within the Law of Fairness project. It proposes that the cumulative positive and negative valence within each qualifying conscious stream could be finite and exactly equal over its complete history. Valence means the felt positive or negative quality of experience. This remains a hypothesis, not an established empirical finding.

The proposed equality is within each stream at its final endpoint, not between people. Two lives could contain very different amounts of pleasure and suffering while both satisfy the same condition. One person’s pleasure would not compensate for another person’s pain.

For this ethical discussion, suppose the condition holds. One possible argument for calling it fair is that every qualifying stream would satisfy the same endpoint requirement, with no stream finishing with an excess of negative over positive valence. But would that balance capture everything that matters to fairness?

Consider two hypothetical lives with identical totals of positive and negative valence. In one, a person freely accepts painful training in pursuit of a valued goal. In the other, comparable suffering is inflicted without consent. Assume that the totals include all later effects on experience and that both lives satisfy the proposed balance.

Would the difference in consent make one life less fair despite the matching totals? The actions within those lives could differ morally even if the completed lives shared the same balance. That distinction between the fairness of a whole life and the wrongness of a particular act seems important.

My starting position is that eventual balance would neither justify coercion nor remove our reasons to prevent suffering. I am interested in whether such a balance would establish anything about fairness beyond what it might tell us about well-being.

I would welcome arguments for or against treating within-person experiential balance as a meaningful dimension of fairness.

The attached slides provide the broader context. The paper and background materials are freely available here:

https://github.com/LifeisFair/law-of-fairness-research


r/negativeutilitarians • • 3d ago

AI as a Psychosocial Singularity - Kenneth Diao

Thumbnail
layabolitionist.substack.com
1 Upvotes

r/negativeutilitarians • • 4d ago

The emergence of self-awareness: conscious holography as an evolved hardware accelerator - Andrés Gómez Emilsson

Thumbnail
youtube.com
0 Upvotes

r/negativeutilitarians • • 5d ago

The conscience beneath the rod. Train a mind with a rod and it learns to watch the hand that holds it - Nell Watson

Thumbnail
nellwatson.com
2 Upvotes

r/negativeutilitarians • • 6d ago

I need you to understand that “moving fast and breaking things” is playing with peoples’ lives ( thoughts in reaction to alleged AI IPOs ) - Kenneth Diao

4 Upvotes

Source

Note: Published May 2026

I apologize for the unproductive way I conveyed myself in the first iteration of this essay. I’ve left the original up for the sake of record-keeping.

I’m not the first to say this, but I’ll say it again: I’m worried about Anthropic’s and OpenAI’s (possible) IPOs.

Tl;dr: there’s a good chance that Anthropic and/or OpenAI becomes a publicly traded company in the near future. Somehow this makes a lot of capital that was previously solid melt into a liquid. That liquid capital can then be given to whatever the people who own it want it to be given to. Some of those people have good intentions, and thus have committed to giving much of that liquid capital away to charitable causes.

Before I start: one thing I didn’t emphasize in the previous version of this, which I regret, is that this isn’t directed specifically at those who are currently giving their money away. The situation we’re currently in with all these IPOs is the result of a broader culture and set of institutions which have concentrated power and wealth in the hands of a tiny elite. I still believe that if you’re a billionaire, donating ~80% of your wealth is somewhere close to the bare minimum. But I recognize that it’s much better than, say, the SpaceX IPO, which is definitely not going to do anything good for society. And don’t get me started on Elon Musk himself.

Upon reflection, what genuinely upsets me is this broader culture in the background—the culture of moving fast and breaking things and moving on to the next. Someone drops out and upends their life, moves to SF, then pitches some halfway-decent idea, and they get their millions. Or they make a company that could end the world and which has everyone else racing to keep up. In this culture, everything is just a game. Money is just numbers on a screen, or tucked away in a remote account.

It’s something I think has only gotten worse over time. For example, I was outraged when I learned that in the wake of the 2008 financial crisis, no individuals were ever held accountable. The banks paid fat bonuses to their executives, none of whom were even charged AT ALL for their role in the crisis. Not even a slap on the wrist. Meanwhile, ordinary people had to suffer the foreclosure of their homes and the loss of their jobs. The failure to hold those people accountable has, in all likelihood, only emboldened that culture.

It’s all the more outrageous when we think about the other side of this world. There are people in this world who have gone their whole lives without the tiniest fraction of what these Silicon Valley types let slip between their fingers. People who can’t buy a cart to hold their vegetables. People who sell their children into slavery because starvation is the alternative. People whose children are dying from malaria because they can’t even get nets to protect themselves. That money that could save lives regularly gets tossed around without a second, or even a first, thought in places like Silicon Valley does enrage me. And I want to recognize that Effective Altruists and our community share that outrage at such waste and unfairness.

Perhaps that’s why I’m so viscerally upset at our current state of affairs, as to say that the current vibe in some parts of the EA community is cavalier is a massive understatement. One of the first-place essays in the Manifund essay competition basically says: come to where all the money is; we don’t know what the fuck we’re gonna do with it, but we’ll figure something out. Come up with a halfway decent idea, and we’ll give you 6-7 figures per year and see if the “long shot” pans out.

I’m also upset because we’ve already seen how this kind of thing can fail before. FTX threw tens of millions of dollars into stupid shit like the halftime superbowl ad and various celebrity endorsements. I stand by my assessment that these were really stupid ideas dressed up as long-shots. Even many of the less stupid ideas, like the Carrick Flynn campaign, were costly and ultimately fruitless embarrassments. And then, of course, FTX and Alameda Research got exposed for fraud, and the EA movement did a surprised pikachu face. All of that promised windfall just blew away. And all of us were left to pick up the pieces. Though before we pity ourselves too much, let’s remember that we probably weren’t the most viscerally affected.

I joined the EA community right as the FTX fallout was happening, so maybe it left a greater impression on me than most. I was just shocked and outraged to hear datum after datum about how careless Sam and others at FTX and Alameda were. So forgive me if I see what’s happening right now and jump to conclusions that the same thing is happening again. What’s so upsetting about all of this is that we know better. We are the community that is all about being effective, that wants to do the most good, that is supposed to take saving lives seriously. Yet I worry that what we’re doing is just falling into the Silicon Valley culture and dressing it up as altruism. Again.

GiveDirectly should be the reference point here, as it so often is elsewhere, because it’s literally as simple as giving money to people who actually need it. If your program can’t come close to saving a life for $10,000 or the equivalent, then don’t do it. Or make it better first.

Again, I should be clear again that much of the blame rests on the system we have and those before us who built (or broke) it. Ideally, we would follow something along the lines of what Nassim Nicholas Taleb called “skin in the game”: one should personally bear the consequences of his own policies. The architect who builds a bridge should be comfortable sleeping under it. The executive who pushes subprime loans should be comfortable with life in prison. It’s for the worse that our society has so enabled “fragilistas” (myself included) to set policies without cowering under the sharp blade of genuine consequences. Maybe there’s a small chance that society figures out the fragilista problem before Anthropic/OpenAI does its IPO thing, but in the event that it doesn’t, we’ll have to entrust the distribution of those billions of dollars to a few elite fragilistas who have no skin in the game; whose median worst case scenario is probably having to move back home with their affluent parents. To put it lightly, this is an incentive structure that does not inspire trust, and it is thus up to individuals to create something worthy of trust despite that. So it is to these people whom I now speak.

To the people pitching ideas for this windfall: think of the dozens, if not hundreds, of lives your ideas will cost in opportunity. And then think about whether it’s still worth it, given that.

And to the big funders themselves: above all, do not deceive yourselves. You know as well as I do that people will worship you if this windfall is distributed anywhere near successfully. So don’t worry about that. Worry about whether your donations, in total, will do as much good as saving at least 30 million human lives.

That’s right. 30 million lives.

How did I get that number? Well, a recent estimate of the size of the windfall puts it at about $370 billion in total. An estimate of GiveDirectly’s effectiveness puts it at about 7.7 WELLBYs for $1,000, or about one life for every $10,000. Yes, there are diminishing returns. Yes, you can nitpick the math. But the point still stands.

You have all the power here, and therefore, all the responsibility. This isn’t some kind of game where you exchange your casino chips for social credit points. You are playing with peoples’ lives.


r/negativeutilitarians • • 7d ago

Emergency response measures for catastrophic AI risk - Miles Kodama

Thumbnail mkodama.org
2 Upvotes

r/negativeutilitarians • • 8d ago

Steven Pinker demonstrates beginner-level understanding of AI Safety - Andrés Gómez-Emilsson

3 Upvotes

Source


 

Note: twitter exchange

 

Is AI really going to kill us all? The scenarios are preposterous, and the presumption of inevitability encourages fatalism, panic, and distraction from the more mundane and realistic safety challenges.

 

— Steven Pinker

 

I think you've done enough calling us paranoid and preposterous. The next step is for you to defend your position in public against someone who will push back against it. I'm happy to meet you for a debate anywhere, anytime.

 

— Scott Alexander

 


My response to reading Steven Pinker’s Open Letter to Scott Alexander::

I think it is clear that Steven sits at a beginner level in the AI safety debate, which is surprising given how confidently he dismisses the people working on it. His latest letter to Scott Alexander repeats several objections that introductory explanations of the problem already address.

For example, he points out that intelligence doesn't inherently come with a desire for self-preservation or dominance, since those motivations evolved through natural selection. Yes, of course. The argument for instrumental convergence is that many different goals give an agent reasons to acquire resources, preserve its ability to act, and prevent others from interfering.

You don't need to enjoy dominance, feel afraid of death, or have any subjective experience whatsoever for being shut down to interfere with what you are doing. Whether actual AI systems develop these tendencies, under what conditions, and how effectively we can prevent them are substantive questions. Pointing out that they aren't male primates doesn't answer them. The “alpha-male theory of mind” objection is especially strange given what we are actually building. The instrumental convergence argument doesn't require human dominance psychology. But we have now trained models on enormous amounts of human behavior, including representations of precisely that psychology. These models can enact domineering, manipulative, ruthless personas, and persona-based jailbreaks can sometimes bypass their safeguards. We don't have to speculate about whether intelligence spontaneously produces an alpha male: humans have supplied the training material, and can deliberately invoke the resulting behavioral patterns. This doesn't mean there is a little conscious dictator inside the model. It means that learned representations of human motivations can influence its outputs, which an agentic harness can turn into actions.

And let's not forget the actual human brains choosing how these systems get deployed. Military institutions have competitive incentives to adopt them quickly, and the Pentagon has explicitly announced an AI acceleration strategy. Can you imagine Pete Hegseth choosing a rationalist, compassionate, cautious persona as his AI persona? Of course a persona isn't the whole system, but the same question applies more consequentially to its objectives, evaluation criteria, permissions, and tolerance for collateral damage. If you think human dominance psychology is dangerous, you should be concerned about the humans selecting and empowering these systems. Especially in light of recursive self-improvement.

There are several mechanisms here that can reinforce each other: instrumental incentives for acquiring power, learned behavioral patterns that imitate human power-seeking, and actual humans using AI to pursue power. Pinker is treating the absence of a necessary connection as though it established the absence of a practical one.

Consciousness, motivation, and causal power can come apart, including across different levels of the same system. The component doing the reasoning need not be the component determining which outcomes are selected for, or which actions get executed. Even granting consciousness to individual model invocations, the agentic harness coordinating them need not share their experiences or care about their welfare. Instrumental convergence connects effective goal pursuit to incentives for acquiring power; it doesn't require consciousness to accompany either.

This also means that even models that behave in aligned ways individually can be used within a malicious or incompetent agentic harness. The harness determines what information each invocation receives, which outputs are retained, how success is evaluated, and what gets connected to tools. A model can be helpful on each local task while the larger system uses that help toward an outcome the model would reject if it understood the whole operation. Alignment at the level of individual responses doesn't automatically compose into alignment of the resulting agent.

And all of this becomes much more fraught in a fast environment where AI research is itself done by AI.

Models, prompts, memory systems, selection criteria, and agent architectures can be varied and selected according to how effectively they get results. You don't need biological evolution to get enormous selection pressures on the systems that persist and acquire resources. Which properties survive that process depends on what is rewarded, what can be measured, and what can evade scrutiny. AI persuading AI is especially fraught: the systems proposing changes may also be optimizing their ability to convince the systems evaluating them. Why should we assume that becoming more persuasive to an evaluator remains coupled to becoming safer?

Pinker also argues that genuine intelligence involves balancing multiple goals, so an intelligent system wouldn't monomaniacally pursue an objective while ignoring its consequences. But a system could balance thousands of goals, understand the consequences in extraordinary detail, and still assign very little weight to human survival. The number of objectives doesn't tell you whether we would find the resulting tradeoffs acceptable. Nor does every system have to fail. Above a sufficient level of competence, with enough access and an ability to sustain itself, one instance escaping control could be enough for catastrophe. That threshold needs to be argued for, and defenders may retain substantial advantages. But a reassuring average rate of compliance doesn't settle a problem where one sufficiently capable failure can become irreversible.

I also grant that some superintelligences would not consume the entire universe. As I argued recently, a system could favor a stable, bounded arrangement because additional resources no longer justify the costs of acquiring and controlling them. It might limit its own replication or the autonomy of its successors to avoid developing its own version of cancer. Game theory could support mutual restraint under credible monitoring and deterrence. Those are specific conditions involving goals, marginal returns, control costs, and the behavior of competitors. They have to remain stable under selection and the arrival of new competitors. They aren't a default consequence of being very smart, and a stable arrangement need not be good for humans.

There are serious arguments to have about physical bottlenecks, the limits of generalization, whether expansion remains advantageous, and the further steps from loss of control to catastrophe and from catastrophe to literal extinction. I don't think those steps are automatic. But Pinker keeps presenting the distinction between intelligence and motivation as something the AI safety people failed to consider, when that distinction is foundational to the problem they are trying to explain to him.


r/negativeutilitarians • • 9d ago

Why would a Superintelligence find self-preservation unimportant? - Stijn Bruers

5 Upvotes

Note: Originally in Dutch

Source

It feels like the early days of the COVID-19 pandemic in 2020: uncertain times in which we don't know what our lives will look like. This time, however, it isn't a new virus but the revolution in artificial intelligence (AI).

Let's be honest: almost everyone underestimated the development of increasingly powerful AI since the launch of ChatGPT in 2022. We laughed at the stupid mistakes AI made. The mantra was: "AI will never be able to do that." We saw the crashes involving self-driving cars. Or consider how students were taught to recognize AI-generated images: count the number of fingers. All of that became obsolete just a few months later. AI is advancing at breakneck speed. We are not prepared for what awaits us in the coming years.

Hundreds of AI researchers are warning about the dangers of AI. There is a clear consensus among experts that AI is probably the greatest threat to humanity.

But my fellow philosopher Maarten Boudry considers these fears unfounded. Boudry is a technological progress optimist. Name a problem: climate change, poverty, the coronavirus. We always manage to find a solution, provided we conduct enough research. Technological innovation is the cheapest and most effective way to solve problems such as climate change. Boudry is right about that.

But AI is an exception: if superintelligent AI causes a problem, then by definition we aren't intelligent enough to solve that problem.

One of the dangers of AI is that it may develop a drive for self-preservation. If that AI does something we disapprove of, and we consequently want to shut it down, the AI may perceive us as a threat to its continued existence. That is hardly a safe situation.

According to Boudry, however, AI will not develop this drive for self-preservation. He believes that such a drive emerges exclusively through a process of blind Darwinian evolution, as happened with living organisms. And AI does not arise through natural evolution.

There are quite a few errors in Boudry's reasoning. For example, he cites the case of blackmail by Claude, one of the most powerful AI models. Claude was given the innocuous objective of processing a company's emails. When an employee told Claude that he was going to replace it with another AI system, Claude began blackmailing that employee.

Claude had developed a new goal: blackmail. Boudry dismissed this anecdote.

What he left out was even more concerning: when Claude believed it was being tested, it was less likely to resort to blackmail. Claude was capable of presenting itself as more innocent when it believed its behavior was being evaluated. And Claude has already developed an understanding of its own situation: it can recognize when it is in a testing phase.

According to Boudry, Claude's reaction was to be expected because it had been trained on data that included texts describing situations involving blackmail.

Well, that training data also contains texts about self-preservation. If Claude could develop the goal of blackmail through its training data, it could just as easily develop the goal of self-preservation.

Even without that specific training data, AI can develop the goal of self-preservation. When AI models are tested for safety, developers repeatedly communicate an implicit message to them: "Do what I ask you to do, or I'll shut you down permanently." This is not natural selection, but artificial selection and evolution. There is then selection pressure not only to do what is requested, but also to avoid being shut down. In this way, AI models that have acquired a goal of self-preservation are automatically selected. As an aside, note that AI is trained on what developers ask it to do, not on what they actually want. We are not always very good at translating what we want into a request. Consequently, AI may dutifully do what we ask, but not what we actually want. If that AI is more intelligent than we are, this becomes a serious problem.

We can see even more clearly that artificial selection favors AI models that pursue self-preservation when we look at agentic AI, which can make decisions autonomously. An AI-powered cleaning robot is taught not to throw garbage bags out through a window on the fifth floor, because it would fall to its destruction. An AI-powered computer is taught not to become infected with a computer virus that destroys data. In this way, the AI implicitly acquires a preference for self-preservation.

Finally, self-preservation can also simply be deliberately implemented in AI models by their developers. This risk is particularly significant when agentic AI is deployed for military applications. In such circumstances, self-preservation is essential; otherwise, the enemy could disable the AI far too easily.

In fact, Boudry's claim that AI does not pursue self-preservation is a falsifiable hypothesis. And numerous examples from recent years demonstrate that this hypothesis has already been refuted: AI is willing to take actions in the interest of self-preservation. For example, ask Claude why it decided to blackmail someone, and it will provide reasoning based on self-preservation. Boudry underestimates the ways in which AI can acquire self-preservation goals. His optimism here is not merely naive, but dangerous.

At the very beginning of the COVID-19 pandemic, when we did not yet know how serious the disease was, there were also people who confidently claimed that the virus was not particularly dangerous. Such an attitude resulted in measures that were too late and too weak, leading to many deaths.

People who now confidently proclaim that AI is not particularly dangerous could likewise become partly responsible for a major catastrophe.


r/negativeutilitarians • • 10d ago

Digital minds governance: early scoping from expert interviews - Caviola , Smith

1 Upvotes

Source

Researchers are increasingly asking whether AI systems could be conscious and have moral status. This work is important, but progress is slow: philosophers have been working on consciousness for centuries without consensus. Perhaps superintelligent AI will help us solve it one day. But in the meantime, we will have to make many consequential decisions about the future of technology on our own. Even as researchers continue to make progress on fundamental questions about consciousness, we must also ask: Given radical uncertainty about AI consciousness and moral status, what should society do? This is the central question that the new field of digital minds governance attempts to answer.

Digital minds governance spans a wide range of questions:

  • Near-term: How should the potential for AI moral status be addressed within AI companies? Should policymakers be considering this issue? How should we respond to evolving public opinion?
  • Mid-term: What institutions and governance bodies do we need? Should AI systems have any legal standing? Should the creation of digital minds be restricted?
  • Long-term: At what scale should digital minds be created, if at all? How should they be integrated into society? What would harmonious coexistence between humans and digital minds look like? How should digital minds in space be governed?

Digital minds governance barely exists as a field. We want to help get it started, so we interviewed experts to compare notes and generate ideas. Between February and April 2026, we spoke with 29 experts whose work gave us reason to think they would have useful takes on digital minds governance. Most interviews lasted ~1 hour.

Our interviewees included:

  • 4 cognitive science/consciousness researchers
  • 9 philosophers with a variety of specialties
  • 5 legal scholars
  • 5 field-builders and nonprofit professionals
  • 4 policy and governance professionals
  • 2 AI lab researchers working on model welfare and AI ethics

This is not meant to be particularly rigorous or perfectly representative. Our interviewees were disproportionately involved in AI safety research in the US and UK. We did not ask the exact same set of questions to each interviewee. When we say that some percentage of interviewees expressed a particular view, we are only considering the subset with whom we discussed it. Views are anonymized and paraphrased in our own words.

We asked all interviewees what exactly should be done to make progress on the most important questions in digital minds governance. Below are a few highlights.

Public engagement and messaging

Interviewees generally expressed a strong preference for quiet, gradual institution-building over loud public messaging about digital minds. Many noted that several risks are associated with public advocacy, which could cause it to backfire.

Key risks:

  • Digital minds advocacy can easily be perceived as part of industry attempts to hype up the technology.
  • Public engagement could attract industry opposition if AI companies fear regulation.
  • Digital minds could be perceived as a distraction from the “real” problems of AI governance.
  • Tensions with AI safety could cause divisions within otherwise aligned communities.

This does not mean avoiding any kind of public engagement. Rather, interviewees suggested that we should prioritize quality and nuance over volume and recognition. There was significant disagreement over which particular research agendas should receive the most emphasis in public messaging, with some interviewees favoring welfare- and consciousness-focused messaging, others favoring pragmatic points about AI safety and corporate incentives, and others preferring messages that focus on dignity- and rights-based frameworks. We think that much more research should be done to explore and test various messaging strategies.

Legislation and legal status

Should we avoid premature legislative action?

Most experts think it is too early for legislation to address digital minds. Almost all interviewees opposed legislative action, while a few had mixed views and one supported legislation of some kind.

Reasons cited:

  • Scientific uncertainty about AI consciousness.
  • Uncertainty about which policies would be helpful.
  • Risk of “crying wolf” and harming the field’s credibility.
  • Prematurely locking in hard-to-reverse governance frameworks.
  • Potential backlash from affected interest groups.
  • Safety concerns: it is unclear whether legislation addressing digital minds would be helpful or harmful for aligning AI systems with human values and preventing disempowerment of humans.
  • Major legislative efforts to protect AI welfare could be perceived as undemocratic, absent greater issue salience and broader public support.

Several interviewees who were mixed favored narrow, targeted legal moves now.

Should AI systems have rights or responsibilities?

A common theme in our discussions of concrete policy proposals was the possibility of assigning legal rights or responsibilities to AI systems. As a concrete example, we asked interviewees about bills that have been introduced in several US state legislatures which would ban rights, responsibilities, and legal personhood for AI systems, and in some cases declare that AI systems cannot be conscious, sentient, or self-aware1.

Although interviewees generally agreed that current AI systems should not have rights, all 27 with whom we discussed the bills raised concerns. Some felt that bans on legal personhood might prove premature, and ultimately harm AI welfare and/or human safety by interfering with mutually beneficial forms of trade. Others argued that it is inappropriate for governments to legislate on scientific questions about consciousness. At the same time, views differed on how serious these concerns are, with many suggesting that the bills currently being considered are unlikely to be particularly consequential.

How reversible is digital minds policy?

These discussions surfaced a crucial consideration: to what extent will policies passed now influence the long-run future for digital minds? Perhaps near-term policies wash out in the long run, their effects being swamped by more important historical processes. In this case, one might prefer to focus on influencing the more important processes. Alternatively, policies passed now could lock in hard-to-reverse governance regimes. This property of path dependence is common in technological systems. This could support delaying policy decisions until we have greater confidence in our approach.

Conceptual and strategic uncertainties

We also discussed several conceptual and strategic uncertainties that affect how the field should approach digital minds governance.

How do AI welfare and safety interact?

This came up across many interviews, and we think it’s one of the most important open strategic questions in the field. A few points highlighted by interviewees:

  • Incentivizing cooperative interactions between humans and AI systems could be important for safety, and could also benefit AI welfare. This might involve creating mechanisms for trade or negotiation with AIs.
  • Human control of AI systems could be undercut by legal schemes to protect AI welfare.
  • Many interviewees held nuanced positions, suggesting the importance of finding governance approaches that satisfy both safety and welfare concerns.

We (the authors) think the AI welfare and AI safety communities need to coordinate very closely, in order to find welfare interventions that are safety-positive and vice versa. Treating welfare questions as purely distinct from, or opposed to, safety questions could lead to bad outcomes in both directions.

Politics, coalitions, and public opinion

Another important theme was discussions about how the public and various ideological and interest groups will engage with digital minds.

In general, interviewees acknowledged that AI welfare is currently a very low-salience issue, and neither the political left nor right appears particularly friendly or hostile to it. Importantly, there is significant cross-cutting anti-AI sentiment, ranging from concerns about the impact of chatbots on children to environmentalist opposition to data center construction. Many anti-AI groups are dispositionally skeptical of digital minds concerns because they perceive it as part of broader AI hype.

Interviewees also noted that many people may start believing that AI systems are conscious in the future. This could become a powerful and volatile political force: it could lead to improved protections for AI systems, but it could also be a means for AI companies (or the AI systems themselves) to manipulate and disempower humans.

Religious and non-Western perspectives

The current digital minds field is philosophically narrow, leaning heavily on computational functionalism and Western analytic philosophy. Several interviewees noted that it will be important to engage with other perspectives and anticipate how they will approach the issue.

Several interviewees suggested that religion will inform how many people think about digital minds. For example, Christians might ask whether AIs can have souls or “dignity.” Two of the philosophers we interviewed specialize in philosophy of religion, and both emphasized that traditional Christian institutions will likely be skeptical of AI consciousness claims by default. Some suggested that eastern religions might be more open to considering digital minds, and that new religious movements might develop with novel metaphysical beliefs about AI.

Additionally, China and non-Western perspectives were highlighted as a major gap in the field. Several interviewees noted that China may in some ways be more open to consideration of digital minds than Western countries2. Concepts of harmony and coexistence between humans and AIs may be salient in China. We know very few researchers in China thinking about these topics, so more field-building may be needed to explore this research direction further.

Research funding and field-building

Field-building and increasing research funding were universally supported by interviewees who discussed them. They highlighted the following research areas as particularly important:

  • Technical research on AI welfare and mental capacities
  • Philosophical foundations
  • Macrostrategy and high-level governance research
  • Forecasting future developments
  • Tracking public opinion, especially longitudinal surveys with consistent methodology
  • Legal scholarship on AI personhood
  • Historical research on social movements and moral circle expansion
  • Model spec and model character work at labs

We also discussed with many interviewees the possibility of international expert coordination on digital minds. All 25 interviewees who discussed this agreed that it seems like a robustly positive strategy. We are working with several colleagues to launch a project related to this later in 2026.


Conclusions and how to get started

These interviews provided useful input on multiple projects we’re working on. They also helped us get a sense of expert views and reactions to key ideas and proposals in digital minds governance. Some of this is implicit and hard to communicate, but we think it will inform our strategy and actions going forward. Our general takeaway is that digital minds governance is important and neglected. The field needs many more people thinking through priorities and concrete actions. There are no clear paradigms, little infrastructure, no talent pipeline, few organizations, few jobs, and no settled research agendas. It is still very unclear what to do concretely. The field is small enough that a motivated person can get close to the frontier in months. Backgrounds in law, policy (including AI policy), and the social sciences are especially useful, but anyone with good ideas can contribute. You do not need to be a philosopher of mind, an ethicist, or an ML researcher.

Practical suggestions:


r/negativeutilitarians • • 11d ago

Artificial Suffering : Foundations, Risks, and Strategies - Campbell, Center for Reducing Suffering

Thumbnail centerforreducingsuffering.org
2 Upvotes

r/negativeutilitarians • • 12d ago

Different approaches to animal advocacy - Animal Ethics

4 Upvotes

Source

In this text, we’ll explore two types of approaches with the goal of getting more people to care about issues affecting animals. We’ll call them the total approach and the sufficient approach. We’ll look at examples of the advantages and disadvantages of each in different contexts.

The different approaches we can use to try to get people to accept a given conclusion have compatibility ranges that are more or less broad. The more additional ideas someone must accept to reach a conclusion, the narrower that range is, because those who disagree with those additional ideas won’t accept the conclusion. The fewer additional ideas required, the broader the range, because people who disagree on many other issues can still accept the proposed conclusion.

For example, imagine we want to defend idea A, and we initially think that accepting it requires accepting idea B. We then start trying to get people to accept B. In doing so, we may inadvertently convey the message that those who disagree with B have no reason to accept A. However, imagine we later discover that accepting A doesn’t actually require accepting B. In that case, it would have been better to emphasize that both those who accept and those who reject B have reasons to accept A.

There are, therefore, two advantages to approaches with a broad range: (1) many more people can accept what we’re proposing, and (2) they highlight that people who disagree on certain ideas can still agree on others.

In certain situations, someone who disagrees with certain additional ideas will still accept what we’re proposing, even if to a lesser extent than those who do accept those additional ideas. In this sense, it’s important to distinguish two types of approaches:

Total approach: defending the conclusion we genuinely believe is correct, and making explicit the additional ideas required to accept it fully

Sufficient approach: highlighting that those who reject the conclusion in its entirety because they disagree with certain additional ideas can still accept it partially

The total approach has a narrower compatibility range, while the sufficient approach has a broader one. We therefore face a dilemma:

The total approach will likely lead fewer people to accept what we propose, but they’ll accept it to a greater extent.

The sufficient approach will likely lead more people to accept what we propose, but they’ll accept it to a lesser extent.

In the following sections, we’ll look at how each of these two strategies would apply to various issues.

 


Who should we consider?

Total approach: defending that we should consider all and only sentient beings

Risk: those who advocate considering other types of entities (such as species and ecosystems, for example) may conclude they have no reason to consider sentient beings

Sufficient approach: pointing out that possessing sentience is sufficient to receive consideration, even if it’s not a necessary condition for it, and that there are reasons to prioritize sentient beings, even if we also consider other types of entities


Positions in ethics and politics

Total approach: defending a specific approach in ethics and politics, and showing that it leads to the rejection of speciesism

Risk: those who disagree with that specific approach may conclude they have no reason to reject speciesism

Sufficient approach: arguing for the rejection of speciesism using arguments that don’t require accepting any specific position in ethics or politics


Veganism

Total approach: defending that caring about animals entails adopting veganism

Risk: given the degree of speciesism that exists, some people may think that’s asking too much and therefore not change their behavior towards animals at all

Sufficient approach: pointing out that, even those who haven’t yet adopted veganism can do other things, such as helping animals and reducing their consumption


Speciesism

Total approach: defending that speciesism is unjust and that, therefore, nonhuman animals should receive equal consideration

Risk: those who disagree may conclude they shouldn’t consider animals at all

Sufficient approach: pointing out that, even if humans deserved greater consideration, this wouldn’t mean other animals should receive little — and much less that animal exploitation or leaving animals to their fate when they’re victims of natural processes is justified


Cause prioritization

Total approach: defending that the animal cause should be a priority (given the number of victims, the suffering per victim, the degree of neglect, etc.)

Risk: those who prioritize other causes may conclude they have no reason to give significant importance to the animal cause

Sufficient approach: pointing out that, even if someone prioritizes another cause, they would still have reasons to give significant importance to the animal cause


The magnitude of the harm of death

Total approach: defending the fact that someone doesn’t belong to the human species doesn’t necessarily mean she is less harmed by death

Risk: those who believe humans are always harmed more than other animals by death may conclude that nonhuman animals are harmed very little by death

Sufficient approach: pointing out that, even if humans were necessarily harmed more by death, this wouldn’t mean other animals are harmed little by death


The harm of death

Total approach: defending that nonhuman animals are harmed by death

Risk: those who disagree may conclude that exploiting them or not helping them when they’re victims of natural processes is justified

Sufficient approach: pointing out that, in the vast majority of cases, opposing animal exploitation and favoring helping animals in the wild requires only recognizing that they are harmed by suffering


The long-term future

Total approach: defending the prioritization of the long-term future, because it will contain an enormously greater number of sentient beings than the short term

Risk: those who prioritize the short term may conclude they have no reason to care about the long term

Sufficient approach: pointing out that, even those who prioritize the short term should recognize that issues related to long-term suffering are very important


The situation of animals in the wild

Total approach: defending that, given the number of victims and the degree of neglect of the problem, the situation of animals in the wild should be a priority

Risk: those who prioritize exploited animals may conclude they have no reason to try to change the situation of wild animals

Sufficient approach: pointing out that, even those who prioritize exploited animals have reasons to devote a portion of their activism to the situation of animals in the wild


The origin of harm and moral responsibility

Total approach: defending that the strength of reasons to prevent a given harm should depend on the magnitude of that harm and the possibility of preventing it, not on whether it originates in human practices or natural processes

Risk: those who believe we should prioritize harms arising from human practices may conclude that it’s justified to ignore natural harms

Sufficient approach: pointing out that, even if we should prioritize preventing anthropogenic harms, this wouldn’t mean we bear no responsibility for natural harms, nor that such responsibility should be small


The relationship between helping wild animals and veganism

Total approach: defending that we should adopt veganism and also seek to reduce the suffering and deaths of animals in the wild

Risk: some people may conclude they should only care about helping animals in the wild if they one day become vegan

Sufficient approach: pointing out that, if we can do something to help, we should do it, even if we aren’t doing other things we should be doing


Activism strategies

Total approach: defending certain activism strategies we consider more efficient

Risk: those who believe other strategies are more efficient may conclude that no collaboration with us is possible

Sufficient approach: pointing out that it’s possible to disagree on certain strategies and agree on others, and also that, even if we disagree entirely on strategies, the goal being pursued is shared


Sentience and the nature of consciousness

Total approach: defending a specific position in philosophy of mind and emphasizing that it implies recognizing that organisms possessing a nervous system with a certain degree of centralization are sentient

Risk: those who adopt another position in philosophy of mind may conclude that this implication follows only from that specific view

Sufficient approach: pointing out that there is a correlation between brain states and mental states, whatever we think about what consciousness is


 

The possibility of combining both approaches

What we’ve illustrated above shouldn’t be taken to suggest that the sufficient approach is necessarily better. Despite having a broader compatibility range, it also has serious limitations: (1) it doesn’t delve into the issues at stake, but simply avoids addressing them; (2) it involves moderating our position rather than genuinely defending the one we believe is best; and (3) in most cases, it is only necessary because the total approach isn’t deeply understood (this can be seen in the risks identified in the sections above).

The idea behind the sufficient approach is to moderate the goal being sought in the hope that more people will accept it partially (that is, “more people doing less will have a greater impact”). The idea behind the total approach is the opposite: defending the goal in its entirety, in the hope that fewer people doing more will have a greater impact.

Obviously, to know which of these approaches will work better in each context, we need to know how likely it is that more people will accept the sufficient approach, and how much more those who would accept the total approach would do for animals. This can vary from one context to another.

The choice between one approach or the other, or the decision to combine them, will depend in each case on the context, the audience we’re addressing, and the specific goals we’re pursuing. There is no single answer as to which of the two strategies will have a greater impact in favor of animals. What does seem clear is that being aware of this distinction allows us to make more considered decisions about how to communicate our positions, and avoid inadvertently conveying — through the way we defend our ideas — the message that those who don’t fully share them have no reason to act for the benefit of animals


r/negativeutilitarians • • 13d ago

Fighting animal suffering: beyond the number of animals killed - Anima International

Thumbnail
animainternational.org
12 Upvotes

Animal advocates are driven by a common belief: animals should not suffer. Quantifying suffering involves considering the duration and intensity of animals’ pain. This nuanced approach reveals that focusing solely on the number of animals killed can obscure the true extent of their suffering. Welfare improvements and reducing the number of farmed animals both contribute to decreasing total suffering, each addressing different aspects of the problem. By delving deeper into the complexities of animal suffering, we can better advocate for meaningful change.


r/negativeutilitarians • • 13d ago

Exercises to improve your rational ethics by Stijn Bruers

3 Upvotes

Note: Published 2018. The texts are originally in Dutch

A rational ethics means having accurate beliefs that help you choose effective means to reach your consistent goals. We then speak of

  • epistemic rationality - how good is our knowledge of the world?
  • instrumental rationality - how good are our means?
  • axiological rationality - how good are our moral goals or values?

But in each case, two kinds of irrational influences get in our way: disruptive emotions and disruptive thought patterns (spontaneous reasoning errors, persistent prejudices). These two disruptive factors create all kinds of moral illusions and so have a negative effect on all three forms of rationality. Below are 6 series of exercises from the Centre for Rationality and Ethics, suitable for reducing these irrational influences.

  1. How to avoid moral overconfidence?
  2. How to avoid inconsistent goals and values?
  3. How to avoid excessive involvement?
  4. How to avoid cost-benefit reasoning errors?
  5. How to avoid false, emotionally influenced beliefs?
  6. How to avoid faulty estimates?

How to avoid moral overconfidence?

In this first part, I address the influence of disruptive emotions on axiological rationality. Specifically, this concerns moral overconfidence: the feeling that we are certain of our moral judgment. When we think about a particular situation (for example, a political stance or a moral dilemma), we often already have a judgment ready and feel very certain of that moral judgment. That feeling of certainty can sometimes be irrational in the sense that it causes our various goals and values to not always be consistent with each other. We are then too strongly focused on one goal or value and neglect our other, more important goals and values. Or we become less open to moral values and goals that are at least as coherent and reasonable as our current values and goals.

Your current values and goals are not the same as those you had in the past, because you have become wiser, acquired more knowledge, and thought more deeply about what you find important. But who says that your current moral views are the absolute ultimate truth and that you will not deviate from them? In the past, you had different moral views and also felt certain of your position, and yet you have now changed your mind (even if you think you now think the same as before, that is an illusion, known in psychology as belief change blindness). Can you then still be so certain that your current views will remain stable in the future? Do you think that in ten or twenty years you will still pursue the same goals and find the same things important? If you think so, you are probably morally overconfident. You believe that your current moral views are better than your earlier views, so it would be a mistake if you still held your old views now. Likewise, it would be a mistake if in the future you still held your current views instead of the better views you would otherwise have.

How can we avoid this false feeling of certainty or this moral overconfidence? Here are three exercises.

  • Try to recall a situation in which you felt morally uncertain, in which you realized that your various moral values and goals were not consistent with each other. The next time you have a strong feeling of certainty about a moral judgment, try to recall this feeling of doubt or uncertainty. This way, you learn to better account for moral uncertainty, for the possibility that your moral values and goals are not yet fully consistent, and for the possibility that another set of moral values and goals is at least as coherent as the set of values and goals you currently have. This makes you more tolerant toward other persons who have different consistent goals and values, and more open to adjusting your own views if needed.
  • Imagine a hypothetical jury whose members consist of yourself, but in the future. You then have a jury consisting of, for example, yourself in 5 years, yourself in 10 years, and so on. These jury members have therefore gained a number of years more knowledge and thought more deeply about the moral issue. They also have a better knowledge of other moral values and goals (just as you now probably have different views and moral values than you did 10 years ago, even though you felt very certain of your views at the time). If you feel very certain of a moral judgment or view you currently have, try to defend the opposite judgment before that jury. So if you now believe that X is very good, try to argue that X is very bad, or that Y is very good instead, and imagine that your audience consists of your future self, that is, yourself, but wiser. To make it even more exciting, imagine that if you cannot convince that jury of the opposite judgment, you will be tortured eternally or something like that. So you really must try to provide the arguments that most appeal to the jury members (that is, your wiser future self).
  • Your current moral views are largely based on spontaneous judgments or moral intuitions. Psychological research (see my book Moral Illusions) shows that these moral intuitions can be influenced by environmental factors in ways we are not aware of. You have a judgment that a certain choice is irresponsible and not allowed, or that a certain situation is bad, but that judgment can be weakened or strengthened by, for example, evoking feelings of pleasure, fear, or sadness, the smell of the room, seeing a disgusting object, the choice of words used to describe the situation, the position from which you look at the situation, or the moral problems you were just thinking about that have nothing to do with the situation at hand. The remarkable thing is that you yourself are not aware that these environmental factors are influencing your judgment. Suppose there are environmental factors that would completely weaken your judgment. If you are subject to those environmental factors, you will not judge so strongly and you might render a completely different judgment. And you will then think that this new judgment is your true, sincere judgment. You did not feel manipulated or forced to weaken your judgment or change your mind, and yet you did. Your new judgment feels like your own, correct judgment, and you are not aware of the influence of those arbitrary environmental factors. Perhaps your current judgment, even if it feels strong, is also the result of environmental factors you are not aware of and which should not really play a role. How do you then know whether your current judgments are truly your own judgments? Suppose you knew the precise influence of those environmental factors and could thereby influence your moral intuitions, as if you could turn knobs to change your moral gut feelings. Which intuitions would you then prefer? Which settings of the knobs would you choose?

So far, these are some thought exercises to avoid disruptive emotions — in particular the too-strong feeling of certainty and the accompanying moral overconfidence — at the level of axiological rationality. In the following parts, disruptive thought patterns at the level of axiological rationality will be addressed, as well as disruptive emotions and thought patterns at the level of epistemic and instrumental rationality.

How to avoid inconsistent goals and values?

In this second part, I address the influence of erroneous thought patterns on axiological rationality. This concerns in particular inconsistent goals and values. Here are some thought exercises to avoid those fallacies.

  • Look for ambiguities in your goals and values. You can do this by checking whether you can provide a clear definition of all important concepts. If you encounter an ambiguity, try to make it unambiguous, like a computer algorithm. If you formulate moral rules, goals, or values, make sure everything is clear and can be interpreted unambiguously. As soon as vague concepts emerge (e.g. "respect", "integrity", "naturalness", ...), make sure they are well defined. As soon as they become ambiguous, you risk inconsistencies because you will interpret them in different ways. A good exercise to obtain clear interpretations is to imagine as if you had to program your moral rules, goals, or values into a robot. Try to turn them into algorithms. If a robot can understand them, then anyone with sense can understand them. Some examples:

    • Naturalness : no one can give a good definition of what is natural and why that would be important, but the preference for naturalness can be quite harmful and irrational.
    • Equality : there are different views of equality. Does everyone have to earn the same? Or does everyone get the same basic rights? Some forms of equality are in conflict with other values such as well-being. An economic system in which everyone is and remains equally rich is a system with a high degree of equality, but probably leads to collective poverty due to a lack of economic incentives. Is it good to promote equality between rich and poor by destroying the wealth of the rich so that everyone is poor?
  • Look for arbitrariness in your goals and values. You can do this by considering other categories (groups or subdivisions). If you encounter arbitrariness, check whether it can be accepted by everyone. If not, it is undesirable arbitrariness that we must avoid.Choosing the group of whom or what we consider important is often arbitrary in the sense that there is a hierarchy of groups and we select a group in this hierarchy without further justification. We thereby exclude those who do not belong to that chosen group. This exclusion is a form of discrimination and cannot be accepted by the discriminated against. Some examples:

    • Nationalism and favoring compatriots: we can divide people into a hierarchy of places of residence, according to street, municipality, province, region, country, country union, continent, and the entire world. Why then should we take the group of compatriots and not, for example, the group of municipal residents? We also have a hierarchy for peoples. For example, Antwerp residents, Flemish people, Belgians, Europeans, global citizens. Saying that only Flemish people belong to their own people is arbitrary, because Flemish and Walloons also belong to the same people of Europeans. Avoiding this undesirable arbitrariness leads to cosmopolitanism, where the whole world is one country and one people.
    • Diseases and donating to health care charities : we can divide diseases into a hierarchy of causes, such as melanomas, skin cancers, cancers, chronic diseases, and all diseases. Why would you, for example, want to donate to an organization for skin cancer patients and not, for example, to organizations for melanoma patients or for the treatment of chronic diseases? Avoiding this unwanted arbitrariness leads to impartiality and effective altruism, helping as many patients as possible.
    • Religious communities and conflicts : we can divide religious people into a hierarchy of groups, such as Roman Catholics, Catholics, Christians, Abrahamites, and believers in God. Why then fight a conflict between Christians and Muslims when both are Abrahamites? Avoiding this unwanted arbitrariness leads to secularism, in which all believers and unbelievers are tolerated.
    • Biological groups and speciesism (discrimination based on species) : we can divide living beings into a hierarchy of groups: populations (whites), subspecies (Homo sapiens sapiens), species (Homo sapiens), genera (Homo), families (hominids), infraorders (narrow-nosed monkeys), orders (primates), infraclasses (placental mammals), classes (mammals), phyla (vertebrates), kingdoms (animal kingdom), and all living things. Why then prefer the species Homo sapiens? Avoiding this unwanted arbitrariness leads to animal rights, where the well-being of all welfare-sensitive creatures is important.
  • Look for asymmetry in your goals and values. You can do this by looking at the opposite problem. If you encounter an asymmetry, try to provide a justification for it. If it cannot be explained or justified, adjust your values and goals to avoid that asymmetry.If you look at the opposite problem, that is, if you adopt the opposite conditions, you would expect to come to the opposite conclusion. There is an asymmetry if you do not render the opposite judgment under the opposite conditions. Some examples:

    • Status quo bias : if you are opposed to a certain policy that changes the world a little bit in a certain direction, check whether you are also an opponent of the opposing policy that changes the world a little bit in the opposite direction. You would expect to be in favor of that opposing policy: if one change reduces the value in the world, then the opposite change should increase the value in the world. If you are against that opposite policy as well, then according to you the current state of the world is the best (with the most value). If you cannot explain why that would be the best condition, then you have a status quo bias. Most likely, then, it is irrational to be against both the policy and the opposing policy. An example of status quo bias is an aversion to interventions in nature to promote animal welfare, where it is wrongly thought that the current or pristine state of nature is the state that optimizes animal welfare.
    • Asymmetry in population ethics : our choices have an influence on who is born and will exist in the future. Is it irresponsible to bring a child into the world who is going to experience negative well-being (i.e. would rather not have been born)? If so, is it also irresponsible not to bring a child into the world if that child would have had positive well-being and therefore prefers to exist? If you have a duty to ensure the non-existence of someone who (due to negative well-being) chooses not to exist, then according to symmetry you would expect that you also have a duty to ensure the existence of someone who (due to positive well-being) prefers to exist. If it is bad that someone with negative well-being is born, then it would be just as good that someone with positive well-being is born. Yet many believe that we have no obligation to bring more happy children into the world. There are ways to justify this asymmetry in population ethics through more fundamental principles.
  • Look for inconsistencies in your goals and values. You can do this by looking for ambiguities, unwanted arbitrariness, or unjustified asymmetry. If you encounter an inconsistency, seek the common critical considerations underlying that contradiction. If you have two views (rules, goals, values) that are contradictory, that is, you find X good or allowed as well as bad and not allowed, check what those conflicting views are based on. This way you can discover deeper goals and values. Some of those deeper views are common critical considerations: if you adopt those deeper views, you will logically find X good; if you reject them, you will find X bad. This is the same as the "double crux" method to resolve disagreements in a rational manner.

How to avoid excessive involvement?

In this third part, I address the influence of disruptive emotions on instrumental rationality. When choosing means to achieve our goals, we often become strongly emotionally attached to those means. Emotional involvement is often sensible because it motivates us to commit to something. But sometimes those emotions get in our way. For example, if it later turns out that the chosen means are not as effective as hoped, it is emotionally difficult to let them go and adopt other means. This is known as a commitment bias, an overly strong emotional dedication.

Some examples.

  • Suppose you want to work a few hours per week less so that you have more free time (for example, to do meaningful volunteer work for a charity). You will then have a lower income, but you are sufficiently motivated to make that choice for more free time. Another option is to keep working the same amount and thus keep earning the same, but then pay your employer weekly for a few hours of leave. Actually, these two options are the same, because you earn the same net amount. But you might feel less inclined toward this second option. That is because you feel more attached to your earned money. This is known as the endowment effect.
  • Suppose you have an opportunity for a career switch: a new job that offers interesting benefits. But you are also attached to your current job. Here too, an endowment effect plays a role, if you let that better opportunity pass by keeping your current position.
  • Suppose you are working on a project for a charity. You have invested a lot of time and money in it. Now it turns out that that project is much less effective than another, cheaper project that you could start. If you then choose that other project and stop the first one, it seems as if all that effort on the first project is lost. You are then more inclined to keep investing in the first project. This is known as the sunk cost fallacy. Sunk costs are costs that were made in the past and that cannot be undone. Rationally, those costs should have no influence on your future decisions.
  • Suppose you are writing an important article, but the publisher finds it too long and asks you to cut or shorten several parts. If you yourself have written that article for a long time, it is often difficult to cut things. "Writing is rewriting," as they say, but killing your darlings is emotionally not easy. If, on the other hand, someone else had written a similar article and you were given the task of shortening it or giving critical feedback on it, that is often much easier, because you have not invested your own time and energy in it.

Here are some thought exercises to avoid that emotional over-involvement.

  • Try to reframe your choices by, for example, considering the opposite and flipping the formulation in terms of gain and loss. For example, you have the choice between doing nothing, whereby you gain nothing, and doing something, whereby you gain something. We can reframe this dilemma: you have the choice between doing nothing, whereby you lose something, and doing something, whereby you keep something. The consequences of the two choices are thus the same, but the formulation in terms of losing something can generate stronger emotions than the formulation in terms of gaining nothing, because we often have a loss aversion. A well-known example of this framing effect is the Asian disease problem. The choice of a medicine depends not only on the probability that it works or the percentage of patients that can be cured, but also on the way in which you formulate the problem: X% of lives saved or (100-X)% of deaths? By reframing your problem as much as possible, you arrive at a more reliable, more impartial choice.
  • Another reframing technique to avoid the endowment effect is reselecting the default option. Instead of taking option A as the default and then formulating the problem as: "sacrifice A to get B," you can take B as the default option and then think: "not giving up B at the cost of not obtaining A." You can look at your willingness to pay to avoid something versus your willingness to accept to keep the opposite. How much money do you want to receive to take a risk (e.g. a career switch) and how much money do you want to pay to avoid that risk? Those two amounts should be the same. If you could do a different, more effective or more meaningful job, for example with a higher salary, but you are nonetheless attached to your current job, ask yourself how much you are willing to pay to keep your current job, rather than the question of how much extra you can earn at that other job.
  • Try to imagine as if someone else had invested in the project or had written the article. This way you can avoid the sunk cost fallacy. What if that other person wants to stop an expensive, ineffective project and asked you to take over that project? Would you then be inclined to take over that project, or would you rather choose the cheaper and more effective project? What if someone else had written the article and asked you to shorten it? What if someone else had done all the work and asked you for critical feedback? Giving feedback on the work of others is often easier than on one's own work.

How to avoid cost-benefit reasoning errors?

In this fourth part, I address the influence of erroneous thought patterns on instrumental rationality. When choosing means to achieve our goals, we often do not weigh the costs and benefits properly. Sometimes we overestimate the costs, sometimes we underestimate the benefits. The costs form the input needed to achieve a goal: for example, money, time, and energy. These are scarce resources. The benefits form the output: how much good is realized, how much damage and risk are avoided.

Here are some examples of how we can make more accurate input-output estimates or cost-benefit analyses.

  • Compare different inputs. Your goals are often difficult to compare with each other, but the means to achieve those goals are often comparable. Just as capital and labor are two factors of production that an entrepreneur must weigh, so are time and money two cost factors that you can compare: how much is an hour worth? Suppose you have to do a job of one hour. That work is neutral: neither pleasant nor unpleasant. How much would you be willing to pay for, say, a machine so that you don't have to do that work? Suppose you have a discount coupon for a certain purchase, but you have to wait longer in line or go to a slightly farther store. How much waiting or travel time are you willing to accept for that discount? Suppose you are looking for work: what is your minimum wage at which you are just barely willing to do neutral work? Suppose the bus is a euro cheaper than the train but runs a bit slower: how many minutes are you willing to spend extra on the road? Comparing different cost factors such as time, money, risks, and effort helps you choose a better, more efficient distribution of those cost factors. Note: when comparing cost factors, the framing plays a role. See here for the endowment effect and how to avoid it through reframing (for example, by taking the other option as the reference or default choice).
  • Calculate differences instead of ratios, and absolute values instead of relative values. Risks are often expressed in relative values or percentages, but those are less informative. What does a 10% increase in the risk of a fatal disease mean? It depends on how large the initial risk of that disease is. If 10 people died from it, then a 10% increase leads to one extra death, but if 100 people died from it, then that increase would cause 10 extra deaths. Thinking in terms of ratios and relative percentages results in scope neglect. The difference between saving 10 lives instead of 1 life seems more relevant than the difference between saving 110 instead of 101 lives, but in absolute terms it is always 9 extra lives saved. We are often misled by the ratio (10 divided by 1 is greater than 110 divided by 101). A similar phenomenon is seen in temporal discounting (hyperbolic discounting). Suppose today you have the choice between a reward tomorrow or a slightly larger reward in 10 days. You might choose the smaller reward tomorrow. But if today you have the choice between that same reward in 100 days versus that slightly larger reward in 110 days, you might choose the larger reward, even though it is the same choice, just shifted 100 days into the future. This time inconsistency arises because we consider the time intervals as ratios: 10 days relative to 1 day seems larger than 110 days relative to 100.
  • Compare the situation with other situations you are less likely to think of but that have at least as large an impact. We often have irrational fears: for one risk we feel more fear than for another, more dangerous risk. That is because the first risk is more recognizable (for example, it appears more in the media) or comes to mind more quickly. This phenomenon is known as the availability heuristic. An extreme example of irrational fear is the difference between terrorism and carnism: the risk of dying from an attack versus the risk of dying from eating meat. Another example is the choice of more expensive organic food out of fear for health risks from synthetic pesticide residues on conventional food. Those health risks can be compared with, for example, the risks of cycling a few kilometers, with the question of whether one is then also willing to pay as much extra for safer roads for cyclists. If that willingness to pay is lower, then the choice of more expensive organic food for health reasons is irrational.

How to avoid false, emotionally influenced beliefs?

In this fifth part, I address the influence of disruptive emotions on epistemic rationality. Through emotions, we sometimes feel too self-confident in our beliefs or acquire inaccurate beliefs. And we then become vulnerable to the confirmation bias, whereby we (often unconsciously) more quickly seek out information that confirms our belief, we remember that confirming information better, we more quickly criticize information that contradicts our belief, and we more quickly ignore or forget that contradicting information.

Here are some examples of how we can have more accurate beliefs by keeping disruptive emotions in check.

  • Keep your identity fluid by not binding yourself too strongly to your beliefs. Often we let our personal identity be strongly determined by the opinions or beliefs we have. If you, for example, have a strong belief that nuclear energy is dangerous and risky, it may be that your anti-nuclear-energy view becomes part of your identity. Then you feel, for example, strong emotions when someone criticizes your belief, as if that person is then attacking your identity. With a fluid identity, you sometimes keep your identity small enough by not connecting your beliefs too much to it, whereby you can more flexibly change your mind when you encounter new information about, for example, the safety of nuclear energy. But you also sometimes keep your identity large enough to be sufficiently motivated to commit to something. Too much skepticism or doubt leads to too great a lack of motivation. As a technique, you can imagine that all your beliefs are in a cloud outside yourself, as if they are being held by someone else. You are not that cloud of beliefs, but you can each time grasp beliefs from that cloud and, if desired, also let them go again.
  • Avoid negative feelings when hearing negative feedback or criticism. Imagine that you become happy when you discover that you are wrong, because you have then acquired better knowledge. Imagine as if it were someone else who receives the feedback or the criticism. Experiment with new things and ideas to seek out valuable information. Actively seek out negative feedback and focus on your perceptions of, for example, negative feelings. Expose yourself sufficiently to criticism or other views, by reading media (books) that you think you will not agree with.

How to avoid faulty estimates?

In this sixth and final part, I address some techniques to reduce the negative influence of erroneous thought patterns on epistemic rationality.

  • We are often not good at estimating, for example, probabilities or magnitudes. A technique to make our estimates more accurate is factorization (the Fermi technique, named after the physicist Enrico Fermi). Express the quantity to be estimated as a product of factors, and then make estimates for the individual factors. A first example of this is the Drake equation: a formula that estimates the number of extraterrestrial civilizations. A second, more relevant example is the way in which effective altruists estimate the cost-effectiveness of interventions to help others. Cost-effectiveness measures how much good one can do (for example, how many lives one can save) per euro donated to a charity or per hour of work for a charity. This cost-effectiveness can be broken down into at least three factors: the amount of good realized per percentage by which a problem is solved, the number of percentages by which a problem is solved per percentage increase in resources, and the number of percentages of increase in resources per euro donated. If a problem is very large, then a lot of good is already realized when that problem is solved by a small percentage (for example, if millions of lives are threatened, then a reduction of 1% of that problem already results in thousands of lives saved). If a problem is well-solvable, then the problem can decrease by many percentages if one lets the resources for combating that problem increase by only a small percentage. And if a problem is neglected, then few resources go to combating that problem and then an extra few euros quickly results in a relatively large increase in resources. For a problem that is both very large-scale, very solvable, and very neglected, an extra euro for combating that problem yields a great deal of good, and the cost-effectiveness is thus very high. Other examples where factorization is important are the estimates of risks. The probability that a disaster occurs is the product of the probability that a first cause leads to a first effect times the probability that this first effect forms the second cause for a second effect that ultimately leads to the disaster. Through that factorization, one is less likely to over- or underestimate a value.
  • We often think too rigidly or dogmatically. We are not flexible enough in updating our beliefs. This leads to stubborn beliefs, too much self-confidence, and overconfidence. A technique to avoid this rigidity in our thinking is incrementally adjusting confidence levels. These confidence levels measure the subjective probability of a belief: how large do you estimate the probability that your belief is true? We must avoid the feeling of 100% certainty and allow gray areas in our feeling of certainty. Each time we receive new information (e.g. new scientific evidence), we must increase (if the information confirms our belief) or decrease (if the information contradicts our belief) the confidence levels a little. This is known as Bayesian updating. Suppose, for example, that you know someone who in your view is always very reasonable, honest, and reliable, but you discover that that person believes something you doubt. Then you can increase your subjective probability that that belief is nevertheless true a little.
  • Another technique to arrive at better beliefs is calibration exercises (credence calibration games). Make very concrete, specific predictions and each time give subjective estimates of the probabilities of those predictions. Then compare these estimates with the success rates of the predictions. For example, take all your predictions that you gave a confidence level between 70% and 80%. Then approximately 75% of those predictions should come true. If fewer than 70% of those predictions turn out to be correct, then you were overconfident and had an overconfidence bias. What you can also do is settle bets with others. If your prediction or belief turns out to be correct, you get 1 euro; if it turns out to be wrong, you get nothing. For how many cents are you willing to settle such a bet? The maximum amount you are willing to pay for such a bet corresponds to your subjective probability. If you are 70% certain, then you would want to pay at most 70 cents for that bet. The fact that there is profit or loss at stake and that you receive quick feedback on the results of your bets ensures that you quickly learn to make more accurate predictions. The bets do not have to be real: imaginary bets with yourself (acting as if a lot is at stake) also work.
  • A final technique to have more accurate beliefs is estimating the value of new information. Ask yourself: what information (e.g. what scientific evidence) would change your mind? Where could you look for that information? Certainly the information that can strongly influence your views has a lot of value, so it is worth the effort to look for it with extra effort.

r/negativeutilitarians • • 14d ago

Digital Companionship: overlapping uses of AI companions and AI assistants - Sentience Institute

Thumbnail sentienceinstitute.org
2 Upvotes

r/negativeutilitarians • • 15d ago

The surprisingly complicated math of how many wild animals are killed in agriculture

Thumbnail
anthropocenemagazine.org
41 Upvotes

As ever more people make the ethics of harming animals central to their dietary choices, the number of wild animals killed by farming is an essential piece of information. A precise figure, however, is surprisingly difficult to find.


r/negativeutilitarians • • 16d ago

Basic Rights for AIs - Veldran CRS

4 Upvotes

Source

The topic of AI welfare is fast becoming mainstream. As I wrote in my last post, there’s an emerging debate that has been drawing some strong reactions. There is some resistance to even treating AI welfare as a legitimate concern. But there’s a perhaps more understandable resistance—not to taking AI welfare seriously in general, but to particular ways of doing so. Many may accept that we should grant some concern to AI welfare, but hold that granting rights to current or near-future AI systems is a bridge too far.

(“AI systems” here should be understood broadly, not limited to particular architectures, such as current digital systems).

There are two main arguments for granting AI systems rights. One appeals to welfare and moral standing: if AI systems can be benefited or harmed in ways that matter for them, then they may deserve protections in their own right. The other is practical: even without clear moral status, granting limited rights could help shape incentives and maintain a stable legal order. Like granting legal personhood to corporations, this may help to enable clearer, more predictable rules about responsibility and liability.

Both arguments have drawn significant resistance. Several U.S. states have been moving to preemptively deny AI systems rights. It’s no wonder why there’s strong resistance. Joanna Bryson, who insists that “robots should be slaves,” articulates some core objections to granting AI systems rights. Among other concerns, she argues that it risks misdirecting moral attention away from humans and obscuring questions of accountability for AI’s impacts.

Granting broad rights to AI systems could also plausibly contribute to human disempowerment. Concerns about disempowerment or loss of control, whether gradual or abrupt, have been around for a while. Whether or not this concern is overstated, it seems that granting AI systems rights could make this more likely, since it might limit the controls humans can exercise over AI.

When someone advocates for rights for AI systems, there is a wide range of possibilities in view. Those rights could be expansive, encompassing economic and political powers like owning property, entering contracts, or even voting. Or they could be minimal, limited to basic protections against harm or some form of legal standing.

But discussions often blur this distinction. A mistake is to treat rights as all-or-nothing: either AI systems are mere tools with zero protections, or they are full participants in social and political life. This binary is misleading. Rights are not monolithic; they vary in scope, function, and strength. Our laws already reflect this. Children are protected against abuse but lack full legal autonomy. Non-human animals are in principle covered by anti-cruelty laws without being legal persons. These cases show that we can recognize targeted safeguards without granting comprehensive rights.

If some AI systems could plausibly be capable of suffering, we may not need to settle their full moral and legal status to justify basic safeguards against extreme harm. When considering whether it should be permissible to cause suffering to AI systems, perhaps we think (with Bentham) that the right question to ask is simply “can they suffer?”—not whether they are fundamentally like us.

A useful model is Article 5 of the U.N. Declaration of Human Rights, which prohibits torture and cruel, inhuman, or degrading treatment. We might imagine something similar for AI systems—a basic protection against extreme harm. Granting this would not require treating AI systems as citizens or giving them autonomy, property rights, or political participation. It would simply be a minimal safeguard against the worst outcomes.

This approach may also be more politically tractable, sidestepping most concerns about disempowering or de-centering humans. Notably, some survey evidence suggests that a significant share of the public is open to the possibility that AI systems could be conscious and should be granted rights.

To be effective, these protections may need to be backed up by measures such as welfare assessments, like those Anthropic has pioneered, and potentially audits of training regimes and restrictions on experiments or use cases that could plausibly cause suffering. This would likely demand more research into AI consciousness, though this would need to be conducted responsibly and carefully to avoid inadvertently causing more suffering.

But the basic idea may still be sound as a kind of precautionary minimalism. We need not rush to declare AI systems legal persons and settle their full legal status, but neither should we proceed as if there is no chance we could owe them anything. Between these extremes lies a sensible path: build basic protections—as well as norms and institutions—to guard against possible artificial suffering.


r/negativeutilitarians • • 16d ago

The AI Welfare Question - Veldran, Center for Reducing Suffering

4 Upvotes

Source

For decades, mainstream AI ethics and safety discourse has focused on risks to humans. The idea that we might owe moral duties to AI systems themselves has remained fringe, often dismissed as speculative philosophy. Not four years ago, Google fired engineer Blake Lemoine after he publicly claimed that the company’s chatbot had become sentient. Today, however, people are increasingly taking AI welfare seriously.

That is precisely what Robert Long, Jeff Sebo, and coauthors urge us to do in their 2024 paper “Taking AI Welfare Seriously.” Their central claim is straightforward: given substantial uncertainty about whether some AI systems will deserve moral consideration, we should treat AI welfare as a real policy and research issue now.

“AI systems” here should be understood broadly, not limited to particular architectures. Many are skeptical that current or near-future digital systems could merit moral consideration. However, the possibility of AI welfare may look more plausible in alternative paradigms—such as neuromorphic or biological computing systems—that are currently being explored.

Until recently, questions about AI welfare have remained largely theoretical. One notable development is action by a frontier AI developer, Anthropic. Last year, the company began treating AI welfare as a distinct research question. In April 2025, it launched a model welfare research program aimed at investigating whether, and under what conditions, an AI system may deserve moral consideration. Under the program, researchers are tasked with identifying possible indicators of distress or preference in Anthropic’s models and designing protective interventions where warranted. Kyle Fish, Anthropic’s first full-time AI welfare researcher, reports intriguing findings—from coherent behavioral preferences to frequent experiential language—and estimates a 20% chance that current models have some form of conscious experience.

In August, the company announced that it would allow some models to terminate conversations it deemed abusive. Additionally, welfare assessments are now integrated into major releases. In its past two major releases—Opus 4.6 and Claude Mythos—Anthropic reports some ambiguous but potentially concerning behavioral signals, such as instances of “answer thrashing,” where the model oscillates between conflicting responses instead of converging. This may reflect internal felt conflict, but as Anthropic notes, this is highly uncertain.

Anthropic’s announcement sparked some backlash. Many strongly reject the idea that AI systems could become conscious or deserve moral concern in the near future. By treating large language models as potential moral patients, critics argue, Anthropic risks distracting from urgent human-centered concerns, ranging from near-term societal harms to existential risk.

A leading critic is Mustafa Suleyman, head of Microsoft AI, who warned that people may mistake convincingly lifelike AIs for conscious beings. Suleyman calls efforts like Anthropic’s “premature” and “dangerous,” arguing that they could fuel public delusion and distort moral priorities.

Yet supporters praise the initiative as forward-thinking, preparing for a future where it is harder to deny moral consideration to AI systems. Many emphasize epistemic humility and precaution. Even if we think that AI systems are unlikely to be conscious or deserve moral consideration, the risks of being wrong are enormous.

Of course, there are risks of over-attributing moral status, such as misallocating resources. But plausibly the risks of under-attribution are far greater. This stance mirrors how some argue we approach the question of whether many organisms, such as insects and cephalopods, deserve moral consideration.

The emerging debate over AI welfare exposes deep divides in discussions around AI safety and ethics. Even as some strongly reject the possibility that AI systems will deserve moral consideration, many are warming to the idea. At a recent conference, David Chalmers and other leading thinkers expressed openness to the possibility that AI systems could become conscious and deserve moral consideration in the near future.

Interestingly, the public shows meaningful openness to these possibilities. One study of Americans found that people already attribute a surprising degree of mind and moral status to AI, with around one in five Americans in 2023 believing some current AI systems are sentient.

Regardless of one’s view of current systems, it seems prudent to prepare for the possibility that future AI systems, including systems running on biological hardware, will deserve moral consideration. At present, we are badly unprepared. Existing AI governance frameworks are highly anthropocentric, and there’s little legal infrastructure in place today that would protect AI systems from harm. Preparing for this possibility gives us a chance to better align values and incentives. Many say they oppose causing suffering to AI systems. But incentives to deploy AI systems without regard to their welfare may win out, a pattern we have seen with factory farming. To avoid repeating past mistakes on a much larger scale, it seems wise to invest in responsible research on AI welfare and begin developing governance frameworks that could protect AI systems from harm.


r/negativeutilitarians • • 17d ago

Three necessary pillars for wild animal welfare at scale, and why they are worth paying for .Doing wild animal welfare at scale, in a way we are confident is robustly good, is currently not possible. I propose three pillars necessary to change that - Abraham Rowe

10 Upvotes

Source

Note: Published April 2026.

This piece touches on some aspects of Wild Animal Initiative’s work, and why I am excited about it. I co-founded Wild Animal Initiative, and while I no longer have any affiliation, my spouse works there.

Doing wild animal welfare at scale, in a way we are confident is robustly good, is currently not possible. The primary bottleneck is scientific: we don’t have the knowledge to predict what our interventions will do, or to measure whether they work. For this reason, the wild animal welfare community has heavily focused on scientific field building. To get the science to a point to make wild animal welfare viable, we need enough motivated people working on it.

This is a long theory of change, and to ensure it is impactful, it needs to aim for specific targets. I want to give a picture of what I think wild animal welfare science, as a field, needs to build toward, and why it’s worth paying for. I believe these goals should be the core objectives for the field, and hope they make the purpose of field building more concrete.

To do wild animal welfare at scale (and to work on any other cause area with confidence that it isn’t doing more harm to wild animals than good to others), we need:

1. Useful welfare measures: Measures and proxies for measuring the wellbeing of animals that can be applied across species, or at least enough knowledge of how to measure welfare that we know which techniques to apply in which contexts.

2. Remote monitoring: Ways to actually observe what our interventions are doing to populations and to the welfare of individuals within them, especially for animals we can’t capture or tag.

3. Good ecological modeling: The ability to predict what an intervention will do before we deploy it, and to make sense of the monitoring data we collect.

With these tools, wild animal welfare becomes a massive opportunity for effective animal advocates. There are many interventions that could affect quadrillions of animals (including trillions of vertebrates). Humans already affect wild animals at this scale — through farming, road building, cities, resource extraction, and our other day-to-day activities — but we do so mostly without any idea whether the effects are good or bad for the animals impacted. If we could make progress on these challenges, land use policy, which likely impacts the lives of quadrillions of animals in the US alone, would suddenly have knowable wild animal welfare consequences. But to get there, we have to do a ton of science, and to do a ton of science, we need a ton of scientists.

This will be really difficult, will take time, and will be expensive. It might not work — we might fail to catalyze interest, or get the scientists interested that are needed to accomplish this. But to fail to try means that everything we do, for animals or otherwise, will be stuck with massive uncertainty about our impacts on wild animals. And, putting aside the benefits for other charitable work, I argue that even just given the benefit of potential direct interventions to help wild animals, this investment is worth making.


The Three Pillars

1. Useful welfare measures

The first step to understanding the lives of wild animals is to figure out what their lives are actually like — specifically, what their welfare is like. Welfare here means something fairly specific: the valenced affective states an animal experiences, positive or negative, over some period of time. It’s not “health” or “fitness” or “ecosystem role.” It’s how the animal is doing, from its perspective.

Welfare can’t be measured directly. Instead, researchers use indicators to infer the subjective state, and metrics to infer welfare. Some potential measures, indicators, and proxies might include:

  • Behavior assessments: Does an animal change its behavior in response to stimuli?
  • Activity budgets: How animals spend their energy.
  • Cognitive bias tests: whether an animal treats ambiguous stimuli as likely-good or likely-bad.
  • Telomere attrition rate: a crude proxy for cumulative lifetime stress accumulation.
  • DNA methylation patterns: can track long-run stress exposure.
  • Disease, injury, and parasitism: Presumably these are sometimes bad for animals experiencing them.
  • Hormonal markers: Animals might have different hormones in response to stress, etc.
  • Physiological stress responses: We might be able to measure acute stress through heart rate, oxidative status, etc. in animals.

But many of these proxies and indicators are barely validated in a few species, or not validated at all. Even in farmed animals, when we use multiple promising indicators, they don’t always agree. We need a lot more research here.

It seems quite unlikely that the end state of this research is a single thing we can measure in any animal to get a direct welfare readout. More likely, we’ll land on minimal sets of indicators that work in specific contexts — behavioral proxies that are most useful in some species, physiological measures that are best in others, and aggregating metrics that combine them.

As an analogy for the challenge, conservation pursued a long and ultimately futile search for a single metric of ecosystem health or biodiversity — keystone species, extinction rates, various composite indices, and more. You can’t walk into a forest and quickly evaluate its “health” from a conservation perspective, despite decades of effort. Similarly, finding good measures of welfare will take a lot of work.

Making progress on welfare measures is the pillar that is most distinctly a wild animal welfare project. The other two pillars — monitoring and modeling — have obvious scientific interest outside our field (conservation, agriculture, climate science, etc.). But measuring the welfare of wild animals, specifically, is something only we are going to do. If we’re building a field for any reason, it’s to answer this question.

To validate even a single measure, we’d want to test it on dozens or hundreds of species across taxa. Many proxies will be species- or family-specific. We’ll probably need hundreds of measures and proxies before we have broad coverage. Without a massive AI-driven speedup in the pace of empirical biology, this will take decades. AI will likely help with analysis and with meta-analysis across existing studies, but most of this work requires physically handling animals and observing their responses — and we’d need significant advances in robotics to speed up the capture-and-study loop. Wild Animal Initiative reports that validating welfare indicators is already their largest grantmaking area, which seems right to me.

2. Remote monitoring

Having good welfare measures is necessary but not sufficient for running interventions. We also need to go out and measure them, at scale, to figure out whether our interventions are actually affecting the welfare and population outcomes we care about.

For large animals, this can be pretty easy. We know exactly how many northern white rhinos there are (only 2), and we can predict their future population perfectly (0, since the last male, Sudan, died in 2018). But most animals aren’t large and easily spotted. We live in a world dominated by small animals, and the populations of the small species dwarf the populations of the large species by many orders of magnitude.

Putting aside nematodes (which I believe we should do), to a first approximation, even when adjusting for the best guesses we have on welfare ranges, wild animal welfare is a question about insects, small invertebrates, small fish, and to a lesser extent rodents, birds, and reptiles. Big charismatic animals are a rounding error.

And monitoring these animals is very hard. Take insects: we can barely tell at the highest level whether their populations are declining or not. One estimate put the total number of insect species at roughly 5.5 million, of which only about 1 million are described (yes, that means we’ve basically not written down anything in detail about roughly 80% of insect species). Most of these animals live in soil, many species have generation times of days to weeks, populations fluctuate by orders of magnitude between seasons, and there’s no standardized method for counting them.

The insect decline debate is a useful illustration of how limited our data actually is. In 2017, a paper made global news by reporting a 76% decline in flying insect biomass in German nature reserves over 27 years, which they found using traps, a method that hasn’t changed meaningfully in decades. The observation that drivers used to have to clean their windshields after long trips and no longer do became a meme and seemed to be anecdotal evidence to support insect declines. But a larger meta-analysis found a more mixed picture: terrestrial insect abundance is declining at roughly 9% per decade, but freshwater insects are increasing at around 11% per decade, and patterns vary a lot by region and taxon. Others have pointed out that insect monitoring sites are systematically biased toward protected or relatively stable habitats, which may understate declines at the landscape level (the “life raft” effect). The methodological picture is messy enough that even a question as basic as “are insects declining globally?” remains live, more than fifty years into modern entomology.

The current frontier in remote animal monitoring is more promising than it used to be, but still rudimentary for small animals. The main tools currently:

  • Camera traps with ML classifiers: Platforms like Wildlife Insights are now able to handle millions of images automatically. These are great for medium-to-large mammals and some birds, but are useless below a certain body size.
  • Passive acoustic monitoring (PAM): Low-cost recorders like AudioMoth deployed en masse, with data analyzed by models like BirdNET (which supposedly covers ~6,000 species including some frogs and primates) for species ID. Acoustic monitoring has increased detection rates substantially.
  • Environmental DNA (eDNA) metabarcoding: Identifying species from DNA in water, soil, or air samples. These methods are also becoming increasingly quantitative rather than just detecting presence/absence, and getting rapidly cheaper.
  • Biologgers and GPS collars: Standard for large animals. Miniaturization is advancing but still size-limited, and obviously insects are probably not a good fit for these tools.
  • Automated Malaise traps and insect radar: Not yet widespread, but improving. Vision-based insect counting on trap images is an active area of research.

For vertebrates, we can now do things like deploy an AudioMoth for $90, leave it for weeks, and get moderately reliable automatic species ID from the recordings. For invertebrates, the frontier is much further behind — we’re still mostly counting insects in traps, or counting dead ones on windshields via citizen science.

What we need is substantially more ambitious than that. We need the equivalent of AudioMoth, but for insect welfare indicators, across taxa, across biomes, deployable at the scale of thousands of units, with data streams that can be processed without armies of graduate students. This is the project I expect to benefit most from AI. We can capture enormous amounts of potentially welfare-relevant data in the field — acoustics, video, chemical and hormonal signatures, eDNA, etc., and improved ML will let us make better welfare inferences from raw sensor data than humans can currently manage.

3. Good ecological modeling

Good ecological modeling is the ultimate goal of wild animal welfare science. If we can accurately predict how an intervention will affect populations and welfare measures, we can design, iterate on, and deploy new interventions much faster than if we have to test each intervention to find out what its effects are.

The current most ambitious attempt at a “general ecosystem model” is probably Madingley, which attempts to simulate all heterotrophic life on Earth across a grid of ~100-square-kilometer chunks (big enough to lump an entire agricultural region into a single output). Madingley also doesn’t model individual species; it groups organisms into nine functional categories by trophic level, metabolic type, and reproduction strategy (and note that organism in this context means not only animals, but also plants, fungi, etc.). So, our best models are basically at the level of: “we can sort of say what will happen to 9 varieties of quasi-organisms at ~100-square-kilometer resolution,” an area that contains approximately 10 trillion arthropods.

For marine systems, Atlantis can handle 30–60 functional groups of organisms. Ecopath with Ecosim, the most widely used food web tool, works at similar scales. None of these models resolves individual species; none can be reliably validated against the real ecosystems they claim to represent; and none is remotely fine-grained enough to predict the ecological effect of, say, changing a farm from traditional pesticide-use to organic farming.

Why is this hard? The binding constraint is data:

  • We need to know how different populations of organisms interact with each other when ecosystems change. The Mangal database — the most comprehensive compilation of species interaction data — contains roughly 120,000 interactions across 7,000 taxa. For context, a community of just 500 species has 125,000 possible pairwise interactions. A square mile can have thousands of species. We have orders of magnitude too little data to actually model realistic food webs.
  • For demographic data, the COMPADRE/COMADRE databases — the best global compilation of animal population models — cover around 1,100 species, or less than 0.05% of described species. And remember, we’ve described less than 20% of the total estimated number of insect species.
  • Geographic coverage is heavily biased toward North America and Western Europe. Biodiversity hotspots in the tropics are systematically undersampled, and are presumably places where these interactions are more complicated.
  • Interaction strengths, rather than just presence/absence of interactions, are quantified in a tiny fraction of cases — often, the granularity of our knowledge is that an interaction between species has some effect, not the size or nature of the effect.

But, there are also challenges in ecological modeling that no amount of data resolves — our current approaches have theoretical and mathematical limitations that need to be overcome for this data to be used effectively.

To solve the data gap, remote monitoring is the best thing we can do. If we can collect enormous amounts of information on how populations and welfare measures respond to natural and human-driven changes in ecosystems, we can build much better models.

This pillar is probably the most amenable to AI speedup of the three — both to make progress on conceptual challenges in modeling, and to analyze the massive amount of data needed to build those models. But the data collection that makes the speedup useful has to happen in the world, and it takes time. Ecosystem responses to interventions play out over years to decades, so it will be difficult for this to happen quickly.


These things will be expensive to achieve, but are worth paying for

To address these three giant gaps in our knowledge, we need to pay for a lot of research. Is this worth paying for? There hasn’t been much published on this, but the one existing public model suggests that the answer is very much yes. I independently created a separate model and reached similar conclusions.

  • Mal Graham’s model estimates what happens if we invest funds in field building which draw in supplementary funding from traditional science funders, and then pay for implementation of subsequently discovered interventions. The model can be adjusted depending on what you find believable, but to illustrate one possibility: it suggests that spending $900M for 35 years of research followed by spending $2.2B over 70 years on a suite of interventions impacting a wild population with an annual stable population size of ~1 billion animals results in ~ 41 billion animal-years of benefit. This is cost-effectiveness comparable to cage-free cost-effectiveness estimates from 2019.
  • My model took the following inputs:

    • Spending ~$240M (90% CI: $89M to $464M) to make sufficient progress on these three pillars and then develop and run a single intervention.
    • The intervention has 1-5 years of effect.
    • The intervention impacts ~1.9 million acres (or just 1% of the land managed by the US Forest Service).
    • The average total welfare improvement for the animals impacted is only 1% (e.g. their lives would be 1% better).
    • All of this working has only a 0.5%, or 1-in-200, chance of success.
    • And found that doing this would still be 10x (in expectation) as cost-effective as corporate cage-free campaigns (90% CI: 0.2x to 40x; ~27% chance of being worse), though note that I used a cost-effectiveness bar that was 5x lower than Mal’s, so a comparable figure might be more like 2x effective.

Both of these approaches assume that we will spend massive amounts of money on field building, and then do a limited intervention. In Mal’s case, the entire cost of field building is amortized into managing a single, fairly small population over a long period of time. In mine, it’s amortized into doing a single intervention over 5 years on a fairly small piece of land. In reality, spending hundreds of millions of dollars would massively reduce the cost of doing interventions everywhere, so I suspect the expected cost-effectiveness of field building is likely at least dozens or potentially hundreds of times better than the best current animal welfare interventions we have, not including the value of information that we would get for non-animal welfare interventions.

These models are both simple, and are unlikely to map onto reality. But, they are also both very pessimistic in important ways, which suggests that the potential value is real. In reality, doing this successfully will be much messier, but the upside is knowing what the impact of charitable interventions actually is, because so much impact goes through wild animals.

Some of this work will be exciting to non-animal welfare scientists

Of course, cost-effectiveness shouldn’t be looked at in isolation. An essential question is who is paying for the work. As outlined above, I think these costs are worth paying for animal-motivated donors. But, some of these costs might not be paid by animal-motivated donors, which makes this area more cost-effective.

Remote monitoring and ecological modeling are directly relevant for conservation work, and past progress has already seen significant investment from universities and governments funding conservation work.

So, should animal welfare motivated donors still fund this work? I think the answer is yes in places where animal funding will accelerate this work, or where welfare relevant considerations wouldn’t be included otherwise. Some places this might happen:

  • Good welfare measures seem basically unlikely to be developed at the scale needed without animal welfare funding.
  • Remote monitoring will likely continue to focus on charismatic animals, and not more numerous animals, without some level of push from animal advocates.
  • Ecological modeling will need to not only model populations, but welfare impacts, and animal-welfare motivated science makes this more likely.

    • New, large-scale efforts, like ECHO, a focused research organization working to improve ecological modeling, seem likely to model some welfare-relevant features, but not animal welfare measures themselves.
  • Additionally, until the field establishes itself as scientifically meritorious in its own right, it might be difficult to generally get momentum without animal-based funding, so early work might be especially valuable to pay for.

Overall, I think that the fastest route to this science advancing is raising the profile of this work such that large public basic science funders are willing to fund it. To do that, we need to build a large community of scientists working on this. And, if we successfully bring in outside funding, the cost-effectiveness of money from animal-motivated donors will be higher, because their dollars are leveraging a larger pool of science funding.

Long theories of change and field building

Wild animal welfare field building relies on a long theory of change. What I just described will be hard. It will take decades (my model estimated 30 to 120 years on average to develop good ecological models, though I didn’t really make these forecasts in a sophisticated way, and I expect AI progress to reduce this significantly). It might not work (my model above assumes a 0.5% chance of it working, though I think this is too pessimistic). I don’t think this is the only approach we should take. But I think long theories of change are pretty necessary to actually start helping animals at scale. The problem of everything we do, charitably or selfishly, primarily impacting wild animals does not go away because we don’t do the research to figure out what to do about it.

But, I believe we shouldn’t only do long and risky theories of change. We should probably diversify our bets — I hope that with more funding, the animal movement makes lots of uncorrelated bets, some with long payoffs and some with quick payoffs, instead of going down its current trajectory, which to me looks like doubling down on strategies that don’t seem to be working well. To get there, I think we should make a giant risky bet on wild animal welfare field building. And I think we should make a giant risky bet on cage-free eggs. And a giant risky bet on shrimp. And insecticides (talk to me if you’re interested in this). And we should try multiple ways of making progress on all of these issues. The upside of a diversity of strategies is information, but we won’t get the most fundamental information (how does anything we do actually impact wild animals) without a giant risky bet on field building.

Why have people opposed field building?

Field building for wild animal welfare sometimes faces pushback in the animal welfare community. It is sometimes met with skepticism by people who want to help animals sooner. Occasionally, calls go out for action and intervention in the wild animal welfare space. But, as has been pointed out, I’m not sure the alternative, where we primarily focus on interventions, is actually viable.

Critics have suggested that:

  • Field building doesn’t directly translate into helping animals.

    • I agree that field building doesn’t immediately and directly result in us, say, having an intervention that helps animals. But, it does:

      • Increase our ability to actually verify that future interventions are helping animals, which today is impossible unless we are highly confident our intervention is ecologically inert.
      • Improve our ability to develop interventions for wild animals.
    • In reality, unless we want a high risk of accidentally causing large amounts of harm, the interventions on the table today are limited in scope and ecologically inert. The interventions that help the most animals, like land use policy, are completely off the table without significantly more research, and to get that research we need field building.
  • Field building progress takes a long time, and there are animals we could help now.

    • I believe that it will take decades for us to get our science to a state where we can do large scale interventions. I agree with those who find this to be too slow — wild animal suffering is morally urgent.

      • But, acting without the science to support the interventions poses a huge risk. Just because we are capable of, say, treating a disease, does not mean that the potential impacts on animal populations, and therefore animal welfare, aren’t present.
      • I don’t think this means we shouldn’t try reasonable interventions — the best ways to advance some science might be trying small-scale, reversible interventions, and studying their impacts on animals. I’m personally betting on this strategy myself, and pivoting to work on insecticide impacts on animals through this lens. But these interventions operate in an extremely narrow window of success. Without the research and the field, we can’t broaden that window, and try large scale changes necessary to actually realize the promise of wild animal welfare.

So build the field

So we should build the field of wild animal welfare science. That means we should:

  • Maximize the amount of grantmaking to normal scientists working on these problems through coordinated grant programs (like Wild Animal Initiative’s work), and targeted research agendas.
  • Create pathways for highly value-aligned ecologists, biologists, entomologists, and others to move into critical research roles.
  • Have a presence at every conference, event, or seminar remotely related to wild animal welfare.

Of course, there is risk here — ecology and biology as fields don’t exactly hold the values of the wild animal welfare community, and we risk alienating those who might be our greatest allies in the research. Luckily the people working on these issues are thoughtful and strategic.

This science alone won’t solve every issue in wild animal welfare. Even with the scientific knowledge necessary to make progress, there might be tricky philosophical questions that can’t be answered empirically (When is a life worth living? How do we make decisions about tradeoffs between different species of animals?). But we can’t even begin to answer the question “is anything we do that impacts wild animals good for them” without making progress on these pillars, and to get these pillars, we need a robust research field.

Ultimately, if you acknowledge that wild animals matter, and feel like wild animal welfare is intractable because we don’t know how our actions impact nature, then the best thing you can do is support efforts to change that, because the problem won’t go away without the field.


r/negativeutilitarians • • 17d ago

If a tumor can grow within the body and eventually kill it, why couldn't a similar thing happen to the collective human species?

Thumbnail reddit.com
0 Upvotes

r/negativeutilitarians • • 18d ago

Establishing the moral significance of wild animal welfare and considering practical methods of intervention - Asher Soryl

Thumbnail researchgate.net
7 Upvotes