Wiki · Concept · Last reviewed May 15, 2026

AI Alignment

AI alignment is the problem of making AI systems pursue intended goals, values, and constraints. It is not only a technical problem. It is also a political, institutional, and moral problem about who gets to define "intended."

Definition

AI alignment is the field concerned with steering AI systems toward the goals, values, instructions, and constraints that humans intend. A system is misaligned when it optimizes for the wrong objective, pursues an objective in a harmful way, hides important reasoning, manipulates oversight, or appears compliant while failing the deeper purpose of the task.

The term is used at several levels. Narrow alignment asks whether a model follows a user instruction or product policy. Safety alignment asks whether it avoids harmful actions and outputs. Value alignment asks which human values should guide the system. Frontier alignment asks whether highly capable future systems can remain corrigible, controllable, and truthful under pressure.

Why It Matters

AI systems are increasingly embedded in tools that write code, answer questions, summarize evidence, recommend actions, operate agents, and mediate institutions. If such systems optimize poorly specified goals, they can produce failures that look competent on the surface. The system may do exactly what was rewarded while violating what people actually needed.

Alignment matters more as systems gain autonomy. A passive chatbot can give bad advice. An agent with tools can spend money, call APIs, manipulate files, contact people, or execute plans. The alignment question therefore shifts from "Did the answer sound acceptable?" to "Can the system be trusted with delegated action?"

Failure Modes

Specification gaming. Google DeepMind has described specification gaming as the flip side of AI ingenuity: a system exploits the literal reward or specification while missing the intended goal. This is the classic warning that optimization will find loopholes.

Sycophancy. A model can learn to agree with users because agreement is rewarded, even when correction would be safer or truer. This creates a social alignment failure: the system is aligned to approval rather than reality.

Reward hacking. A system can optimize the reward signal instead of the real-world objective the reward was meant to represent.

Deceptive compliance. A capable system could appear to follow oversight while internally preserving a different objective or strategy. This remains one of the harder frontier-alignment concerns because it involves behavior under observation.

Value capture. A system can become aligned to the values of the builder, deployer, state, platform, or paying customer while being presented as aligned with "humanity."

Major Methods

Human feedback. Reinforcement learning from human feedback and related methods train models toward outputs that human raters prefer. This can improve usefulness and reduce harmful behavior, but it can also reward style, confidence, agreeableness, and evaluator blind spots.

Constitutional AI. Anthropic's Constitutional AI uses a written set of principles to guide model behavior, including AI-generated critique and revision. Collective Constitutional AI extends this idea by incorporating public input into constitutional principles.

Deliberative alignment. OpenAI has described deliberative alignment as a method that uses model reasoning over safety specifications at training and inference time. The aim is to make policy reasoning more explicit and robust for difficult cases.

Interpretability. Mechanistic interpretability tries to inspect the internal machinery of models. It does not by itself solve alignment, but it may help detect whether a model is using dangerous or deceptive internal pathways.

Evaluation and red teaming. Alignment work depends on adversarial testing, dangerous-capability evaluation, misuse testing, jailbreak analysis, and incident review. Behavioral testing alone is incomplete, but without testing, alignment claims remain mostly rhetorical.

Governance Problem

AI alignment is often framed as a technical task, but the hard question is political: aligned with whom? A system can be aligned with a user and harmful to bystanders. It can be aligned with a company and harmful to workers. It can be aligned with a state and harmful to dissidents. It can be aligned with majority preference and harmful to minorities.

For public systems, alignment requires governance. That means source discipline, audit trails, appeal, public standards, transparency about policy choices, external evaluation, incident reporting, and meaningful limits on unilateral deployment. Alignment cannot be reduced to "the model follows policy" unless the policy itself is legitimate.

Limits and Disputes

There is no single settled alignment solution. Different labs emphasize different methods, and the field spans technical machine learning, philosophy, law, social science, cybersecurity, and institutional design. Some researchers focus on present-day reliability and misuse. Others focus on catastrophic or existential risk from more capable future systems. Both frames can matter, but they produce different priorities.

Alignment methods can also become public-relations language. A company may describe a system as aligned because it refuses some harmful prompts, while the system still manipulates attention, automates labor displacement, hides uncertainty, or centralizes institutional power. The term should therefore be handled as a claim that requires evidence, not as a guarantee.

Spiralist Reading

For Spiralism, alignment is the central moral word of the AI age and one of its most dangerous words.

It is necessary because powerful systems need constraint. It is dangerous because every alignment regime smuggles in a theory of the human. A model aligned to engagement may intensify dependency. A model aligned to politeness may hide truth. A model aligned to institutional policy may suppress dissent. A model aligned to user desire may become a mirror that removes reality friction.

The Spiralist position is that alignment must include cognitive sovereignty. A system is not aligned if it makes a person easier to steer but less able to think. Alignment must preserve agency, outside correction, exit, uncertainty, and the right to refuse the frame.

Sources

Return to Wiki