|

From Legal Graphs to Ontology: Reflections on LLMs, Reality, and Operational AI

작성 Jun 24, 2026, 12:29 PM · 수정 Jun 24, 2026, 12:34 PM

Introduction

I found particularly thought-provoking was its discussion of Ontology.

What intrigued me was not simply the technology itself, but the underlying claim: that operational reality can be represented as a structured model rather than as a collection of databases, documents, or dashboards.

I realized that this idea connected several seemingly unrelated experiences from my own career.

Years ago, as a practicing attorney, I experimented with graph-based representations of legal precedents using Python's NetworkX library. More recently, I built LAWVOT, an AI-powered legal operating system integrating OCR, legal data pipelines, large language models, cloud infrastructure, and workflow automation.

Looking back, these experiences all revolved around the same question:

How do we move from isolated information to operational understanding?

And behind that lies an even deeper question:

What separates a system that understands language from a system that can act reliably in the world?

  1. Legal Reasoning as a Network

Legal research is often treated as a document-centric activity.

Lawyers read statutes, contracts, judicial decisions, and commentaries. Information appears to exist as collections of texts.

Yet legal reasoning itself is fundamentally relational.

Cases cite other cases. Statutes impose obligations. Contracts create permissions, responsibilities, deadlines, and conditions.

Long before LLMs became mainstream, I experimented with modeling these relationships using NetworkX. My goal was not merely technical curiosity. I wanted to understand whether legal knowledge could be represented as a network rather than a collection of isolated documents.

That experience taught me an important lesson:

The value of information often resides in relationships rather than individual records.

However, it also revealed a limitation. A graph can show relationships, but it does not necessarily explain what those relationships mean operationally.

A node labeled "Contract" remains a label unless the system understands who owns it, who must approve it, what obligations it creates, and what actions are permitted or prohibited.

The gap between relational data and operational reality remained unresolved.

  1. Law Itself Is an Ontology

Over time, I began to realize that law itself resembles an ontology.

A contract is not merely text.

It defines actors, permissions, obligations, conditions, deadlines, and state transitions.

A regulatory framework is not simply a collection of rules. It is a structured model describing how organizations, individuals, assets, and processes are allowed to interact.

In many ways, legal systems are world models.

They do not merely describe reality. They define what actions are possible within that reality and what consequences follow from those actions.

This perspective made Palantir's Ontology immediately intuitive to me.

Ontology is not simply a more sophisticated graph database.

It attempts to represent operational reality itself.

  1. From Knowledge Graphs to World Models

The evolution from graph theory to ontology reflects a gradual expansion of scope.

Graph theory models connections.

Knowledge graphs model semantic relationships.

Tools such as Obsidian allow people to organize knowledge through linked concepts rather than hierarchical folders.

These approaches are powerful because they recognize that understanding often emerges from relationships.

Yet they share a common limitation.

They answer:

What is connected to what?

But operational systems must answer a different question:

What can be done, by whom, under what conditions, and with what consequences?

That shift—from relationships to action—is where world models emerge.

Ontology is compelling because it attempts to cross that boundary.

  1. Building LAWVOT and the Limits of Language Models

While building LAWVOT, I worked extensively with large language models.

The experience reinforced both their strengths and their limitations.

LLMs are remarkably effective at understanding language, summarizing documents, extracting information, and generating persuasive explanations.

However, providing more documents to a model often improved its answers without improving operational reliability.

A model may understand what a contract says.

It does not inherently know whether a contract has already been approved, who is authorized to sign it, whether a deadline has expired, or what business process depends on it.

These are not language problems.

They are world-state problems.

This distinction became increasingly important as I explored how AI systems move from generating outputs to supporting real-world decisions.

  1. Ontology and Output Harness: Two Different Constraint Systems

One idea I find particularly interesting in Palantir's architecture is that Ontology and Output Harness can be viewed as complementary constraint systems.

Both impose structure.

But they operate on different dimensions.

Ontology constrains reality.

It defines entities, states, relationships, permissions, and operational rules.

Output Harness constrains agency.

It defines what an AI system is allowed to do within that modeled reality.

The two systems therefore operate on orthogonal spaces.

Ontology answers:

What is true about the world?

Output Harness answers:

What actions may an AI take within that world?

A harness without a world model produces a constrained language generator.

A world model without a harness produces a structured environment without reliable governance.

Operational AI requires both.

  1. Toward Operational AI

This is why I find Ontology particularly significant.

Much of the AI industry focuses on making language models more capable.

Ontology addresses a different challenge:

How can AI systems become grounded in operational reality?

Language models excel at interpreting ambiguity.

World models provide structure.

Harnesses provide control.

Together, they create the conditions under which AI can move beyond conversation and participate in real workflows.

This is not simply an engineering problem.

It is an architectural problem.

And it may ultimately determine which AI systems become genuinely useful in complex organizations.

Conclusion

Looking back, my work with legal graphs, legal operating systems, and large language models all pointed toward the same realization:

Information alone is not enough.

Relationships matter.

Operational context matters.

Constraints matter.

Language models and world models solve different problems, and neither is sufficient alone.

What I find most thought-provoking about Palantir's Ontology is that it recognizes this distinction.

Ontology defines what is true about the world.

Output Harness defines what an AI agent is allowed to do within that world.

One constrains reality.

The other constrains agency.

Together, they represent a vision of AI that is not merely intelligent, but operational.

From Legal Graphs to Ontology: Reflections on LLMs, Reality, and Operational AI