
Text-to-SQL Solves Hallucination. So Why Do AI-Driven Decisions Still Go Wrong?
Grounding AI in trusted enterprise data can improve factual reliability. But reliable data does not automatically produce a reliable decision.
Enterprises have spent the past several years trying to ground Large Language Models in their own data.
The reason is understandable.
Early Generative AI systems could produce remarkably convincing answers while getting important facts wrong.
For serious enterprise use, that was unacceptable.
So organisations began connecting AI directly to trusted systems of record.
One increasingly common architecture is:
Natural language → SQL → Enterprise database → Answer
Instead of relying only on what a Large Language Model learned during training, the system can retrieve current information directly from enterprise data.
This is an important improvement.
But it can also create a misconception:
If the AI is grounded in reliable data, are the decisions it produces now reliable too?
Not necessarily.
Because retrieving the right facts and making the right decision are two fundamentally different problems.
Consider a simple executive question:
Should we discontinue Product X?
An AI system might retrieve:
Sales: down 3%
Margin: declining
Inventory: increasing
All three numbers could come directly from trusted enterprise systems.
No hallucination.
No invented data.
But should Product X actually be discontinued?
That depends on considerably more than whether the numbers are correct.
Perhaps the entire market declined 8%.
Perhaps Product X is strategically important to a major customer.
Perhaps the margin decline is temporary because of a supply disruption.
Perhaps discontinuation would breach a contractual commitment.
Perhaps Product X enables sales of another highly profitable product.
Perhaps manufacturing capacity could be used more profitably elsewhere.
The data can be completely accurate while the decision is still wrong.
That gives us an important distinction:
Data grounding establishes what is true about the situation.
Decision grounding establishes what should be done about it.
Relational databases are extremely good at representing structured information.
Customers.
Orders.
Transactions.
Products.
Invoices.
Inventory.
Suppliers.
But the existence of data does not automatically establish its organisational meaning.
Consider a seemingly simple question:
What is our revenue?
An enterprise database might contain:
orders.amountorders.net_amount
transactions.settlement_value
invoices.invoice_total
Which one represents revenue?
That depends on the organisation's accounting definitions and business context.
Modern semantic layers help solve this problem by giving consistent business meaning to data and metrics.
That is important.
But even a perfect semantic definition of revenue does not answer:
Given what has happened to revenue, what should we do?
That requires another layer.
Enterprise decisions are rarely determined by a single fact or metric.
Consider:
Should we approve this transaction?
The evidence may include:
transaction amount
customer history
device information
location
recipient history
transaction velocity
sanctions information
risk signals
But the decision also depends on:
Objectives
What are we trying to protect or achieve?
Alternatives
Approve, challenge, hold, escalate or reject?
Constraints
Which conditions cannot be violated?
Policies
Which organisational and regulatory requirements apply?
Trade-offs
How should customer experience, commercial value and risk be balanced?
Authority
Who can approve an exception or override?
Evidence is essential.
But evidence alone is not the decision.
An enterprise AI decision pipeline may look something like this:
Enterprise data
↓
AI retrieves evidence
↓
AI interprets evidence
↓
AI generates recommendation
↓
Human or agent acts
Every step can appear reasonable.
Yet the final action can still be inappropriate.
Suppose:
Product X sales declined 3%.
AI summarises:
Sales are declining.
A manager interprets:
Product X may be losing traction.
The recommendation becomes:
Consider discontinuing Product X.
Nothing necessarily hallucinated.
But somewhere between the original fact and the resulting action, the meaning changed.
A factual signal became an interpretation.
The interpretation became a narrative.
The narrative became a recommendation.
The recommendation became a decision.
The problem isn't necessarily data accuracy.
It is the transformation between evidence and decision.
Retrieval-Augmented Generation, Text-to-SQL, semantic layers and enterprise search all improve AI's access to relevant information.
They solve important problems.
But they primarily answer:
What information should the AI use?
The decision problem asks:
How should the organisation determine what should be done using that information?
Those are different architectural questions.
A system may retrieve the correct customer balance, risk score, inventory level or sales figure.
It may still not know:
which objective has priority
which constraint cannot be violated
which alternative is permissible
which trade-off is acceptable
which policy governs the situation
who has authority to decide
Those requirements belong to the decision itself.
Large Language Models are trained to model patterns in language.
That makes them extraordinarily capable at interpreting and generating language.
But an organisation is not made of tokens.
It consists of grounded realities:
customers
transactions
employees
suppliers
products
assets
obligations
resources
policies
authority
changing conditions
And those realities exist in relationships with one another.
The same word can also represent very different things in different contexts.
A person can simultaneously be an employee, customer, shareholder or supplier.
What matters to a decision is not simply the person's name.
It is:
Who or what is this object in this decision, what relationships exist, and which organisational realities matter now?
Language can describe that reality.
But the language representation should not become a substitute for the reality being decided upon.
This is why enterprise AI needs another layer.
An Enterprise Decision Model makes explicit how the organisation determines what should be done.
It can represent:
Business Reality
What objects, relationships, conditions and evidence actually exist
Objectives
What outcome is the organisation trying to achieve?
Alternatives
What courses of action are available?
Constraints
Which boundaries cannot be violated?
Policies
Which organisational or regulatory requirements apply?
Trade-offs
What happens when objectives conflict?
Authority
Who can decide, approve, challenge, escalate or override?
Now the AI is not being asked to reconstruct the organisation's way of deciding from language every time.
The Decision Model provides an explicit organisational foundation.
Data lineage can tell us:
where information came from
which database was queried
which fields were used
when the information was retrieved
That is valuable.
But imagine an executive asks:
Why did we reject this customer?
Knowing which database supplied the customer's information is not enough.
The organisation also needs to understand:
which evidence mattered
which constraints applied
which policy was relevant
which alternatives were considered
which trade-off determined the recommendation
who had authority
That is decision lineage.
The distinction matters:
Data lineage explains where the evidence came from.
Decision lineage explains how the organisation got from evidence to action.
Another limitation appears when circumstances change.
Suppose an inventory decision was originally based on:
supplier lead time: 30 days
demand: stable
warehouse capacity: available
working capital: sufficient
A week later:
supplier lead time increases to 60 days
demand rises
warehouse capacity tightens
The underlying data has changed.
But the organisation should not need to reinvent how it makes the inventory decision.
The Decision Model remains.
The grounded reality changes.
The decision can be evaluated again.
Reality changes. The decision recomputes. The reasoning remains inspectable.
This is very different from simply asking an AI system the same question again and accepting another generated response.
When evaluating an enterprise AI system that will influence consequential decisions, ask:
1. Can it access reliable evidence?
Where does the underlying information come from?
2. Is the decision itself explicit?
Can the organisation see the objectives, alternatives, constraints, policies and trade-offs being applied?
3. Can the decision be explained?
Can we understand why this recommendation followed from this situation?
4. Can the decision be governed?
Is authority, escalation and human review explicit?
5. Can the decision be recomputed?
When material reality changes, can the decision be evaluated again against the updated situation?
A system that answers only the first question may be an excellent enterprise AI interface.
But reliable enterprise decision-making requires more.
None of this is an argument against Text-to-SQL.
Text-to-SQL is extremely useful.
So are:
RAG
semantic layers
knowledge graphs
enterprise search
analytics
predictive models
Large Language Models
AI agents
Each can contribute valuable intelligence.
The mistake is assuming that because AI has access to reliable enterprise information, the organisation has also made its decision-making reliable.
It hasn't.
Grounding intelligence and grounding decisions are different problems.
DecisionAI addresses this second problem.
DecisionAI is WorldMind's Enterprise Decision Operating System.
It enables organisations to turn consequential decisions into explicit Enterprise Decision Models grounded in business reality.
Data and AI systems can contribute evidence and intelligence.
The Enterprise Decision Model provides the organisational structure for determining:
what matters
what alternatives exist
which constraints apply
which trade-offs are acceptable
who has authority
what should be done
The objective is not to replace enterprise databases, semantic layers or Large Language Models.
It is to provide the missing decision layer between intelligence and action.
The first enterprise AI challenge was:
Can AI generate useful answers?
Then:
Can we ground those answers in reliable enterprise data?
The next question is:
Can we make the decisions that follow explicit, explainable and governed?
Because ultimately:
Reliable data does not guarantee a reliable decision.
A grounded answer is not yet a grounded decision.
That distinction will become increasingly important as AI moves from answering questions to influencing consequential organisational action.

Director of DecisionAI, WorldMind
Original LinkedIn Article →
DecisionAI is WorldMind's Enterprise Decision Operating System.
It enables organisations to turn consequential decisions into explicit Enterprise Decision Models that can be inspected, explained, governed and recomputed as business reality changes.