Q-Cyber Magazine

AI · 23 September 2026 · 3 min read

On-premises and sovereign AI: Control the estate, then the model

A sovereign or on-premises AI deployment is defined by who holds the weights, the keys and the data, and by the same security and data-protection duties that apply to any other sensitive system.

Abstract graphic of a network of connected nodes in Knowlcom blue

Moving a model inside a national or organisational boundary is a deployment choice. It becomes a security choice only when keys, weights, data, logs and tool permissions are also brought under a named authority.

Sovereignty is an evidence question

The word "sovereign" should be reserved for deployments that can be evidenced. Where does the model run? Who can extract the weights? Who holds the encryption keys, and under which law? Which data, including prompts and logs, leave the organisation? Who can change the system prompt or connect a new tool? If those questions cannot be answered, the deployment is merely hosted somewhere convenient.

The IndiaAI Mission can support a more domestic answer: public-private compute, indigenous models, and a national dataset path for non-personal data. It does not automatically answer the questions above for any particular ministry or firm. Those answers remain a matter of architecture and contract. For some workloads, hardware-enabled confidential computing, as described in NIST's May 2026 draft, may reduce exposure of data in use on infrastructure that is not wholly private. It is a complement, and still a draft blueprint, not a complete solution.

Exhibit 1

What must still be true after an AI system is brought on premises

Still required on a private estate
Not solved by location alone
Personal data
DPDP principles, consent or lawful use, safeguards, 90-day rights, breach notice
A local model can still over-collect, retain too long, or leak personal data in outputs
Model behaviour and tools
Least privilege, human approval for high-risk actions, segregation of untrusted content (OWASP)
Prompt injection and excessive agency travel with the application design
Operations and evidence
CERT-In incident reporting within six hours; 180-day logs in India; inventory of models and software
Logs that are incomplete, unsynchronised, or held in the wrong place fail the duty regardless of where the GPU sits

Source: Qualitative framework based on PIB DPDP Rules notification, 14 November 2025; OWASP LLM01:2025; CERT-In Directions, 28 April 2022; Cabinet IndiaAI Mission release, 7 March 2024. No performance claims are made.

A disciplined deployment sequence

A sound sequence is ordinary, and that is its virtue. Classify the data. Decide whether personal data is involved. Choose an estate — on-premises, a domestic hosted facility, or a confidential-computing arrangement — that matches the classification. Inventory the model, the toolchain and the software bill of materials. Constrain tools and agency. Enable time-synchronised logs for at least 180 days in India. Rehearse incident reporting. Only then should a "sovereign AI" label be used in a board paper.

Firms that advise on on-premises AI, including Knowlcom, can help with that sequence. They cannot waive the statutory duties that come with it.

Implications

  1. Define sovereignty in writing: weights, keys, data, logs and legal venue.
  2. Apply DPDP and CERT-In as default, not as exceptions for cloud systems.
  3. Control agency and untrusted content, following OWASP, even on private GPUs.
  4. Use national compute and indigenous models as options, not as proof of safety.

What this means for AI

On-premises deployment is often the right choice for sensitive work. It is not a complete security architecture. The organisations that will get it right are those that can show, for each model they run, where the data goes and who can make the model act.

Sources

  1. Cabinet approval of the IndiaAI Mission
  2. PIB notification of the DPDP Rules, 2025
  3. OWASP LLM01:2025 Prompt Injection
  4. NIST IR 8320E ipd on confidential computing
  5. CERT-In Directions, 28 April 2022