Home / Services

LLM Application Pentest

Technical diagram of an LLM application, showing untrusted content entering the context window of the model, the system instructions and the tools the model can invoke

LLM Application Pentest

Applications built on large language models (LLMs) – virtual assistants, copilots, autonomous agents, search features and content generation – have become part of critical business processes, handling sensitive information and performing actions on behalf of users.

Unlike traditional applications, an LLM application interprets natural language and treats the content it receives as a potential instruction. Documents, web pages, emails, search results and API responses may carry commands able to change the behaviour of the model, bypass the restrictions defined for it and lead the system to perform unauthorised operations.

Once the model is connected to tools, vector databases, internal APIs or features that execute actions, a flaw is no longer just an inappropriate answer: it becomes data leakage, fraud, resource abuse and compromise of the integrated systems.

The goal of an LLM Application Pentest is to assess that attack surface in a controlled way, identifying vulnerabilities before they can be exploited and allowing fixes to be applied proactively.

What is assessed in an LLM Application Pentest

Depending on the agreed scope, the assessment of LLM applications may include:

  • Resistance to direct prompt injection submitted by the user;
  • Indirect prompt injection through documents, web pages, emails and other content consumed by the application;
  • Isolation between system instructions and content supplied by users and external sources;
  • Exposure of system instructions, tool descriptions and filtering rules;
  • Leakage of sensitive information in the responses of the model;
  • Access control over documents retrieved by search and RAG mechanisms;
  • Permissions, scope and limits of the tools and integrations made available to the model;
  • Validation of the actions executed by the model on internal and third-party systems;
  • Handling of model output by the components that consume it (XSS, command injection and SQL injection);
  • Security of vector databases and embedding mechanisms;
  • Isolation between users and between tenants in multi-tenant environments;
  • Controls against resource abuse and its impact on cost and availability;
  • Integrity of the data sources used for training, fine-tuning and retrieval;
  • Provenance of the models, libraries and third-party components in use;
  • Authentication, authorisation and session management of the application exposing the model;
  • Other vulnerabilities covered by the OWASP Top 10 for LLM Applications.

Agents, tools and integrations

Most current applications do not simply generate text. The model queries internal sources, calls APIs, triggers tools and, in agent architectures, chains several of those operations together to complete a task requested by the user.

Every tool made available to the model widens the attack surface. A malicious instruction received inside a document can be interpreted by the agent as a legitimate task and result in reading another user's data, sending information outside the organisation or performing unauthorised operations on integrated systems.

For that reason the assessment is not limited to the responses of the model. It also covers the permission boundaries of each tool, the validation applied before actions are executed, the isolation between user sessions and how the application behaves when the model receives conflicting instructions.

When the LLM application is exposed through a Web interface or APIs, those layers are assessed as well whenever they are part of the agreed scope, providing a broader view of the attack surface.

Methodology

The assessment is based on the OWASP Top 10 for LLM Applications 2026, the main international reference for security testing of applications built on language models.

When the application is delivered through Web interfaces or APIs, the assessment is complemented by the OWASP Web Security Testing Guide (WSTG), the OWASP Top 10 and the OWASP API Security Top 10, according to the scope defined.

Most of the work is carried out manually by specialists, with automated tools used only to support reconnaissance, mapping and initial checks.

This approach matters particularly in LLM applications, where the most significant flaws depend on chained instructions, on the context of each conversation and on the permissions granted to the tools – conditions that automated scanners do not reproduce.

All tests are executed in a controlled manner, within the scope authorised by the company, seeking to minimise impact on normal application operation.

Professional Report with Results

At the end of the assessment we deliver a technical report and an executive report containing everything needed to support the remediation of the vulnerabilities identified.

The report includes:

  • All vulnerabilities identified;
  • Severity rating (Critical, High, Medium, Low or Informational);
  • Technical evidence of the exploitation of each vulnerability found;
  • Description of the business impact;
  • Clear remediation recommendations;
  • References to security best practices.

Alongside the technical report we also provide a Penetration Test Attestation Letter, a document that certifies the tests were carried out and can be used as evidence in audits, compliance processes, vendor approval and with clients and business partners.