Imagine a project review on a Thursday afternoon. The dashboard is green. Milestones are on track, and AI is part of the delivery process.

Yet reviews take longer, rework increases, and teams spend more time validating AI outputs.

Is AI improving delivery,  or are we simply integrating new tools into the same ways of working?

As AI becomes embedded in everyday delivery, tracking activity and progress is no longer enough. We need to understand what drives performance, where AI makes a difference and whether that difference translates into better outcomes. The opportunity goes beyond individual tasks. AI challenges us to rethink work, organise delivery and create value.

This is both a delivery and a strategic question. Our Next-Gen Intelligence strategy has a clear north star: making data actionable, for our clients and within Celfocus. Consistent data and metrics help us turn evidence into informed decisions and concrete actions.

AI is changing  the way value is created and understood Indicators such as hours, cost and margin no longer tell the full story. The real challenge is to understand what AI enables us to achieve. Does it mean better delivery, stronger quality, greater value for clients or more informed ways of working?

In this new AI landscape, we need to understand how changes in delivery translate into value for clients and value captured by Celfocus.

This is where the Delivery & Agility Hub KPI Catalogue comes in: a shared foundation to measure what matters, create consistency, and turn delivery data into actionable insights.

Bringing together 58 KPIs across 5 layers and 10 categories, it provides a structured view of AI-Native Delivery, connecting adoption and observability with execution, governance, business outcomes and people.

Counting prompts, generated lines of code or AI tool usage tells us that AI is being used, not whether it improves delivery. Changes in execution can also be misleading if quality suffers, rework increases, oradditional complexity is introduced.

The question is not how much AI we use, but what difference it makes.

Three things we need to get right

1. Establish a baseline.

Know where you started before claiming improvement. Without a baseline, it is difficult to determine what changed or attribute that change to AI. The catalogue recommends capturing at least one quarter of baseline data or using a comparable team as a reference.

2. Make the evidence trustworthy.

Observability connects AI contributions to delivery work. Linking AI assistance to work items and, where possible, relevant artefacts and reviews helps teams interpret performance changes and understand what drives them.

Without reliable evidence, we may see a change but cannot confidently explain why or decide what to improve.

3. Measure the whole picture.

Improvements in production may be lost in validation and introduce defects or create downstream rework.

Measure delivery performance, quality and business outcomes together to determine whether AI improves end-to-end delivery without compromising quality  

With 58 KPIs available, the goal isn't to measure everything, but to focus on what matters. Start with observability and baseline data, then progressively expand to delivery, quality, and business outcomes as measurement practices mature.

Measurement should lead to action, not more reporting. What can we simplify, eliminate or redesign? Which activities still add value, and how should teams adapt their ways of working as AI becomes part of delivery?

Integrated into the Celfocus Project Management lifecycle, these metrics become part of how we plan, monitor and improve delivery, helping teams turn reliable evidence into better decisions, rather than adding another layer of reporting.

As a Project Manager, you don't need another dashboard or 58 KPIs to figure out. You need to know where AI can make a difference, what to measure and what to do next.

The AI-Native Delivery KPIs & Metrics Catalogue automatically analyses your project context, identifies the most relevant KPIs and generates actionable insights to help you assess AI's potential impact and make better-informed delivery decisions.

The goal is to understand how AI contributes to better delivery, greater value for clients and value captured by Celfocus, looking beyond adoption to understand what those gains make possible.

Give it your project context. Discover where AI can make a difference and what to do next.

Find the catalogue in the Delivery & Agility Lab SharePoint Area.

This article is brought to you by the Delivery & Agility Hub.