Workshop Takeaway · The AI-Fluent Leader

The COACH Model

A repeatable leadership cycle for building, assessing, and sustaining AI fluency across your data team.

Maven Analytics Workshop
Stephen Tracy
A leadership loop, not a one-time audit

The core idea

Most leaders try to develop their team's AI capability with one tool: a self-assessment survey or a generic training course. Both fail for the same reason.

They never make contact with the team's actual work. The COACH model is a repeatable leadership cycle that moves from definition, to organizational context, to self-reported capability, to observed reality, to targeted coaching. It deliberately separates what people say they can do from what they demonstrably do — and the gap between those two is where the coaching value lives.

COACH is a loop, not a one-time audit. Roles change, tools change, and people grow. The most fluent leaders re-run it on a cadence — quarterly to biannually — treating AI fluency as an ongoing leadership capability rather than a project with an end date.

Three lenses, working together

🔄

The COACH model

What you (the leader) do, in sequence.

🔍

The AI Fluency Framework

What you look for — Understand, Work with, Evaluate, Manage risk.

📊

The fluency spectrum

How you grade what you see — Resistor → Enthusiast → Operator → Multiplier.

C — Calibrate

Establish a shared, role-specific definition of AI fluency before you assess anyone against it.

C

Define what "fluent" looks like

You cannot coach toward a target you haven't defined.

Calibration is where you internalize the AI Fluency Framework and translate it into what good looks like for each role and level on your team.

The four components of AI fluency

Component 1

Understand AI

Grasping what AI is, where it helps, and deciding what to delegate.

Signals: core concepts, spotting use cases, knowing failure modes, weighing cost vs. benefit.
Component 2

Work with AI

Directing it clearly — the right tool, the right prompt, the right level of automation.

Signals: automation level, model/tool selection, prompt strategy, context management, workflow automation.
Component 3

Evaluate AI

Judging the output critically — calibrated trust, not passive acceptance.

Signals: calibrated trust, source verification, iteration on bad outputs.
Component 4

Manage AI Risk

Owning the outcome — bias, ethics, safety, and governance.

Signals: bias mitigation, risk awareness, ethics, safety practices.
The calibration discipline: Fluency is universal in its components but role- and level-specific in what it looks like. A junior data analyst demonstrates "Understand AI" by knowing which repetitive cleaning tasks to hand over; a senior data manager demonstrates it by deciding where AI belongs in the team's workflow and where the governance lines sit. Same component, completely different bar. Sketch what each component looks like for each role you manage before moving on.
Output

A role-by-component picture of "good" that becomes your scoring rubric for the rest of the cycle.

O — Orient

Separate capability gaps (the person) from enablement gaps (the organization) before you coach.

O

Audit your organizational reality

It's unfair — and ineffective — to coach an individual for low fluency when the organization hasn't enabled them.

Orient yourself to the environment your team is actually operating in across three dimensions.

1

Access

Which AI tools and models are approved and provisioned? Do people have the paid tiers that actually matter, or are they quietly using personal accounts — Shadow AI?

2

Governance

What frameworks or policies govern how AI should be used? Is there guidance on confidentiality, disclosure, and acceptable use — or a vacuum people are filling on their own?

3

Enablement

What learning resources, budget, and protected time does the team have to build fluency? Is there a path, or just an expectation?

Recommended action: Run Cisco's AI Readiness Assessment to benchmark your organization's maturity across infrastructure, data, governance, talent, and strategy. This grounds the whole exercise in the readiness-gap reality: 88% of organizations use AI, but only ~13% are genuinely ready ("Pacesetters") — and 70% of AI's value comes from the people layer, not the tech (BCG's 10-20-70 rule).
Output

A clear read on your org's maturity and the enablement gaps you must either fix or work around before individual coaching can land.

A — Ask

Get a fast, cheap baseline of each person's capability, confidence, and exposure — and surface self-awareness gaps.

A

Direct-report self-assessment

Treat self-report as a hypothesis, not a verdict.

Have each direct report complete a short self-assessment. It tells you not just where people are but how accurately they see themselves — the overconfident Enthusiast and the underconfident Operator are both coaching signals.

Important: Self-report is systematically biased. The least fluent often over-rate themselves (they don't know what they don't know), and careful people under-rate themselves. That's exactly why "Ask" precedes "Check" — the next stage validates these answers against real work.
Usage & Exposure
Overall, how would you rate your AI skills? (Novice · Developing · Proficient · Advanced · Expert)
How many days per week do you use AI tools for work?
Roughly what share of your daily tasks involve AI? (<10% · 10–25% · 25–50% · 50%+)
Which AI tools and models do you use for work? (list all)
How long have you been using AI regularly in your role?
Delegation Judgment — Understand AI
What tasks do you most commonly delegate to AI?
Are there tasks you deliberately keep human-led? Which, and why?
How confident are you in knowing when to delegate to AI vs. keep a task human-led? (1–5)
Direction — Work with AI
How do you typically brief or prompt AI? Do you reuse any prompts or workflows?
When an AI output is heading the wrong way, how do you steer it back?
Critical Judgment — Evaluate AI
How do you check AI output before you rely on it?
Describe a time AI was confidently wrong in your work. How did you catch it — or not?
Accountability — Manage AI Risk
What kinds of work would you never put into an AI tool, and why?
How familiar are you with our organization's AI policies and guidelines? (Not at all · Somewhat · Very)
Strengths, Gaps & Support
Where do you feel strongest when using AI?
Where do you feel weakest or least confident?
What would help you get more value from AI? (training · time · tools · examples · something else)
Output

A self-reported baseline per person, plus an early read on self-awareness — both to be validated in Check.

C — Check

Replace self-report with evidence by watching people work with AI on tasks that actually matter.

C

Observe & evaluate real work

The stage almost everyone skips — and the most important one.

Don't run a disconnected pilot. Most AI pilots fail precisely because they're side projects untethered from daily work. A novelty pilot lets people perform AI use without ever rewiring how they actually operate. Instead — have each person rebuild an existing, day-to-day workflow, AI-enabled.

Routine work is the only thing that forces a genuine re-architecture of process and judgment, and it's where fluency — or its absence — becomes visible.

The Check protocol

1

Pick one real workflow

Select a workflow the person owns and runs regularly — chosen by you, tied to their specific role. This is where Calibrate pays off: you know what good looks like for that role.

2

Decompose it into component tasks

Break the workflow down. You don't monitor everything — that's noise. Look for the natural seams where AI would or should touch the work.

3

Select 3 core tasks to observe

Evaluate each against the AI Fluency Framework: Does the person know how much of this task to delegate vs. keep human-led? Are they briefing the tool well? Are they verifying the output? Are they handling the risk?

4

Enable them to do it properly

Provide support and explicitly carve out time and capacity. Forcing this on top of a full load guarantees a bad signal — and breeds resentment.

Then compare. Match observed performance against the self-assessment from Ask. Where they match, you've confirmed a baseline. Where they diverge — confident on paper, shaky in practice, or vice versa — you've found your highest-value coaching target.
Output

An evidence-based read of where each person genuinely sits, per component and on the fluency spectrum.

H — Hone

Close the specific gaps you've now evidenced — and protect capacity so growth is sustainable.

H

Coach, enable & sustain

With three data sources in hand, you can finally coach with precision.

Use the AI Fluency Framework to name the gap exactly — this isn't "get better at AI." It's: "You're strong at directing the tool but you're taking its output at face value. Let's build your evaluation habit."

Match the coaching move to the spectrum position

Click a position to see the recommended coaching approach.

Resistor

Rejects or avoids AI — skepticism, fear, or a bad early experience.

Enthusiast

High usage, low judgment. Fast and confidently wrong. The dangerous middle.

Operator

Uses AI well within their lane. Solid, reliable, ready to grow.

Multiplier

Elevates the team's AI use. Sets standards, mentors others.

Coaching the Resistor

Address the why first — skepticism, fear, or a bad early experience are all solvable, but only if you surface them. Then start with one high-trust, low-risk use case: something low-stakes where the worst outcome is a mildly unhelpful output. Build confidence from a single win before expanding scope.

Coaching the Enthusiast

The priority is Evaluate and Manage Risk. This is where most hidden risk lives on a team. The Enthusiast moves fast and ships AI outputs without checking them — they're not malicious, they just don't know they should. Build a verification habit: slow them down at the output review step before you worry about anything else.

Coaching the Operator

Stretch them toward broader use cases and workflow automation. The Operator is reliable within their current scope — the coaching goal is to push the edges of that scope. Introduce adjacent use cases, encourage them to experiment, and give them a safe environment to fail fast before making AI-assisted changes production-ready.

Coaching the Multiplier

Give them scope to set standards and mentor others — and protect them from becoming a bottleneck. The risk with Multipliers is that they become the team's AI resource, fielding questions and reviewing everyone's work. That's not scaling; that's a single point of failure. Help them build systems that teach the team to fish rather than feeding everyone themselves.

Make coaching a habit, not an event

🔁

Meet often

Build AI fluency into regular 1:1s rather than an annual review. Fluency is a living capability — it deserves living feedback.

👂

Listen for friction

Fluency stalls on friction you can remove — blocked access, missing tooling, unclear policies. Surface these in check-ins and act on them quickly.

🛡️

Watch for hidden costs

Faster output isn't free. Monitor for the cognitive load of constant context-switching and the emerging risk of "AI burnout" from task overload. Protecting your team's capacity is a fluency-leadership behavior — it sits inside the model, not outside it.

Output

Rising, role-appropriate fluency across the team — and a leader who can see, develop, and sustain it.

The COACH model at a glance

Five stages. Each one builds on the last. The loop makes AI fluency a leadership habit, not a one-time initiative.

Stage The leader's job Key tool / action Output
C
Calibrate
Define what fluent looks like, by role & level The AI Fluency Framework A scoring rubric
O
Orient
Audit org access, governance & enablement Cisco AI Readiness Assessment Map of enablement gaps
A
Ask
Capture self-reported capability & confidence Self-assessment questionnaire Per-person baseline (hypothesis)
C
Check
Observe real work; validate the baseline Rebuild a real workflow; evaluate 3 core tasks Evidence-based read + spectrum placement
H
Hone
Coach the specific gap; sustain capacity Four-component lens + spectrum-matched coaching Rising fluency; healthy team
🔄

Then loop back to Calibrate

New tools ship, people move between roles, and the bar for "fluent" keeps rising. Run the COACH cycle on a cadence — quarterly to biannually — and treat AI fluency as an ongoing leadership capability, not a box you check.