The Voice of Business

Knowledge Retention

How much of what staff learned in training they still remember and use afterwards. The site's training article treats it as the figure worth tracking, since completing a course and being able to use what it covered are not the same thing.

A laptop on a sunlit wooden office desk showing a chat interface where the request "Do people still use what they learned?" is answered with "Let's check again in a month." beside a violet bar chart icon and three violet chips reading Used, Repeated and Checked, next to a mug printed with AI, a plant, a notebook and a pen, under a GLOSSARY badge, the heading Knowledge retention and the subtitle Whether AI training lasts.

What Knowledge retention means

Knowledge retention is how much of what staff learned in training they still remember and use afterwards. The second half of that sentence matters as much as the first. Remembering a fact for a quiz is not the aim. Using the right habit on an ordinary Tuesday, weeks after the session, is.

The site’s training article treats it as the figure worth tracking. Its reason is short: completing a course and being able to use what it covered are not the same thing. A programme can have full attendance and a certificate for everyone and still leave the work unchanged.

This page defines the term, sets out what the training article reports about it, and explains how to check it without a test or special software. It is the measure behind upskilling, and it is what separates a programme that took place from one that worked.

Why is retention a better measure than attendance?

Because attendance records something that happened, and retention records something that lasted. The two are easy to mix up, and the HR training article says they get conflated more often than either gets checked. Attendance and a completion certificate say nothing about whether a decision made six weeks later actually applies what the session covered.

Retention also has the property that a business cares about. It tells you whether the money and the hours spent on training are still working. A team that attended and forgot has bought nothing. A team that attended once and still uses the habits has.

The training article puts it as advice: measure retention over time and not course completion alone. The word “over time” is doing real work. A check on the day of the session measures memory of the last hour. A check a month later measures whether the habit survived contact with a busy week.

Want this for your team?

Pick a time to talk it through with one of our trainers.

What do the Training figures say?

The training article reports four figures that bear on this. None is the site’s own measurement, and the page repeats them as the article states them.

  • 58% higher knowledge retention for adaptive learning than for static, one-size-fits-all content. This is the one figure that is about retention directly.
  • 93.7% more effective for digital training applied to real workflows than for generic, traditional training, at moving staff towards organisational expectations. This is about effectiveness, not retention, and it is worth keeping the two apart.
  • A 40% improvement in measured employee productivity reported for organisations investing in structured AI training.
  • 19% of workers have been through a formal AI training programme, which the article reads as a large opening for organisations that build one properly.

The article’s reading of the first two is that relevance and personalisation drive the result. Staff keep what they practise on their own tasks far better than what they are told in a session unconnected to their day. Content that adjusts to how a person is progressing is retained better than one curriculum delivered identically to everyone.

Why does practice on a person’s own work beat being told?

The training article’s explanation is relevance. A person who practises on a task they actually do has a reason to remember it and a place to use it the next morning. A person who hears a general description has neither. The same article says staff retain what they practise on their own tasks far better than what they hear described in the abstract.

The training plan article makes the same point at the level of a single session. Its first session includes a live task that everyone does in the room, with someone there to answer questions. Its stated reason is blunt: people remember what they did far longer than what they heard.

This is also why generic content tends to fade. A slide about what AI can do is true for everyone and useful to nobody in particular. A task drawn from the team’s own week is true for them and gets repeated. The bespoke training page covers training built that way, and the AI literacy page notes that a generalist team can reach working literacy in a session built around its own work.

What does adaptive Learning change?

Adaptive learning is content that adjusts to how an individual is progressing. The training article reports that it produced 58% higher knowledge retention than a fixed curriculum delivered identically to everyone.

The practical meaning for a small team is modest. It does not need software to behave adaptively. A trainer who notices that one person has stalled on writing a request, and gives that person another example, is adapting. A pair of colleagues who swap requests and note what changes is adapting. The point is that the next step depends on where the person is, not on where the slide deck is.

A fixed curriculum can still be the right starting point. A core course gives a team the same foundations in the same order, and the set-course page says its advice is the same as for bespoke work: measure retention over time and not completion. What the article’s figure warns against is treating delivery as the end of the job.

How is it Different from AI Literacy?

The two terms are related and often run together. AI literacy is the working understanding a person needs to use AI safely in their own job: that a chatbot’s confidence is not evidence, that a prompt’s phrasing changes the output more than most people expect, and that a tool will not automatically behave the same way on another organisation’s data.

Knowledge retention is whether that understanding is still there later. Literacy is what the training aims to build. Retention is how a business finds out whether it lasted. A team can reach literacy in a good session and lose it within a month if nothing makes them use it, which is why the literacy page lists treating a one-off session as done among the common mistakes.

How is it Different from Data retention?

The word turns up on this site in a second, unrelated sense. Data retention is how long a tool keeps what you enter. The banning article uses it when it advises setting an approved tool up on a business account, where data-handling and retention settings are under the business’s control, and when it warns that a consumer service whose terms let it retain and reuse what you enter should be off the table for confidential material.

The two share a word and nothing else. Knowledge retention is about people and what they remember. Data retention is about a system and what it stores. If a page or a vendor says “retention”, check which one is meant before reading further. The shadow AI page covers the data side.

How do you measure retention after AI Training?

You do not need a test, and a test would measure the wrong thing. The training plan article gives four measures, taken before and after, with no special software:

  • Use. How many people used the approved tool in the past week, and for how many tasks. A shared tally is enough.
  • Time. One chosen task, timed the old way and the new way, with the checking included in the new figure. A task that takes five minutes with the tool and ten of correction has saved nothing.
  • Rework. How often output needed correcting or redoing. If use rises and rework rises with it, the training taught speed without checking.
  • Confidence. A one-to-five score asked again at the end. A rise in confidence without a fall in rework is a warning, not a success, because confident and careless look the same on a survey.

Read together, use up, time down, rework steady or falling and confidence up is a good result. Any other pattern says where to look next. The article adds a caution about small samples: with ten people, one enthusiast can move an average a long way, so look at the spread and at what individuals said as well as the totals.

Two further checks suit retention in particular. The first is to measure again later, not only at the end. The baseline is taken before the first session, the same measures are taken in the last week, and a second check some weeks after that shows what survived. The second is the cold behavioural check from the HR article: ask someone, without notes, to explain why a decision is defensible and to name the safeguard that makes it so. A programme that cannot survive that question when asked cold was not really training, whatever the attendance sheet says.

What does a 30-day plan build in to make it stick?

The training plan article’s four weeks are built around the findings above, even where it does not say so. Each week ends with something each person has done, not something they have heard:

WeekFocusWhat each person produces
1Rules and first tasksOne real task done and kept
2Prompts for real workTwo requests added to the shared library
3Checking output and finding limitsOne mistake found and written up
4Making it routineTwo tasks agreed as the standard way

Three features stand out for retention. The sessions are short, and the article says the learning happens in the daily use between them. The week 2 habit of adding working requests to a shared prompt library means the second person in the team starts with a working request, and the training article notes that this habit carries over when the tool changes. And week 4 writes the routine down, which the plan article calls the thing that survives after the month ends.

The plan also ends with an owner. A plan with no owner after day 30, the article says, is a plan that ends on day 31. An internal champion is one way to keep the habit alive after the formal programme has finished.

Why is a one-off Session not enough?

The training article says to treat the programme as ongoing and not as a single event. Its reason is that the tools, and the tasks worth applying them to, keep changing faster than a one-off session can account for. A habit taught once and never used has nothing to hold it in place, and a tool that changes underneath it makes the original examples stale.

The same article names the habits worth repeating: writing a prompt and keeping the good ones in a prompt library, practised on real tasks. These carry over when the tool changes, which is the sense in which they are retained. The specific menu of the old tool is forgotten without harm. The habit of briefing it clearly is kept.

The HR article makes the same point from the other direction. A programme booked once and never repeated is answering a question that keeps changing underneath it. The team briefing page covers the hour that comes before the training, and the training plan article covers what follows it.

Does the format of the Training matter?

The training article observes, from inside the programmes the business runs, that teams on bespoke training built from their own workflows close the adoption gap in months, while teams left to self-teach are still closing it a year later. That is the business’s own observation and not a published study, and it is offered as such.

The article is also clear about why. Relevance is where the largest effectiveness gain comes from. A core course gives a team shared foundations. Bespoke training builds from the team’s own documents, systems and tasks. Either can be measured the same way, by retention over time, and the sensible reading is that the format matters less than whether the training is attached to real work and repeated.

The self-teaching alternative has a cost beyond speed. Most staff using AI today are doing so through self-directed experimentation, and the article says this is often how shadow AI starts. Habits settled on that way are the ones a structured programme would have corrected in the first session.

Where does retention go wrong?

The pages above point to a short list of ways it fails.

  • Counting attendance as the result. A full room and a certificate are a record of an event.
  • Treating the session as done. Without practice, use fades and the next tool change finds nobody ready.
  • Teaching in the abstract. Generic content is true for everyone and remembered by no one.
  • Measuring only at the end. The last day of the programme measures memory of the last hour.
  • Trusting confidence. A rise in confidence with no fall in rework means people feel capable, not that they are.
  • Leaving it without an owner. The habit needs a named person and a review date after the formal programme ends.

Each has the same fix: attach the training to real work, repeat it, name an owner and check later. The AI adoption page covers what retained skills turn into when they work.

What to do first

Before the next session, take a baseline. Time one real task the way it is done today, and ask each person to rate their confidence from one to five. Write both numbers down, because without them any later claim is an opinion.

Then make the session practical. Choose three tasks per person from their own week, do one of them live in the room, and agree what each person will have done by the end of the week. Set a date a few weeks later to take the same measures again and to ask one person, without notes, to explain a decision they made and why. Name who owns the shared prompt library. If the numbers move, the programme worked. If they do not, you will know which of the four measures to look at, which is more than an attendance sheet could tell you.

The full figures are in what makes AI training stick, and the week-by-week plan and the four measures are in how to train your team to use AI.

FAQ

Questions about Knowledge Retention

What is Knowledge retention?

It is how much of what staff learned in training they still remember and use afterwards. The training article treats it as the figure worth tracking, because finishing a course and being able to use what it covered are not the same thing. It is judged over time, on real work, and not on the day the session ends.

What improves Knowledge retention after AI Training?

The training article names two factors. Training applied to real workflows was 93.7% more effective than generic training at moving staff towards organisational expectations, and adaptive learning, where content adjusts to how a person is progressing, produced 58% higher knowledge retention than a fixed curriculum delivered to everyone.

Is a one-off AI Training Session enough?

The training article says no. It advises treating training as ongoing, because the tools and the tasks worth applying them to change faster than a single session can account for. It also advises measuring retention over time rather than course completion alone.

Why is attendance not Evidence that Training worked?

The HR training article says attendance and a completion certificate say nothing about whether a decision made six weeks later applies what the session covered. The better check is behavioural: can people explain, in their own words and without notes, why a decision is defensible, and name the safeguard that makes it so.

How do you measure whether AI Training stuck?

The training plan article gives four measures taken before and after: how many people used the approved tool that week, how long one chosen task takes including the checking, how often output needed rework, and a one-to-five confidence score. Read together, use up, time down, rework steady or falling and confidence up is a good result.

Is Knowledge retention the same as AI Literacy?

No. AI literacy is the working understanding a person needs to use AI safely in their own job. Knowledge retention is whether that understanding, and the habits built on it, are still there weeks later. Literacy is what training aims to build, and retention is how you find out whether it lasted.

Is Knowledge retention the same as Data retention?

No, they are unrelated. Knowledge retention is about what people remember. Data retention is about how long a tool keeps what you enter. The banning article uses the second sense when it says to set tools up on a business account, where data-handling and retention settings are under your control, and warns about services that retain and reuse what you enter.

Does the 58% figure apply to every team?

Treat it as a direction and not a forecast. The training article reports that adaptive learning produced 58% higher knowledge retention than static, one-size-fits-all content, citing published training statistics. It is not the site's own measurement, and what it compares is the format of the content, not a promise about your results.

What it means for a Business

A programme is judged by retention over time, not by how many people finished it. The training article reports that adaptive learning produced 58% higher knowledge retention than static content, and that staff retain what they practise on their own tasks far better than what they are told in the abstract.

Ready to Put This to Work?

Tell us where your team is with AI and we will tell you honestly what would make the biggest difference.