With the advances in technology, whether it is mobile devices, social media sites, annoying automated telephone menus, supermarket loyalty cards or computers in-general, whether we like it or not we are generating and consuming very large amounts of data. Data which is then being used – or worse, sold – to third parties to tailor products and services based on our buying and viewing profiles – a marketeer's dream! Organisations are benefiting directly (and indirectly) from our data – we have become the product!
What data are we talking about?
To bring this data generation (and use) into the L&D world, we are initially talking about user data, course data and, importantly, completion data.
Your users are creating data within your LMS. What are you doing with it? Are you doing anything to interrogate and analyse the data in your LMS? As a minimum you should be generating some course completion reports along the lines of: ‘x number of users completed x number of courses in the last month’. Or, possibly, ‘x number of users haven’t completed the mandatory course x’. You should then be able to contact these learners and/or their line manager.
Key Performance Indicators (KPIs)
KPIs are used to measure the success (or not) of an organisation or of a particular activity in which it engages. Often success is simply the repeated, periodic achievement of some levels of operational goals (e.g. zero defects, 10/10 customer satisfaction etc.) and sometimes success is defined in terms of making progress towards strategic goals.
Accordingly, choosing the right KPIs relies upon a good understanding of what is important to your organisation. ‘What is important' often depends on the department measuring the performance – for example, the KPIs useful to finance will really differ from the KPIs assigned to sales. Choose carefully and think about what you are looking to measure.
Typical LMS KPIs
You should establish from your organisations what measures are important. Always consider what you are looking to achieve from analysing the data within your LMS. As well as working in the positive, e.g. how many learners have accessed the site in the last week/month/quarter/year, also consider how many learners haven’t accessed the site in the last week/month/quarter/year.
Be wary of popular courses, if a course has a high completion rate is it because it is a mandatory course? Try and identify what is working (and what isn’t working) on the site and use the data that is generated to feedback into the site to improve the content, the UX, the site as a whole. Continual improvement will keep the LMS ‘fresh’ and your learners will keep coming back.
GiGo – Garbage-In Garbage-Out
Get to know your data. Before you start waving your report around the office with some good (or not so good) statistics, you should consider the data that is in your LMS.
If you are not confident of the data that has gone in, how up-to-date it is or the data that is being generated, then how can you be confident in the conclusions you, or your peers, will be making based on the reports that are generated?
What can you do about your data?
To ensure good quality data within the LMS you should undertake regular housekeeping tasks. This housekeeping should focus on learner data as well as the content that is accessed via the site.
Data quality can be improved by implementing some ‘quick-win’ solutions. For example, make your site more accessible to learners by removing the need to remember login details by implementing single sign-on, improve the quality of the user data by importing data into your LMS regularly straight from your HR system (assuming your HR system is up-to-date!).
From a content perspective, when is the last time the learning catalogue was reviewed? Is the content still relevant and up to date?
All LMSs come with some form of reporting functionality. Totara LMS is now able to create graphical reports and combine these with user-defined dashboards out of the box. These can give decision makers an accurate picture of what is happening within the site.
Some organisations are benefiting from combining data from their LMS with other company data by exporting information from their LMS into a central data warehouse, where powerful reporting tools are able to slice and dice the data.
Another quick-win-low-cost option is to implement Google Analytics on your site. Google Analytics is the most widely used website statistics service and is currently in use on around 55% of the 10,000 most popular websites. Why not implement it on your LMS? It can provide information such as who is accessing your site, where they are accessing it from (home, work, on the move?), when (during or outside ‘normal’ working hours?), what devices are being used, how long are users spending on particular pages and more. Google Analytics can also provide you with data about your users such as their demographic, gender and even spending habits. Become a marketing expert and use the tools that are available to ‘sell’ you LMS.
What does this data do for you?
Accurate and up-to-date reporting can only be a good thing - we all know that. But what can you actually do with the information within the reports? What do they really tell you?
Just like those marketers mentioned at the beginning of this article, know more about the product: your learners! Build up a picture of their behaviours and their likes/dislikes, and feed this information back into the LMS and other business processes to enrich the learning experience. This, in turn, will ensure a higher level of engagement within your workforce, and help you leverage your LMS to achieve your organisational goals.
5 top tips
- Keep your data clean, make sure that your data feeds are relevant and that data is up to date
- Take the time to understand your data, what is available to you and how can it be used
- Have a vision and objective for your data, can you engage your stakeholders with great data? Can you help the business measure investment better? Can you help the business understand where learning is not succeeding and more…
- Think about the audience, what do they want to see and what will most turn them on?
- Make your data look sexy, use graphical reporting as a way to bring your data to life
To find out more about how Kineo uses Totara LMS to help clients collect meaningful data, why not visit the Kineo website?
This is a guest post from Totara Platinum Partners City & Guilds Kineo.