Professional Partner Content
Capturing Data to Improve the E-Learning Experience with Learning Analytics (Part 1)
Published Wed Aug 08 2018
Brought to you by
Content
Whether you work in industry or education, your training initiatives should have well-defined goals and produce measurable outcomes. By clearly establishing objectives, collecting data, and analyzing trends, you will obtain a much clearer understanding of how well your training programs are performing. This will allow you to see which programs are working, what you need to improve, and how best to implement that change. Increasingly, learning and development (L&D) organizations are coming to appreciate the power of a rigorous analytics strategy.
Whether you work in industry or education, your training initiatives should have well-defined goals and produce measurable outcomes. By clearly establishing objectives, collecting data, and analyzing trends, you will obtain a much clearer understanding of how well your training programs are performing. This will allow you to see which programs are working, what you need to improve, and how best to implement that change. Increasingly, learning and development (L&D) organizations are coming to appreciate the power of a rigorous analytics strategy.
Content
Approaching Your Learning Analytics Data
Approaching Your Learning Analytics Data
Content
Ultimately, the goal of data analysis is to obtain actionable information. To do this, you need to establish a consistent framework that gives context to your raw learning data. A complete analytics framework has two main components: strategy and techniques. Strategy refers to the high-level questions that will determine the key objectives, metrics, and tools for your analytics program. Techniques are the best practices that will allow you to design and implement an effective program.
Ultimately, the goal of data analysis is to obtain actionable information. To do this, you need to establish a consistent framework that gives context to your raw learning data. A complete analytics framework has two main components: strategy and techniques. Strategy refers to the high-level questions that will determine the key objectives, metrics, and tools for your analytics program. Techniques are the best practices that will allow you to design and implement an effective program.
Content
In the first part of this two-part blog post, we will discuss the ‘Strategy’ piece.
In the first part of this two-part blog post, we will discuss the ‘Strategy’ piece.
Content
The three major questions you want to ask are:
The three major questions you want to ask are:
Content
1. Why do I need analytics for my training program?
1. Why do I need analytics for my training program?
Content
What are you trying to achieve in your training program? While all programs involve some element of knowledge acquisition or behavioural change, specifics can vary quite widely. For instance, your training program could be attempting to:
What are you trying to achieve in your training program? While all programs involve some element of knowledge acquisition or behavioural change, specifics can vary quite widely. For instance, your training program could be attempting to:
Content
increase the success rate of outbound sales calls
increase the success rate of outbound sales calls
Content
reduce average time spent on customer support calls
reduce average time spent on customer support calls
Content
maximize productivity in a manufacturing facility.
maximize productivity in a manufacturing facility.
Content
These are “big-picture” business goals that are not always straightforward to evaluate. As a result, many organizations lose sight of the original objective and end up trying to measure too many things at once. By committing to a specific goal, you will be able to avoid this trap and focus only on the metrics that matter.
These are “big-picture” business goals that are not always straightforward to evaluate. As a result, many organizations lose sight of the original objective and end up trying to measure too many things at once. By committing to a specific goal, you will be able to avoid this trap and focus only on the metrics that matter.
Content
2. What are the key metrics to measure toward my objectives?
2. What are the key metrics to measure toward my objectives?
Content
The next step is to determine the key metrics that will allow you to measure progress toward your high-level objective. These metrics are known as “key performance indicators” (KPIs).
The next step is to determine the key metrics that will allow you to measure progress toward your high-level objective. These metrics are known as “key performance indicators” (KPIs).
Content
Some common learning KPIs include:
Some common learning KPIs include:
Content
Activity Scores
Activity Scores
Content
Course Completion
Course Completion
Content
Grades
Grades
Content
Courses Purchased
Courses Purchased
Content
Time Spent Engaged
Time Spent Engaged
Content
Often, to accurately evaluate progress, you will need to combine several of these metrics in some way.
Often, to accurately evaluate progress, you will need to combine several of these metrics in some way.
Content
3. How do I implement my analytics strategy?
3. How do I implement my analytics strategy?
Content
Once you’ve determined the metrics you need to answer key questions, you have to decide how to implement your learning analytics program. It is very important to have realistic expectations. Many analytics programs fail because they do not consider the organization’s current analytics capabilities.
Once you’ve determined the metrics you need to answer key questions, you have to decide how to implement your learning analytics program. It is very important to have realistic expectations. Many analytics programs fail because they do not consider the organization’s current analytics capabilities.
Content
In particular, there are three common challenges you should watch out for:
In particular, there are three common challenges you should watch out for:
Content
Technology: Do you have the tools required to collect, store, analyze, and present your data?
Technology: Do you have the tools required to collect, store, analyze, and present your data?
Content
Data: Are you able to get access to all the relevant data in your LMS and other business intelligence systems?
Data: Are you able to get access to all the relevant data in your LMS and other business intelligence systems?
Content
Skills: Do your people have the knowledge, judgment, and experience to analyze your data effectively?
Skills: Do your people have the knowledge, judgment, and experience to analyze your data effectively?
Content
Appropriately calibrating your expectations can mean the difference between a successful analytics program and one that fails to get off the ground. In our next blog post, Capturing Data to Improve the E-Learning Experience with Learning Analytics (Part 2), we’ll discuss the various techniques required for implementing learning analytics.
Appropriately calibrating your expectations can mean the difference between a successful analytics program and one that fails to get off the ground. In our next blog post, Capturing Data to Improve the E-Learning Experience with Learning Analytics (Part 2), we’ll discuss the various techniques required for implementing learning analytics.