<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=115389302216927&amp;ev=PageView&amp;noscript=1">
LET'S TALK

Evaluating Training Effectivenes

    mega-menu-graphic

    Storyline Scheduled Public Courses

    2 min read

    Sitting in a toilet cubicle on Friday morning break

    By Andrew Jackson on Thu, Mar 14,2024

    Autumn is often our busiest period. The time of the year when people are most likely to decide to take some training or embark on a new project to develop a learning programme or course.

    And naturally, starting a development project or a training course means thinking about objectives and outcomes. So this week, I wanted to share a personal story with you that vividly highlights the importance of getting this kind of stuff right.

    It's a cold February day. I'm in a hotel in Bournemouth running a 5-day open (public) course for a fairly well-known training provider. It's morning break and I've locked myself in a cubicle in the gent's toilet.

    Do I need to use the facilities? Actually, no. Am I having a nervous breakdown? Thankfully, not. So why the heck am I there? Easy. To be absolutely sure of having a delegate-free 20 minutes! (I did take a newspaper with me to avoid getting bored - this is a pre-smart phone era story, I'm sure you will have realised). 

    Before I go any further, I should point out, the delegates would have had no idea I was so desperate to escape them.

    So how, you may well ask, did it get to this? Well we need to go back to Monday morning. Andrew to mission control: we have a problem. Unfortunately, mission control didn't give a stuff. 

    By break time on Monday morning it was quite clear half the delegates were entirely unsuited for the course. Being a smart bunch of people, they had realised this, too. Hence the call to mission control. 

    The solution seemed obvious to me. Refund of money or offer of a place on an alternative course at a later date. Problem solved. Mission control was having none of it. No refund. No transfer. Stick with the programme as advertised. Good luck…

    As you can imagine, not a great start to any training week.

    A couple of delegates left, vowing to fight the battle with mission control from back at the office. But most stayed. 

    Did I stick with the programme as advertised. Of course not, how could I. Did I have one of the worst weeks of my training life? Without doubt. Every spare minute was frantically spent devising exercises and activities, typing up worksheets, trying to think of ways to effectively run two courses in one. And this was when internet resources were nothing like as plentiful as now.

    Every session was a struggle, trying hard to manage a demanding group of people with very disparate needs.

    So you can see the attraction of the toilet cubicle by the time the course was almost done (we finished at lunchtime on the Friday).

    This example, of course, was about a problem with the sales people. Not knowing (or properly understanding) the course objectives and the content, resulting in the wrong people to the wrong course. 

    But let's be honest, it's a problem that could just as easily be caused by poor audience and content analysis, unclear or unstated objectives or just not getting to the heart of why a piece of training is needed in the first place.

    We're probably all guilty of seeing planning and analysis as a bit boring, something we want to get done as quickly as possible, so we get on to the interesting bits. But this experience seared into my little brain, how utterly important it is to get the early stages of the training development process right and that it is worth taking the time to do this.

    If planning and analysis is one of your current challenges (or you have challenges in other aspects of developing training for the classroom or online mediums) then take a look at  our instructional design training programme. Modular. Highly flexible. Continually updated. Lots of options and choice.

    Topics: Instructional Design Course Design
    2 min read

    Instructional design: using visuals to support learning

    By Pacific Blue on Mon, Jan 15,2024

    When developing learning materials, most instructional designers and trainers rarely give much thought to how they use visuals and graphics. Typically, they just add them as a way to liven up dull looking text. 

    In contrast, as most graphic designers know well, there is an entire vocabulary and language connected with the use of visuals. This is something rarely included as part of conventional instructional design training. A pity, because it is a language which instructional designers and trainers would get a great deal of benefit from knowing.

    If you are interested in learning more about the language of visuals, as good a starting point as any is an understanding of the five instructional functions for graphics. These functional categories are as follows:

    Decorative visuals: used to make instruction more appealing and motivating. They typically do not have a strong association with the instructional content. Interestingly, in a study of sixth grade science textbooks in the US, Richard Mayer found that over 85% of graphics fell into the decorative category.

    This statistic seems to support the view expressed in the opening of this article - that many instructional designers (and text book publishers) pay little attention to the significance of visuals and graphics. In the light of this finding, it’s probably fair to say that decorative graphics should be used with caution.

    Representative visuals: used to make information more concrete. They convey information quickly and easily, reducing the need for lengthy textual explanation.

    Organisational visuals: help learners understand the structure, sequence and hierarchy of information and help people integrate that into their existing knowledge. Examples include charts, graphs and displays that help people see relationships between elements.

    Interpretive visuals: used to help learners understand difficult and ambiguous or abstract content. In general, they help make information more comprehensible. Examples include models of systems and diagrams of processes.

    Transformative visuals: used to make information more memorable. They are intended to aid learners' thought processes. They focus more on helping the learner understand than on presenting content. Transformative visuals can be a little unconventional and because of this are not widely found in learning materials.

    In conclusion, we've all heard the phrase "a picture is worth a thousand words". And many people accept this wisdom without question. 

    In fact, just because something is communicated visually doesn't necessarily make it more valid or easier to understand. A poorly designed visual or graphic could just as easily impede learning as facilitate it. 

    Indeed, a poorly designed graphic where the purpose and instructional function are mismatched might need a thousand words to help explain it clearly to learners.

    Topics: Instructional Design Course Design
    2 min read

    In-person training: helping adults learn effectively

    By Pacific Blue on Mon, Nov 13,2023

    When you are designing learning (regardless of the delivery medium) key to success is an understanding of how adults actually process new information and, therefore, acquire new knowledge and skills.

    Different instructional design experts use slightly different ways to describe the basic knowledge transfer process, but when you are thinking about in-person training in essence it boils down to three broad stages.

    Typically, at the start of this process is the presentation stage. This is when the trainer is introducing new or partially familiar knowledge and/or skills to the learners. Ideally, this is done through a familiar and meaningful context, rather than in a dry, abstract way. Once the trainer has carried out some basic checks to ensure learners have grasped the new information, the transfer process quickly moves to stage two.

    Here, learners are given the opportunity to practice what they have just learnt in a structured environment. During this phase, the learners might take part in one or several activities - depending on the level of difficulty and how much need they have for initial practice. 

    Once the structured practice is complete and the learners have grasped the basics, it is time to move to the final stage - more spontaneous practice. Here, learners are encouraged to use their newly embedded skills and knowledge with less structure provided. Ideally, this stage will use a context and activity that is both relevant and motivating to the learners.

    Overall, the three stages move from a very teacher or trainer centred starting point through to a highly learner-centred one - where the trainer can take a back seat, observe the learning in action and provide feedback at the very end of the process.

    One of the advantages of this broad approach is its flexibility and adaptability. You can vary the amount of structured and spontaneous practice you use based on the needs of your learners. 

    You can increase or decrease the amount of feedback you provide based on the results you are seeing. This feedback can be adjusted during the structured and/or spontaneous practice stages. You could even add remedial structured or spontaneous practice at the end of the entire process, if you decide this is appropriate.

    Additional flexibility is available to you with the sequence of stages. For example, you could use a structured practice activity as your starting point. This would enable you to diagnose existing knowledge and possible areas of difficulty before embarking on a customized presentation and follow-on practice activities.

    Alternatively, with more experienced learners, you could turn the process on its head and start with a spontaneous practice activity to see how they cope. Following on from this, you can draw out learning points, leading you to structured practice (or additional spontaneous activities) for the purposes of revision or consolidation.

    Understanding the significance of this flexible 'presentation, structured practice, spontaneous practice' model enables you to create effective learning events that help your learners to quickly acquire and embed new knowledge and skills.

    Need help with instructional design for yourself or your team? As a starting point, why not download our free Essential Guide to Instructional Design Success.

    Topics: Instructional Design Course Design
    2 min read

    Animation in e-learning: is it worth it?

    By Pacific Blue on Mon, Nov 14,2022

    Now, here's an interesting point that came up on one of our instructional design programmes recently. Is using animation in e-learning really effective? 

    A good question. It's time-consuming to produce and depending on the length and sophistication of said animation, it may not come cheap. So should you bother? 

    While I’d always counsel caution when it comes to looking at research, there are a couple of interesting studies done on this. One by Narayanan and Hegarty and the other by Mayer, Mathias and Werzell. 

    In each study, two sets of learners were given identical lessons explaining a process - with one difference. One lesson showed the process using an animation and one showed the process using a sequence of still diagrams. At the end of the lesson each set of learners took the same test. 

    What is so very interesting about this is the test results in both studies: no significant difference between the two sets of learners. In other words, the use of an animation didn't have any major impact on the effectiveness of the learning. 

    Can we extrapolate out from that and say animations make no significant difference whatever the subject matter? That's probably a bit of a stretch. 

    What we can say with some certainty, however, is that if your aim is to teach someone a process, spending a lot of money on creating an animated version of that process certainly doesn’t guarantee a significantly better learning outcome. 

    However, what I find most interesting is that there was no significant difference between using still and animated visuals. This is not a case of saying, ‘don’t bother with well-designed and integrated graphical presentation’. 

    What it does seem to be saying is that super-charging that graphical presentation, by animating it, won’t actually make a significant difference. 

    When we talk about e-learning we can all get carried away with talk of making it engaging; and animations are one way we might choose to achieve that engagement. 

    It’s always worth remembering that spending big on additional multimedia bells and whistles won’t necessarily have the positive impact on learning outcomes that we might wish for.

     

    If you are looking for help with designing and/or developing a piece of e-learning, check out our service options.

    Topics: Instructional Design Course Design e-learning
    3 min read

    Custom E-Learning Design: Is Your Authoring Tool Holding You Back?

    By Andrew Jackson on Thu, May 26,2016

    Increasingly, if you are working in a learning and development role associated with designing and developing e-learning, you’ll probably be expected to have some ability in using an authoring tool.

    This should be good a thing. It increases your overall skill set and more important, it enables you to create more effective learning for your learners.

    But what about if this isn’t what is happening. What about if your e-learning authoring tool is actually holding you back?

    This might seem like an odd question to ask. Surely an ability to use an authoring tool will mean you are creating really effective e-learning. Not necessarily.

    First, it’s your instructional design skills that should determine the effectiveness and quality of the e-learning you create.

    But what about if you are not going down the road your instructional design leads you because you find yourself thinking, “No point in doing that because I’ve no idea how to implement it in my authoring tool. Better stick with a less ambitious design because I know how to do that.”

    Hey presto, before you know it, your authoring tool is most definitely holding you back. The good news? It doesn’t have to be this way.

    The problem with legacy authoring tools

    Going back 10 or 15 years, most easy-to-use authoring tools were so limited in their functionality, they really restricted truly creative instructional design thinking.

    Only if you were lucky enough to work in an organisation with a massive budget for creating e-learning and unrestricted access to programmers could you really pull off much that was original or really effective.

    This is one of the key reasons we have had years of deathly boring e-learning. Lots of slides with dense text and stock photos. A Back and Next button applied to each slide – and not much else.

    The emerging new breed of tools

    Fortunately, the world of authoring tools is changing. While there are still far too many rubbish ones out there, we are seeing a new breed emerge. Much more powerful. Fantastic functionality. Much fewer limits on what you can achieve with your e-learning.

    So here’s the rub. Lots of people using one of these new style of authoring tools don’t really know about some of the more powerful features available to them. Instead they are still churning out e-learning, barely removed from the deathly dull variety just described above.

    What a pity! This is like owning a Porsche and only ever driving it around your local neighbourhood at about 20 miles an hour.

    Getting the most from your authoring tool

    So what’s the solution? Well, it’s twofold. First, you really need to make sure your instructional design thinking is up-to-date and fit for creating e-learning that is more focused on delivering practice of skills, than delivering screens of knowledge.

    And, by the way, if you need some help with this, you can download a free 12 page guide to creating boredom-busting e-learning here.

    Second, it’s time to up your game and start learning about the more powerful features of your authoring tool.

    To help you with this, I’ll be writing three more articles focused around one of the most popular of this new breed of authoring tool, Articulate’s Storyline.

    Why focus on Storyline?

    Why the focus on Storyline? It may not be absolutely the most sophisticated and capable of all the tools out there, but it does offer a great balance between being relatively easy to learn and achieving well above average functionality and interaction.

    In each of the articles that follow this one, I’ll be focusing on a different Storyline feature. Features that you’ve quite possibly heard of or maybe even used a little.

    But you may not be aware of their real power and how they can help you create much more effective e-learning. Features which can really help liberate your instructional design thinking and save your learners from the boredom of endless knowledge presentation.

    The best bit of all this? Once you feel confident in your ability to get your authoring tool to implement your instructional design ideas, it really will be your instructional design thinking that drives your development and not your authoring tool.

    This will almost certainly make your role as an instructional designer more interesting and satisfying. It will also turn you into an e-learning hero in the eyes of your learners. Don’t underestimate how much they will thank you for NOT making them sit through hours and hours of dull, sleep-inducing e-learning!

     

    This article first appeared on the Training Zone website.

    Topics: Course Design e-learning
    2 min read

    Courseware Design: When SME Rockstars Just Don't Rock

    By Pacific Blue on Tue, Aug 20,2013

    We've heard quite a bit in recent weeks about our new 'rockstar' Bank of England Governor, Mark Kearney. Well, today, I have a 'rockstar' story of my own to share with you today. A story about a subject matter expert who was supposed to be the rockstar of his subject matter world. - in this case systems analysis

    It was 1997. And there was great excitement all round because this great genius was coming to my university to give a guest lecture. (I was studying for a masters degree in systems analysis at the time).

    In the world of systems analysis, he was renowned for thinking outside the box, challenging the conventional wisdom and coming up with innovative solutions to sticky problems.

    At the appointed hour, we all shuffled into the huge lecture theatre ready for a memorable 90 minutes.

    And it certainly was memorable  - but for all the WRONG reasons. Because after only a couple of minutes, it became painfully clear the 'rockstar' just wasn't going to rock.

    He was quiet. Rambling. Obtuse. After about 10 minutes, I was completely lost. No idea about most of what he was saying. Overall, the 'rockstar' was completely oblivious to the needs of his audience. Completely wrapped up in the complexity of his own little world.

    And this story is an interesting one, because it's an extreme example of some very flawed thinking: that the smartest person in the room must be the best and only person to teach us the subject, or design the courseware to teach us the subject.

    What a big mistake. In most cases, the subject matter expert is almost always the very WORST person to take on either of these roles.

    And if you've ever worked your way through a piece of e-learning designed by an SME, you'll know exactly what I'm talking about.

    Yet in the worlds of both business and academia, the thinking seems to be that your brain simply can't fail to benefit from being exposed to another brain that's much smarter than yours.

    But as my story shows, if the smart brain is so wrapped up in its own complexity and cleverness, nothing much gets communicated. Confusion, boredom and disappointment are usually the only outcomes.

    And, by the way, my apologies if you belong to that small minority of SMEs who are also naturally gifted teachers and/or course designers. If that describes you, trust me when I say you are truly an SME rockstar.

    So what about if you belong the the majority? An SME who doesn't possess natural rockstar status? The good news? There is still hope. It's perfectly possible to make your knowledge and skills more accessible and their transfer to others more effective.

    You'll need to learn some new skills yourself. And you'll need to recognise your wealth of knowledge has to be constantly re-worked and re-calibrated each time you are designing or delivering a piece of learning, so it is suitable for different groups of learners and different delivery mediums.

    You'll also have to learn how to carefully structure and refine your knowledge and skills to make sure what you are designing or delivering actually results in useful, effective learning.

    But if you are up for the challenge, there's almost certainly a great piece of learning  or two inside of you, just waiting to get out.


    If you are you an SME designing courseware or delivering learning and you feel like you could do with some help and guidance, check out our Essential Step-by-Step Guide to Instructional Design Success.
    Topics: Instructional Design Course Design
    1 min read

    Instructional Designer Training: Integrating Practice in Your Design

    By Pacific Blue on Fri, Mar 16,2012

    When we struggled to learn things or carry out new tasks as children, it's more than likely that our parents or teachers reminded us that 'practice makes perfect' or told us to keep going and to 'try, try, try again'.

    As adults, we might find those phrases irritating (or down right annoying); but, you know what, hate to have to admit it, but mums and teachers really did know best!

    This is borne out by some research into the use of practice activities in e-learning. It should be interesting to anyone involved in instructional design or instructinal designer training.

    Comparing learning from two versions of an e-learning course, (one offering more practice activities than the other) researchers found that the version with more practice activities increased learning for both higher and lower ability learners.

    In this study, both lower and higher ability learners scored 15% higher on end of course tests compared with those who had taken the version of the course with fewer practice activities.

    So it does seem that if higher learner achievement is a key goal (and surely it will be), broadly speaking, more practice will mean better learning outcomes.

    The other key point in relation to practice activities is the pacing of learning through a course. A good many studies have been carried out around this. The research has consistently highlighted two key points:

    First, that spacing practice activities through a course really is more effective.

    Second, the benefit does not show up immediately. Longer term studies have revealed that over a period of several years, spaced practice leads to much better long-term retention of learning.

    Need more instructional designer training like this? Check out our flexible, modular programme.

    Topics: Instructional Design Course Design
    3 min read

    The Trouble with the Virtual Classroom - Logged in and Gabbing Away

    By Andrew Jackson on Mon, Mar 12,2012

    It's 10.30 at night. I'm sat in front of my computer logged in as a participant on a webinar being run in the US.

    No idea how many other people are taking part in this 'training' - but after two and half hours of non-stop lecture and 30 minutes to go before we reach the finishing line, my attention levels are at a low point. I've already snuck off to the loo a couple of times and made several cups of tea.

    While the overall quality of the content is very good, the presentation is terrible and the interaction with the presenters zero. They  spend so much time labouring each topic, it's easy to slip away for a couple of minutes and not to have missed much by the time you come back.

    If you've had an online 'training' experience like this one, you'll understand why there is frequently such a gulf between an organisation's enthusiasm for the virtual classroom and the learners' lack of willingness to engage with it.

    And organisations seem to be very enthusiastic. In 2009 an ASTD survey revealed that 23% of companies surveyed were using online learning compared with only 10% in 2003. An IITT survey here in the UK last year showed that 44% of companies surveyed anticipated making greater use of live online learning.

    You can understand why. The cost and time savings are compelling and the technology is relatively cheap and easy to deploy. "What's not to like?" would be the question on the lips of many advocates.

    In theory it should be attractive to learners, too. The opportunity to get more focused, bite-sized training with minimum convenience would seem like a no-brainer.

    In practice, as my experience as a participant shows, for many learners online training is little more than a live, scheduled version of a deathly boring e-learning module - with minimal interaction.

    But, as always, it doesn't have to be this way. There are three key factors involved in making live online training successful:

    1. Is it a meeting, a webinar or a training session?
    Seems obvious when written down in black and white, but many people planning and running live online sessions are not particularly clear on what type of session it  is they are running.

    An online meeting is a virtual equivalent of a face-to-face session where issues are discussed, information is shared and decisions are made.

    A webinar is much closer to a live seminar or lecture - largely presenter focused with potentially large numbers of attendees and  limited interactivity between presenter and audience.

    A live online training session should aim to replicate what happens in a classroom. Trainer led, but with plenty of opportunity for activities and interactions between trainer and learners and between learners working in pairs or small groups.

    2. Is your trainer ready for the challenge?
    Understandably, many trainers feel that they can never replicate the real classroom  experience online. You can't see the participants, you can't read their body language. They can't see you. How can it possibly work?

    The reality is different. Taking exactly the kind of care you would over preparing and running a classroom event, it's perfectly possible to run a throughly engaging, effective and successful online event. It does take time, however, to adjust to a very different medium and understand how to do things somewhat differently in the virtual classroom.

    3. Do you understand how to fully operate your virtual classroom?
    One critical success factor is familiarity with the software you are using to deliver your virtual classroom event.

    Unless you understand all the features and functions available to you, you'll never be able to design and deliver the best event you could. And this is no different, by the way, from taking into account all the different facilities,  equipment and aids you have available when designing and delivering a classroom course.

    One final point - not all software is created equal. Some systems have more sophisticated ways of enabling interaction than others - something to be very aware of when making a buying decision.

    If your organisation is one of the 44% thinking about making use of (or perhaps wanting to make better use of) the virtual classroom, and you'd like to get best practice principles and hands-on experience of running a virtual event, this is one of the modules available in our instructional design programme.
    Topics: Instructional Design Course Design Train the Trainer
    2 min read

    How Instructional Designers Can Manage Out of Control SMEs

    By Andrew Jackson on Fri, Feb 24,2012

    We can all feel our pulse quicken, our emotions rise when we get chance to talk or write about a topic that engages us totally.

    And we usually know lots about this topic. We can frequently talk about it for hours without getting bored. We can tell anyone willing to listen about its every last detail. In that sense, we are all subject matter experts (SMEs) in something.

    As instructional designers, when we have a talkative SME in front of us and limited time to get the information we want, it's worth remembering how our own passion for a particular subject matter can allow us to get carried away.

    So aside from being more empathetic to a talkative SME, is there anything else we can do to make our time with them more productive? I think there are four areas to consider when gathering content from SMEs. By the way, the greater the quantity of content you need to gather, the more you are likely to want to formalise the approaches below.

    Ownership
    Before any information gathering even happens, you need to take ownership of the process. This may involve becoming more assertive than normal: be quite specific about how you want the process to unfold, including the number of meetings you'll need, how long each meeting should be and how much time you'll need between meetings for reviewing and feedback.

    Planning
    Tempting as it might be to go into your early meetings knowing nothing, better to do research to familiarise yourself with the subject matter area. Spend time creating a basic project plan. Clearly define your and their roles in the whole process. Formally identify the risks of not getting the required information in a timely fashion and communicate this to the project sponsor.

    Connecting
    Your initial research can pay dividends once you start interacting with your SME. Exhibiting some knowledge of his/her topic can help build rapport and, more important, establish your credibility. Earn trust by emphasising the confidentiality of your information gathering sessions and the promise of a review of content before making it more widely available.

    As the content gathering progresses, aim to establish points of shared interest both within the subject matter area and outside. Most people appreciate a little interest in their life outside work.

    Focusing
    Set an agenda in advance of the meeting clearly stating goals and expectations.
    During your content gathering sessions, regularly paraphrase, clarify and summarise what you have covered; use closed questioning techniques if your SME has a tendency to go off on tangents. After the session, collate the content into a structured document you can share with your SME for review and feedback.


    It's easy to dismiss some of the subject matter experts we deal with in our professional capacity as out of control windbags who want to bore us and our learners with every last detail of their knowledge.

    That may be true. But let's not forget, given the right topic and the opportunity, many of us can happily do the same.

    So with a bit empathy and some detailed preparation and work before, during and after your content gathering, the analysis phase of your project need not be an out of control nightmare.

    If out of control SMEs are your current nightmare, check out our the Analysis and Planning modules in our instructional design programme for help on dealing with this problem.
    Topics: Instructional Design Course Design e-learning
    1 min read

    Does Compliance E-Learning Have to Be Boring?

    By Andrew Jackson on Tue, Feb 14,2012

     At a conference a year or so ago, I noticed a seminar that drew a good crowd was entitled, "Who says e-learning compliance training has to be boring?". Well not me for sure.

    Perhaps, I'm a bit naive, but even now (after many years in the world of learning) it shocks me that some people can shrug their shoulders and say., "well this material is pretty dry and boring, so we'll just have to accept that the way we deliver it is dry and boring". To me that's a bit like the designers at a car company saying, "well it's a bit difficult to design a really comfortable car seat, so we'll just fit the car with uncomfortable wooden benches and the passengers will have to lump it."

    Perhaps the acceptance of poor quality compliance training is linked to the box ticking mentality that often accompanies the dreaded 'c' word. We have to do the training  -  even though nobody wants to, so let's just collectively hold our noses and all be bored together - designers, trainers and delegates. Oh yes, and let's make it even worse, by delivering it as the most boring, sleep-inducing piece of e-learning you have ever seen.

    From this point of view, you'd think that compliance in a particular job role or organisation wasn't something anybody really needed to know or do. Yet it most definitely is.

    So rather than treating it as a dry abstract topic, why not relate it back to the context or contexts in which learners need to be compliant? Why not provide the learners with challenging, life-like scenarios and activities that require them to think about what they actually need to do to be compliant. How about some intrinsic, contextual feedback that vividly demonstrates the consequences of not being compliant or trying to cut corners.

    If you find yourself nodding your head and you are about to embark on creating some compliance e-learning (or any kind of e-learning for that matter) and you would like to read more about the four-pronged approach to e-learning development just described (context, challenge, activity and feedback) take a look at our free  'Effective E-Learning Toolkit'.
    Topics: Instructional Design Course Design e-learning