InstructionalEngineer

How to Choose an LMS – Questions to Ask Before You Sign

By Instructional EngineerSCORM, xAPI and LMSAI8 min read

How to Choose an LMS – Questions to Ask Before You Sign - 3D Cutaway Animation

The demos all looked great. Every vendor had a clean dashboard, a friendly learner home page and a slide that said "AI-powered." Now there's a contract on the table, a renewal term measured in years, and a nagging feeling that you've seen what each product does best but not what it does on an ordinary Tuesday. Figuring out how to choose an LMS isn't about finding the flashiest platform. It's about finding the one that fits your learners, your admins and your data. So what should you ask, and test, before you sign?

To choose an LMS well, define your requirements before you watch demos, then make every vendor prove those requirements with your own content, your own users and your own reports. Start with who your learners are, what training you deliver, which systems must connect, and who will run the platform day to day. Ask specific questions about standards support, integration, reporting, data export and pricing, and get the answers in writing. Evaluate AI features the same way: ask to see them working on your content, and confirm how your data is used. Finish with a hands-on trial scored against a checklist you wrote before the trial started.

What Should You Decide Before Talking to Vendors?

Decide what problem the LMS is solving and who it's solving it for. Without that, every demo looks good, because each vendor steers toward its strengths.

Write a one-page brief that covers:

Then split requirements into must-have, nice-to-have and don't-care. Be ruthless. A long list of must-haves usually means nobody prioritized.

Which Questions Should You Ask Before You Sign?

Ask questions that require specific answers and, ideally, a demonstration. Here are the ones that separate good fits from expensive regrets.

For learners

For administrators

For content and standards

For integration

For data and exit

Don't let the exit question slide to the end of the list. Your next LMS change will be far easier if you negotiate data portability now, while the vendor still wants your signature.

Who Should Be on the LMS Selection Team?

Put the people who will live with the decision on the team, not just the people who sign it. A small group of five or six works better than a committee of twenty.

Add a handful of real learners during the trial. They'll notice things the team can't, like a confusing home page or a course player that misbehaves on older phones.

What Does an LMS Really Cost?

The license fee is only part of the cost of an LMS. When you compare vendors, add up the full picture over the whole contract term, not just year one.

Ask each vendor to price the same scenario, with your learner counts and modules, so the numbers are actually comparable.

LMS vs LXP: Which Do You Need?

An LMS (learning management system) manages assigned, tracked training. An LXP (learning experience platform) focuses on discovery: personalized recommendations, curated content from many sources, user-generated content and social features. If you mostly assign required training and need audit-ready records, you need an LMS. If you want people to explore and build skills on their own, an LXP adds value.

NeedLMSLXP
Assign required training with due datesCore strengthLimited or none
Compliance records and auditsCore strengthUsually relies on an LMS
Personalized recommendationsGrowing, varies by productCore strength
Curating outside content (articles, videos, courses)SomeCore strength
Social and user-generated learningSomeCommon

The line keeps blurring. Many LMS platforms have added discovery features, and some LXPs now handle assignments. Don't buy based on the label. Buy based on which of the rows above matter most to you, and test those rows in the trial. The Wikipedia overview of learning management systems gives useful background on how the category developed.

How Should You Evaluate AI Features in an LMS?

Evaluate AI features by the job they do for your learners and admins, with your content, during the trial. AI in learning platforms has become truly useful in a few areas, and it deserves a serious look. Common examples include natural-language search across your catalog, content recommendations, automatic tagging of courses by skill, help drafting course outlines or quiz questions, translation, and admin assistants that answer "who's overdue in the Denver office?" without building a report by hand.

How to Choose an LMS – Questions to Ask Before You Sign - 3D Animation

For each AI feature a vendor shows, ask:

  1. Can I see it working on our content, not your demo library?
  2. Where does the AI run, and is our data used to train models? What do the contract and data processing terms say?
  3. Can admins review, edit or turn off what the AI produces, such as tags or generated questions?
  4. Does it work in the languages our learners use?
  5. Is it included in the price or an add-on?

Good AI features save admins real time and help learners find the right thing faster. The best implementations keep a person in the loop for anything learners will see, which is simply good content practice. If you want a closer look at what's working, my article on AI LMS features for search and admin walks through the most useful ones.

How Can AI Help You Run the LMS Selection Itself?

General AI assistants such as ChatGPT, Claude or Microsoft Copilot are excellent helpers for the paperwork side of choosing an LMS. They won't pick the platform for you, but they can save hours of drafting and comparison.

Treat the output as a strong first draft. Check every claim in a comparison against the vendor's actual documents, because a summary can blur details, and follow your organization's rules about what can be pasted into which tools. Used that way, an assistant lets you spend your time on judgment calls instead of formatting.

How Do You Run a Fair LMS Trial?

Run the same scripted tasks on every shortlisted platform, with real users, and score them against criteria you wrote before the trial began.

  1. Pick two or three finalists. More than that and nobody tests thoroughly.
  2. Load real content: a SCORM course, a video, an xAPI or cmi5 course if you use them, and one instructor-led session.
  3. Create test users that match your real roles and locations.
  4. Have admins run the scripted tasks and time them.
  5. Have a few real learners take assigned training on their own devices and tell you where they got stuck.
  6. Build the three reports your managers ask for most often.
  7. Score each platform against your must-haves and record evidence for every score.

If a vendor won't provide a trial environment with your content, that tells you something about how support will feel after you sign.

What Red Flags Should Make You Pause?

Some warning signs show up early if you look for them:

None of these automatically rules a vendor out. Each one deserves a direct question and a written answer.

How to Choose an LMS You'll Still Like at Renewal Time

Knowing how to choose an LMS comes down to doing the homework in the right order. Define your audiences, training types, integrations and admin capacity first. Ask specific questions and get written answers, especially about standards, data export and pricing. Judge AI features on your own content, and let AI assistants speed up the drafting and comparison work. Then run a scripted trial with real users.

Your first move is the brief: audiences, training types, integrations, admin capacity and budget, written down before the next demo. Every later step gets easier once you know exactly what you're shopping for.

← All articles