Buying Smart

Building a Vendor Shortlist

The healthcare software market is crowded. For almost any category, you could find dozens of vendors. The goal of shortlisting is to get from that long list to three or four serious candidates worth a deep evaluation — without wasting weeks on options that were never a real fit.

Set your filters first

Before looking at any vendor, define the criteria that will quickly eliminate poor fits:

  • Practice type and size — does the vendor serve practices like yours?
  • Specialty fit — do they support your specialty's workflows?
  • Certification — if you need a certified EHR, is it on the CHPL?
  • Integration — does it connect to systems you must keep?
  • Budget range — is it plausibly affordable for you?
Use the Certified Health IT Product List. ONC's public CHPL database lets you confirm whether an EHR is certified and what criteria it meets — a fast, objective filter before you ever talk to sales.

Where to find candidates

SourceStrengthCaution
Peer practicesReal-world experienceTheir needs may differ from yours
Professional associationsSpecialty-relevant optionsMay favor sponsors
Review sitesBreadth of optionsReviews can be gamed
CHPL (for EHRs)Objective certification dataDoesn't rate quality

Apply the filters ruthlessly

Run every candidate through your filters and cut anything that fails a must-have. If a vendor doesn't serve your practice size, isn't certified when you need certification, or can't integrate with a system you must keep, it's out — no matter how polished the demo would be.

Aim for three to four finalists

A shortlist of three or four lets you run thorough, comparable evaluations without burning out your team. Fewer than three and you lack genuine comparison; more than four and the process drags and demos blur together.

Beware the demo halo

It's tempting to shortlist based on which sales team gave the slickest presentation. Resist it. A polished demo reflects the vendor's sales skill, not the software's daily fit for your practice. The shortlist should be built from your filters and objective data before any sales conversation, so that demos confirm or eliminate candidates rather than create them. Otherwise you risk advancing the best presenter instead of the best product.

Talk to real references — pointedly

Before finalizing the list, ask each candidate for references at practices like yours, then actually call them. Vendors offer their happiest customers, so steer the conversation toward specifics: what went wrong during implementation, what they'd change, how support responds when something breaks. A few candid reference calls can reorder your shortlist faster than any datasheet, surfacing real-world limitations that never appear in marketing.

Don't let the list go stale

A shortlist built six months ago may already be out of date. Vendors release new versions, change pricing, get acquired, or sunset products; certification status can change; your own requirements evolve. If your selection process stretches over many months, revisit the list before finalizing rather than assuming last quarter's research still holds. A quick refresh — re-checking certification, recent reviews, and any major product changes — protects you from choosing a finalist based on facts that no longer apply.

Document your reasoning

Write down why each vendor made or missed the list. This creates an audit trail, helps you explain the decision to stakeholders, and makes it easy to revisit a near-miss if a finalist falls through. A short, dated rationale per vendor is enough — and invaluable months later when someone asks why a particular product wasn't considered.