Lessons from Real-World Device Testing

Paul Charlebois and Eric Olson are seated across from each other at a white table in a modern office setting. The man on the left has curly brown hair and is wearing a light blue button-up shirt. He is smiling and looking toward the man on the right, who has short gray hair, glasses, and is wearing a dark patterned shirt with a small microphone clipped to his collar. The background is a bright, blurred open-plan office with desks and chairs, creating a soft focus effect behind the subjects. A blue pen and a blurred stack of folders or documents are on the table in the foreground.
Resources

Lessons from Real-World Device Testing

YouTube video thumbnail

Design teams work hard to understand workflows, anticipate user behavior, and build usable devices. But as Eric and Paul discuss in this episode of Before the Build, even the most carefully planned usability work can’t fully replicate what happens in real clinical and emergency environments. The stories they share make the case for why real-world observation matters.

When the Room Changes Everything

One example involves a circulating nurse preparing a specialized cutting device during a glioblastoma resection surgery. The procedure can run five to ten hours. The room is dark. The surgical team is under pressure. The nurse was working through the instructions for use while the surgeon demanded the device immediately. The stress of that moment raised a direct question about usability testing: was this device ever tested in a dark room, under that kind of pressure? And more fundamentally, how do you replicate that level of stress in a simulated environment when a person’s career isn’t actually on the line?

The Gap Between Design Intent and Real-World Access

AEDs offer a different kind of example. Modern AEDs are designed for bystander use, with voice prompts and automation that remove the need to read instructions or press a button at the critical moment. In practice, however, facilities often install AEDs without adequate signage, train only one or two employees on their location, and store them in locked cabinets. The device may be well-designed for use, but the context of use creates its own barrier entirely separate from the device itself.

Assumptions That Don’t Survive Contact with Reality

A third example comes from an epidural observation session. An anesthesiologist described the first patient as a nurse, someone familiar with clinical environments and likely to be cooperative throughout the procedure. The situation turned out to be the opposite, with the patient in significant distress, the procedure completed quickly, and the observation session effectively lost. The second patient, expected to be more difficult, was the one described as potentially ideal. Neither assumption held.

What Edge Cases Actually Tell You

The thread running through each story is that unexpected situations aren’t necessarily outliers. As one host puts it, these edge cases seem to follow you around, which raises the question of whether they’re really edge cases at all. Understanding what happens at the fringes of expected use, alongside the predictable workflow, is what ultimately leads to better products.

What this episode covers

  • The limits of design planning and usability simulation: some stressors and scenarios simply cannot be replicated in a lab environment
  • A neurosurgery observation where a circulating nurse struggled to operate a specialized cutting device in a dark room under direct pressure from the surgical team, raising questions about whether the device had been tested under realistic conditions
  • The AED example: a device designed for intuitive bystander use that in practice is often stored in locked cabinets, without signage, with only one or two employees aware of its location
  • An epidural observation session where a patient expected to be cooperative turned chaotic, and a patient expected to be difficult was anticipated to be the clearest case, with neither assumption holding
  • The hosts’ view that what appears to be an edge case may actually reflect consistent patterns in how devices get used, and that observing these situations produces some of the most valuable design insights
Nick and Nigel discussing the hidden costs of sterile medical device production including shipping in a Bio Break episode, with text overlay reading 30% Hidden Costs

Nick and Nigel breaks down what actually goes into the cost of getting a sterilized device into a user’s hands, and why up to 30% of costs can sit in places most teams don’t plan for.

Gloved hands handling a pharmaceutical vial through a shielded enclosure, illustrating the manual theranostics delivery workflow discussed in a Bio Break episode

Theranostics combines diagnosis and therapy into a single targeting system, using one ligand to attach to two different radioactive payloads, one for imaging and one for treatment. It represents a significant shift in how cancer is being identified and treated. But the theranostics delivery workflow tells a different story.

Home use medical device usability challenges for a lay user managing a monitoring device at home

Most medical devices were designed for clinical settings, not the patients and caregivers who increasingly rely on them at home. Here’s what good home-use device design actually requires.

Comfort evaluation in medical device design showing researcher recording observations while assessing wearable device fit on a participant's wrist

How do you measure comfort in medical device design? Explore the tools, scales, and study design principles that turn a subjective experience into actionable design data.