Lessons from Real-World Device Testing

Paul Charlebois and Eric Olson are seated across from each other at a white table in a modern office setting. The man on the left has curly brown hair and is wearing a light blue button-up shirt. He is smiling and looking toward the man on the right, who has short gray hair, glasses, and is wearing a dark patterned shirt with a small microphone clipped to his collar. The background is a bright, blurred open-plan office with desks and chairs, creating a soft focus effect behind the subjects. A blue pen and a blurred stack of folders or documents are on the table in the foreground.
Resources

Lessons from Real-World Device Testing

YouTube video thumbnail

In this episode of Before the Build, Eric Olson and Paul Charlebois explore the unpredictable nature of real-world device testing. Even the best-designed devices, prepared with careful simulations and usability studies, can behave very differently when used in actual clinical or emergency situations.

Eric opens by reflecting on the limits of design planning. Teams work hard to understand workflows, but sometimes no amount of mockups or lab testing can replicate the stress, urgency, or unpredictability of real life. Paul recalls a neurosurgery case where a circulating nurse struggled with a specialized cutting device. In the dark, under pressure from the surgical team, she had to fumble with instructions while the surgeon demanded immediate action. The moment highlighted how hard it is to simulate stress during usability studies and raised important questions about testing devices under realistic conditions.

When Training Meets Reality

Eric and Paul share additional examples, such as automatic external defibrillators (AEDs). These life-saving devices are designed for simple bystander use with clear prompts and automation. Yet in practice, many AEDs end up locked in cabinets, hidden from view, or only known to a few trained employees. The gap between intended usability and real-world access shows the importance of considering full context during real-world device testing.

Another observation came from an epidural case. The anesthesiologist expected a straightforward procedure with a cooperative nurse as the patient. Instead, the situation turned chaotic when emotions ran high, leaving the researchers to realize how quickly assumptions can collapse. These moments, while unplanned, create some of the most valuable insights for improving device design.

Why Unpredictability Improves Design

As Paul notes, what feels like an “edge case” may actually reveal critical lessons. Unexpected reactions and stressful environments expose hidden design flaws and usability challenges. Ultimately, testing devices in real-world conditions helps teams create safer, more effective solutions that perform in both calm and chaotic situations.

Watch now to hear Eric and Paul discuss the stories that shaped their understanding of how unpredictable use can drive better MedTech design.

Learn more about StarFish Medical.

A red defibrillator inside a white wall-mounted cabinet labeled DEFIBRILLATOR. A red arrow points to it, with overlay text reading ‘Locked away?’ in bold black letters on a white highlight.

Lessons from Real-World Device Testing

Even the best-designed devices, prepared with careful simulations and usability studies, can behave very differently when used in actual clinical or emergency situations.

A medical professional wearing a white coat and blue gloves holds a red cooler labeled ‘Organ Transport.’ Overlay text reads: ‘The call came’ in bold black letters on a white highlight.

Organ Transplant Logistics in Device Design

In this Before the Build episode, Eric Olson and Paul Charlebois dive into the importance of organ transplant logistics when designing effective medical devices.

A patient lies with eyes closed while a clinician marks dotted surgical lines on her face with a skin marker. The patient wears a surgical cap. Overlay text reads: ‘More than a procedure?’ in bold font on a white highlight box.

Patient-Centered Field Research in Medtech

In this Before the Build episode, Eric Olson and Paul Charlebois reflect on the value of patient-centered field research—and how firsthand observation can reframe design priorities and impact outcomes in profound ways.

A hospital patient lies in bed with a blurred background of medical equipment; bold text reads “Empathy in Design” across the top.

Translating Emotion into Empathetic Medical Design

What does empathetic medical design really look like in practice? Eric and Paul discuss how emotional insight from field research can profoundly impact the design of medical devices