Case study · Healthcare · iPhone and Apple Watch

Say When: helping older adults avoid missed and double doses

Older adults take more prescription medicines than any other age group. Missing a dose or taking one twice can put them in the emergency room. Say When is an iPhone and Apple Watch app that keeps a person’s medicines and appointments in one schedule. Setup reads each pharmacy label and turns its directions into times the person confirms. After that, Say When checks before a dose is marked twice and adjusts reminders around appointments like a fasting blood test.

Context

My own product, for older adults and the family who help them

My role

Product designer and design technologist. I did the research, designed both apps and built them

Built with

SwiftUI, with one Swift package for the day’s logic that both apps share

Runs on

iPhone and Apple Watch, plus the watch face and the iPhone lock screen

Say When's Today screen at 8:12 AM on Wednesday: Good morning, June, 1 of 5 taken today, the day drawn as the sun's path, and the breakfast card, due now at 8:00 AM, 5 tablets with food, listing Metformin and Eliquis. Say When's Today screen at 8:12 AM on Wednesday: Good morning, June, 1 of 5 taken today, the day drawn as the sun's path, and the breakfast card, due now at 8:00 AM, 5 tablets with food, listing Metformin and Eliquis.
Say When on the Apple Watch at 8:12: now, 8:00 AM, Breakfast, 5 tablets, with food, and a Taken button.

Breakfast is due. One tap on the phone or the Watch marks all five tablets.

01 · The problem

Taking several medicines a day is easy to get wrong

Four in ten adults over 65 take five or more prescription medicines. Each one has its own schedule and its own rules about food.

That leads to two common mistakes. A dose gets missed when the day doesn’t follow its usual pattern. Or a dose gets taken twice because the person can’t remember if they already took it. With a blood thinner or a diabetes drug, either mistake can lead to a hospital visit.

Appointments cause a third problem. Before a fasting blood test, some morning tablets have to wait until after the draw and some don’t. Those instructions come from the doctor’s office, and medication reminders don’t account for them.

Reminder apps already exist. Apple’s Health app has had medication reminders, follow-up reminders and Critical Alerts since iOS 17. But it keeps medicines and appointments separate. It can share a medication list with family, but Apple’s documentation doesn’t describe any alert to family when a dose is late.

43%

of adults 65 and over took five or more prescription drugs in 2017 to 2020, up from 33.3% in 2001 to 2004.

CDC, Health, United States, from the national health survey

34.5%

of emergency room visits for harm from a medicine were adults 65 and over. 43.6% of them were admitted to the hospital.

Shehab et al., JAMA 2016, 58 US emergency departments, 2013 to 2014

31.3%

of medicine mistakes reported to US poison centers in 2024 were a dose taken twice by accident, the most common mistake on the list.

National Poison Data System, 2024 report, 361,402 cases

60%

of outpatients arrived properly prepared for a blood test. Only 39% knew what fasting meant.

Kackov et al., Biochemia Medica 2013, 150 adults

Taking medicines as prescribed also matters over time. A 2019 review of studies in older adults linked missed doses to more hospital stays, and linked taking medicines as prescribed to a 21% lower long-term risk of death.

What this evidence doesn’t show. The poison center figure covers all ages, and the blood test figure comes from one clinic in Croatia. Cost isn’t the main reason older adults skip doses: 3.4% of adults 65 and over didn’t take medicine as prescribed because of cost in 2021 to 2022. I left out the often-quoted claim that missed doses cause 125,000 US deaths a year, because I couldn’t verify it in the original source.

02 · Constraints

What the design had to work within

Most of these limit what the app can say about medicine and when it can interrupt someone.

It can’t give medical advice

The FDA treats apps that track medicines and send reminders the user sets up as low risk. An app that tells someone to change a dose is regulated differently. So every instruction in Say When comes from the prescriber, the pharmacy label or the lab, and says which. FDA guidance on device software, 2022, Appendix B

Reminders can be silenced

Time Sensitive notifications get through Focus modes, but the user can turn that off. Critical Alerts play even when the phone is muted, but Apple has to approve each app that sends them. Apple developer documentation on Time Sensitive and Critical Alerts

Apple Health already sends reminders

Rebuilding Health’s reminders would add nothing. Since iOS 26, other apps can read the medicines a person keeps in Health, so Say When imports that list. Health shares which medicines a person takes, not when, so Say When reads the times from each label. Apple, WWDC 2025, read access only

Reading with older eyes

Medicine names and instructions start at 19 points and grow with the iPhone’s text size. Main buttons are at least 60 points tall. Each time of day has its own color, and nothing is shown by color alone.

Help from family, not monitoring

Family involvement can easily become monitoring. June decides what Kate is told and can see every message Kate gets. Kate can’t change anything.

Health data stays on the device

No account, no ads and no tracking. Labels are read on the phone, and the only thing that leaves it is a medicine’s name, checked against the US national drug list, RxNorm.

03 · Decisions

Three decisions that shaped it

Each decision had a cost. It’s listed at the end of each card.

Decision 1
Read the label’s text, not its barcode

What I chose

Setup brings in the list from Apple Health, then the camera reads each pharmacy label’s printed text. Say When checks the drug name against the national drug list and turns the directions into times June confirms.

What else I considered

Scanning the barcode, which is faster. Or typing each medicine in, which is how most reminder apps start.

Why

Pharmacy labels have no standard barcode content, and some only hold the pharmacy’s prescription number. The printed text always has the drug, the strength and the directions. Typing long drug names on a phone is where mistakes start.

What I gave up

Speed. Reading text takes a moment longer and can misread in poor light, so every line goes in front of June before it’s saved.

Decision 2
One schedule for medicines and appointments

What I chose

Medicines and appointments share one schedule. When a lab asks for fasting, that morning’s reminders change to match, and the office’s instructions are shown word for word.

What else I considered

A reminder app alongside a calendar. That’s how most people manage today, and how Apple’s Health and Calendar apps work.

Why

The conflict only shows up when both are in one place. A metformin reminder at 8:00 AM is wrong on a fasting morning.

What I gave up

A longer setup. Someone has to enter the office’s instructions, and Say When can only apply what it’s given.

Decision 3
A check before a second dose

What I chose

The Watch and the phone show what was taken and when. Marking a dose that’s already marked asks for confirmation first, on both devices.

What else I considered

A Watch app that only sends reminders, with the history kept on the phone.

Why

Taking a dose twice is the most common medicine mistake reported to US poison centers. I designed for June wearing her watch with her phone in another room.

What I gave up

An extra tap when a second dose really was taken. Say When records it and shows the pharmacist’s number, but doesn’t tell June what to do.

04 · The scenario

June’s medicines and her two days

Every screen on this page follows the same two days.

June takes seven medicines at five times a day. On Wednesday her evening blood thinner is late. On Thursday at 8:30 AM she has a fasting blood test her doctor ordered.

June Ito, 79. Lives alone in Sunnyvale. Wears an Apple Watch her daughter gave her and keeps her phone in the kitchen.

Kate Ito, her daughter. Lives in Oakland. Helped June set up Say When, one pill bottle at a time. Hears about the blood thinner only.

June's medicines on a usual day, and how Thursday's blood test changes them
When Tablets On Thursday, the test day
7:00 AM, on waking Levothyroxine, for her thyroid, on an empty stomach No change
8:00 AM, breakfast Metformin, Eliquis, lisinopril, metoprolol and vitamin D Split in two. Eliquis, lisinopril and metoprolol at 7:45 AM with water. Metformin and vitamin D with breakfast once the test is done
6:00 PM, dinner Metformin No change
8:00 PM Eliquis, her blood thinner, 12 hours after the morning dose No change. If it’s an hour late, Kate is told
9:30 PM, bedtime Atorvastatin, for cholesterol. Four tablets left No change, plus a reminder to order a refill
05 · The app

Seven moments across June’s two days

Say When on the iPhone and the Apple Watch, each screen at the time its moment happens.

Setup · 10:30 AM

Setting up from the pill bottles

Kate and June set Say When up together at the kitchen table. Medicines come in from Apple Health. Then June holds each bottle up to the camera, and Say When reads the label. A photo of the label works too, and so does typing it.

Every line Say When read waits for June to check it against the bottle, and the name is checked against the national drug list. Clear directions become times: “twice daily” ticks breakfast and evening. Vague ones, like “once daily”, tick nothing and ask. June can tick any time of day on or off before the medicine is added.

Setup ends with her doctor, her pharmacy, the visits coming up and who hears what, then the whole day on one screen to show her pharmacist. The Watch fills in as each bottle is added.

Setup after reading June's Eliquis label: here's what Say When read, check each line against the bottle. Eliquis 5 mg tablet, found in the national drug list. Directions: take 1 tablet by mouth twice daily, about 12 hours apart. Supply: 60 tablets, 5 refills. Pharmacy: Corner Pharmacy. Looks like: pink oval tablet. Buttons: That's right, and Something's wrong. Setup after reading June's Eliquis label: here's what Say When read, check each line against the bottle. Eliquis 5 mg tablet, found in the national drug list. Directions: take 1 tablet by mouth twice daily, about 12 hours apart. Supply: 60 tablets, 5 refills. Pharmacy: Corner Pharmacy. Looks like: pink oval tablet. Buttons: That's right, and Something's wrong.

Wednesday · 8:12 AM

Breakfast is due

The five breakfast tablets share one card. One tap marks them all, on the phone or the Watch, or June can mark each tablet on its own on the phone. Every mark can be undone.

“Remind me in 10 minutes” puts the card off. “Skip a tablet” asks why: my doctor told me to, I’ve run out, I don’t feel well enough, or another reason. A skip is a decision, not a miss, so it never makes the dose late and Kate is never told about it.

Skip which tablet? A skipped tablet is saved with your reason. It doesn't count as late, and Kate isn't told. Below, the breakfast tablets to choose from: Metformin 500 mg, Eliquis 5 mg, Lisinopril 10 mg, Metoprolol 25 mg and Vitamin D3 1,000 IU. Skip which tablet? A skipped tablet is saved with your reason. It doesn't count as late, and Kate isn't told. Below, the breakfast tablets to choose from: Metformin 500 mg, Eliquis 5 mg, Lisinopril 10 mg, Metoprolol 25 mg and Vitamin D3 1,000 IU.
The Watch at 8:12: now, 8:00 AM, Breakfast, 5 tablets, with food, and a Taken button.

Wednesday · 11:20 AM

Was it already taken?

June isn’t sure she took her blood thinner. The Eliquis page shows it was taken at 8:12 AM, the next dose at 8:00 PM and the last seven days, with how to take it and whose words those are.

Tapping Eliquis again on the Watch asks first and says when it was taken. If she did take another, Say When records it and shows her pharmacy’s number. It doesn’t tell her what to do.

The Eliquis page at 11:20 AM: blood thinner, Eliquis 5 mg, apixaban, taken today at 8:12 AM, next at 8:00 PM, and the last 7 days, all on time but one late dose on Saturday. The Eliquis page at 11:20 AM: blood thinner, Eliquis 5 mg, apixaban, taken today at 8:12 AM, next at 8:00 PM, and the last 7 days, all on time but one late dose on Saturday.
The Watch at 11:20: Eliquis, already taken, 8:12 AM. Another now would be a second dose. Next at 8:00 PM.

Wednesday · 9:00 PM

An hour late

The evening Eliquis was due at 8:00 PM. At 8:30 PM the Watch reminded June again. At 9:00 PM it still isn’t marked, so the card shows the medication guide’s own words for a missed dose, and the Watch offers Taken now.

If June took it at 8:00 PM and only forgot to mark it, “I took it at 8:00 PM” records it on time.

Say When's Today screen at 9:00 PM: Good evening, June, 3 of 5 taken today, and the evening card, late, an hour past 8:00 PM, Eliquis 5 mg, with the Eliquis medication guide's words for a missed dose. Say When's Today screen at 9:00 PM: Good evening, June, 3 of 5 taken today, and the evening card, late, an hour past 8:00 PM, Eliquis 5 mg, with the Eliquis medication guide's words for a missed dose.
The Watch at 9:00: late, 8:00 PM, Eliquis. Still not marked. Kate has been told. A Taken now button.

Wednesday · 9:00 PM

Kate hears about one medicine

At 9:00 PM Kate gets one message: “Mom hasn’t marked her 8 PM Eliquis”. She hears nothing about the vitamins, the skipped tablets or the doses taken on time.

June chooses what Kate hears: the blood thinner if it’s an hour late, a missed appointment, or every dose, which is off. Every message Kate was sent is listed on June’s own phone, word for word.

The Family tab: Who hears what. Kate Ito, your daughter in Oakland, hears only what you turn on here. Eliquis if it's an hour late, on. A missed appointment, on. Every dose, off. What Kate was told: Wednesday 9:00, your 8 PM Eliquis was an hour late, Kate was told. Kate saw: Mom hasn't marked her 8 PM Eliquis. The Family tab: Who hears what. Kate Ito, your daughter in Oakland, hears only what you turn on here. Eliquis if it's an hour late, on. A missed appointment, on. Every dose, off. What Kate was told: Wednesday 9:00, your 8 PM Eliquis was an hour late, Kate was told. Kate saw: Mom hasn't marked her 8 PM Eliquis.

Thursday · 7:45 AM

The blood test morning

The night before, the Watch told June when to stop eating. This morning, breakfast is already split: three tablets now, with water, and two once the test is done.

The after-test tablets come due when June marks the test done, not at a set time, because she can’t know how long the lab will take. The card says the instruction is from Dr. Patel’s office, on her lab order.

Say When's Today screen on Thursday at 7:45 AM: due now, before you leave, 3 tablets with water only and no breakfast yet, from Dr. Patel's office, on your lab order. Eliquis and Lisinopril are listed. Say When's Today screen on Thursday at 7:45 AM: due now, before you leave, 3 tablets with water only and no breakfast yet, from Dr. Patel's office, on your lab order. Eliquis and Lisinopril are listed.
The Watch at 7:45: blood test day, before you leave, 3 tablets, with water only, and a Taken button.

Wednesday · 9:00 PM

Visits, with the office’s own words

Doctor visits, blood tests and anything else June needs to be at live on their own tab. A blood test carries its fasting hours and the lab’s instructions word for word. Each visit has the time it takes to get there, so Say When knows when to tell her to leave.

Two hours before, Today shows the visit with what to bring and a button to check in. The tab wears a badge the day before.

The Visits tab: a blood test on Thursday, Oct 22, at 8:30 AM at Valley Lab, fasting from 10:30 PM tonight, and Dr. Anita Patel, primary care, on Tuesday, Oct 27, at 10:15 AM, bring your medicine list. An Add a visit button. The Visits tab: a blood test on Thursday, Oct 22, at 8:30 AM at Valley Lab, fasting from 10:30 PM tonight, and Dr. Anita Patel, primary care, on Tuesday, Oct 27, at 10:15 AM, bring your medicine list. An Add a visit button.

On the iPhone and the watch face

Did I take it? Without opening the app

Next dose widgets for the home screen and the lock screen answer that at a glance: the next time of day and its tablets, Due now, Late, or All done with when tomorrow starts. A row of dots fills as the day’s times are done. The widgets only show; marking stays in the app, so nothing is recorded by accident.

The Watch keeps the same day as a ring, and its Next dose complication sits on the watch face in four sizes.

The Next dose widgets in each of their states: Next, Breakfast at 8:00 AM, 5 tablets; Due now, Metformin at 6:00 PM; Late, Dinner at 6:00 PM; Next, Bedtime at 9:30 PM; Today, All done, tomorrow at 7:00 AM. Below them, the lock screen version: Next, 8:00 AM, Breakfast, 5 tablets. The Next dose widgets in each of their states: Next, Breakfast at 8:00 AM, 5 tablets; Due now, Metformin at 6:00 PM; Late, Dinner at 6:00 PM; Next, Bedtime at 9:30 PM; Today, All done, tomorrow at 7:00 AM. Below them, the lock screen version: Next, 8:00 AM, Breakfast, 5 tablets.
The Watch's day ring at 11:20: taken, 8:12, Breakfast, with the morning's arc filled in and Metformin listed below as taken at 8:12 AM.

Medicines

When the doctor changes a dose

Say When never changes a dose. When the doctor or pharmacist does, June or Kate opens the medicine and taps Scan the new label, which reads just that one bottle, or Stop taking it, which asks first. Change times moves a medicine to other times of day without scanning again, and Add a medicine brings in a new bottle.

The rest of the plan, and every dose already marked, stays as it was. Refills count down as doses are marked, and a medicine running low says so before it runs out.

The Medicines tab: 7 medicines, 5 times a day, read from each bottle's label. Eliquis 5 mg, blood thinner, 8:00 AM and 8:00 PM, Kate hears. Levothyroxine 50 mcg at 7:00 AM. Metformin 500 mg at 8:00 AM and 6:00 PM. Lisinopril 10 mg and Metoprolol 25 mg at 8:00 AM. Atorvastatin 20 mg at 9:30 PM, with a Refill badge. The Medicines tab: 7 medicines, 5 times a day, read from each bottle's label. Eliquis 5 mg, blood thinner, 8:00 AM and 8:00 PM, Kate hears. Levothyroxine 50 mcg at 7:00 AM. Metformin 500 mg at 8:00 AM and 6:00 PM. Lisinopril 10 mg and Metoprolol 25 mg at 8:00 AM. Atorvastatin 20 mg at 9:30 PM, with a Refill badge.

Reminders that get through

Due, again and leave-by reminders are Time Sensitive, so they get through Focus. Each has Taken and In 10 minutes. A reminder swiped away records nothing.

One model, two apps

June’s plan, the day’s logic, the rule for Kate and the reminders live in one Swift package both apps share. Each device sends the other every change, so a dose marked on both is kept once.

On the watch face

A Next dose complication, in four sizes, shows the next time in its color, or Due now, Late or All done. It redraws after every mark.

Checked for access

UI tests drive both apps through the two days. Xcode’s accessibility audit runs on the main screens, in light and dark, and text grows to the largest accessibility sizes.

The note in the app, word for word.

“Say When shows what your prescriber, your pharmacy label and your lab say, word for word. It doesn’t give medical advice. If something doesn’t look right, or you’re not sure what to do, ask your pharmacist or doctor.”

06 · Two devices

What goes on the Watch and what goes on the phone

I assumed June wears her watch all day and leaves her phone in one place.

So the Watch handles anything that needs a quick answer: a dose is due, a dose was already taken, a dose is late, or it’s time to stop eating. Each Watch screen asks one question and has one main button.

The phone handles anything that needs reading, like setup, the plan for a test morning and what Kate is told. Both devices show the same day, so June can switch between them without losing her place.

Reminders

Time Sensitive notifications, so reminders get through Focus modes. The iPhone schedules them, and a Watch without its phone schedules its own.

The medicine list

Brought in from Apple Health where it exists, with permission for each medicine. Each label is then read for its directions, and nothing is typed unless the camera can’t read one.

The Watch

A standalone Watch app that keeps the day’s schedule on the watch, so it can answer whether a dose was taken even when the phone is out of range.

Kate’s message

Sent only when one of June’s rules is triggered. No other health information leaves June’s devices.

07 · What I decided against

Ideas I considered and left out

Each of these came up while I was designing Say When. These are the reasons I left them out.

Scanning the barcode

Pharmacy labels have no standard barcode content, and some carry only the pharmacy’s prescription number. A barcode can’t be relied on to fill in the medicine or the directions.

Typing each medicine in

Long drug names on a small keyboard are easy to get wrong. Typing stays as a fallback for the rare label the camera can’t read.

A caregiver dashboard with every dose

If Kate sees every vitamin, help becomes monitoring, and June has less reason to keep marking doses. June chooses what Kate hears about instead.

Photographing each tablet

A photo before every dose adds a step each time and fails in poor light. One tap to mark, with a check before a second dose, does the same job faster.

A connected pill dispenser

A dispenser can confirm a dose physically, but it costs money, needs setting up and refilling, and only works at home. Say When works with the bottles June already has.

Counting a dismissed reminder as taken

Say When only records a dose when June marks it. The check before a second dose depends on an accurate record, so it never assumes.

Streaks and rewards

A streak rewards an unbroken run, so one missed dose can feel like failure. The seven-day view shows a plain record instead.

Alerting emergency services

A late dose isn’t an emergency on its own. Alerts stop at the one family member June chose, who can call her.

AI answers about missed doses

Telling someone what to do about a missed dose is medical advice. Say When shows the medication guide’s own instruction and the pharmacist’s number.

08 · Outcome

What success means: fewer missed doses and no double doses

These are the targets I measure Say When against.

The measures for Say When, each with its target, the reason for it and what to change if it is missed
What is measured Target Why this number If it’s missed
Labels read correctly on the first scan 9 in 10 Each correction slows setup down, and a misread June doesn’t catch becomes a wrong reminder. Find which labels fail, like curved vials or small print, and add guidance for those.
Doses marked within an hour of their time 9 in 10 One hour is also when Kate is told, so both measures use the same definition of late. Find which times of day run late, and move those reminders to fit June’s routine.
Second doses stopped by the check, compared with second doses recorded More stopped than recorded The check is meant to prevent double doses, not just record them. The check is coming too late. Show the last dose time on the watch face.
Blood tests repeated because of preparation Zero The test morning plan exists to prevent this. A repeated test means another morning of fasting and another needle. Show the lab’s instructions again the evening before, word for word.
Alerts to Kate when June had taken the dose but not marked it Fewer than 1 in 5 If Kate gets too many false alerts, she’ll start ignoring them. The option to say “I took it at 8:00 PM” exists for this. Wait longer before telling Kate, or remind June once more on the Watch first.
People still marking doses after 90 days 70% Early use doesn’t say much. Three months shows whether marking doses has become routine. Ask people who stopped what changed in the week before.

The 9 in 10, 1 in 5 and 70% figures are my own starting points.

09 · Reflection

What everything depends on

Whether people in their late seventies mark doses consistently. Everything in Say When depends on that tap. A dose taken but not marked sends a false alert to a family member, so the first number I watch is how often that happens.

More case studies

Three more case studies about stopping a mistake before it happens.

Allowance, an agent that pays the bills inside rules you set
A business banking app for the owner's phone, with a desktop for accounts payable. An AI agent pays a company's routine vendor bills, stops and asks when the bank details are new or the amount is far above the usual, and leaves a day to stop any payment before it goes.
1QR, a travel payment app in an outdoor theme
A payment app for scanning QR codes abroad. It runs in two outdoor modes from the Wolf-Rayet design system: a high contrast day mode that stays readable in direct sun, and a dim night mode in one warm color that protects night vision.
Watchtower, supervising AI voice agents on calls
One person watches every AI voice agent on the line from one dashboard. When an agent tries something outside its limits, Watchtower pauses it and asks the supervisor to approve, edit, hold or take over.