Sources: 3 · Verified 2026-10-22
Patient cancelled is not a cause. It is a category that hides whether the patient had a conflict, could not reach the clinic, or was told the wrong time. A codebook with clear definitions and a reliability check makes reschedule data usable.
Workflow at a glance
| Factor | Details |
|---|---|
| Unit | Rescheduled appointment |
| Fields | Initiator, reason, notice, backfill |
| Reliability | Double-code a sample |
| Limit | Codes describe events, not blame |
Research question and scope
The question is how to code reschedule causes reliably enough to compare periods. Scope covers rescheduled appointments in a scheduling operation. The unit is the change event. The design separates the initiator from the reason and adds notice time and backfill outcome. It treats coding as a measurement instrument that needs a codebook and a reliability check. The scope also fixes the unit and the coding moment. A change event is one appointment that is moved, cancelled and rebooked, or replaced by a different time. If a visit is moved twice, each move is recorded, with the original booking linked, so the count does not treat a chain of changes as one event. Coding happens when the change is handled or as soon as the record is complete, not months later from memory. The codebook separates the initiator, which is the party who asked for the change, from the reason, which is the operational circumstance. Notice time is recorded in hours before the original appointment, and the backfill outcome is recorded after the slot is resolved. A change with two causes gets one primary cause and a note. These rules keep the unit stable and make agreement checkable.
Required scheduling checkpoints
| Category | Specific Tasks | Planning Estimate / Note |
|---|---|---|
| Codebook |
| Before coding |
| Code |
| At the change |
| Check |
| Monthly |
| Use |
| Monthly |
- Category
- Codebook
- Specific Tasks
- Define each code
- Give examples
- State exclusions
- Planning Estimate / Note
- Before coding
- Category
- Code
- Specific Tasks
- Assign initiator
- Assign reason
- Record notice
- Planning Estimate / Note
- At the change
- Category
- Check
- Specific Tasks
- Double-code a sample
- Compare agreement
- Clarify rules
- Planning Estimate / Note
- Monthly
- Category
- Use
- Specific Tasks
- Review the mix
- Choose one fix
- Track the next period
- Planning Estimate / Note
- Monthly
Evidence and decision controls
| Decision factor | Manual process | Documented workflow |
|---|---|---|
| Code set | Free text | Defined codes with examples |
| Initiator | Assumed | Patient, clinic, provider |
| Reliability | None | Double-coded sample |
| Use | Blame | Process improvement |
Code set
- Manual process
- Free text
- Documented workflow
- Defined codes with examples
Initiator
- Manual process
- Assumed
- Documented workflow
- Patient, clinic, provider
Reliability
- Manual process
- None
- Documented workflow
- Double-coded sample
Use
- Manual process
- Blame
- Documented workflow
- Process improvement
Why free text fails
Free text is rich and inconsistent. Two coordinators describe the same event differently, and a manager cannot count patterns. A small code set with examples narrows judgment without pretending that every event is simple. The note field keeps context while the code supports comparison. A free-text field also invites the coder to explain and evaluate at the same time. One coordinator writes that the patient forgot, another writes that the patient was unreliable, and a third writes that the clinic did not confirm. The three notes may describe the same event, but they carry different judgments and cannot be counted together. A code set with examples moves the judgment into the codebook, where it can be reviewed and corrected. The note still holds the context, and the code holds the comparison. The codebook should be small enough to remember and specific enough to separate common events. Each code needs one positive example and one exclusion, because the boundary between codes is where disagreement starts. When a new situation appears, the team decides whether it fits an existing code or earns a new one, and records the version change.
A reliability check
The lead codes a sample of ten changes, and a second reviewer codes the same records independently. They compare agreement, discuss disagreements, and clarify the codebook. The goal is not perfect agreement but a clear, stable rule that another person can apply. The sample should include changes from different coordinators, visit types, and notice windows, not only the difficult cases. The second coder works from the same record and the same codebook version, without seeing the first coder's choice. Agreement is reviewed code by code, because a high overall match can hide one code that is applied inconsistently. Every disagreement is discussed until the coders can state the rule they would apply next time. If the rule cannot be stated, the code is probably too broad. The lead records the change to the codebook, dates it, and uses the new version going forward. A short written note explains the decision so a later reviewer does not reopen it. The goal is a stable instrument, and stability is built through these small clarifications rather than through a single training session or a quarterly reminder.
Quality controls
| Success Factor | How To Do It | Results You Get |
|---|---|---|
| Small set | Five to seven codes | Usable data |
| Examples | One example per code | Consistent judgment |
| Second coder | Sample ten records | Disagreement is visible |
| Review | Fix the codebook, not the coder | Reliability improves |
- Success Factor
- Small set
- How To Do It
- Five to seven codes
- Results You Get
- Usable data
- Success Factor
- Examples
- How To Do It
- One example per code
- Results You Get
- Consistent judgment
- Success Factor
- Second coder
- How To Do It
- Sample ten records
- Results You Get
- Disagreement is visible
- Success Factor
- Review
- How To Do It
- Fix the codebook, not the coder
- Results You Get
- Reliability improves
Limits of cause coding
A code cannot capture every reason, and a low agreement rate may reflect a vague code rather than a careless coder. The data describes events, not motives. It should not be used to rank staff or patients. It is a process signal. The code set also cannot capture the patient's full situation, and it should not try. A code records the operational circumstance that the clinic can act on, not a judgment about the patient's priorities or honesty. The same is true for staff. A code that reads like a fault finding will be avoided or applied defensively, and the data will lose value. Low agreement is a signal about the instrument, not about the people using it, so the first response should be to inspect the definitions and examples. The sample should be large enough to show a pattern across codes and small enough to review in one sitting. Keep the codebook version with the data, and mark any break in the series. These limits are what make the codes safe to use in a capacity review and in a conversation with the people who schedule.
What this means for a scheduling team
A reliable codebook turns a pile of changes into a capacity conversation. SchedulingAppointment keeps the initiator, reason, notice, and backfill fields together so the review is possible. The scheduling team is also the group that sees the change as it happens, so it can record the initiator and the notice time while the details are fresh. That advantage disappears if the field is optional or if the codebook lives in a document nobody opens. Keeping the four fields together, the initiator, the reason, the notice, and the backfill, makes the review possible without reconstructing the event from messages. SchedulingAppointment holds those fields next to the appointment, so a change event and its outcome stay connected. The team should own the codebook and the reliability check, and clinical or access leaders should review how the results are used. The codes describe process gaps. They are not a score for a coordinator, a patient, or a provider. A small set of codes that everyone can explain is more useful than a detailed taxonomy that only one person understands, and the team should keep it that way.
Research methodology
This paper defines a codebook and reliability design. It separates initiator, reason, notice time, and backfill outcome, and requires a double-coded sample. It does not report an observed agreement rate.
This is a measurement design. It does not report an agreement statistic or a benchmark cause distribution.
Data sources and methodology
This brief reports published findings as stated by each source. It does not combine study populations into a new benchmark; local operators should treat the figures as context and measure their own workflow.
- AHRQ: Quality improvement: Measurement context
- CMS: Coverage: Coverage context
- NIST Privacy Framework: Data minimization
Related content
Frequently asked questions
What if a change has two causes?
Who should double-code?
Can the codes be used in performance reviews?
Make reschedule data comparable
If every coordinator codes cancellations differently, write a codebook and check agreement before analyzing trends.
Book a Free Consultation →



