Designing Non-Visual Instructional Cues Using Context-Aware Audio

Overview

This project explores how audio can function as an instructional signal rather than a simple alert. By designing context-aware, non-visual audio cues, I created an interactive learning experience that supports attention, accessibility, and cognitive load management without relying on visual interfaces.

The project was developed as part of a Computer Audio course and later reframed as an instructional design case study.

Problem

In many real-world situations, learners cannot rely on visual information due to divided attention, mobility, or accessibility constraints. Traditional alert systems often fail to convey urgency or priority clearly when multiple signals compete for attention.

This creates a need for instructional cues that communicate meaning through sound alone.

Instructional Goal

The goal of this project was to help learners recognize urgency and priority using audio-only cues across different contexts.

Instructional Strategy

The experience was designed using:

• Context-aware audio behaviors

• Priority-based sound interruption and queuing

• Simplified earcons and programmatic audio effects

• Cognitive load–aware filtering to reduce distraction

Different contexts (e.g., walking, presenting) alter how audio information is delivered, reinforcing how instructional cues must adapt to situational demands.

Sample Learning Module

Learning Goal

By the end of this module, learners will be able to distinguish urgency and priority using audio-only cues across different contexts.

Activity

Learners select a context and initiate the simulation. They observe how audio cues change based on event priority and situational demands.

Feedback

High-priority events interrupt ongoing sounds, while lower-priority events are delayed or filtered. In high cognitive load contexts, audio feedback is simplified to minimize distraction.

Reflection

Which sounds required immediate attention?
How did context influence how information was presented?

Prototype

The simulator serves as an interactive demonstration that reinforces learning through experience rather than explanation alone.

Takeaways

This project emphasized the importance of designing instructional cues that respect cognitive limits and accessibility needs. It reinforced how audio can serve as a meaningful instructional medium when intentionally designed.