Revolutionizing Instructional Coaching with AI

Revolutionizing Instructional Coaching with AI

The world of education can feel isolating and overwhelming for educators without mentors or role models.

The world of education can feel isolating and overwhelming for educators without mentors or role models.

We set out to transform how educators receive coaching by designing an MVP for an AI-powered coach that addresses their everyday struggles and lack of personalized and delayed feedback. Our goal was to make coaching more accessible, timely, and tailored to individual needs, ultimately making it easier for educators to grow and succeed in their roles.

Through a collaborative and iterative design process, we developed a platform that combines AI strengths with human expertise from discovery to design handoff.

My Role: UX Designer, Researcher

As one of the designers on this project, I dove deep into understanding educators' needs. I reviewed over 20 research papers and teaching frameworks and spoke with 5 educators to uncover their challenges. Synthesizing over 50 insights into actionable UX artifacts, I led the development of the feedback page and conducted 5 user tests.

Project Type: Graduate Capstone

Duration: 30 Weeks

Team Size: 4 UX/UI Designers (including me)

Client: Logan & Friends (Led by Dr. Jocelyn Logan Friend)
Domain: Edutech
Tools: Figma, Miro, Figjam, Google Suite

PROJECT OUTCOMES

0%

Overall user satisfaction rate of 90%

0%

Reduced coaching feedback delays by 100%

0%

Cut down feedback navigation time by 40%.

PROCESS

01

Understanding the project scope & Discovery

Weeks 1-3

02

Empathize with educators

Weeks 3-5

03

Define and Plan

product requirements

Weeks 6-8

04

Brainstorm and

Ideate

Weeks 9-14

05

Design and

prototype

Weeks 15-27

06

Test

prototype

Weeks 28-30

UNDERSTANDING THE PROJECT SCOPE

UNDERSTANDING THE PROJECT SCOPE

Weeks 1-3

Weeks 1-3

We began by clarifying the client's vision and defining the project objectives and challenges of traditional instructional coaching through several initial meetings with the client and desk research.

To gain a foundational understanding, ensure the design process aligns with the client’s expectations and addresses key issues.

CHALLENGES IN TRADITIONAL COACHING IDENTIFIED AFTER INITIAL CLIENT MEETINGS AND RESEARCH.

CHALLENGES IN TRADITIONAL COACHING IDENTIFIED AFTER INITIAL CLIENT MEETINGS AND RESEARCH.

Coaching unavailable to teachers

Coaching unavailable to teachers

Distressed teaching environments

Distressed teaching environments

Limited observation time

Limited observation time

Inadequate progress tracking

Inadequate progress tracking

CLIENT'S VISION

CLIENT'S VISION

The client, Dr.Logan, had a vision to overcome these challenges -

Leverage AI with human expertise to analyze audio recordings of teaching sessions, provide personalized feedback, and align insights with existing teaching frameworks.

OBJECTIVES

OBJECTIVES

01

To build the experience around the client's vision for MVP1.

02

Enhance instructional coaching experience.

03

Make instructional coaching accessible

ADDRESSING THESE CHALLENGES - INITIAL PROBLEM STATEMENT

ADDRESSING THESE CHALLENGES - INITIAL PROBLEM STATEMENT

"How might we redefine the coaching experience for educators?"

Despite the clear vision from our client, the project posed significant challenges, especially since the team and I had no prior experience working with AI or machine learning models.

One of the primary hurdles was -

01 Translating the vision into a practical, user-centered tool. We had to address complex issues, such as how the AI would analyze classroom dynamics using only audio inputs and provide accurate, actionable feedback.


02 Technical uncertainties regarding the feasibility and scope of integrating AI into the feedback process.

I delved into online resources to overcome these challenges and consulted with subject matter experts. I understood Acoustic Feature Extraction, Voice/Sentiment Analysis, and Natural Language Processing models.

Another profound challenge was -

01 Bridging the experience between Human and AI interactions.

I specifically focused on designing the feedback section of the product. My goal was to make receiving feedback and putting it into action seamless, along with unhindered navigation between multiple feedback and chat channels with AI and human coaches.

EMPATHIZING WITH EDUCATORS

EMPATHIZING WITH EDUCATORS

Weeks 3-5

Weeks 3-5

To understand educators' challenges and their openness to AI and ensure our design was grounded in real needs, we conducted comprehensive research. This included desk research, 5 interviews with experienced and novice teachers, and teacher coaches. Additionally, 12 participants filled out surveys, we reviewed 20+ research papers, and analyzed 7 competitors.

KEY FINDINGS -

KEY FINDINGS -

0%

Schools provide teachers with instructional coaches in the US.

Schools provide teachers with instructional coaches in the US.

0%

Found traditional coaching time-consuming (delayed feedback time -avg.72 hours), primarily written or verbal. (generalized, subjective feedback)

Found traditional coaching time-consuming (delayed feedback time -avg.72 hours), primarily written or verbal. (generalized, subjective feedback)

0%

Teachers were excited to use an AI tool for feedback.

Teachers were excited to use an AI tool for feedback.

0%

Comfortable being recorded, but privacy concerns remained.

Comfortable being recorded, but privacy concerns remained.

Contains Research details and Empathy map

How did we empathize with them?

Recognizing the challenges teachers face in balancing the classroom demands with their professional growth.

See more

How did we empathize with them?

Recognizing the challenges teachers face in balancing the classroom demands with their professional growth.

See more

How did we empathize with them?

Recognizing the challenges teachers face in balancing the classroom demands with their professional growth.

See more

KEY TAKEAWAYS -

KEY TAKEAWAYS -

The key themes identified revealed that educators are excited about AI's potential to enhance teaching.

Concerns —

  1. Ability of AI to understand human nuances

  2. Availability of personalized support

  3. AI replacing human coaches

To engage teachers, we must —

  1. Address their motivation

  2. Offer quality resources

  3. Resolve issues with privacy, tech adoption, and feedback timing

The absence of AI-powered products in the market gives us a competitive edge. Many are open to AI if privacy and effectiveness concerns are addressed.

Figure shows: Data Analysis to find key themes using affinity mapping on Figjam.

DEFINE AND PLAN PRODUCT REQUIREMENTS

DEFINE AND PLAN PRODUCT REQUIREMENTS

Weeks 6-8

Weeks 6-8

We organized research data into affinity maps, created 4 personas, 10 user stories, 24 use cases, and mapped out journeys to represent different types of educators and to provide a clear picture of the users' needs, behaviors, and expectations.

KEY THEMES ADDRESSED -

KEY THEMES ADDRESSED -

  1. Identifying the User's pressing challenges and needs.

  2. Balancing technical feasibility with those needs.

  3. Bridging human-AI interactions smoothly.

PERSONAS

PERSONAS

PERSONAS

USER STORIES

USER STORIES

USER STORIES

USE CASES

USE CASES

USE CASES

KEY TAKEAWAYS -

KEY TAKEAWAYS -

We focused on the personas, user stories, and use cases to capture maximum value without overwhelming or overcomplicating the design, aligning with the MVP.

BRAINSTORM AND IDEATE

BRAINSTORM AND IDEATE

Weeks 9-14

Weeks 9-14

With a clear understanding of user needs, we moved into ideation. We focused on defining functional and technical requirements, structuring the information architecture, and creating process flows. This phase led to the development of wireframes and user flows that laid the groundwork for the final design.

With a clear understanding of user needs, we moved into ideation. We focused on defining functional and technical requirements, structuring the information architecture, and creating process flows. This phase led to the development of wireframes and user flows that laid the groundwork for the final design.

PROJECT REQUIREMENTS

PROJECT REQUIREMENTS

PROJECT REQUIREMENTS

DESIGN RECOMMENDATIONS

DESIGN RECOMMENDATIONS

DESIGN RECOMMENDATIONS

We structured information logically and explored various design ideas to ensure the product would be user-friendly and intuitive.

We structured information logically and explored various design ideas to ensure the product would be user-friendly and intuitive.

INFORMATION ARCHITECTURE

INFORMATION ARCHITECTURE

INFORMATION ARCHITECTURE

PROCESS FLOWS

PROCESS FLOWS

PROCESS FLOWS

Led to the development of wireframes and user flows.

WIREFRAMES

We then established the basic layout and structure of each screen, ensuring that all necessary elements are included and logically arranged.

Reports page

Feedback page

Overview page

Schedule session modal

Reports page

Feedback page

Overview page

Schedule session modal

Reports page

Feedback page

Overview page

Schedule session modal

DESIGN AND PROTOTYPE

DESIGN AND PROTOTYPE

Weeks 15-27

Weeks 15-27

Through multiple iterations backed with testing, We aimed to design a platform that provided educators with timely, personalized feedback and possibly empowered them to improve their teaching practices continuously.

Through multiple iterations backed with testing, We aimed to design a platform that provided educators with timely, personalized feedback and possibly empowered them to improve their teaching practices continuously.

I took the lead on the feedback page while my teammates tackled other areas of the product. Here’s a snapshot of how we evolved:

I took the lead on the feedback page while my teammates tackled other areas of the product. Here’s a snapshot of how we evolved:

Iteration 1

The Initial Feedback Page Layout - Using empathy as a guide, I designed the feedback page to focus on what teachers needed most: easy access to feedback and AI interaction. I organized it into three sections: class session audio recordings, AI-generated feedback, and a chat feature.

Test observations

During testing, we put ourselves in the shoes of educators by asking them to locate specific feedback tied to a teaching framework. However, teachers struggled to quickly find and act on the feedback—they spent nearly 6 minutes navigating through the content. The long search time caused frustration and self-doubt as they had to scroll through each piece of feedback to find what was relevant.


  1. long search and scroll time led to self-doubt.

  2. Skimmed through each feedback to identify the specific feedback.

Challenges Identified

Considering the amount of feedback the AI coach might provide and educators engaging in conversation with the AI coach —

  1. Excessive scrolling overwhelmed educators, reducing their confidence.

  2. Difficulty in identifying the most critical feedback.

  3. Limited time for meaningful engagement with the AI coach due to navigation issues.

Iteration 2

Dynamic Chat to Enhance Usability: To improve the user experience, we iterated based on feedback by introducing a dynamic chat feature. This feature adapted the chat content based on the selected feedback, reducing unnecessary scrolling and making interactions more context-specific.

Dynamic Chat to Enhance Usability: To improve the user experience, I iterated based on feedback by introducing a dynamic chat feature. This feature adapted the chat content based on the selected feedback, reducing unnecessary scrolling and making interactions more context-specific.

Iteration 3

Time-Stamped Audio for Seamless Navigation: Focusing on usability and minimizing cognitive load, I implemented time-stamps on the audio recordings. This allowed teachers to jump directly to the part of the session where specific feedback was provided, cutting down on the time and effort needed to find the most relevant information.

Test observations

We saw a significant improvement. Educators were now able to navigate through feedback in less than 3.5 minutes—a 40% faster than before. The combination of time-stamped feedback and reduced scrolling made the experience smoother and more intuitive.

KEY IMPROVEMENTS —

KEY IMPROVEMENTS —

  • Dynamic chat feature: Reduced scrolling and delivered relevant, timely feedback based on user selection.

  • Time-stamped audio: Enabled quick, precise navigation through feedback.

  • Simplified and color-coded feedback: Helped educators interpret feedback more easily and confidently.

​Other considerations to make the experience even better—

  • Incorporate a multi-modal chat experience to recommend additional learning resources.

  • Connect feedback to teaching frameworks to track improvement in specific areas (e.g., through color coordination and tags).

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

SOLVING EDUCATORS PAINPOINTS THROUGH DESIGN

SOLVING EDUCATORS PAINPOINTS THROUGH DESIGN

We focused on creating a user-friendly, intuitive, and supportive platform for teachers and coaches by addressing specific pain points and meeting their needs through various design and functional elements that could empower them to create engaging and effective learning experiences for their students.

Painpoint 1

Time-Consuming Process:


Traditional coaching requires scheduling meetings, which often conflicts with teachers' busy schedules.

SOLUTION —

SOLUTION —

We prioritized convenience by designing an on-demand platform, allowing educators to access AI-generated feedback at their own pace, reducing the need for time-consuming meetings.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

Painpoint 2

Limited/Delayed Feedback Timeliness:


Slow feedback hinders teachers' ability to make timely improvements in their teaching.

SOLUTION —

SOLUTION —

By focusing on immediacy, we aimed to design the system to provide real-time feedback, ensuring educators can adjust their teaching strategies instantly rather than waiting for formal sessions.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

Painpoint 3

Lack of Personalization:


Generalized coaching feedback often fails to address specific teaching challenges.

SOLUTION —

SOLUTION —

To meet each teacher’s unique needs, we incorporated personalized feedback based on classroom data and individual teaching styles, ensuring tailored, actionable advice.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

Painpoint 4

Subjectivity in Feedback:


Feedback from human coaches can vary in objectivity based on their perspective and experience.

SOLUTION —

SOLUTION —

We emphasized consistency by using AI to deliver unbiased, data-driven feedback that maintains objectivity, helping educators make informed improvements.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

Painpoint 5

Limited Accessibility:


Geographic limitations and the availability of qualified coaches can restrict professional development opportunities for teachers.

SOLUTION —

SOLUTION —

We expanded accessibility by allowing teachers to upload recorded teaching sessions from all locations to receive high-quality feedback and support, making professional growth universally available.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

TESTING THE PROTOTYPE

TESTING THE PROTOTYPE

Weeks 28-30

Weeks 28-30

We began by conducting usability tests with the same participants from earlier interviews, including both experienced and novice teachers, streamlining recruitment and ensuring continuity. This allowed us to observe how the design met the diverse needs of different users. Cognitive walkthroughs and internal design critiques helped us catch early usability issues while focusing on improving intuitive interactions.


We provided participants with both low- and high-fidelity prototypes, assigning tasks to observe their natural behavior. Think-aloud sessions offered real-time feedback on how teachers interacted with the platform, helping us understand their pain points in the moment. Expert reviews and heuristic evaluations, grounded in design principles like consistency and error prevention, provided valuable insights into improving the user flow.


To gain further clarity, we conducted user satisfaction questionnaires and system usability scale assessments, which resulted in a 90% satisfaction score

  1. Scroll

Issue: The current scroll and fixed layout on the feedback page reduces the scrollable area, hindering user experience.

Recomendation —

Recomendation —

Rethink the layout to maximize the scrollable area for easier reading of feedback.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

b. Flagged feedback

Issue: Users weren't able to identify flagged feedback items easily due to a lack of visual cues.

Recomendation —

Recomendation —

Implement a review status indicator on each feedback card to highlight flagged items.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

c. 'Learn more' option

Issue: The "Learn More" option followed by hover functionality for accessing feedback details seems redundant.

Recomendation —

Recomendation —

Remove the "Learn More" text. Users should be able to click directly on the feedback card to access details.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

d. AI assistant icon

Issue: The AI Assistant icon looks like a comment bubble, potentially leading to confusion with the feedback section.

Recomendation —

Recomendation —

Redesign the AI Assistant icon to clearly indicate it as the functionality to chat with the AI bot.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

e. Performance page

Issue: The performance page lacks clarity regarding user scores. 

  • Percentage indications are missing for each card.

  • Color-coding to represent different domains is absent.

  • Understanding subdomain scores is difficult.

Recomendation —

Recomendation —

  1. Display percentages on each performance card. 

  2. Use color-coding to visually represent different domains.

  3. Improve the presentation of sub-domain scores for better comprehension.

  • Introduce a multi-modal chat experience to offer personalized learning resources, meeting users where they are.

  • Tie feedback more closely to teaching frameworks with visual cues like color coordination and tags, helping educators see improvement in specific areas.

FINAL DESIGNS

DETAILED, TIMESTAMPED FEEDBACK

Timestamped feedback directly linked to the audio recording, allowing teachers to listen to the exact instances highlighted in the input. Additionally, the platform includes an interactive chat feature with AI, enabling teachers to discuss the feedback in real time.

DETAILED, TIMESTAMPED FEEDBACK

Timestamped feedback directly linked to the audio recording, allowing teachers to listen to the exact instances highlighted in the input. Additionally, the platform includes an interactive chat feature with AI, enabling teachers to discuss the feedback in real time.

DETAILED, TIMESTAMPED FEEDBACK

Timestamped feedback directly linked to the audio recording, allowing teachers to listen to the exact instances highlighted in the input. Additionally, the platform includes an interactive chat feature with AI, enabling teachers to discuss the feedback in real time.

DETAILED, TIMESTAMPED FEEDBACK

Timestamped feedback directly linked to the audio recording, allowing teachers to listen to the exact instances highlighted in the input. Additionally, the platform includes an interactive chat feature with AI, enabling teachers to discuss the feedback in real time.

CONCLUSION

The project evolved non-linearly due to our early challenges with AI/ML, especially in audio analysis and feedback. As we gained insights from research, we refined the scope, separating the AI assistant from chat functions and improving the information architecture. Our iterative design process, fueled by user feedback, embraced flexibility and constant improvement. Using an agile approach, we focused on the MVP and adapted to changing needs, continuously refining our ideas based on new discoveries.

MY LEARNINGS

  • Navigating AI: I gained hands-on experience with AI, turning complex tech into user-friendly solutions.

  • User Empathy: Deeply understanding educators’ needs taught me the importance of designing with empathy.

  • Iterative Design: Iterating and refining designs based on user feedback proved essential for creating effective solutions.

  • Balancing Ambition and Practicality: I learned to balance big ideas with practical constraints, focusing on what was essential for the MVP.

  • Human-AI Interaction: Designing how humans interact with AI taught me to ensure it complements rather than replaces human input.

  • Prototyping Skills: Creating and refining prototypes improved my ability to design intuitive and user-friendly interfaces.

  • Problem-Solving: Tackling challenges with AI feedback helped me develop creative problem-solving skills.

  • Teamwork and Communication: Effective collaboration and clear communication with my team and client were crucial for success.

I'm glad you made it here;

I'm currently open for new and exciting opportunities. Let's connect and create something nice.

V.2024

19:03:50

+1 (765)767 0056

I'm glad you made it here;

I'm currently open for new and exciting opportunities. Let's connect and create something nice.

V.2024

19:03:50

+1 (765)767 0056

I'm glad you made it here;

I'm currently open for new and exciting opportunities. Let's connect and create something nice.

V.2024

19:03:50

+1 (765)767 0056

I'm glad you made it here;

I'm currently open for new and exciting opportunities. Let's connect and create something nice.

V.2024

19:03:50

+1 (765)767 0056