Bridging the Gap: How AI Can Enhance Digital Accessibility

Artificial intelligence often sparks heated debates, especially in the accessibility community. In a recent piece by Joe Dolson, skepticism toward AI's role in accessibility was both articulate and warranted. As someone deeply involved in this space—I serve as an accessibility innovation strategist at Microsoft and help run the AI for Accessibility grant program—I share many of those concerns. But I also see a path forward where AI becomes a powerful ally rather than a threat. This article is a 'yes… and' companion to Joe's analysis, highlighting where AI can make meaningful differences for people with disabilities while acknowledging the very real risks that demand immediate attention.

The Promise and Peril of AI in Accessibility

Like any tool, AI can be used constructively or destructively. For people with disabilities, the stakes are especially high. Poorly designed AI systems can reinforce exclusion, while thoughtful implementations can break down barriers. The key lies in how we design, train, and deploy these technologies. The challenges Joe outlines—especially around computer vision and alternative text—are valid, but they also point to areas ripe for improvement.

Alternative Text and Computer Vision: A Work in Progress

Joe's piece rightly spends significant time on computer-vision models generating alternative text. The current state of image analysis is far from perfect. AI systems still evaluate images in isolation, missing the surrounding context that determines whether an image is decorative or informative. This leads to poor descriptions, especially for complex visuals like graphs and charts. Yet progress is being made. The latest models, including those demonstrated in the GPT-4 announcement, show improving richness and detail—even if they still fall short of human-quality descriptions.

Distinguishing Decorative from Informative Images

One of the biggest hurdles is teaching AI to understand context. A photo of a sunset used purely for aesthetic effect needs no description, but the same photo used to illustrate a weather report demands one. Current foundation models for text and image analysis are separate, making it difficult to combine visual understanding with textual context. If we can train models to analyze image usage within a page, we can more quickly identify which images are decorative and which require alternative text. This would not only improve accessibility but also save authors time.

Human-in-the-Loop: The Real Path Forward

Joe advocates for human-in-the-loop authoring of alt text—a sentiment I fully endorse. AI can serve as a starting point, even if that starting point is flawed. Imagine a system that, upon generating a poor description, prompts the user: "This doesn't look right—let's try something else." That interaction is a win. It turns AI into a collaborator, not a crutch. Over time, as models improve, these suggestions will become more reliable, but the human judgment remains essential.

Tackling Complex Images

Complex images like infographics, charts, and diagrams pose unique challenges. Even humans struggle to describe them succinctly. However, AI can assist by extracting key data points or providing structured summaries. For example, a bar chart's trend could be described as "Sales increased by 30% from Q1 to Q4," while a human fine-tunes the narrative. This hybrid approach ensures accuracy while leveraging AI's speed.

Future Opportunities: Context-Aware and Beyond

Looking ahead, we need AI that understands not just the content of an image but its role in the overall document. That means training models on full web pages or documents, not isolated images. Such context-aware systems could automatically flag images that lack alt text, suggest descriptions based on surrounding text, and even detect when an image is purely decorative. These advances will improve efficiency for content creators and ensure a more inclusive web.

Another promising area is real-time captioning and sign language translation, where AI can make live events accessible to deaf and hard-of-hearing audiences. While not without challenges—accuracy in noisy environments, handling multiple speakers—these tools are already changing lives. The key is to keep humans in the loop for quality assurance.

A Cautiously Optimistic Future

I remain skeptical of AI's hype, but I am also hopeful. The risks Joe highlights—bias, inaccuracy, exclusion—are real and must be addressed with urgency. But dismissing AI entirely would mean ignoring its potential to create a more accessible world. By investing in human-centered design, rigorous testing, and inclusive datasets, we can steer AI toward genuine progress. The goal is not to replace human effort but to amplify it, making accessibility a seamless part of creation rather than an afterthought.