Evaluating a Bilingual COVID-19 Chatbot: A Rigorous Defence Against Pandemic Misinformation
Source PublicationPLOS Digital Health
Primary AuthorsAtwine, Jjingo, Nsubuga et al.

Evaluating a Bilingual COVID-19 Chatbot
Researchers have successfully engineered a bilingual COVID-19 chatbot capable of answering medical queries in both English and Luganda. This technical feat was exceptionally difficult to achieve because Luganda lacks the massive, pre-labelled datasets required to train modern natural language processing models.
The Misinformation Crisis
During the height of the pandemic, public health organisations relied heavily on manual human moderation to counter false claims on social media. This older method was slow, resource-intensive, and highly prone to fatigue. Human moderators simply could not categorise and respond to false claims fast enough to prevent them from spreading across digital networks.
The new approach replaces this manual triage with an automated system. By deploying an artificial intelligence model trained exclusively on medically approved data, authorities can provide continuous responses without exhausting human staff. The system actively compares incoming queries against a curated database of verified answers.
Bridging the Language Gap
The research team built their model using deep learning techniques on a growing database of verified pandemic information and frequently asked questions. To bypass the data scarcity in Luganda, they routed the system through a heavily resourced English natural language processing framework.
This clever architectural choice allows the model to process a user's intent in a low-resource language by mapping it to English equivalents. The results demonstrate that the system effectively disseminates accurate information in real time. Furthermore, the team measured steady improvements in accuracy through conversation-driven development, where user interactions continually refine the model's automated responses.
Current Limitations
Despite these technical successes, the study does not solve the fundamental problem of user trust. While the model provides medically curated answers, it cannot force a sceptical public to accept automated advice over highly emotive human misinformation. Additionally, the researchers have not yet established how the system handles complex, multi-turn conversations where medical context shifts rapidly.
Future Applications
This implementation suggests that automated translation frameworks could stabilise public health communications in linguistically diverse regions. If scaled properly, similar models may reduce the administrative burden on hospitals during future outbreaks.
The framework provides a clear blueprint for adapting high-resource language models to regional dialects. Public health bodies will need to carefully monitor these systems to ensure clinical safety, but the methodology offers a pragmatic step toward better crisis management.
Key advantages of this system include:
- Continuous availability without human fatigue.
- Real-time updates to medical guidelines.
- Cost-effective scaling across multiple regional dialects.