CheckMate: AI-Powered Fact-Checking System
CheckMate is an innovative AI-driven fact-checking system designed to assist journalists and fact-checkers in identifying and verifying claims in real-time, particularly during live stream broadcasts and recorded video or audio content. This project is a collaborative effort between journalists and technologists from prominent organizations such as News UK (The Sun and The Times), Deutsche Presse-Agentur (dPA), DataCrÃtica, and the BBC, as part of the 2024 JournalismAI Fellowship.
Key Features and Functionality
1. Transcription
CheckMate begins by transcribing video and audio content in real-time. The system uses advanced transcription tools, such as AssemblyAI, to convert spoken content into text. Although the initial version has a small delay in real-time transcription and does not include speaker identification, it effectively captures the audio data and splits it into manageable chunks for further analysis.
2. Claim Identification
The AI component of CheckMate identifies potential claims within the transcribed text and cross-references them against existing fact-checking databases, such as the Google Fact Check Explorer API. This step is crucial in flagging unverified or false claims for further review.
3. Notification to Journalists
Once claims are identified, the system notifies journalists with detailed information about the claim, including links to reviewed sources. This enables journalists to quickly verify the accuracy of the claims and provide accurate information to the public.
4. Feedback Loop
Although the feedback feature was removed from the initial version (V1), the intended functionality allows journalists to provide feedback on the accuracy of the claims. This feedback can be used to improve the fact-checking model and add new claims that were not initially highlighted by the AI.
Technical Implementation
- Data Processing: The tool processes recorded video by splitting the audio into data chunks, which are then uploaded to Amazon S3 buckets and analyzed using a video builder script and the AssemblyAI transcription tool.
- Error Correction: The system uses a confidence score for each word provided by the transcription tool to correct potential errors in the transcription.
- Integration: The tool integrates various JavaScript scripts and compiled tools to achieve its tasks, ensuring a seamless workflow from transcription to claim identification and notification.
Benefits
CheckMate is particularly valuable in the context of fast-paced communication environments, such as election periods, where false information can spread rapidly. By enabling journalists to respond quickly and accurately, CheckMate enhances the integrity of journalistic reporting and helps maintain public trust in media outlets. The collaborative nature of the project ensures that it leverages a broad range of expertise, making it a robust and reliable tool for fact-checking in real-time.