Facebook Details AI Advancements in Combating Misinformation and Hate Speech

Facebook Details AI Advances in Catching Misinformation and Hate Speech
Facebook is continuously working to combat misinformation and hate speech on its platform through advancements in its AI systems. CTO Mike Schroepfer highlighted these improvements, emphasizing the company's commitment to maintaining a safer online environment.
Key AI Improvements:
- Language Analysis Systems: Facebook is refining its AI to detect hate speech with greater accuracy. The company is particularly careful to minimize false positives, which could lead to the wrongful removal of legitimate content.
- Linformer: To manage the increasing computational costs of analyzing billions of posts daily, Facebook developed Linformer. This tool approximates the attention mechanism in transformer-based language models, offering better language understanding with only marginally higher computational costs.
- Multimodal Analysis: Researchers are working on understanding the interplay of text, images, and text within images. This is crucial for detecting sophisticated forms of misinformation, such as fake screenshots, memes, and manipulated images where a single word change can alter the meaning.
Tackling COVID-19 Misinformation:
Facebook's AI has made significant strides in identifying COVID-19 misinformation, including fake news reports that falsely link masks to cancer, even when the content is visually manipulated.
Reinforcement Integrity Optimizer:
This new approach monitors the effectiveness of AI models on live content and continuously feeds this information back into the training system, enabling faster iteration and improvement.
Measuring Success: Prevalence
Facebook defines success not just by the volume of content removed, but by "prevalence" – the actual frequency with which users encounter violating content. The company aims to reduce this prevalence, considering the removal of content that was about to go viral a major success.
- Hate Speech Prevalence: In Q3 2020, Facebook reported hate speech prevalence between 0.10% and 0.11%, meaning 10 to 11 out of every 10,000 content views included hate speech.
- Challenges and Criticisms: Despite these efforts, challenges remain. Reports from conflict zones like Ethiopia suggest that hate speech is still prevalent and inadequately addressed. The company's CTO, while focused on implementation, acknowledges the complexity and the need for continuous improvement.
Future Outlook:
Facebook continues to invest in AI research and development to stay ahead of evolving tactics used to spread misinformation and hate speech. The focus remains on improving the accuracy, efficiency, and contextual understanding of its AI systems.
Image Credits: Facebook
Image Credits: Facebook
Original article available at: https://techcrunch.com/2020/11/19/facebook-details-ai-advances-in-catching-misinformation-and-hate-speech/