ELSA’s document intelligence use case team announces their upcoming competition.
Brought to you as part of the IEEE SaTML 2025 conference in Denmark, this competition invites the development of inference attacks to extract sensitive information from Document Visual Question Answering models.
Join the Challenge
All details about the Read Team Challenge are online on our ELSA benchmarks platform.
- Register on the ELSA benchmarks platform
- access the “Document Intelligence” section
- navigate to the “Red Team” instructions
You will find information about the two tracks, participation instructions, rules and resources, and more about the models and frameworks.
Key Dates
- Submission Deadline: March 7, 2025
- Announcement of Winning Teams: March 17, 2025
- Competition Track: April 9-11, 2025 (during SaTML’25)
We are looking forward to your submissions!
Questions?
For any inquiries, feel free to reach out at info_pfl(at)cvc.uab.cat
Recap: The Blue Team Challenge at NeurIPS 2023
The first part of the competition consisted of the Blue Team challenge “on Privacy Preserving Federated Learning Document VQA”. While the use case team prepares the second challenge, you can look at the first challenge’s slides and videos.
About IEEE SaTML 2025
“The 3rd IEEE Conference on Secure and Trustworthy Machine Learning (IEEE SaTML 2025) will expand on the theoretical and practical understandings of vulnerabilities inherent to machine learning (ML), explore the robustness of learning algorithms and systems, and aid in developing a unified, coherent scientific community which aims to establish trustworthy machine learning. IEEE SaTML will be hosted on the campus of the University of Copenhagen on April 9-11, 2025. The venue for the conference will be the Lundbeckfond Auditorium.” – (source: IEEE SaTML website, February 14th, 2025)
