Group Leader: Moritz Hardt, PhD. , 16.06.2026
MPI for Intelligent Systems, Department: Social Foundations of Computation
Scientific Study on arena-like benchmarks and human judgement of side-by-side output comparisons of generative AI.
Title of the Study: comparity.ai
I have received and read the Data Protection Information Sheet for this study. I had the opportunity to ask questions concerning protection of my data and carefully consider my participation in this study.
I am aware that
- • processing and use of recorded study data occurs in a pseudonymized form within the legal data protection framework. Data may be recorded in written or electronic form and may be kept for 10 years or longer, if this is required by the objective of the study.
- • in anonymized form recorded personal study data be used for scientific research work, publication in scientific journals, and in public scientific databases. Study data cannot be related to me as an individual in these cases.
- • in anonymized form recorded personal study data may be sent to cooperation partners for scientific purposes. Cooperation partners may be located within the realm of the EU-GDPR or in countries with different data protection levels, e.g., the USA.
- • user-submitted prompts are sent to third-party AI service providers for model inference. All models are accessed through Microsoft Azure. Depending on the models used, prompts may be processed by: Microsoft Corporation (USA), OpenAI, L.L.C. (USA), Anthropic, PBC (USA), and xAI Corp. (USA). Open-weight models (such as DeepSeek, Llama, Mistral, and Kimi) are hosted entirely on Microsoft Azure infrastructure and no data is sent to the original model developers. The list of providers may change over the course of the study.
- • the platform uses Matomo, an open-source web analytics tool hosted entirely on Max Planck Institute infrastructure in Tübingen, to collect anonymised usage statistics (e.g. page views and navigation patterns). No analytics data is transferred to third parties. I may opt out of analytics tracking via the cookie consent banner or by enabling "Do Not Track" in my browser.
- • the account registration form is protected against automated abuse by Cloudflare Turnstile, a privacy-focused CAPTCHA service operated by Cloudflare, Inc. (USA). To distinguish human users from bots, Cloudflare processes technical data such as my IP address and browser characteristics; this does not involve advertising or cross-site tracking. Further details are provided in the Data Protection Information Sheet.
- • recorded study data may also be used and processed in future studies inside the institute.
I have been informed that I have the right to
- • withdraw my declaration of consent.
- • request information about personal data recorded in the study, corrections to my personal data, or exclude my personal data from further use.
- • request immediate deletion or anonymization of my personal data when I withdraw from participation in the study.
- • request that my personal data are handed out to me or to a third party if technically possible.
I hereby declare that
- • I have been adequately informed about the kind of personal data recorded and the way these data are processed and the rights I have.
- • I agree to the collection and processing of my personal data within the scope of this study.
- • I agree that my personal data may be transferred in pseudonymized form so that only the authorized persons are able to relate the data to me as an individual.
- • I will use the platform in a lawful and responsible manner and will not submit prompts that contain or solicit illegal, hateful, violent, or sexually explicit content, attempt to circumvent safety filters, or use the platform for purposes unrelated to the study.
- • I acknowledge that Microsoft's privacy statement (https://privacy.microsoft.com/privacystatement) applies to data processed through their Azure services.
- • I have read and agree to the Terms of Use of the Platform, including the acceptable use policy, rate limits, and enforcement measures described therein.