This role seeks highly skilled AI Evaluators to support the development of advanced AI tools focused on grammar correction and proofreading for the French language. This project involves creating a rich and diverse dataset of written French text, which must be accurately annotated and corrected by human evaluators.
Responsibilities
The AI Evaluator will engage in two primary areas: content generation and message review/annotation.
Content Generation:
- Respond to a set of prompts that simulate realistic business or casual communication scenarios.
- Write clear, plausible short texts (3-4 sentences for business settings, 1-2 sentences for casual chat).
- Generate responses that contain intentional but realistic grammar, spelling, and structural errors, simulating genuine user input.
Message Review and Annotation:
- Review annotated message pairs (consisting of the input text and the corrected/proofread version) to ensure the highest quality standards are met.
- Verify that all grammar, spelling, preposition, and punctuation errors are corrected appropriately.
- Ensure the original meaning is preserved between the input text and the corrected text.
- Correctly classify the types of errors present in the message.
- Confirm that explanations provided are clear and linguistically sound.
Qualifications and Experience
Essential Qualifications:
- Language Proficiency: French as a first language (C2 French proficiency).
- Language Proficiency: English as a second language (B2 English proficiency).
- Education: BA/BSc/HND qualification.
- Professional Experience: 2 years of working experience in a corporate or business environment.
- Specific Experience: 1 year of working experience as an AI Evaluator, data annotator, or in a similar role.
- Technical Skills: Strong computer literacy and fast, accurate typing skills, essential for efficiently navigating annotation tools and maintaining productivity in text-based tasks.
- Cognitive Abilities: Strong logic, intuitive problem-solving, and critical thinking; must be open-minded and welcome different viewpoints or solutions.
- Work Style: Demonstrated proactiveness and confidence to work independently without constant support. Must exhibit reliability and the ability to make sound decisions autonomously.
- Collaboration: Be a thought partner to delivery managers, providing input into project delivery strategies and sharing quality best practices to help achieve project goals.
- Adaptability: Must be able to adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
- Resources: Access to your own reliable laptop for work.
Preferred Qualifications:
- C1 or C2 English proficiency is preferred.
- Experience in Generative AI (GenAI) is a strong plus.
.png){kind=logo}
