Quebec French Language Evaluation Specialist Job at AuraOne Human Data, Remote

  • AuraOne Human Data
  • Remote

Job Description

Quebec French Language Evaluation Specialist is a remote evaluation track for reviewing french generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn french generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate french generalist evaluation model outputs against a versioned rubric and assign severity tags for Quebec French Language Evaluation Specialist assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on french generalist evaluation or adjacent content for Quebec French Language Evaluation Specialist work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two french generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • French generalist evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$50 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, For contractors, 10 hours per week

Similar Jobs

Eating Disorder Center of Denver

Art Therapist Job at Eating Disorder Center of Denver

 ...Art Therapist# Art TherapistDENVER, CO 80246## OverviewSalary Range$32.00 - $50.00 HourlyPosition TypeContractor## DescriptionAbout EDCareEDCare is a leading provider of comprehensive eating disorder treatment, offering a collaborative and multidisciplinary approach to... 

Starkey Inc

Audiologist OR Hearing Instrument Specialist (Morganton, NC) Job at Starkey Inc

 ...Starkey Retail Audiologist Or Hearing Instrument SpecialistJoin a dynamic team dedicated to innovation and excellence in Morganton, NC. We are seeking a motivated and skilled professional who is ready to contribute to a fast-paced, collaborative environment.At Starkey... 

RadiantHire Solutions, Inc.

Onsite RMIC Program Manager, Army National Guard Job at RadiantHire Solutions, Inc.

RadiantHire Solutions, Inc. seeks an experienced Program Manager to lead on-site support for the Army National Guard RMIC program at Arlington Hall Station, VA. You will coordinate with the COR, senior Army leadership, and a technical team to sustain internal controls and... 

Apple

Camera Software Frameworks Engineer Job at Apple

 ...ServicesLocation: San Diego Metro Area; San Francisco Bay AreaWeekly Hours: 40Posted: 2026-09-18SummaryiPhone is the most popular camera in the world. The seamless integration of software and hardware has led to features like Cinematic Mode, Portrait Mode, and Center... 

Burger King

Crew Member Job at Burger King

 ...Opportunities Live life your way! Whether you're looking for a part-time job now or a career with us, we've got great...  ...have jobs for all ages teens to adults, starting at 14 years old. That's right, 14-15 year olds have job opportunities with us. Apply today....