AI Quality Analyst (English)
| Company: | JVLM Tech |
|---|---|
| Hours: | Full-time |
| Working pattern: | Remote |
| Job type: | Contract |
| Posting date: | 6 Sept 2026 |
| Closing date: | 6 Oct 2026 |
Summary
Turing is hiring AI Quality Analysts to evaluate a new personalisation feature for Gemini. You will assess how well the model uses information from your past Gemini conversations, Gmail, Google Search and YouTube activity to make its responses more relevant and helpful.
The role blends creativity with analytical rigour. You will design prompts drawn from your own personal experience, then assess the quality of the model's personalised responses across dimensions such as grounding, integration and helpfulness.
Day to day:
- Design and run multi-turn conversational prompts, typically 1 to 5 turns, that require the AI to use your personal information and experiences
- Evaluate responses against your original intent, checking whether personalisation was applied appropriately
- Analyse responses for grounding issues, ensuring claims about you are supported by evidence rather than flawed inferences or hallucinations
- Assess integration quality, so personal data is woven in naturally rather than robotically overnarrated
- Evaluate and rank two model responses side by side to determine which is more helpful, usable and enjoyable
- Write clear, defensible rationales for your comparisons, referencing specific turn numbers
- Extract and verify debug information to confirm that chat summaries and data sources were properly used
- Maintain strict data hygiene by deleting evaluation conversations so they do not pollute your future chat history
Important: this role requires you to use your primary personal Google account rather than a test account, and to enable your personal data sources so the assessment is genuine.
Contract details: a three-month contractor engagement. At least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with US Pacific time. We are staffing a global 24-hour operations team.
Evaluation process: shortlisted candidates receive a job interest form, then an assessment to be completed within 24 hours, then a discussion of pre-onboarding requirements.