Data Annotator (Arabic) | $11/hr Remote

Position: LLM – AI Quality Analyst (Personalization) – ArabicType: Short-Term ContractLocation: RemoteCommitment: 30–40 hours/week, 4-hour overlap with PSTEngagement Length: 2 monthsStart Date: Immediate
Role ResponsibilitiesDesign multi-turn conversational prompts based on personal contextEvaluate personalized AI responses for relevance, grounding, and helpfulnessAssess correct and incorrect use of personal data in model outputsPerform side-by-side (SxS) evaluation and ranking of AI responsesIdentify grounding errors, poor inferences, and forced personalizationWrite clear, structured rationales referencing specific conversation turnsExtract and verify model debug information and data source usageMaintain strict data hygiene by deleting evaluation conversations.
RequirementsArabic fluency (reading and writing)Strong experience in data annotation, AI quality evaluation, content moderation, or related rolesStrong analytical thinking and attention to detailAbility to evaluate nuanced and ambiguous AI responsesComfortable using a primary personal Google account with enabled data sourcesBS/BA degree or equivalent experience in a relevant analytical fieldStrong written communication and structured feedback skillsSelf-motivated and able to work independently in a remote settingReliable desktop/laptop with stable internet connectionFull-time availability (8 hours/day) with required PST overlap.
Application ProcessFill out the application formComplete the ICFAssessment