IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in Japan.
Pay: $90–$140/hr
Role Title: Educator/ Assessor Writer
Role Type: Contractor
Location: Remote
We are engaging Educator/ Assessor Writers to contribute expertise on a customer project focused on advanced AI system development. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This opportunity is ideal for individuals experienced in evaluating written work against a rubric, examining academic writing, or designing effective assessments. The engagement is fully remote and offers the flexibility to participate alongside other professional obligations.
Scope of Work
- Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
- Assign analytical quality scores based on provided rubrics and guidelines.
- Compose detailed written rationales justifying each assessment or score.
- Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
- Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
- Document findings meticulously and maintain thorough records of decisions and observations.
- Collaborate asynchronously with project managers and reviewers using digital content review platforms.
Preferred Qualifications
- First-language proficiency or fully equivalent fluency in written English.
- Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Experience marking, grading, or examining written work against set criteria or rubrics.
- Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
- Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.
- Capable of independent remote work and meeting project deadlines.
- Experience with model evaluation, RLHF, or annotation is an asset but not mandatory.
How to apply
Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
