Mercor
AI

Engineering PhD AI Evaluation Expert

Mercor · · $151k

Actively hiring Posted about 3 hours ago

Role overview

Type:
Contract
Compensation:
$73/hour
Location:
Remote
Role Responsibilities

  • Write and refine prompts to guide model behavior in engineering scenarios.
  • Evaluate LLM-generated responses for technical accuracy and applied reasoning.
  • Conduct fact-checking and verify technical claims using authoritative sources.
  • Annotate model responses, identifying strengths and areas for improvement.
  • Assess clarity and appropriateness of explanations for different audiences.
  • Ensure model responses align with expected conversational behavior and guidelines.

What we're looking for

  • Experience with applied research, industry engineering workflows, or systems design
  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience teaching or explaining engineering concepts to non-expert audiences
  • Familiarity with evaluation rubrics or structured review frameworks

Interview process

  • Upload resume
  • AI interview based on your resume
  • Submit form

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,

Tags & focus areas

Used for matching and alerts on DevFound
Parttime Remote Ai Generative Ai