Job Description
About The JobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.Position: AI Research EvaluatorType: ContractorCompensation: $50–$60/hourLocation: RemoteCommitment: 30 hours/weekRole ResponsibilitiesReview and audit submitted data, including prompts, solutions, final answers, references, and metadata.Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency.Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, identifying flaws, gaps, or inconsistencies.Assess coding problems by validating test cases, solution correctness, and language consistency.Provide concise, well-reasoned written feedback to justify evaluation decisions.Work independently and asynchronously following provided tools and workflows.QualificationsMust-HavePhD (or current PhD candidacy) or Master's in Mathematics, Computer Science, Applied Mathematics, or a related STEM field.Expertise in one or more domains, including Mathematics (algebra, geometry, number theory, combinatorics, probability, graph theory), Coding (data structures, algorithms, application frameworks, testing & quality assurance), General domains (summarization, open/closed Q&A, classification, reasoning tasks).Strong analytical skills with the ability to evaluate multi-step reasoning.Excellent written communication and attention to detail.Ability to work independently in a fully remote environment.PreferredBasic knowledge of Python and testing frameworks (e.g., Pytest, JUnit).Compensation & LegalContractor position via Mercor, paid hourly.Competitive rates based on expertise: $50–$60/hour.Weekly payments processed securely through Stripe Connect.Application Process (Takes 20–30 mins to complete)Upload resumeAI interview based on your resumeSubmit formResources & SupportFor details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcomeFor any help or support, reach out to: support@mercor.comPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.,
Job Application Tips
- Tailor your resume to highlight relevant experience for this position
- Write a compelling cover letter that addresses the specific requirements
- Research the company culture and values before applying
- Prepare examples of your work that demonstrate your skills
- Follow up on your application after a reasonable time period