Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Machine Learning Engineer — Model Evaluation & Experimentation

Type: Contract

Compensation: $60–$90/hour

Location: Remote

Commitment: 35 hours/week

Role Responsibilities

Design tasks by transforming real ML research ideas into well-defined, multi-step tasks.
Run experiments by implementing changes, executing training experiments, and analyzing results to define correct solutions.
Explore reinforcement learning concepts such as reward functions and training behavior in task development.
Evaluate frontier models' performance on tasks and identify areas of improvement.
Collaborate with researchers to ensure tasks are consistent, rigorous, and fair.

Qualifications

Must-Have

MSc or PhD in machine learning , computer science , or a related STEM field.
1+ years in a research or research-engineering role.
Experience in training and evaluating ML models and conducting end-to-end experiments.
Proficiency in Python and Git .
Strong understanding of large language models and their evaluation.

Preferred

Basic knowledge of reinforcement learning .
Experience in AI training, model evaluation, or benchmark/task authoring.

Compensation & Legal

Hourly contractor
Paid weekly

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Hourly pay, Weekly pay, Full time, Contract work, For contractors, Summer work

Similar Jobs

Express Employment Professionals - Lancaster

Assembly Technician Job at Express Employment Professionals - Lancaster

...Job Description Job Description Overview We are seeking a dedicated and detail-oriented Assembly Technician to join our team in Lancaster, PA. In this role, you will play a crucial part in the assembly and quality assurance of our products. If you have a passion...

Sentara Simulation Center

Standardized Patient Job at Sentara Simulation Center

...Standardized Patient A standardized patient (SP) is defined as, "A person trained from a standardized case to present a social and emotional history, as well as specific findings on physical examination with such realism that even an experienced clinician can rarely...

Farmland Hardware

Farm Hand Job at Farmland Hardware

...Farmland Hardware is seeking a Farm & Contractor Sales Associate in Iowa to help customers at the counter and support daily store operations. This part-time role requires approximately 2530 hours per week with every other Saturday and Sundays off.You will assist contractors...

Contrarian Thinking

Remote Short-Form Video Editor for Viral Clips Job at Contrarian Thinking

...A digital media company is seeking a short-form video editor focused on editing viral content for social media. This fully remote position requires editing at least five high-quality clips per week, employing skills in storytelling, motion graphics, and software like Adobe...

Stryker Corporation

Post-Doc Sport Psychology Clinician (Athletics) Job at Stryker Corporation

...Mississippi is seeking a Post-Doctoral Clinical/Counseling Psychologist to deliver direct clinical services, assessments, and sport psychology consultation within an integrated athletics health model. This supervised, training-focused appointment emphasizes advanced competencies...

AI Research Scientist - Fully Remote Job at Mercor, Remote

ZDhjOWpsL2lSNHU5RkxqMDdnVHZoWTBL