Talent.com
Mercor
Systems Engineer AI Model EvaluatorMercor • Berlin, Berlin, Germany
Systems Engineer AI Model Evaluator

Systems Engineer AI Model Evaluator

Mercor • Berlin, Berlin, Germany
Vor 30+ Tagen
Stellenbeschreibung

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Systems Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex engineering tasks.
  • Review model-generated code architecture decisions and systems implementations.
  • Identify bugs edge cases performance bottlenecks and failure modes.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic systems engineering scenarios.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • 2 years of professional systems engineering experience.
  • Experience with distributed systems networking operating systems storage systems infrastructure software or database internals.
  • Regular use of AI coding agents such as Cursor Claude Code Codex Windsurf Gemini CLI or similar tools.
  • Ability to evaluate model-generated systems designs and implementations.

Preferred

  • Experience building highly scalable and performance-critical systems.

Compensation & Legal

  • $400 per accepted task
  • Compensation is tied to accepted work.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Jobalert für diese Suche erstellen

Systems Engineer AI Model Evaluator • Berlin, Berlin, Germany

Ähnliche Stellen

Satellite Systems Engineer / System Architect (all genders)

Reflex Aerospaceberlin, Deutschland

Satellite Systems Engineer / System Architect (all genders).Join the Pinnacle of Satellite Technology Advancement in Germany! Reflex Aerospace is at the forefront of propelling high-performance sat... Mehr anzeigen

 • Gesponsert

System Engineer - AI Data Center Solutions (m/f/d)

Corning Inc.berlin, Deutschland

System Engineer - AI Data Center Solutions (m/f/d).The company built on breakthroughs.Corning is one of the world’s leading innovators in glass, ceramic, and materials science.From the depths of th... Mehr anzeigen

 • Gesponsert

Generative AI Engineer

Few&Farberlin, Deutschland

Principal Consultant | Building Platform teams for start‑ups & scale‑ups @ Few&Far.A fast‑growing European startup is on a mission to bring.Backed by leading European VCs, they’re now expanding the... Mehr anzeigen

 • Gesponsert

AI Solutions Engineer

NEEW Venturesberlin, Deutschland

We are NEEW Ventures, the Venture Builder of EEW – Energy from Waste.Want to be part of bringing AI innovation to the waste space?Apply now!.As our AI Solutions Engineer, you own the end-to-end del... Mehr anzeigen

 • Gesponsert

AI Research Engineer - ML & Signal Processing

Helsingberlin, Deutschland

AI Research Engineer – Signal Processing.Join to apply for the AI Research Engineer – Signal Processing role at Helsing.Get AI-powered advice on this job and more exclusive features.Helsing is a de... Mehr anzeigen

 • Gesponsert

AI/ML Engineer

Melotechworkfromhome, berlin, Deutschland

Melotech is revolutionizing media and entertainment.We create art through technology for humans to enjoy.In just 24 months, our work has been heard, watched and loved for over 3 billion minutes wor... Mehr anzeigen

 • Gesponsert

Lead Analytics Engineer (f/m/d)_metrify

Enpalberlin, Deutschland

Germany’s largest competitive smart metering operator, and a new strategic spin-off initiative by Enpal.Are you ready for one of the great infrastructure challenges of the 2100s? To truly transform... Mehr anzeigen

 • Gesponsert

AI Engineer

group.oneberlin, Deutschland

Are you a software engineer energised by complex challenges and eager to delve deeper to devise smart solutions? Within our Intelligent Experience team, you'll work on innovative software that dire... Mehr anzeigen

 • Gesponsert

DevOps Engineer - AI Model Evaluator

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Mehr anzeigen

Applied AI / ML Lead Engineer

DAiNA Inc.berlin, Deutschland

Start Date: As soon as possible / by arrangement.DAiNA is a precision-oncology company focused on enabling personalized cancer treatment for individual patients.We combine comprehensive molecular t... Mehr anzeigen

 • Gesponsert

AI Prompt Evaluator

Cross Border Talentsberlin, Deutschland

Bachelors degree, valid work permit for Germany.As soon as possible limited vacancies, apply fast!.Competitive salary + signing bonus (3,000 split over 3rd & 6th months).Apply here or send your CV ... Mehr anzeigen

 • Gesponsert

(Applied) AI Engineer

Qontextberlin, Deutschland

That takes people who are exceptionally talented, obsessed by the vision, and set on doing the best work of their lives.You’ll design and scale the backend that powers a company's brain, the logic ... Mehr anzeigen

 • Gesponsert

ML Engineer, Agents & Reasoning

Duniaberlin, Deutschland

Build agentic AI systems that reason, plan, and act inside real materials discovery workflows.Most agent systems live in clean environments: browsers, codebases, or synthetic benchmarks.At Dunia, a... Mehr anzeigen

 • Gesponsert

Systems Engineer - AI Model Evaluator

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Systems Engineer (Coding Agent Experience).Review model-generated code, architecture decisions, and systems implementations.Identify bugs, edge... Mehr anzeigen

AI Systems Engineering Subject Matter Expert

TripleTen Indonesiaberlin, Deutschland

At TripleTen, we’re building an international platform of digital re‑skilling products to help people from diverse backgrounds learn new professions and build sustainable careers in tech.Our progra... Mehr anzeigen

 • Gesponsert

AI Engineer (m/f/d)

Vectoryx USA Inc.berlin, Deutschland

We're building an AI-native claims operation.Our thesis: the moat isn't the model — it's the system around it that makes AI reliable enough to trust with real operational work.Building that system ... Mehr anzeigen

 • Gesponsert

Business Systems Engineer (f/m/d)

Thermondo GmbHberlin, Deutschland

At thermondo, our mission is to decarbonize every home, using technology as our primary lever for change.We disrupt a massive industry entangled with legacy systems and manual work, building intell... Mehr anzeigen

 • Gesponsert

AI Engineer

CEF.AIberlin, Deutschland

Join to apply for the AI Engineer role at CEF.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Are you excited by the opportunity to become a par... Mehr anzeigen

 • Gesponsert

Staff AI Engineer

Atlas Metricsberlin, Deutschland

We celebrate diversity and encourage individuals of all genders (m/f/d) to apply.We’re on the lookout for an ambitious AI-Engineer to join our Engineering team at our office in Berlin.Join us in bu... Mehr anzeigen

 • Gesponsert

AI Research Engineer

Nulegal GmbHberlin, Deutschland

Wir bauen die Infrastruktur, die KI in der Rechtsbranche tatsächlich belastbar macht, nicht als Demo, sondern in Produktion, mit messbarer juristischer Qualität.Dafür suchen wir Menschen, die tief ... Mehr anzeigen