Talent.com
Mercor
PhD Physicist AI Evaluation SpecialistMercor • Berlin, Germany
PhD Physicist AI Evaluation Specialist

PhD Physicist AI Evaluation Specialist

Mercor • Berlin, Germany
Vor 30+ Tagen
Stellenbeschreibung
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Physics AI Evaluator Type: Full-time or Part-time Contract Work Compensation: $73/hour Location: USA, UK, Canada, EU Role Responsibilities Write and refine prompts to guide model behavior in physics contexts. Evaluate LLM-generated responses to physics-related queries for conceptual accuracy and reasoning quality. Conduct fact-checking using authoritative public sources and domain knowledge. Annotate model responses by identifying strengths and areas of improvement. Assess clarity, structure, and appropriateness of explanations for different audiences. Apply consistent evaluation standards by following clear taxonomies and benchmarks. Qualifications Must-Have PhD in Physics or closely related field . Deep expertise in Classical Mechanics & Dynamics , Electromagnetism , Thermodynamics , Quantum Physics , or Relativity . Significant experience using large language models (LLMs). Excellent writing skills and ability to explain complex physics concepts. Strong attention to detail and experience reviewing technical writing. Preferred Experience with RLHF , model evaluation, or data annotation work. Experience teaching or explaining physics concepts to non-experts. Familiarity with evaluation rubrics or structured review frameworks. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Jobalert für diese Suche erstellen

PhD Physicist AI Evaluation Specialist • Berlin, Germany

Ähnliche Stellen

AI Governance Framework Spezialist (w/m/d)

50Hertz Transmission GmbHBerlin, DE

Hier übernehme ich die Verantwortung für die kontinuierliche Weiterentwicklung des AI-Governance Frameworks.Das macht diesen Job für mich interessant.Hertz engagiert sich seit langem für die Energi... Mehr anzeigen

 • Gesponsert

PhD student (m/f/d) in Precision Frequency-Comb Spectroscopy

Max-Born-Institut im Forschungsverbund Berlin e.Vberlin, Deutschland

The successful candidate will develop and apply dual‑comb spectroscopy for broadband precision spectroscopy.The research combines the development of advanced laser‑based instrumentation with experi... Mehr anzeigen

 • Gesponsert

Biomedical Evaluator - Fully Remote | Upto $120/hr

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Clinical / biomedical / pharma Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, a... Mehr anzeigen

Research fellow (m/f/d) in project ATOMAQUA

EURAXESS Irelandberlin, Deutschland

Organisation/Company Humboldt-Universität zu Berlin Department Physics Research Field Physics » Other Researcher Profile Recognised Researcher (R2) Positions PhD Positions Application Deadline 12 A... Mehr anzeigen

 • Gesponsert

AI Governance Specialist EU AI Act (w/m/d)

50Hertz Transmission GmbHBerlin, DE

Hier übernehme ich die Verantwortung für die kontinuierliche Weiterentwicklung des AI-Governance Frameworks.Das macht diesen Job für mich interessant.Hertz engagiert sich seit langem für die Energi... Mehr anzeigen

 • Gesponsert

Applied Scientist - LLM, Alexa Conversational Modelling Intelligence

Amazonberlin, Deutschland

As an Applied Scientist II in the Alexa Conversational Modelling Intelligence team within Alexa AI, you will drive model post-training for Large Language Models that power Alexa+.You'll adopt and a... Mehr anzeigen

 • Gesponsert

Physics Research Expert - PhD

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Solve research-level physics challenges end-to-end with verifiable derivations, code, and peer-reviewed references.Decompose challenges into st... Mehr anzeigen

DevOps Engineer - AI Model Evaluator

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Mehr anzeigen

AI Prompt Evaluator

Cross Border Talentsberlin, Deutschland

Bachelors degree, valid work permit for Germany.As soon as possible limited vacancies, apply fast!.Competitive salary + signing bonus (3,000 split over 3rd & 6th months).Apply here or send your CV ... Mehr anzeigen

 • Gesponsert

Clinical Evaluator - Domain Expert

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Clinical / biomedical / pharma Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured written feedback to ... Mehr anzeigen

Hamburg PhD Student strategies for GHz speckle experiments (f/m/d)

European X-Ray Free-Electron Laser Facility GmbHBerlin, DE

European XFEL is an international non-profit company located in the Hamburg area in Germany.X-ray laser, which produces X-rays of unique quality for studies in physics, chemistry, the life sciences... Mehr anzeigen

 • Gesponsert

Research fellow (m/f/d) in project ATOMAQUA

Euraxessberlin, Deutschland

Organisation/Company Humboldt-Universität zu Berlin Department Physics Research Field Physics » Other Researcher Profile Recognised Researcher (R2) Positions PhD Positions Application Deadline 12 A... Mehr anzeigen

 • Gesponsert

Physics Researcher - Fully Remote | Upto $140/hr

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Solve research-level physics challenges end-to-end with verifiable derivations, code, and peer-reviewed references.Decompose challenges into st... Mehr anzeigen

ML Research Engineer - PhD

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Human Baseliner for Open-Ended ML Research Tasks.Work independently in a sandboxed.Use preferred tools, including.Record full working sessions ... Mehr anzeigen

Croatian AI Evaluator Career Opportunity in Essen

Cross Border TalentsBerlin, Germany
Quick Apply

Are you fluent in Croatian and ready to play a key role in shaping tomorrows AI technologies?.Croatian-speaking AI Prompt Evaluator.In this position, you will work in a structured, international en... Mehr anzeigen

AI Governance Specialist (w/m/d)

50Hertz Transmission GmbHBerlin, DE

Hier übernehme ich die Verantwortung für die kontinuierliche Weiterentwicklung des AI-Governance Frameworks.Das macht diesen Job für mich interessant.Hertz engagiert sich seit langem für die Energi... Mehr anzeigen

 • Gesponsert

Systems Engineer - AI Model Evaluator

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Systems Engineer (Coding Agent Experience).Review model-generated code, architecture decisions, and systems implementations.Identify bugs, edge... Mehr anzeigen

AI Strategist

OnHiresBerlin, Germany

Wonderful enables enterprises to build, test, deploy, and monitor AI agents for their most complex needs, serving customers and employees seamlessly across voice, chat, email, and back-office syste... Mehr anzeigen

Astrophysics Specialist - Fully Remote | Upto $85/hr

MercorBerlin, Berlin, Germany
Homeoffice
Quick Apply

Headquartered in San Francisco, our investors include.Develop challenging problems in.Contribute to a project involving state-of-the-art.Create high-quality data to inform the future of.Application... Mehr anzeigen

Sr. Applied Scientist, Amazon Robotics

Amazonberlin, Deutschland

Are you interested in how to build AI reasoning systems that give provably correct answers? Are you excited by science at the interface of classical AI reasoning and Large Language Models (LLMs)? W... Mehr anzeigen