Talent.com
MCP & Tools Python Developer - Agent Evaluation Infrastructure
MCP & Tools Python Developer - Agent Evaluation InfrastructureMindrift • Munich, BY, DE
MCP & Tools Python Developer - Agent Evaluation Infrastructure

MCP & Tools Python Developer - Agent Evaluation Infrastructure

Mindrift • Munich, BY, DE
Vor 6 Tagen
Anstellungsart
  • Homeoffice
  • Quick Apply
Stellenbeschreibung

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.

At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.

What we do

The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.

Who we're looking for

Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment.

If you thrive on digging into complex systems, uncovering hidden vulnerabilities, and thinking creatively under constraints, join us!

We’re looking for someone who can bring a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. We value contributors with a passion for continuous learning, experimentation, and adaptability.

About the project

We’re on the hunt for hands-on Python engineers for a new project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You’ll implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team.

What you’ll be doing :

  • Developing and maintaining MCP-compatible evaluation servers
  • Implementing logic to check agent actions against scenario definitions
  • Creating or extending tools that writers and QAs use to test agents
  • Working closely with infrastructure engineers to ensure compatibility
  • Occasionally helping with test writing or debug sessions when needed

Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.

How to get started :

Apply to this post, qualify, and get the chance to contribute to a project aligned with your skills, on your own schedule. Shape the future of AI while building tools that benefit everyone.

Requirements

The ideal contributor will have :

  • 4+ years of Python development experience, ideally in backend or tools
  • Solid experience building APIs, testing frameworks, or protocol-based interfaces
  • Understanding of Docker, Linux CLI, and HTTP-based communication
  • Ability to integrate new tools into existing infrastructures
  • Familiarity with how LLM agents are prompted, executed, and evaluated
  • Clear documentation and communication skills - you’ll work with QA and writers
  • We also value applicants who have :

  • Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces
  • Knowledge of FastAPI or similar async web frameworks
  • Experience working with LLM logs, scoring functions, or sandbox environments
  • Ability to support dev environments (devcontainers, CI configs, linters)
  • JS experience
  • Benefits

  • Get paid for your expertise, with  rates that can go up to $50 / hour  depending on your skills, experience, and project needs.
  • Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments.
  • Participate in an advanced AI project and gain valuable experience to enhance your portfolio.
  • Influence how future AI models understand and communicate in your field of expertise.
  • Jobalert für diese Suche erstellen

    Python Developer • Munich, BY, DE

    Ähnliche Stellen
    Senior Python engineer

    Senior Python engineer

    Top Remote Talent • Munich, Bavaria, .DE
    Quick Apply
    A medical industry company is looking for a.The company offers exposure to a variety of industries and technologies, room to grow as a professional, time in projects to learn new skills and an oppo...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen
    Technical Team Lead Python Engineering (mfx)

    Technical Team Lead Python Engineering (mfx)

    Scalable GmbH • München, Bavaria, Germany
    Your mission : take an already high-performing team to the next level.This unit powers core services - wealth management market making risk management regulation and more - with outstanding efficien...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen • Gesponsert
    Software Engineer (m / f / d) - C, C++, Python

    Software Engineer (m / f / d) - C, C++, Python

    retarus GmbH • München, Bayern, DE
    Become Software Engineer (m / f / d) - C, C++, Python at Retarus.Retarus is a worldwide provider of cloud-based messaging solutions at enterprise scale. We serve over 40% of the companies listed on the ...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen
    Mid-level Platform Engineer (mfd)

    Mid-level Platform Engineer (mfd)

    enmacc • Munich, Bavaria, Germany
    Europes largest over-the-counter trading market venue for energy and environmental commodities.Were reshaping how energy is traded by bringing speed transparency and simplicity to a market thats lo...Mehr anzeigen
    Zuletzt aktualisiert: vor 2 Tagen • Gesponsert
    IT Solution Engineer Cloud / Network (m / w / d)

    IT Solution Engineer Cloud / Network (m / w / d)

    netgo group GmbH • München, DE
    Werde auch du "part of netgo group" - einem der größten IT-Dienstleister Deutschlands.Mitarbeiter •innen an zahlreichen Standorten in ganz Deutschland erwarten dich als neues Teammitglied.Kunden – d...Mehr anzeigen
    Zuletzt aktualisiert: vor 9 Tagen • Gesponsert
    Lead Cloud Google Engineer (m / w / d) / Google Cloud Platform und AWS -Mnchen

    Lead Cloud Google Engineer (m / w / d) / Google Cloud Platform und AWS -Mnchen

    INFOMOTION GmbH • Bad Tölz, Germany
    Erfahrung : 24 Jahre in Data Engineering mit Schwerpunkt Google Cloud Platform, gerne auch AWS-Kenntnisse.Know-how : Best Practices in Aufbau, Evaluierung und Umsetzung von GCP-Architekturen.Methoden...Mehr anzeigen
    Zuletzt aktualisiert: vor 9 Tagen • Gesponsert
    Senior Software Engineer - SAP HCM Payroll (m / w / d)

    Senior Software Engineer - SAP HCM Payroll (m / w / d)

    Burda DigitalSystems GmbH • Münich, DE
    Außerdem verfügt BurdaSolutions über eine hohe Kompetenz in den Bereichen Business Intelligence, CRM, ERP und mobile Applikationen. Offenburg oder München, Vollzeit, unbefristet Was dich bei...Mehr anzeigen
    Zuletzt aktualisiert: vor 6 Tagen • Gesponsert
    Senior Software Engineer – V&V Python

    Senior Software Engineer – V&V Python

    Luminar • Munich, Bavaria, Germany
    Luminar Technologies is a global automotive technology company ushering in a new era of vehicle safety and autonomy.For the past decade Luminar has built an advanced hardware and software / AI platfo...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen • Gesponsert
    Cloud Platform Engineer mit Fokus CI / CD (m / w / d)

    Cloud Platform Engineer mit Fokus CI / CD (m / w / d)

    LBBW • Münich, DE
    Über uns Referenznummer : (Inhalt entfernt) Einsatzort : Stuttgart, teilweise remote - Unternehmen : LBBW - Funktionsbereich : IT Services - Vollzeit / Teilzeit : 100 Die LBBW zählt zu den führenden Ba...Mehr anzeigen
    Zuletzt aktualisiert: vor 1 Tag • Gesponsert
    Project IT Engineer – Networks & Infrastructure (m / w / d)

    Project IT Engineer – Networks & Infrastructure (m / w / d)

    Home & Marine electronic systems GmbH • Münich, DE
    Über uns Über unsIT, die nicht im Büro endet – sondern dort läuft, wo individuelle IT-Lösungen für Superyachten entstehen. Als Systemintegrator realisieren wir IT-, Audio / Video-, Security- und SATCO...Mehr anzeigen
    Zuletzt aktualisiert: vor 1 Tag • Gesponsert
    Low-Code Consultant (m / w / d) Microsoft Power Platform

    Low-Code Consultant (m / w / d) Microsoft Power Platform

    HanseVision GmbH - Bechtle Group • Münich, DE
    Unser Ziel : Effiziente, sichere und skalierbare Anwendungen, die Unternehmen befähigen, flexibel und zukunftsfähig zu arbeiten. Dabei setzen wir auf Low-Code-Ansätze, um schnelle, agile und kostenef...Mehr anzeigen
    Zuletzt aktualisiert: vor 13 Tagen • Gesponsert
    Identity & Access Management Engineer (Python & SQL) (mfx)

    Identity & Access Management Engineer (Python & SQL) (mfx)

    Scalable GmbH • München, Bavaria, Germany
    Support with the architecture design and implementation of the used IAM solution.Connecting application systems directory services and cloud services to the IAM tool landscape.Participation in conc...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen • Gesponsert
    Cloud Platform Engineer mit Fokus CI / CD (m / w / d) - LBBW

    Cloud Platform Engineer mit Fokus CI / CD (m / w / d) - LBBW

    LBBW • Münich, DE
    Über uns Referenznummer : (Inhalt entfernt) Einsatzort : Stuttgart, teilweise remote - Unternehmen : LBBW - Funktionsbereich : IT Services - Vollzeit / Teilzeit : 100 Die LBBW zählt zu den führenden Ba...Mehr anzeigen
    Zuletzt aktualisiert: vor 1 Tag • Gesponsert
    OpenStack Cloud Engineer (m / w / d)

    OpenStack Cloud Engineer (m / w / d)

    Burda DigitalSystems GmbH • Münich, DE
    Außerdem verfügt BurdaSolutions über eine hohe Kompetenz in den Bereichen Business Intelligence, CRM, ERP und mobile Applikationen. Offenburg oder München, Vollzeit, unbefristet Was dich bei ...Mehr anzeigen
    Zuletzt aktualisiert: vor über 30 Tagen • Gesponsert
    Python Engineer Backend and Cloud DevOps (mfx)

    Python Engineer Backend and Cloud DevOps (mfx)

    Scalable GmbH • München, Bavaria, Germany
    In this greenfield project youll build and automate a robo-advisor managing several billion euros in assets.You will be creating and improving our next generation wealth management which includes p...Mehr anzeigen
    Zuletzt aktualisiert: vor 3 Tagen • Gesponsert
    AI Software Engineer – Python (mfx)

    AI Software Engineer – Python (mfx)

    Scalable GmbH • München, Bavaria, Germany
    As a Senior Software Engineer in our Data Tribe you will help design and deliver scalable backend and cloud systems that power our AI-driven products and services. You will design and build scalable...Mehr anzeigen
    Zuletzt aktualisiert: vor 13 Tagen • Gesponsert
    Senior Softwareentwickler Plattform (Full‑Stack : Python & Next.js) (m / w / d)

    Senior Softwareentwickler Plattform (Full‑Stack : Python & Next.js) (m / w / d)

    JobNinja GmbH • München, DE
    JobNinja is one of Germany’s leading online job boards.Since 2016, we have been successfully matching professionals and managers with top employers — powered by our in-house Traffic Optimizer that ...Mehr anzeigen
    Zuletzt aktualisiert: vor 10 Tagen • Gesponsert
    Senior Systems Engineer (AI Cloud Infrastructure)

    Senior Systems Engineer (AI Cloud Infrastructure)

    MULTIVERSE COMPUTING • München, Bayern, DE
    Quick Apply
    Come and join our multicultural team!.Multiverse is a well-funded, fast-growing deep-tech company founded in 2019.We are the largest quantum software company in the EU and have been recognized by C...Mehr anzeigen
    Zuletzt aktualisiert: vor 21 Stunden • Neu!