Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.What this opportunity involves:
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT:
What we look for:
Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate
Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation:
Up to $200/hr equivalent, depending on level and pace. Tasks are estimated at ~30 hours each; you set your own schedule.
Senior Python Engineer - AI Coding Agent Evaluation (Freelance) • Berlin, BE, DE
Senior Full Stack Engineer (m/f/d).We are seeking a talented and driven Senior Full Stack Engineer (m/f/d) to join our team, in the Demand Division, responsible for developing our contact center ap... Mehr anzeigen
Exzellenz – und damit auch für vielfältige Entwicklungsmöglichkeiten für alle adessi.Wir wachsen gemeinsam und lernen voneinander: in anspruchsvollen Projekten, interdisziplinären Teams und mit zie... Mehr anzeigen
Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.Contributors help evaluate and improve frontier AI coding models through structured technical assessmen... Mehr anzeigen
We are the platform turning browsing into shopping.We connect 200 million shoppers with deals they love while boosting local sales for hundreds of top retailers and brands.We help consumers save ti... Mehr anzeigen
Headquartered in San Francisco, our investors include.Backend Engineer (Coding Agent Experience).Review model-generated code for correctness, quality, maintainability, and performance.Identify bugs... Mehr anzeigen
We’re excited to find a sharp Senior AI Engineer to join our dynamic Data Science team! You’ll be at the heart of developing, optimizing, and integrating ML models and architecture to fully automat... Mehr anzeigen
Als Forward Deployed Engineer (m/w/d) arbeitest du.Kunden vor Ort, übersetzt sie in.Amazon Bedrock, AWS Lambda, Amazon SageMaker).In kurzen Iterationen entwickelst du.Anwender*innen beim Kunden und... Mehr anzeigen
Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Mehr anzeigen
We are making a strategic investment in Artificial Intelligence and Generative AI to redefine how customers interact with N26.We are looking for a Principal AI Engineer to architect the next genera... Mehr anzeigen
Take ownership of complex backend systems end-to-end - from scoping and architecture to high-quality, reliable delivery.Design and build robust, scalable APIs and distributed systems that power our... Mehr anzeigen
As a Senior AI Platform Engineer, you’ll join the Agentic Enablement side of our Platform team and help build the technical foundation for how Tibber adopts and scales agentic systems across engine... Mehr anzeigen
As a Senior AI Engineer, you'll spearhead the development of LLM-powered products at the forefront of marketing and advertising technologies.Utilizing your expertise in machine learning, large lang... Mehr anzeigen
Exzellenz – und damit auch für vielfältige Entwicklungsmöglichkeiten für alle adessi.Wir wachsen gemeinsam und lernen voneinander: in anspruchsvollen Projekten, interdisziplinären Teams und mit zie... Mehr anzeigen
Solaris is Europe's leading embedded finance platform.Solaris’ full German banking license and proprietary modular B2B tech stack empowers its partners – from SMEs to large, multinational, non-fina... Mehr anzeigen
At jobpal, we build chatbots for the recruiting industry that are based on Machine Learning and Natural Language Processing technologies.Our chatbots automate communication between employers and ca... Mehr anzeigen
Headquartered in San Francisco, our investors include.Data Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, scalability issues, and fai... Mehr anzeigen
N26 is Europe's leading digital bank, fully licensed in Germany and active across more than 20 markets.The mission is not simply to build another fintech product, but to build Europe's most trusted... Mehr anzeigen
Headquartered in San Francisco, our investors include.Integrate web or desktop applications into.Implement populate/snapshot hooks for app state management.Test apps locally and debug build, runtim... Mehr anzeigen
