Talent.com
Scalable GmbH
AI Platform Engineer (m/f/x)Scalable GmbH • München, Bavaria, Germany
AI Platform Engineer (m/f/x)

AI Platform Engineer (m/f/x)

Scalable GmbH • München, Bavaria, Germany
Vor 25 Tagen
Stellenbeschreibung
Job Description

As an AI Platform Engineer embedded within our Data Science and AI tribe, you will design and maintain the foundational infrastructure that enables our AI Software Engineers to build and scale generative AI applications.

You will build our internal AI provisioning platform, focusing on seamless model access, observability, and strict governance. In this role, you will ensure our AI integrations are secure, performant, and cost-effective, providing the robust backbone required for our agentic and LLM-driven workflows.

Responsibilities:

  • Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
  • Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
  • Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
  • Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
  • Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
  • Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
  • Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform).
  • Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker).
  • Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
  • Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog).
  • Strong problem-solving skills, a sense of humor, and the ability to thrive in an ego-free environment as an embedded platform expert within a cross-functional Data Science and AI team.


Additional Information

  • Be part of one of the fastest-growing and most visible Fintech startups in Europe, creating innovative services that have a substantial impact on the lives of our customers
  • Work with an international, diverse, inclusive, and ever-growing team that loves creating the best products for our clients
  • Be productive with the latest hardware and tools
  • Learn and grow by joining our in-house knowledge sharing or career development sessions and spending your individual Education Budget
  • Learn and experience German culture first hand by joining our free German language classes
  • International relocation support is provided if required
  • Opportunity to work from abroad
  • Benefit from an attractive compensation package and from the company pension scheme
  • Monthly contribution of 50% for the ‘Deutschland Jobticket’
  • Say goodbye to order commissions and say hello to your complimentary subscription of Scalable Capital's PRIME+ Broker
  • Enjoy flexible and discounted sports activities with Urban Sports Club
Jobalert für diese Suche erstellen

AI Platform Engineer (m/f/x) • München, Bavaria, Germany

Ähnliche Stellen

Solution Experte (m/w/d) für Conversational AI

E.ON Grid Solutions GmbHMünchen, Bayern, DE

Die Energiewelt ist auf dem Weg in eine neue Zukunft: digital, erneuerbar, dezentral und innovativ.Intelligente Netze und Kundenlösungen sind das Zukunftsgeschäft für eine nachhaltige Energiewelt v... Mehr anzeigen

 • Gesponsert

Junior AI Solutions Engineer (m/w/d)

Reply GroupMünchen, de

Junior AI Solutions Engineer (m/w/d).Als Junior AI Solutions Engineer (m/w/d) arbeitest du an der Entwicklung innovativer AI-Lösungen für unsere Kunden.Gleichzeitig baust du AI-Unterstützungen für ... Mehr anzeigen

 • Gesponsert

AI Technology Lead (m/f/d)

WSCAD electronic GmbHmünchen, bayern, Deutschland

Main place of work: Bergkirchen near Dachau.Engineering software is at a structural turning point.At WSCAD, we are building the next paradigm: AI-native engineering systems, where AI is not an add‑... Mehr anzeigen

 • Gesponsert

(Senior-)AI Engineer (m/w/d)

Atruvia AGAschheim (München), de

Für unser Geschäftsfeld Data, Security and Identity im Tribe Advanced Intelligence (DSIADI) suchen wir dich in Voll- oder Teilzeit ab 30 Wochenstunden als (Senior-) AI Engineer (m/w/d) in Karlsruhe... Mehr anzeigen

 • Gesponsert

Spezialist System Integration/ Agentic AI Process Designer (m/w/d) ANÜ

HOLZER FirmengruppeMünchen, Bayern, DE

Diese Position ist für Arbeitnehmerüberlassung.INNOVATION MEANS RETHINKING PROCESSES - DATA & AI FIRST.Artificial Intelligence and AI agents are transforming how processes are designed, execute... Mehr anzeigen

 • Gesponsert

Forward Deployed Engineer (m/w/d)

Mayflower GmbHmünchen, bayern, Deutschland

Die Mayflower GmbH baut Individualsoftware mit Fokus auf Generative AI – seit 1998 inhabergeführt.Wir bringen komplette AI-Infrastrukturen in Produktion: Model-Serving, Agent-Gateways, Chat und Voi... Mehr anzeigen

 • Gesponsert

AI/ML Engineer (m/w/d) – Generative AI + Legal AI

YPOGMünchen, Bayern, DE

YPOG ist eine führende Wirtschaftskanzlei für Rechts- und Steuerberatung mit einem starken Fokus auf Legal Tech, Legal AI und Innovation.Wir entwickeln digitale Lösungen und AI-Produkte, die unsere... Mehr anzeigen

(Senior) Data Engineer Data & AI (f/m/d)

E.ON Digital Technology GmbHMünchen, Bayern, DE

You have a passion for technology and want to make the world a greener place?.Join the forefront of energy transition with E.ON's Digital Technology organization, as part of our technology in-house... Mehr anzeigen

 • Gesponsert

AI Process & Agent Solutions Engineer (m/w/d)

GoHiring GmbHmünchen, bayern, Deutschland

München Festanstellung Veröffentlicht:.Gestalten Sie die Zukunft intelligenter Prozesse.Im Personalbereich entwickeln wir für unseren Automotive Kunden agentenbasierte Lösungen, die den Weg vom Pro... Mehr anzeigen

 • Gesponsert

Sr. Forward Deployed AI Engineer (Remote Eligible in Germany)

Smartsheetmünchen, bayern, Deutschland
Homeoffice

You independently lead the most complex AI deployments Smartsheet undertakes.You own the full engagement lifecycle from technical discovery through production deployment through solutions org hando... Mehr anzeigen

 • Gesponsert

Digital & Agentic AI Engineer (m/w/d)

ARRK Engineeringmünchen, bayern, Deutschland

Du möchtest echte KI‑ und Automatisierungslösungen erstellen statt nur über Ideen zu sprechen?.Bei uns entwickelst Du maßgeschneiderte KI‑ und Automatisierungslösungen, entwirfst moderne skalierbar... Mehr anzeigen

 • Gesponsert

Senior Data & AI Engineer (Munich, Germany)

D ONEmünchen, bayern, Deutschland

D ONE is a premium consultancy specialized in data, AI, and transformation.We help organizations turn ambition into impact—by aligning strategy, building strong data foundations, delivering high-im... Mehr anzeigen

 • Gesponsert

AI ENGINEER (m/f/d)

ProVI GmbHmünchen, bayern, Deutschland

The Obermeyer Group is a leading, independent German planning firm and has been an expert in comprehensive planning and specialized planning for over 60 years.Obermeyer provides planning services p... Mehr anzeigen

 • Gesponsert

AI Platform Engineer – Developer Tools & LLM Operations (all gender)

ALTEN Consulting Services GmbHmünchen, bayern, Deutschland

Die ALTEN Consulting Services GmbH bietet mit über 20 Jahren Branchenerfahrung ihren namhaften Kunden aus Industrie und Wirtschaft hochspezialisierte Engineering- und IT-Dienstleistungen zur gemein... Mehr anzeigen

 • Gesponsert

Forward Deployed Engineer - VC Backed Munich Start-Up

Oliver Bernardmünchen, bayern, Deutschland

I've partnered with one of the hottest start-ups in the EU, who are looking to scale rapidly and bring on highly-talented Forward Deployed Engineers.Their AI SaaS solution allows companies to strea... Mehr anzeigen

 • Gesponsert

AI Engineer – Generative AI & Automation (m/w/d)

JobiqoMünchen, Bayern, DE

Für unsere Northern Europe Unit (Belgien, Deutschland, Österreich und Schweiz) suchen wir einen AI Engineer (m/w/d), der unsere KI-Transformation aktiv mitgestaltet und innovative Lösungen entwicke... Mehr anzeigen

 • Gesponsert

Digital & Agentic AI Engineer (m/w/d)

Mitsui Chemicals Groupmünchen, bayern, Deutschland

Du möchtest echte KI‑ und Automatisierungslösungen erstellen statt nur über Ideen zu sprechen?.Bei uns entwickelst Du maßgeschneiderte KI‑ und Automatisierungslösungen, entwirfst moderne skalierbar... Mehr anzeigen

 • Gesponsert

AI Platform Engineer – Developer Tools & LLM Operations (all gender)

ALTEN Germanymünchen, bayern, Deutschland

Euro, Wochenstunden: 40 Stunden.Die ALTEN Consulting Services GmbH bietet mit über 20 Jahren Branchenerfahrung ihren namhaften Kunden aus Industrie und Wirtschaft hochspezialisierte Engineering- un... Mehr anzeigen