At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Senior AI DevOps / LLMOps specialist to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.
Key Responsibilities
Automation of Build-to-Production
- Design and implement robust CI/CD pipelines tailored for AI, covering model weights,
dataset versioning, and application code.
- Develop specialized workflows for PromptOps, ensuring that system prompts are
version-controlled, tested for regressions, and deployed with the same rigor as traditional
code.
-Automate the deployment of Agentic workflows, managing the complexities of stateful
AI interactions and multi-agent handoffs.
2. AI Infrastructure as Code (IaC)
- Provision and manage high-performance compute environments (GPU clusters, TPU
pods) using Terraform, Pulumi, or Ansible.
- Define and enforce Policy-as-Code for AI endpoints to ensure compliance with security,
cost-usage limits, and data residency requirements.
- Maintain a consistent environment across Hybrid Infrastructure, ensuring seamless
parity between On-Premises development and Cloud production.
3. Safe Experimentation & Controlled Releases
- Architect Progressive Delivery strategies for AI, including Canary releases, Blue-Green
deployments, and Shadowing (where new models run in parallel with production to
compare outputs).
- Build “Evaluation-in-the-Loop” gates within the pipeline to automatically test for bias,
hallucination, and performance degradation before a release.
- Implement A/B testing frameworks specifically designed for LLM outputs and agentic
behavior.
4. Monitoring & Observability
- Establish deep observability into Inference Endpoints, tracking metrics like tokens-per-
second, latency, and drift in model accuracy.
-Integrate feedback loops that capture production “edge cases” to feed back into the
training and fine-tuning pipelines.
Must-Have Technical Skills:
-Orchestration: Advanced Kubernetes (K8s) skills, specifically with KubeFlow, Ray, or
NVIDIA Triton.
-CI/CD & IaC: Expertise in GitHub Actions/GitLab CI, and Terraform or Pulumi.
- AI Tooling: Experience with Weights & Biases, MLflow, LangSmith, or Arize
Phoenix.
-Hardware: Understanding of GPU virtualization, CUDA drivers, and on-premises
hardware management.
-Security: Familiarity with Open Policy Agent (OPA) and secret management (Vault).
Experience:
- 10+ years in DevOps, SRE, or Cloud Engineering.
- 2+ years of hands-on experience in MLOps or LLMOps, specifically moving LLMs
from notebook to production.
-Proven experience managing Hybrid Cloud environments (e.g., AWS/Azure + Private
Data Center).
Senior AI DevOps / LLMOps • Aachen, NW, DE
For more than two decades, NVIDIA has pioneered visual computing, the art and science of computer graphics.With our invention of the GPU - the engine of modern visual computing - the field has expa... Mehr anzeigen
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Mehr anzeigen
Job Description Job Summary: Is DevOps more to you than just configuring AWS and VMs to run the quick unit tests of web services? Do you enjoy creating tailored solutions for complex throughput pro... Mehr anzeigen
Senior Hardware Compute Architect.Define the hardware architecture of a hybrid compute engine, including execution units (scalar, vector, tensor/matrix), memory hierarchy, memory tiering strategies... Mehr anzeigen
Höre hinter die Kulissen von mgm und erfahre mehr über die Aufgaben einer/s DevOps:.Falls sich der Podcast hier nicht abspielen lässt, schaue gern auf unsere Karriere-Seite unter der Kategorie „Pod... Mehr anzeigen
We see the semiconductor industry as a realm of possibility.We see the profound impact that our graphene solutions will have in transforming the industry.We invite you to join us in driving change ... Mehr anzeigen
Architekturdesign: End-to-End-Architekturen mit SAP AI Core/Launchpad, Joule Studio (Skills, Agents) und SAP BTP konzipierst und integrierst du nahtlos in S/4HANA-Landschaften.Multi-Agenten & RAG: ... Mehr anzeigen
Deal-Verantwortung: End-to-End übernimmst du Verantwortung für Lösungen, Storyline und strategische Ausrichtung von SAP-Angebotsprojekten.Orchestrierung: Du orchestrierst 1 bis 5 Practices bzw.Disz... Mehr anzeigen
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Mehr anzeigen
MachineWare is an innovative and fast-growing start-up spun out of the Institute of Communication Technologies and Embedded Systems at RWTH Aachen University in 2022.We specialize in high-performan... Mehr anzeigen
We see the semiconductor industry as a realm of possibility.We see the profound impact that our graphene solutions will have in transforming the industry.We invite you to join us in driving change ... Mehr anzeigen
Design, build, and integrate AI-powered services, APIs, workflows, and automation capabilities.Develop agentic workflows and AI orchestration patterns that can be used by Deluxe applications and in... Mehr anzeigen
Anforderungen aufnehmen & Lösungen designen: Workshops und Anforderungsanalysen führst du initial durch, erstellst Spezifikationen und entwirfst belastbare Lösungsarchitekturen – immer mit Blick au... Mehr anzeigen
Would you like to play a critical part in the next revolution of human‑computer interaction? The Apple Machine Translation team is building groundbreaking technology that enables connecting people ... Mehr anzeigen
Senior DevOps Engineer - Aachen area - Up to €90,000 (d / m / f).Contribute to the ongoing evolution of the global IT landscape by improving architecture, processes, and infrastructure services.Del... Mehr anzeigen
Die GRÜN Software Group entwickelt seit Jahrzehnten Unternehmens-Branchensoftware für Institutionen sowie Unternehmen aus den Bereichen Handel, Medien und Industrie.So entwickeln wir hochfunktional... Mehr anzeigen
Systems Architect (w/m/d) for AI, Automation and Data Platforms.KLUGE KÖPFE BEI DER REGIO IT – SCHLIEßE DICH UNS AN!.Die regio iT GmbH ist der ideale IT-Partner für öffentliche Auftraggeber: für Ko... Mehr anzeigen
Senior Software Compute Architect.Black Semiconductor to own the software architecture enabling our next-generation hybrid electronic/photonic compute engine.You will define the programming model, ... Mehr anzeigen
We see the semiconductor industry as a realm of possibility.We see the profound impact that our graphene solutions will have in transforming the industry.We invite you to join us in driving change ... Mehr anzeigen
AZAV zertifizierter Bildungsträger mit klarem Fokus auf Projektmanagement und Künstliche Intelligenz.Unsere praxisnahen Weiterbildungen bereiten dich gezielt auf den nächsten Karriereschritt vor – ... Mehr anzeigen
