LLM Platform Engineer

About Medtronic

Medtronic is a global leader in healthcare technology with a Mission to alleviate pain, restore health, and extend life. Our 95,000 employees work across more than 150 countries to put patients first — developing innovative medical technologies that improve the lives of 72+ million patients each year. Your unique talents will help shape the future of healthcare while building a career grounded in purpose, growth, and impact.

About the Role

The AIOps LLM Platform Engineer works as part of a cross-functional team of platform architects, solution architects, engineers, and business stakeholders. This role involves applying industry best practices for designing, hosting, automating, securing, and operating enterprise AIOps and LLM platforms.

Responsibilities

• Participate in a global team of AIOps Architects, Platform Engineers, Automation Engineers, and IT Operations teams.
• Automate the provisioning, configuration, and lifecycle management of LLM runtimes, embedding pipelines, vector databases, and knowledge ingestion services.
• Deploy and manage LLM configurations, embedding models, prompt templates, runtime parameters, patching, and platform tools across environments using Ansible playbooks.
• Integrate ITSM and Service Catalog platforms (ServiceNow / First) with Terraform and Ansible to automate AI platform service requests and approvals.
• Provision and operate LLM, vector, and ingestion workloads on Kubernetes platforms (e.g., Tanzu, EKS, or equivalent) using IaC practices.
• Utilize monitoring and observability tools to track performance, availability, and health of AI platforms, including SolarWinds, Prometheus, Grafana, CloudWatch (where applicable), and custom scripts.
• Support enterprise-grade backup, recovery, retention, and purge strategies for vector data, metadata, and platform configurations.
• Collaborate with IT, Security, and Business partners to continuously improve platform reliability, scalability, performance, governance, and audit readiness.
• Demonstrate strong ownership, willingness to learn, and continuous improvement while supporting AI, automation, and AIOps technologies in an enterprise environment.