Senior AIOps Engineer at Porch Group in Seattle, WA

Job description

Porch Group is a leading vertical software and insurance platform and is positioned to be the best partner to help homebuyers move, maintain, and fully protect their homes. We offer differentiated products and services, with homeowners insurance at the center of this relationship. We differentiate and look to win in the massive and growing homeowners insurance opportunity by 1) providing the best services for homebuyers, 2) led by advantaged underwriting in insurance, 3) to protect the whole home. As a leader in the home services software-as-a-service (“SaaS”) space, we’ve built deep relationships with approximately 30 thousand companies that are key to the home-buying transaction, such as home inspectors, mortgage companies, and title companies. In 2020, Porch Group rang the Nasdaq bell and began trading under the ticker symbol PRCH. We are looking to build a truly great company and are JUST GETTING STARTED. Job Title: Senior AIOps Engineer I Location: United States Workplace Type: Remote Job Summary The future is bright for the Porch Group, and we’d love for you to be a part of it as our Senior AIOps Engineer I. In this role, you will partner with product managers, platform engineers, data scientists, and machine learning engineers to make sure our AI and ML-powered systems are reliable, observable, secure, and cost-efficient in production. You will focus on how AI systems run in the real world: monitoring model performance and drift, keeping deployment pipelines robust, managing incidents, and standing up new AI infrastructure. Our AI/ML stack is built on Python and runs on Kubernetes (GKE) and Google Cloud Platform, using tools such as Union Cloud (Flyte), BentoML, Feast, Label Studio, BigQuery, and Dataflow. On the GenAI side, we operate a centralized LLM routing and gateway service, run batch prediction services for large-scale inference, and are building out RAG infrastructure. You will help evolve this stack so teams can ship AI features quickly and safely. What You Will Do As A Senior AIOps Engineer I Own production reliability for AI/ML services by monitoring availability and performance, defining SLOs and SLIs (latency, error rates, model performance) tied to user experience and business impact, and owning recurring model refresh cycles (retraining, validation, and redeployment) to prevent staleness and drift. Design and implement monitoring, logging, and alerting for models and data pipelines, and integrate model and system metrics with existing observability stacks and dashboards (Datadog, Opik, and others). Streamline deployment workflows with data scientists and ML engineers (blue/green, canary, A/B, and shadow deployments), improve CI/CD pipelines and release processes for AI services, and support the productionization of image-based ML models, including batch prediction workflows. Provision, deploy, configure, and maintain new AI infrastructure as it is adopted, including AI gateways, RAG platforms, LLM observability tools, agentic workflows, and no-code agent builders, using tools such as Union Cloud, BentoML, Feast, Kubernetes, Terraform, and GCP services. Build automation and tooling to reduce manual operational work around model promotion, configuration, environment management, and Docker image maintenance, and support multi-BU infrastructure provisioning (separate environments, projects, roles, and CI/CD integrations). Own the operational health of Label Studio, our production data annotation platform, including supporting GCS buckets, BigQuery pipelines, and database and SSO dependencies, and supporting bi-weekly annotation project cycles. Stand up and operate RAG and vector database infrastructure, including embedding pipelines and context retrieval APIs, and optimize embedding storage and retrieval performance at scale. Monitor and optimize LLM token usage and costs across providers, maintain centralized cost tracking dashboards and alerting across business units, and recommend cost-efficient model rou