Experience: 8+ years
* Design and build scalable, distributed data platform systems
* Own Databricks workspace architecture, governance, and lifecycle management
* Implement infrastructure as code using Terraform/Terramate
* Build and support end-to-end data pipelines, from ingestion to analytics and ML
* Develop and maintain CI/CD pipelines for infrastructure, data pipelines, notebooks, SQL, and ML artifacts
* Operate and optimize Amazon EKS clusters supporting data workloads
* Define and monitor SLIs/SLOs for platform reliability and data quality
* Drive innovation and continuous improvement across platform architecture and tooling
* Lead incident response, on-call rotations, and blameless post-mortems
* Implement strong security, compliance, and governance controls
* Mentor engineers and influence platform standards and best practices
* Proven experience designing complex, distributed data systems end-to-end
* Strong system design skills across cloud infrastructure, data pipelines, storage, governance, and observability
* Ability to evaluate and communicate architectural trade-offs (scalability, reliability, cost, security, operability)
* Introducing new architectural patterns or platform capabilities
* Improving reliability, performance, or developer experience through design
* 8+ years building and operating large-scale cloud platforms
* Expert-level experience with AWS, including networking, IAM, security, and multi-account environments
* Strong hands-on experience with Databricks Lakehouse Platform, including:
* Experience owning Databricks workspace architecture and governance
* Deep experience with Terraform/Terramate (or similar IaC tools)
* Proven experience building CI/CD pipelines (GitHub Actions, Jenkins)
* Hands-on experience managing Amazon EKS clusters and Helm deployments
* Experience defining and operating SLIs/SLOs for platform reliability and data quality
* Experience supporting SOX, GDPR, or regulated environments
* AWS Certified DevOps Engineer - Professional (or equivalent experience)
* Strong communication skills to explain complex system designs to technical and non-technical stakeholders
* Experience with Acceldata, OpenTelemetry, or data observability tools
* Experience with Fivetran Hybrid / HVR or enterprise ingestion tools
* Experience working with Hashicorp vault or similar secret management tools
* Experience working with static Code analysis tool like Sonar
* Databricks serverless compute optimization and cost management
* Experience driving platform strategy across multiple teams distributed globally
Search Data Platform Engineer, Senior Staff jobs near San Diego, CA → Browse all live jobs
This posting was published by Qualcomm on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.