Site Reliability Engineer (SRE)

Veriipro; San Jose (CA); On-site; USD 100,000 - 140,000; Full time

Job summary

Veriipro is looking for a hands-on SRE Engineer located in San Jose, California. You will leverage your expertise in Apache Spark and Kubernetes to design and maintain real-time data pipelines. The ideal candidate should possess strong programming skills, particularly in Python and PL/SQL, and have experience with CI/CD pipelines using tools like Jenkins and Ansible.

This role emphasizes collaboration and leadership, with opportunities to mentor other engineers and oversee technical initiatives to enhance infrastructure reliability and performance.

Qualifications

• Expertise in Apache Spark and Kubernetes required.
• Hands-on experience in Python scripting and PL/SQL.
• Knowledge of CI/CD tools like Jenkins and Ansible.

Responsibilities

• Provide technical leadership to engineering teams.
• Design and maintain real-time data pipelines.
• Develop automation scripts and SQL procedures.
• Manage Docker containers and Kubernetes applications.

Skills

Python

PL/SQL

Apache Spark

CI/CD pipelines

Docker

Kubernetes

Jenkins

Ansible

SQL

Dynatrace

Tools

Dremio

Job description

We are seeking a hands‑on SRE Engineer with expertise in Apache Spark, Kubernetes, CI/CD pipelines, Python, PL/SQL, and containerization to design, develop, and maintain real‑time data processing and infrastructure. The ideal candidate will combine development skills with operational expertise to ensure high availability, scalability, and reliability of applications and infrastructure.

Roles and Responsibilities

• Provide technical leadership and guidance to engineering teams, participating in key technical decisions.
• Design, develop, and maintain real‑time data pipelines and Data Lakehouse infrastructure.
• Write Python scripts for automation and small functionality development.
• Write SQL queries and procedures for data processing.
• Build and maintain CI/CD pipelines using Jenkins and related tools.
• Manage applications in Kubernetes environments, including deployment, configuration, access control, and troubleshooting.
• Develop and maintain Kubernetes manifests, Helm charts, and deployment artifacts.
• Manage Docker containers, including image management in private registries.
• Maintain Apache Spark clusters and related workflows.
• Develop and maintain Ansible playbooks for infrastructure configuration and management.
• Implement Infrastructure as Code (IaC) and collaborate with teams to ensure consistent infrastructure management.
• Monitor services and infrastructure using observability tools for capacity management and performance tuning.
• Drive initiatives to containerize standalone applications and migrate them to Kubernetes.
• Mentor and guide other engineers in development, testing, and deployment practices.

Technical Skills

• Programming & Scripting: Python, PL/SQL
• Data & Processing: Apache Spark, SQL
• CI/CD & Automation: Jenkins, Ansible, CI/CD pipelines
• Containerization & Orchestration: Docker, Kubernetes (EKS/ECS experience a plus)
• Infrastructure & Deployment: Helm charts, IaC
• Monitoring & Observability: Dynatrace or similar monitoring/tracing tools
• Data Platforms: Dremio experience is a plus