Senior DevOps Engineer

Compunnel, Inc.; San Francisco (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology solutions provider is seeking a Senior DevOps Engineer in San Francisco. You will build and maintain development platforms using data tools like Databricks and AWS. Responsibilities include defining CI/CD practices, managing data migration to the cloud, and collaborating with teams to align tech solutions with business strategies. Ideal candidates should have 5+ years in technical roles and experience with AWS and data governance tools.

Qualifications

• 5+ years of relevant technical experience, including 3+ years managing complex systems.
• Hands-on experience with Databricks or similar data processing platforms.
• Familiarity with data governance tools like Collibra and access control systems like Immuta.

Responsibilities

• Define and document best practices for CI/CD.
• Implement and configure data engineering tools within AWS environments.
• Evaluate and recommend new tools, technologies, and processes.

Skills

AWS cloud services

Databricks

Continuous Integration/Continuous Deployment (CI/CD)

Scripting languages

Collibra

Immuta

Starburst

Agile methodologies

Education

Bachelor’s degree in Computer Science or related field

Tools

Jenkins

Git

Jira

Maven

Job description

We are seeking a Senior DevOps Engineer to build and maintain development and product platforms using modern data tools such as Databricks, Immuta, Starburst, Collibra, and AWS.

This role plays a key part in migrating data and data management applications to the cloud, with a focus on reducing costs, improving user experience, and enhancing data value extraction to support business goals.

Key Responsibilities

• Define and document best practices for continuous integration and continuous deployment (CI/CD).
• Implement and configure data engineering tools (Databricks, Immuta, Starburst, Collibra) within AWS environments.
• Solve complex problems using scripting languages across multiple environments.
• Evaluate and recommend new tools, technologies, and processes to improve speed, efficiency, and scalability.
• Coach development teams on building scalable and maintainable applications.
• Conduct technical reviews and provide guidance to product and operations teams.
• Collaborate with cross-functional teams to align technology solutions with business strategies.
• Understand and manage dependencies across multiple platforms and applications.
• Implement and maintain security controls in accordance with organizational policies.
• Support data access control and governance through integration with Immuta and Collibra.

Required Qualifications

• Bachelor’s degree in Computer Science, Management Information Systems, or a related technical discipline (or equivalent experience).
• 5+ years of relevant technical experience, including 3+ years managing complex systems.
• Experience with AWS cloud services, particularly in data infrastructure.
• Hands-on experience with Databricks or similar data processing platforms.
• Familiarity with data governance tools like Collibra and access control systems like Immuta.
• Experience with distributed query engines such as Starburst.
• Proficiency with CI/CD tools (e.g., Jenkins, Maven).
• Strong scripting skills and experience with Linux operating systems.
• Experience with source control tools (e.g., Git, Bitbucket, AWS CodeCommit).
• Familiarity with artifact repositories (e.g., Maven, Nexus, Artifactory).
• Experience using Agile tools such as Jira or VersionOne.
• Strong automation, testing, and operational skills.

Preferred Qualifications

• Experience coaching teams on DevOps best practices.
• Familiarity with cloud-native security and compliance frameworks.