Senior DevOps Engineer

Compunnel Inc.; San Francisco (CA); In loco; USD 180.000 - 240.000; Tempo pieno

Descrizione del lavoro

Compunnel Inc. in San Francisco, CA seeks a Senior DevOps Engineer for a 1-year contract to design and run scalable data pipelines and cloud platforms. You will implement CI/CD and governance with Databricks, Immuta, Starburst, Colllibra within AWS, while mentoring developers and aligning tech with business goals.

You will optimize security, automate operations, and collaborate across teams to deliver reliable data services and cost efficiencies through modern data tools.

Competenze

• Bachelor's degree in Computer Science, MIS, or comparable technical discipline (or equivalent combination of education and experience).
• 5+ years of relevant technical experience with 3+ years managing complex systems.
• Experience with AWS multi-region, resilient cloud services, particularly around data infrastructure required.
• Extensive hands-on experience with CI/CD pipelines tools such as Jenkins and Maven required.
• Experience with Databricks or similar data processing platforms.
• Knowledge of data governance tools like Collibra and data access control systems like Immuta.
• Experience with distributed query engines like Starburst.
• Proficiency in scripting languages and Linux operating systems.
• Experience with source control tools like Git, BitBucket, or AWS CodeCommit.
• Familiarity with binary/artifact repositories like Maven, Nexus, or Artifactory.
• Experience with Agile tools such as Jira or VersionOne.
• Strong automation, testing, and operational skills.

Mansioni

• Define and document continuous integration/continuous deployment best practices.
• Implement and configure data engineering tools including Databricks, Immuta, Starburst, and Collibra within AWS environments.
• Solves complex problems with scripting languages across multiple environments.
• Evaluate new tools, technologies, and processes to improve speed, efficiency, and scalability.
• Coach application developers on proper techniques for building scalable applications.
• Conduct spot checks of product teams to help developers and operations teams.
• Work with partners across all business functions to align technology solutions with business strategies.
• Understand dependencies across multiple platforms and applications.
• Implement and maintain security in accordance with Bank security policies.
• Support data access control and governance through Immuta and Collibra integration.

Conoscenze

CI/CD

Scripting

Linux

Collaboration

Agile

Formazione

Bachelor's degree in Computer Science or MIS

Strumenti

Databricks

Immuta

Starburst

Collibra

AWS

Jenkins

Maven

Git

Bitbucket

AWS CodeCommit

Nexus

Artifactory

Jira

VersionOne

Descrizione del lavoro

plaintext

JOB SUMMARY

Contract Sr. DevOps Engineer roles for one year assignments to implement and manage data products, ensuring that our data pipelines are scalable, secure, and efficient. Building and maintaining product and development platforms, leveraging modern data tools including Databricks, Immuta, Starburst, Collibra, and AWS. Playing a critical role in the mission to move data and data management applications to the cloud to reduce costs, improve user experiences, and enhance data value extraction to drive business goals.

Key Responsibilities

• Define and document continuous integration/continuous deployment best practices.
• Implement and configure data engineering tools including Databricks, Immuta, Starburst, and Collibra within AWS environments.
• Solves complex problems with scripting languages across multiple environments.
• Evaluate new tools, technologies, and processes to improve speed, efficiency, and scalability.
• Coach application developers on proper techniques for building scalable applications.
• Conduct spot checks of product teams to help developers and operations teams.
• Work with partners across all business functions to align technology solutions with business strategies.
• Understand dependencies across multiple platforms and applications.
• Implement and maintain security in accordance with Bank security policies.
• Support data access control and governance through Immuta and Collibra integration.

Required Qualifications

• Bachelor's degree in Computer Science, Management Information Systems, or comparable technical discipline (or equivalent combination of education and experience).
• 5+ years of relevant technical experience with 3+ years managing complex systems.
• Experience with AWS multi-region, resilient cloud services, particularly around data infrastructure required.
• Extensive hands-on experience with CI/CD pipelines tools such as Jenkins and Maven required.
• Experience with Databricks or similar data processing platforms.
• Knowledge of data governance tools like Collibra and data access control systems like Immuta.
• Experience with distributed query engines like Starburst.
• Proficiency in scripting languages and Linux operating systems.
• Experience with source control tools like Git, BitBucket, or AWS CodeCommit.
• Familiarity with binary/artifact repositories like Maven, Nexus, or Artifactory.
• Experience with Agile tools such as Jira or VersionOne.
• Strong automation, testing, and operational skills.