Platform Engineer (DataOps)

blackcanyonconsulting; United States; Hybrid; USD 115,000 - 150,000; Full time

Job summary

blackcanyonconsulting seeks a DataOps Engineer to help design and operate a shared DataOps platform for teams handling large-scale data services. The role emphasizes cloud-native infrastructure, reusable tools, and enabling developers to adopt reliable, secure workflows that support continuous improvement.

The candidate will build and improve the platform, evaluate new technologies, support development teams, and deliver automated compliance pipelines for federal security requirements.

Qualifications

• Strong programming skills in Python or C++.
• Experience with Kubernetes and containerization.
• Familiarity with GCP, AWS, or Azure.
• Experience with Kafka, Pub/Sub, or similar messaging service, and Airflow or comparable workflow tool.
• Knowledge of data processing applications and modern cloud-based data infrastructure.
• Linux command-line skills and a STEM degree or equivalent systems engineering experience.

Responsibilities

• Build and continuously improve the DataOps platform and its shared tools and libraries.
• Assess new technologies and practices for platform and data processing needs.
• Support development teams as they adopt platform capabilities.
• Deliver automated solutions and compliance pipelines for federal application security requirements.
• Participate in agile delivery and team process improvement.

Skills

Kubernetes

Python

C++

Cloud platforms

Kafka / Pub/Sub

Airflow

Linux CLI

Data processing concepts

Education

STEM degree or equivalent

Tools

Docker

Job description

Role overview

Help create and operate a shared DataOps platform for teams working with large-scale data services. The role focuses on cloud-native infrastructure, reusable tools, and helping developers adopt reliable workflows that support security compliance and continuous improvement.

Responsibilities

• Build and continuously improve the DataOps platform and its shared tools and libraries.
• Assess new technologies and practices for platform and data processing needs.
• Support development teams as they adopt platform capabilities.
• Deliver automated solutions and compliance pipelines for federal application security requirements.
• Participate in agile delivery and team process improvement.

Requirements

• Strong programming skills in at least one language, such as Python or C++.
• Experience with Kubernetes and containerization.
• Familiarity with a cloud provider such as GCP, AWS, or Azure.
• Experience with Kafka, Pub/Sub, or a similar messaging service, and Airflow or a comparable workflow tool.
• Knowledge of data processing applications and modern cloud-based data infrastructure.
• Linux command-line skills and a STEM degree or equivalent systems engineering experience.

Nice to have

• Experience with Docker, GitOps, infrastructure as code, source control and CI/CD platforms, artifact management, observability, logging, secrets management, data transfer, or streaming systems. Agile experience and familiarity with sound design and architecture practices are also useful.

Benefits and work setup

This is a full-time opportunity with onsite and/or remote work in the Bethesda, Maryland area. The stated target salary range is $115,000–$150,000, based on experience and location. Benefits include medical, dental and vision coverage, an employer-supported retirement plan, paid holidays and vacation, flexible scheduling, and tuition reimbursement.