Data-Driven DevOps Engineer (Remote)

FirstMessage; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

FirstMessage is seeking a DevOps Engineer focused on data to strengthen our data engineering team. You will design and maintain reliable, scalable data infrastructure powering trading research and production systems.

Responsibilities include ETL automation, data storage on AWS, and observability for data quality and pipelines. You will collaborate with data engineers to enable versioning, deployment, and efficient data workflows, using Python, Bash, Ansible, and GitLab CI/CD.

Qualifications

• 5+ years in a DevOps/DataOps role with hands-on data infra.
• Strong Linux knowledge: networking, kernel tuning, performance.
• Hands-on with Airflow, ClickHouse, DBT, Spark, Project Nessie.
• Solid AWS knowledge: S3, EC2, IAM, networking.
• Scripting/automation in Python, Bash, Ansible.
• Experience with CI/CD pipelines (GitLab).
• Experience with monitoring stacks (Prometheus, Grafana, ELK).
• Familiarity with containers/orchestration (Docker, Kubernetes).
• Understanding of data governance concepts.
• Strong communication and ownership mindset.

Responsibilities

• Design, implement, and maintain DevOps tooling for data pipelines and data platforms.
• Support and automate ETL workflows (e.g. Spark, Airflow).
• Build and manage monitoring and observability for data quality, pipelines, and storage.
• Implement and maintain data storage infrastructure on AWS (S3, EC2, networking).
• Integrate and support Project Nessie as a transactional catalog for Data Lakes with Git-like semantics.
• Work closely with Data Engineers to ensure smooth deployment and scaling of data jobs.

Skills

DevOps experience

Linux knowledge

Scripting

CI/CD

Monitoring

Containerization

Data infrastructure

Security best practices

Communication skills

Ownership mindset

Tools

Airflow

ClickHouse

DBT

Spark

GitLab

Prometheus

Grafana

ELK

Docker

Kubernetes

Terraform

Job description

FirstMessage is seeking a DevOps Engineer focused on data to strengthen our data engineering team. You will design and maintain reliable, scalable data infrastructure powering trading research and production systems.

Responsibilities include ETL automation, data storage on AWS, and observability for data quality and pipelines. You will collaborate with data engineers to enable versioning, deployment, and efficient data workflows, using Python, Bash, Ansible, and GitLab CI/CD.