DevOps Engineer with Big Data Skills

WhiteBIT; United States; Remote; USD 130,000 - 180,000; Full time

Benefits offered by this job

Paid leave (24 days)

Holidays off

Job summary

WhiteBIT is seeking a DevOps Engineer with Big Data skills to own and optimize our data and analytics infrastructure. You will design and maintain scalable pipelines, implement infrastructure as code with Terraform, Ansible, and Helm, and ensure secure, efficient data processing across ClickHouse, Snowflake/Redshift, and Lake storage.

The role requires collaboration with data engineers and analysts to deliver robust data platforms.

Qualifications

• Experience building and running data or analytics infrastructure.
• Translation of data security into practical controls and automation.
• Hands-on with ClickHouse and Hadoop ecosystem.
• Experience with Snowflake or Redshift data warehouses.
• Strong SQL and Python/Bash scripting for automation.

Responsibilities

• Own data and analytics infrastructure end-to-end.
• Implement IaC for data infrastructure (Terraform, Ansible, Helm).
• Maintain CI/CD pipelines for data code and infrastructure.
• Manage multi-terabyte data warehouses and data lake storage.
• Tune performance and control costs for clusters and warehouses.
• Collaborate with data engineers, analysts, and developers.

Skills

Python

Bash

SQL

Data security

IaC

CI/CD

Linux admin

Data pipelines

Tools

Terraform

Ansible

Helm

GitLab CI

GitHub Actions

Jenkins

ArgoCD

Docker

Kubernetes

Job description

We are the creators of a new fintech era!

Our mission is to change this world by making blockchain accessible to everyone in everyday life. WhiteBIT is a global team of over 1,200 professionals united by one mission - to shape the new world order in the Web3 era. Each of our employees is fully engaged in this transformative journey.

We work on our blockchain platform, providing maximum transparency and security for more than 8 million users worldwide. Our breakthrough solutions, incredible speed of adaptation to market challenges, and technological superiority are the strengths that take us beyond ordinary companies. Our official partners include the National Football Team of Ukraine, FC Barcelona, Lifecell, FACEIT and VISA.

The future of Web3 starts with you: join us as a DevOps Engineer with Big Data Skills!

Requirements

We're looking for a DevOps engineer with 4+ years of hands-on experience, at least 2 of them spent building and running data or analytics infrastructure. You've designed systems that move, store, and serve data at scale. Warehouse maintenance is part of your daily routine, and writing Python, Bash, or SQL scripts is second nature. You treat data security as a core responsibility: you protect confidentiality, enforce zero-trust, least-privilege access, and automate everything you touch. Solid IaC skills are a must.

• IaC & CI/CD: Production experience with Terraform, Ansible, and Helm, plus CI/CD systems (GitLab CI, GitHub Actions, Jenkins, or ArgoCD). We expect you to design pipelines, not just use them.
• Containerization: Working knowledge of Docker and Kubernetes, including running data workloads on it (like Spark on Kubernetes, stateful services, operators).
• Cloud: Solid experience with AWS (S3, EC2, EMR, Redshift, Glue, IAM) or an equivalent cloud provider.
• Linux & Networking: Solid Linux administration skills and foundational networking knowledge relevant to distributed systems.
• Analytical Databases: Hands-on operation of ClickHouse and/or the Hadoop ecosystem (HDFS, Hive, YARN), including cluster setup, tuning, and scaling.
• Data Warehouses: Practical experience with Snowflake or Redshift, covering warehouse sizing, workload management, performance tuning, and cost control.
• Large Databases: Experience administering databases at terabyte scale: replication, backup and restore strategies, partitioning, and migrations with minimal downtime.
• SQL & Scripting: Strong SQL skills, including reading execution plans and optimizing heavy queries. Confident in Python and Bash for automation, data parsing, and investigation.
• Data Lakes & Object Storage: Working knowledge of S3-compatible storage, columnar formats, partitioning strategies, and data lifecycle management.
• Orchestration & Streaming: Familiarity with Airflow (or similar orchestrators) and Kafka, and how they fit into data pipelines.

Extra Credit / Big Pluses

• Experience with Tableau, Power BI, Looker, Superset, or similar BI tools, including administration, performance tuning, and data source design.
• Hands-on experience with dbt and analytics engineering practices.
• Experience with open table formats (Apache Iceberg, Delta Lake, Hudi) and query engines like Trino/Presto or Athena.
• FinOps experience in data platforms: managing Snowflake credits, Redshift clusters, and storage costs at scale.
• Spark performance tuning and job optimization.
• Change data capture (CDC) with Debezium or similar tools.
• Data quality tooling (Great Expectations, Soda) integrated into CI/CD.
• Golang or Rust tooling experience.
• Knowledge of data governance and compliance (GDPR, data retention, PII handling).
• Understanding of business processes in the FinTech/Banking/Crypto sector.

Responsibilities

• Infrastructure Ownership: Own the infrastructure behind our data and analytics platform, from provisioning to daily operations. Keep it reliable, scalable, and cost-efficient as data volumes grow.
• Infrastructure as Code: Provision and configure all data infrastructure with Terraform, Ansible, and Helm.
• CI/CD Pipelines: Build and maintain delivery pipelines for both infrastructure and data code (ETL jobs, Airflow DAGs, dbt models, schema migrations), with automated testing, safe rollouts, and fast rollback.
• Database & Warehouse Operations: Maintain ClickHouse, Snowflake, Redshift, and вPostgreSQL at multi-terabyte scale, handling replication, backups, upgrades, capacity planning, and disaster recovery.
• Data Lake Storage: Manage S3-compatible data lake storage, including partitioning, file formats, and lifecycle policies.
• Automation & Script Optimization: Refactor and automate Python, Bash, and SQL scripts to cut runtimes and eliminate manual work.
• Performance & Cost: Right-size clusters and warehouses, tune heavy queries, and keep compute and storage spend under control.
• Monitoring & Alerting: Cover data infrastructure with metrics, logs, and alerts for cluster health, pipeline SLAs, and job failures.
• Security & Access Control: Enforce least-privilege access, secrets management, encryption, and auditability for sensitive data.
• BI Infrastructure: Support the infrastructure behind Tableau or similar BI tools.
• Big Data Platforms: Deploy, tune, and troubleshoot Hadoop, Spark, and Kafka clusters in production.
• Collaboration: Work with data engineers, analysts, and developers to turn their workloads into solid infrastructure decisions.
• Security & Access Control: Implement role-based access, secrets management, encryption at rest and in transit, and auditability for sensitive datasets in line with regulatory requirements.

Working terms

Immerse yourself in Crypto & Web3:

• Master cutting-edge technologies and become an expert in the most innovative industry.

Work with the Fintech of the Future:

• Develop your skills in digital finance and shape the global market.

Take Your Professionalism to the Next Level:

• Gain unique experience and be part of global transformations.

Drive Innovations:

• Influence the industry and contribute to groundbreaking solutions.

Join a Strong Team:

• Collaborate with top experts worldwide and grow alongside the best.

Work-Life Balance & Well-being:

• Modern equipment.
• Comfortable working conditions, and an inspiring environment to help you thrive.
• 24 calendar days of paid leave.
• Additional days off for national holidays.

With us, you'll dive into the world of unique blockchain technologies, reshape the crypto landscape, and become an innovator in your field. If you're ready to take on challenges and join our dynamic team.

Let's Build the Future Together!

WhiteBIT offers all candidates an equal opportunity to join the team. All hiring decisions are made without regard to race, national origin, gender identity or sexual orientation, age, religion, disability, medical condition, marital status, familial status, veteran status, or any other legally protected characteristic of an individual.