Data Operations, Principal

Hut 8 Corp.; Miami (FL); In loco; USD 90.000 - 140.000; Tempo pieno

Descrizione del lavoro

Hut 8 Corp. in Miami, FL, seeks a Principal Data Operations engineer to build and operate data pipelines and analytics-ready data products. This individual-contributor role evolves into leading complex initiatives for seniors, with a focus on reliability, data quality, and governance.

You will own ingestion from APIs, SFTP, files, and databases, develop Airflow workflows, model data in BigQuery/Snowflake, and maintain cloud infrastructure. Strong Python, SQL, and CI/CD experience are essential.

Competenze

• 3+ years in data engineering or a related field.
• Bachelor’s degree or equivalent experience.
• Strong Python and SQL skills.
• Experience with Airflow or Google Cloud Composer.
• Experience with BigQuery and Snowflake.
• Familiarity with Git, CI/CD, and automated testing.
• Linux and Bash familiarity.
• Experience integrating REST APIs, SFTP, scheduled files, or databases.
• Strong communication and cross-functional collaboration.

Mansioni

• Translate business and stakeholder requirements into reliable, well-documented data pipelines and services.
• Build and maintain ingestion from APIs, SFTP endpoints, files, databases, and cloud services, including coordination with external providers.
• Develop and operate Airflow and Google Cloud Composer workflows, including dependencies, retries, backfills, and alerting.
• Model and deliver data across BigQuery, Snowflake, Cloud SQL/PostgreSQL, and Google Cloud Storage using dbt, data marts, and semantic-layer objects.
• Support the cloud infrastructure behind data products, including Cloud Run, container images, Artifact Registry, IAM, service accounts, and Secret Manager.
• Design pipelines for idempotency, safe reruns, recoverability, and failure containment, with freshness, reconciliation, schema, and completeness checks.
• Improve observability through logs, dashboards, alerts, and runbooks, and validate that downstream data products are complete and accurate.
• Own production support for data systems, resolving incidents through root-cause analysis and durable corrective actions.
• Apply least-privilege access, secure secrets management, and sensitive-data controls, and support access reviews and data-governance practices.
• Work within GitHub pull-request, testing, CI/CD, and change-management practices; at the Senior level, lead complex integrations, migrations, reliability initiatives, and technical reviews.

Conoscenze

Python

SQL

Git/GitHub

Communication

Formazione

Bachelor’s degree in CS/Engineering/IS

Strumenti

Airflow

Google Cloud Composer

BigQuery

Snowflake

Cloud SQL/PostgreSQL

dbt

CI/CD

Descrizione del lavoro

The Principal Data Operations builds and operates the systems that move Hut 8’s business and operational data from source systems into reliable, secure, analytics-ready data products. This includes source integrations, API and SFTP ingestion, ETL (Airflow) orchestration, data transformation, warehousing, cloud infrastructure configuration, monitoring, data quality, and production support. This is an individual-contributor role. Principal Data Operations candidates will deliver work within established patterns and grow their ownership of production systems. Senior candidates will lead complex technical initiatives, improve standards, and provide technical guidance through design and code review.

What You'll Do

• Translate business and stakeholder requirements into reliable, well-documented data pipelines and services.
• Build and maintain ingestion from APIs, SFTP endpoints, files, databases, and cloud services, including coordination with external providers.
• Develop and operate Airflow and Google Cloud Composer workflows, including dependencies, retries, backfills, and alerting.
• Model and deliver data across BigQuery, Snowflake, Cloud SQL/PostgreSQL, and Google Cloud Storage using dbt, data marts, and semantic-layer objects.
• Support the cloud infrastructure behind data products, including Cloud Run, container images, Artifact Registry, IAM, service accounts, and Secret Manager.
• Design pipelines for idempotency, safe reruns, recoverability, and failure containment, with freshness, reconciliation, schema, and completeness checks.
• Improve observability through logs, dashboards, alerts, and runbooks, and validate that downstream data products are complete and accurate.
• Own production support for data systems, resolving incidents through root-cause analysis and durable corrective actions.
• Apply least-privilege access, secure secrets management, and sensitive-data controls, and support access reviews and data-governance practices.
• Work within GitHub pull-request, testing, CI/CD, and change-management practices; at the Senior level, lead complex integrations, migrations, reliability initiatives, and technical reviews.

About You

• 3+ years of experience in data engineering, software engineering, DataOps, or a related field; 5+ years for Senior level.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent experience.
• Strong Python and SQL skills.
• Experience with Airflow or Google Cloud Composer.
• Experience with BigQuery, Google Cloud Storage, and Snowflake.
• Familiarity with Git, GitHub, pull requests, automated testing, and CI/CD.
• Linux and Bash familiarity.
• Experience integrating REST APIs, SFTP, scheduled files, or databases.
• Understanding of data quality, freshness, reconciliation, schema evolution, and monitoring.
• Strong communication and cross-functional collaboration skills.

Preferred Qualifications

• 3+ years of experience in data engineering, software engineering, DataOps, or a related field; 5+ years for Senior level.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent experience.
• Strong Python and SQL skills.
• Experience with Airflow or Google Cloud Composer.
• Experience with BigQuery, Google Cloud Storage, and Snowflake.
• Familiarity with Git, GitHub, pull requests, automated testing, and CI/CD.
• Linux and Bash familiarity.
• Experience integrating REST APIs, SFTP, scheduled files, or databases.
• Understanding of data quality, freshness, reconciliation, schema evolution, and monitoring.
• Strong communication and cross-functional collaboration skills.

Nice to Haves:

• Experience with dbt, data modeling, data marts, metadata, lineage, or semantic layers.
• Experience with Cloud Run, Artifact Registry, IAM, Secret Manager, Docker, or service accounts.
• Experience with Cloud SQL/PostgreSQL or time-series data.
• Experience with Grafana, Tableau, Metabase, or similar reporting tools.
• Experience with finance, operational telemetry, infrastructure monitoring, or other time-series data.
• Experience with data governance, access reviews, and sensitive-data handling.
• Experience leading technical initiatives or mentoring peers for the Senior level.

About the Work Environment

This role is in office at our corporate headquarters in the Brickell area of Miami, Florida. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.