Principal Data Operations Architect

Hut 8 Corp.; Miami (FL); Vor Ort; USD 90.000 - 140.000; Vollzeit

Zusammenfassung

Hut 8 Corp. in Miami, FL, seeks a Principal Data Operations engineer to build and operate data pipelines and analytics-ready data products. This individual-contributor role evolves into leading complex initiatives for seniors, with a focus on reliability, data quality, and governance.

You will own ingestion from APIs, SFTP, files, and databases, develop Airflow workflows, model data in BigQuery/Snowflake, and maintain cloud infrastructure. Strong Python, SQL, and CI/CD experience are essential.

Qualifikationen

• 3+ years in data engineering or a related field.
• Bachelor’s degree or equivalent experience.
• Strong Python and SQL skills.
• Experience with Airflow or Google Cloud Composer.
• Experience with BigQuery and Snowflake.
• Familiarity with Git, CI/CD, and automated testing.
• Linux and Bash familiarity.
• Experience integrating REST APIs, SFTP, scheduled files, or databases.
• Strong communication and cross-functional collaboration.

Aufgaben

• Translate business and stakeholder requirements into reliable, well-documented data pipelines and services.
• Build and maintain ingestion from APIs, SFTP endpoints, files, databases, and cloud services, including coordination with external providers.
• Develop and operate Airflow and Google Cloud Composer workflows, including dependencies, retries, backfills, and alerting.
• Model and deliver data across BigQuery, Snowflake, Cloud SQL/PostgreSQL, and Google Cloud Storage using dbt, data marts, and semantic-layer objects.
• Support the cloud infrastructure behind data products, including Cloud Run, container images, Artifact Registry, IAM, service accounts, and Secret Manager.
• Design pipelines for idempotency, safe reruns, recoverability, and failure containment, with freshness, reconciliation, schema, and completeness checks.
• Improve observability through logs, dashboards, alerts, and runbooks, and validate that downstream data products are complete and accurate.
• Own production support for data systems, resolving incidents through root-cause analysis and durable corrective actions.
• Apply least-privilege access, secure secrets management, and sensitive-data controls, and support access reviews and data-governance practices.
• Work within GitHub pull-request, testing, CI/CD, and change-management practices; at the Senior level, lead complex integrations, migrations, reliability initiatives, and technical reviews.

Kenntnisse

Python

SQL

Git/GitHub

Communication

Ausbildung

Bachelor’s degree in CS/Engineering/IS

Tools

Airflow

Google Cloud Composer

BigQuery

Snowflake

Cloud SQL/PostgreSQL

dbt

CI/CD

Jobbeschreibung

Hut 8 Corp. in Miami, FL, seeks a Principal Data Operations engineer to build and operate data pipelines and analytics-ready data products. This individual-contributor role evolves into leading complex initiatives for seniors, with a focus on reliability, data quality, and governance.

You will own ingestion from APIs, SFTP, files, and databases, develop Airflow workflows, model data in BigQuery/Snowflake, and maintain cloud infrastructure. Strong Python, SQL, and CI/CD experience are essential.