Remote Data Engineer - Cloud Pipelines & ML

Eliassen Group; Hartford (CT); A distancia; USD 83.000 - 96.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical benefits

Dental benefits

Vision benefits

401k with company matching

Life insurance

Descripción de la vacante

Eliassen Group is hiring a Data Engineer for a remote contract role. You will design, build, and maintain scalable data pipelines using Kafka and Databricks, with a focus on modernizing data assets across SQL/NoSQL and real-time streaming platforms.

You will develop ML feature engineering pipelines using Vertex AI and BigQuery ML, implement automated testing and CI/CD, and own the data stack across Azure and GCP.

Formación

• 4+ years professional data development experience.
• Experience with SQL and NoSQL technologies.
• 3+ years building data pipelines and workflows.
• 2+ years developing with Python.
• Experience with feature engineering for ML pipelines.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with Git version control.

Responsabilidades

• Design, build, and maintain scalable data pipelines using Kafka and Databricks.
• Modernize and extend data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop and manage feature engineering pipelines for ML using Vertex AI and BigQuery ML.
• Design and implement automated testing frameworks to ensure data quality and reliability.
• Optimize data workflows for performance, cost efficiency, and scalability.
• Draft and review architectural diagrams and design documents to communicate solutions.
• Own systems, processes, and tech stack elements and drive features to completion across internal and external applications.

Conocimientos

Python

SQL

NoSQL

Kafka

Databricks

Vertex AI

BigQuery

CI/CD

Herramientas

Azure

GCP

GitHub Actions

Descripción del empleo

Eliassen Group is hiring a Data Engineer for a remote contract role. You will design, build, and maintain scalable data pipelines using Kafka and Databricks, with a focus on modernizing data assets across SQL/NoSQL and real-time streaming platforms.

You will develop ML feature engineering pipelines using Vertex AI and BigQuery ML, implement automated testing and CI/CD, and own the data stack across Azure and GCP.