Remote Data Engineer: Pipelines & ML Features

Eliassen Group; Montpelier (VT); Remote; USD 83,000 - 96,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Data Engineer to design, build, and optimize scalable data pipelines across Azure and GCP. You will work remotely on a contract basis, collaborating with cross-functional teams to own data systems and the tech stack across the SDLC.

The role emphasizes feature engineering for machine learning using Python and Vertex AI, with a focus on automated testing, CI/CD, and modernizing data assets across SQL, NoSQL, and streaming platforms.

Qualifications

• 4+ years of professional data development experience.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 2+ years developing with Python.
• Experience with feature engineering for machine learning pipelines.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with version control such as Git.
• Understanding of ETL and data warehousing concepts.
• Understanding of Agile principles, including Scrum.

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for ingestion, transformation, and integration using tools such as Kafka and Databricks.
• Modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop and manage feature engineering pipelines for machine learning using Vertex AI, BigQuery ML, and Python.
• Design and implement automated unit, integration, and performance testing frameworks to ensure data quality and reliability.
• Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
• Draft and review architectural diagrams, interface specifications, and design documents to communicate data solutions and requirements.
• Own systems, processes, and tech stack elements and drive features to completion across internal and external applications.

Skills

Python

SQL

NoSQL

Kafka

Databricks

Vertex AI

BigQuery ML

CI/CD

Git

Spark

Streaming

Tools

GitHub Actions

Databricks

Job description

Eliassen Group is seeking a Data Engineer to design, build, and optimize scalable data pipelines across Azure and GCP. You will work remotely on a contract basis, collaborating with cross-functional teams to own data systems and the tech stack across the SDLC.

The role emphasizes feature engineering for machine learning using Python and Vertex AI, with a focus on automated testing, CI/CD, and modernizing data assets across SQL, NoSQL, and streaming platforms.