Remote Data Engineer — ML Pipelines & Cloud DataOps

Eliassen Group; Santa Fe (NM); Remote; USD 83,000 - 96,000; Part time

Benefits offered by this job

Medical, Dental, Vision

401k with match

Life insurance

Job summary

Eliassen Group is seeking a remote Data Engineer to collaborate with cross-functional teams and own data systems across the SDLC. Build and optimize scalable data pipelines on Azure and GCP, implement feature engineering for ML with Python and Vertex AI, and ensure quality via automated testing and CI/CD.

The role focuses on modernizing data assets across SQL, NoSQL, and streaming platforms, with documentation of architectures and interfaces.

Qualifications

• 4+ years of professional data development experience.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 2+ years developing with Python.
• Experience with feature engineering for machine learning pipelines.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with version control such as Git.
• Understanding of ETL and data warehousing concepts.
• Understanding of Agile principles, including Scrum.

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for ingestion, transformation, and integration using Kafka and Databricks.
• Modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop and manage feature engineering pipelines for machine learning using Vertex AI, BigQuery ML, and Python.
• Implement automated testing frameworks to ensure data quality and reliability.
• Optimize data workflows for performance, cost efficiency, and scalability.
• Draft and review architectural diagrams and interface specifications to communicate data solutions.
• Own systems, processes, and tech stack elements and drive features to completion.

Skills

Data pipelines

Python

CI/CD

Git

Agile/Scrum

BigQuery ML

Tools

Kafka

Databricks

Vertex AI

GCP

SQL

NoSQL

Spark

Airflow

Job description

Eliassen Group is seeking a remote Data Engineer to collaborate with cross-functional teams and own data systems across the SDLC. Build and optimize scalable data pipelines on Azure and GCP, implement feature engineering for ML with Python and Vertex AI, and ensure quality via automated testing and CI/CD.

The role focuses on modernizing data assets across SQL, NoSQL, and streaming platforms, with documentation of architectures and interfaces.