Remote Data Engineer — Azure & GCP Pipelines

Eliassen Group; Austin (TX); Remote; USD 83,000 - 96,000; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

401k with company match

Life insurance

Job summary

Eliassen Group is seeking a Data Engineer to design and maintain scalable data pipelines across Azure and GCP, focusing on ML feature engineering, CI/CD and automated testing. This remote contract role requires strong SQL/NoSQL, Python, and streaming tech experience.

You will collaborate with cross-functional teams to own data systems and architectures throughout the SDLC. The position emphasizes modernizing data assets, documenting interfaces, and delivering reliable, scalable solutions in a

Qualifications

• 4+ years of professional data development experience.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 2+ years developing with Python.
• Experience with feature engineering for machine learning pipelines.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with Git version control and code reviews.
• Understanding of ETL and data warehousing concepts.
• Understanding of Agile principles, including Scrum.

Responsibilities

• Design, build, and maintain scalable data pipelines using Kafka and Databricks.
• Modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop feature engineering pipelines for ML using Vertex AI and BigQuery ML.
• Design and implement automated testing frameworks to ensure data quality.
• Optimize data workflows for performance, cost, and scalability.
• Draft architectural diagrams and interface specifications for data solutions.
• Own systems and drive features across internal and external applications.

Skills

Kafka

Databricks

Python

CI/CD

Git

Agile

BigQuery ML

Vertex AI

Tools

GitHub Actions

Spark

Databricks

Kafka

BigQuery

Vertex AI Platform

Job description

Eliassen Group is seeking a Data Engineer to design and maintain scalable data pipelines across Azure and GCP, focusing on ML feature engineering, CI/CD and automated testing. This remote contract role requires strong SQL/NoSQL, Python, and streaming tech experience.

You will collaborate with cross-functional teams to own data systems and architectures throughout the SDLC. The position emphasizes modernizing data assets, documenting interfaces, and delivering reliable, scalable solutions in a