Data Engineer

Eliassen Group; Nashville (TN); Remote; USD 83,000 - 96,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Data Engineer for a remote contract role focused on building scalable data pipelines across Azure and GCP, modernizing data assets, and implementing ML feature engineering. The position emphasizes CI/CD, testing, and documentation across SQL/NoSQL and streaming platforms.

The role requires 4+ years in data development, strong SQL/NoSQL experience, Python, and familiarity with Vertex AI, BigQuery ML, and Databricks.

Qualifications

• 4+ years of professional data development experience.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 2+ years developing with Python.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with version control such as Git.
• Understanding of ETL and data warehousing concepts.
• Understanding of Agile principles, including Scrum.

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for ingestion, transformation, and integration using tools such as Kafka and Databricks.
• Leverage innovative technologies to modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop and manage feature engineering pipelines for machine learning using Vertex AI, BigQuery ML, and Python.
• Design and implement automated unit, integration, and performance testing frameworks to ensure data quality and reliability.
• Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
• Draft and review architectural diagrams, interface specifications, and design documents to communicate data solutions and requirements.
• Own systems, processes, and tech stack elements and drive features to completion across internal and external applications.

Skills

Kafka

Databricks

Python

Vertex AI

BigQuery ML

Tools

Git

GitHub Actions

BigQuery

Cloud Storage

Spark

Job description

Data Engineer

Anywhere

Type: Contract

Category: Engineer

Industry: Retail

Workplace Type: Remote

Standard Hours: Open

Description

Remote

Our client seeks a data engineer to collaborate with cross-functional teams and own systems, processes, and the tech stack across the SDLC. The role focuses on building and optimizing scalable data pipelines across Azure and GCP, implementing feature engineering for machine learning with Python and Vertex AI, and ensuring quality through automated testing and CI/CD. The engineer will modernize and extend data assets across SQL, NoSQL, and streaming platforms while documenting architectures and interfaces.

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $60.00 to $70.00/hr. w2

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for ingestion, transformation, and integration using tools such as Kafka and Databricks.
• Leverage innovative technologies to modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms.
• Develop and manage feature engineering pipelines for machine learning using Vertex AI, BigQuery ML, and Python.
• Design and implement automated unit, integration, and performance testing frameworks to ensure data quality and reliability.
• Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
• Draft and review architectural diagrams, interface specifications, and design documents to communicate data solutions and requirements.
• Own systems, processes, and tech stack elements and drive features to completion across internal and external applications.

Experience Requirements

• 4+ years of professional data development experience.
• 4+ years with SQL and NoSQL technologies.
• 3+ years building and maintaining data pipelines and workflows.
• 2+ years developing with Python.
• Experience with feature engineering for machine learning pipelines.
• Experience with CI/CD pipelines and processes.
• Experience with automated unit, integration, and performance testing.
• Experience with version control such as Git.
• Understanding of ETL and data warehousing concepts.
• Understanding of Agile principles, including Scrum.
• Preferred: Knowledge of structured streaming with Spark, Kafka, or EventHub.
• Preferred: Experience with GCP services such as BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow, or Databricks equivalents.
• Preferred: Experience with GitHub SaaS and GitHub Actions.
• Preferred: Understanding of Databricks concepts, PySpark, and Spark development.
• Preferred: Experience with service-oriented architecture.

Recruitment Transparency Notice

Eliassen Group values transparency in our recruitment practices. Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring process. You may receive email and SMS notifications from the Eliassen Virtual Recruiting Team ([e-mail], 781-808-2924) inviting you to complete a brief voice screening as part of your application process. These tools assist our hiring teams in different ways, including but not limited to, assistance in reviewing application materials to help identify candidates whose qualifications most closely match the requirements of the position. All AI-assisted evaluations and responses are reviewed by human recruiters before any hiring decisions are made. The use of AI in our process is intended to support fairness, efficiency, and consistency, and Eliassen Group takes measures to prevent bias or discrimination in connection with its hiring practices. By proceeding, you acknowledge, agree, and consent to Eliassen Group's use of these tools, including AI tools, as part of the application and hiring process.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:

• When you work with Eliassen Group