Senior ML Data Engineer: Real-Time ML Pipelines & DataOps

Cedent Consulting Inc.

United States

Hybrid

USD 55,104 - 82,656

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health
Dental
Vision Insurance

Job summary

A leading data engineering company in the United States seeks a Data Engineer to develop and manage ML feature engineering pipelines using Databricks and Apache Spark. The role involves overseeing data integration and optimizing pipelines for both real-time and batch model serving. Candidates should have 7 years of data engineering experience along with proficiency in Python and SQL. The position offers competitive hourly compensation and various health benefits.

Qualifications

  • 7 years in data engineering, with 4 years in ML feature engineering.
  • Experience managing pipelines on Databricks using Apache Spark.
  • Familiarity with ML lifecycle management and MLflow is a plus.

Responsibilities

  • Develop and maintain feature engineering pipelines using Databricks.
  • Integrate diverse data sources to create user behavior profiles.
  • Design and implement ETL, ELT pipelines for medallion architecture.

Skills

Apache Spark
Databricks
Java
Python
Scala
SparkSQL

Job description

A leading data engineering company in the United States seeks a Data Engineer to develop and manage ML feature engineering pipelines using Databricks and Apache Spark. The role involves overseeing data integration and optimizing pipelines for both real-time and batch model serving. Candidates should have 7 years of data engineering experience along with proficiency in Python and SQL. The position offers competitive hourly compensation and various health benefits.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Data Engineer — Real-Time Features & Pipelines
Senior ML Data Engineer — Real-Time Features & Pipelines

CeDent • United States

Remote
USD 55,000 - 83,000
Health, Dental, Vision Insurance
Senior ML Data Pipeline Engineer (Spark/Databricks, LLMs)
Senior ML Data Pipeline Engineer (Spark/Databricks, LLMs)

SD Solutions • United States

Remote
USD 120,000 - 160,000
Senior Data Engineer: Real-Time Pipelines & Spark
Senior Data Engineer: Real-Time Pipelines & Spark

InfoVision Inc. • Denver (CO)

On-site
USD 110,000 - 126,000
Senior Data Engineer: Scalable Spark Pipelines & Real-Time
Senior Data Engineer: Scalable Spark Pipelines & Real-Time

3M Consultancy • Washington

On-site
USD 100,000 - 130,000
Data Engineer — Scale Pipelines for ML & Insights
Data Engineer — Scale Pipelines for ML & Insights

Globaldev Group • United States

Hybrid
USD 120,000 - 180,000
20 days of vacation
Public holidays
Mobilization reservation after prob. (
+1
Remote Data Engineer for AI/ML Pipelines
Remote Data Engineer for AI/ML Pipelines

Randstad Digital Americas • Deerfield (IL)

Hybrid
USD 68,880 - 79,308
Medical, prescription, dental, and vision insurance
401K plan
Short-term disability
Senior Data Engineer — Remote Data Pipelines & ML Solutions
Senior Data Engineer — Remote Data Pipelines & ML Solutions

Curinos • United States

Hybrid
USD 110,000 - 140,000
Competitive benefits across financial, health, and lifestyle options
Flexible working options
Competitive annual leave
+2
Data Engineer for ML Pipelines & Production
Data Engineer for ML Pipelines & Production

Highbrow LLC • Atlanta (GA)

On-site
USD 100,000 - 130,000
Senior AI Data Engineer: Databricks, Spark & ML Pipelines
Senior AI Data Engineer: Databricks, Spark & ML Pipelines

HCL Global Systems Inc • Princeton (NJ)

On-site
USD 150,000 - 190,000
Senior Data Engineer: Real-Time Data Platform & ML
Senior Data Engineer: Real-Time Data Platform & ML

AMH • Las Vegas (NV)

Hybrid
USD 121,000 - 151,000
Health insurance
HSA/FSA
Dependent savings
+5