Data Engineer III-6377

itd

United States

Remote

USD 140,000 - 180,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Onsite six-month assignment in Menlo —
Medical benefits
Retirement plan
Paid holidays
Direct W-2 employment; no visa sponsor

Job summary

itd is seeking a data engineer to build and maintain analytics-ready datasets that help large operational teams measure workforce needs and productivity. You will develop ETL/ELT pipelines with SQL and Python, and maintain Hive and Spark-based workflows to support reporting and decision making.

You will collaborate with analysts, data scientists, and operations to translate requirements into scalable data solutions, ensure data quality, and implement improvements to legacy systems.

Qualifications

  • Degree in a technical field required.
  • Strong SQL skills with experience in Presto, Trino or Spark SQL.
  • Python for production data workflows.
  • Experience building large-scale pipelines in Hive or Spark.
  • Knowledge of data warehousing, partitioning, and query optimization.
  • Experience with orchestration tools like Airflow or Dataswarm.
  • Ability to troubleshoot pipeline failures and implement data quality checks.

Responsibilities

  • Develop and tune ETL/ELT pipelines using SQL and Python for analytics and reporting.
  • Maintain workflows in Hive and Spark data warehouse environments, including scheduling, backfills, and failure recovery.
  • Create datasets and data models for workforce and operational measurement.
  • Monitor pipeline health, add data quality checks, and support service-level targets.
  • Improve legacy workflows, automate manual tasks, and provide self-service data assets.
  • Work with analysts, data scientists, architects, and operational partners to translate needs into data solutions.

Skills

SQL
Python
Pipeline troubleshooting
Data modeling
Data warehousing
Airflow
Spark/Hive

Education

Bachelor's degree in CS/CE or related field

Tools

Presto/Trino
Spark SQL
Hive
Airflow
Dataswarm

Job description

Role overview

Build and maintain data pipelines and analytics-ready datasets that help large operational teams measure workforce needs, staffing, capacity, and productivity. The work spans pipeline development, orchestration, reliability, and reporting support, with close collaboration across data and operations teams.

Responsibilities
  • Develop and tune ETL/ELT pipelines using SQL and Python for analytics and reporting.
  • Maintain workflows in Hive and Spark data warehouse environments, including scheduling, backfills, and failure recovery.
  • Create datasets and data models for workforce and operational measurement.
  • Monitor pipeline health, add data quality checks, and support service-level targets.
  • Improve legacy workflows, automate manual tasks, and provide self-service data assets.
  • Work with analysts, data scientists, architects, and operational partners to translate needs into data solutions.
Requirements
  • Strong SQL skills, including experience with Presto, Trino, or Spark SQL.
  • Basic to intermediate Python skills for production data workflows.
  • Experience building and supporting large-scale pipelines in Hive or Spark environments.
  • Knowledge of data warehousing, partitioning, incremental loads, data modeling, and query optimization.
  • Experience with orchestration tools such as Airflow, Dataswarm, or comparable systems.
  • Ability to troubleshoot pipeline failures, manage backfills, and apply data quality and reliability practices.
  • Bachelor’s degree in computer science, computer engineering, or a related technical field.
Nice to have
  • Experience supporting dashboards or reporting tools, and familiarity with workforce or support operations metrics.
  • Git, code review, technical documentation, workflow automation, data quality frameworks, anomaly detection, or SLA alerting experience.
  • Relevant process certifications such as Six Sigma, ITIL, CMMI, or similar.
Benefits and work setup
  • Onsite role in Menlo Park, California, with a stated six-month duration.
  • Medical benefits, retirement plan, and paid holidays are offered. The listing indicates direct W-2 employment and no visa sponsorship.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer III-6377
Data Engineer III-6377

itD Tech • Menlo Park (CA)

On-site
USD 140,000 - 180,000
Data Engineer III: Spark/Hive Data Pipelines for Workforce
Data Engineer III: Spark/Hive Data Pipelines for Workforce

itd • United States

Remote
USD 140,000 - 180,000
Onsite six-month assignment in Menlo —
Medical benefits
Retirement plan
+2
Staff Data Engineer
Staff Data Engineer

Join9am • United States

Remote
USD 150,000 - 190,000
Remote work options
Professional development budget
Health, dental, and vision coverage
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Data Engineer III - Scalable ETL Pipelines (6mo)
Data Engineer III - Scalable ETL Pipelines (6mo)

ITD Technology Co. • Menlo Park (CA)

On-site
USD 140,000 - 180,000
Data Engineer
Data Engineer

ErthDev • United States

Remote
USD 55,000 - 110,000
Remote work from Egypt
Medical insurance
Learning opportunities
+2
Senior Data Engineer – ETL/ELT & Pipelines
Senior Data Engineer – ETL/ELT & Pipelines

itD Tech • Clayton (GA)

On-site
USD 100,000 - 167,000
Medical benefits
401k plan
Paid holidays
PySpark Data Engineer
PySpark Data Engineer

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 120,000
Discretionary Annual Incentive
Medical Coverage (Health, Dental & Vis
401K Plan
+1
Data Engineer III-6377
Data Engineer III-6377

itD Tech • Clayton (GA)

On-site
USD 100,000 - 167,000
Medical benefits
401k plan
Paid holidays
Data Engineer
Data Engineer

Sago • United States

Remote
USD 90,000 - 140,000
5 Days working
Remote Job
Medical Insurance