Senior Data Engineer: Scalable Pipelines & Architecture

HTC Global Services; Dearborn (MI); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health insurance

Paid time off

401(k) matching

Life insurance

Disability insurance

Professional development

Wellness programs

Job summary

HTC Global Services seeks a Senior Data Engineer to design, develop, test, and maintain scalable data solutions. You will craft data architectures, build robust pipelines, and optimize large-scale data systems while collaborating with cross-functional teams.

You will work with modern tech like Spark, Hadoop, Kafka, and cloud services, delivering high-quality data products and ensuring data integrity and performance.

Qualifications

• Bachelor's degree in a STEM field or related area.
• 5+ years of progressive experience in Data Engineering with large-scale systems.
• Proficiency in Python or Scala.
• Advanced SQL skills with complex querying and data modeling.
• Experience with Spark, Hadoop, Kafka, and Flink.
• Experience with AWS, Azure, or GCP and related data services.
• Strong data warehousing concepts and ETL/ELT processes.
• Experience with NoSQL databases and modern cloud infra.

Responsibilities

• Design, develop, test, and maintain scalable data solutions.
• Engage stakeholders to translate business needs into technical solutions.
• Design data architectures including warehouses, lakes, and streaming platforms.
• Develop and optimize ETL/ELT pipelines for large data volumes.
• Determine technology stacks, deployment strategies, and integration methods.
• Create high-level software architecture designs and interfaces.
• Collaborate with product owners, architects, and cross-functional teams.
• Define and implement testing strategies and CI/CD practices.
• Improve performance and efficiency by adopting new technologies.
• Apply modern software engineering practices including TDD, CI, CD.
• Support security practices to protect data via encryption and anonymization.
• Develop and maintain backend services, APIs, and microservices.
• Evaluate emerging technologies and drive continuous improvement.
• Ensure data integrity, quality, scalability, and performance across pipelines.

Skills

Python

Scala

SQL

Big data

Cloud platforms

NoSQL

Kubernetes

Docker

Git

Data warehousing

ETL/ELT

Spark

Hadoop

Kafka

Education

Bachelor's degree

Tools

Git

Docker

Kubernetes

Job description

HTC Global Services seeks a Senior Data Engineer to design, develop, test, and maintain scalable data solutions. You will craft data architectures, build robust pipelines, and optimize large-scale data systems while collaborating with cross-functional teams.

You will work with modern tech like Spark, Hadoop, Kafka, and cloud services, delivering high-quality data products and ensuring data integrity and performance.