Senior Data Engineer — Real-Time & Cloud Data

Hudson Manpower; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Hudson Manpower is seeking a Senior Data Engineer with 8+ years of hands-on experience to design, build, and maintain scalable data platforms, pipelines, and analytics solutions. The ideal candidate will excel in Python/SQL, ETL/ELT, cloud data platforms, data warehousing, and distributed processing.

You will collaborate with data scientists, BI developers, software engineers, and product managers to deliver reliable, secure data solutions supporting analytics and AI/ML initiatives.

Qualifications

• 8+ years of hands-on data engineering experience.
• Strong Python/SQL and data warehousing expertise.
• Experience with cloud data platforms (AWS, Azure, GCP) and distributed processing.
• Experience designing and building scalable data pipelines.
• Knowledge of data governance, security, and compliance.

Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines.
• Build ETL/ELT workflows to ingest and transform data from multiple sources.
• Develop optimized SQL queries, stored procedures, and transformations.
• Design data warehouses, lakes, lakehouses, and dimensional models.
• Work with Spark and distributed processing for large datasets.
• Implement data quality, monitoring, and observability frameworks.

Skills

Python

SQL

ETL/ELT

Data Warehousing

Spark / PySpark

Airflow

Cloud Platforms

Data Modeling

Data Governance

CI/CD

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science

Tools

Apache Airflow

Azure Data Factory

AWS Glue

dbt

Informatica

Talend

SSIS

Databricks

Docker

Kubernetes

Job description

Hudson Manpower is seeking a Senior Data Engineer with 8+ years of hands-on experience to design, build, and maintain scalable data platforms, pipelines, and analytics solutions. The ideal candidate will excel in Python/SQL, ETL/ELT, cloud data platforms, data warehousing, and distributed processing.

You will collaborate with data scientists, BI developers, software engineers, and product managers to deliver reliable, secure data solutions supporting analytics and AI/ML initiatives.