Data Engineer – Real-Time Pipelines on AWS

DataJobs; New York (NY); On-site; USD 70,000 - 95,000; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

Retirement plans (401(k))

Life and disability insurance

Employee assistance programs

Job summary

DataJobs in New York, NY is seeking a data engineer to design, build, and optimize scalable ETL/ELT data pipelines for cloud-based analytics. You will work with AWS, GCP, Databricks, and Snowflake to enable batch and real-time processing.

The role requires 3–8+ years of data engineering experience, strong SQL and programming skills (Python/Scala/Java), and a solid understanding of data modeling, warehousing, and governance. On-site, competitive benefits included.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3-8+ years of experience in data engineering or related roles.
• Proficiency in SQL and at least one programming language: Python, Scala, or Java.
• Experience with ETL tools and frameworks.
• Solid understanding of data modeling, warehousing, and big data concepts.
• Familiarity with distributed processing frameworks: Spark, Hadoop.
• Experience with CI/CD pipelines and version control (Git).

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services.
• Develop and optimize batch and real-time data processing systems.
• Ensure data quality, integrity, and governance across platforms and workflows.
• Partner with stakeholders to translate business requirements into technical solutions.
• Implement data integration solutions across multiple sources and formats.
• Monitor and troubleshoot data workflows to support performance and reliability.
• Optimize costs and performance for AWS and GCP data infrastructure.
• Collaborate with data scientists, analysts, and DevOps teams.

Skills

SQL

Python

Scala

Java

Data modeling

Big data

Git

CI/CD

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

AWS

GCP

Databricks

Snowflake

dbt

Python

Scala

Java

Spark

Hadoop

Terraform

CloudFormation

Power BI

Tableau

Job description

DataJobs in New York, NY is seeking a data engineer to design, build, and optimize scalable ETL/ELT data pipelines for cloud-based analytics. You will work with AWS, GCP, Databricks, and Snowflake to enable batch and real-time processing.

The role requires 3–8+ years of data engineering experience, strong SQL and programming skills (Python/Scala/Java), and a solid understanding of data modeling, warehousing, and governance. On-site, competitive benefits included.