Senior Data Engineer: AWS Pipelines & GenAI

Tiger Analytics; Jersey City (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

A fast-growing analytics consulting firm is seeking an experienced Data Engineer to design and maintain scalable data pipelines on AWS. You will collaborate with data scientists and AI teams while managing data integration and infrastructure. The ideal candidate has over 8 years of experience with AWS services, expertise in data pipeline construction with Databricks and Apache Spark, and familiarity with modern AI applications. This role offers significant career development opportunities in a dynamic environment.

Qualifications

• 8+ years experience as a Data Engineer working with AWS cloud services.
• Hands-on experience with AWS services such as S3, Glue, Lambda, Redshift.
• Experience building data pipelines using Databricks, Apache Spark, and SQL.

Responsibilities

• Design and deploy end-to-end data pipelines on AWS infrastructure.
• Implement data processing workflows using Databricks and Apache Spark.
• Build orchestration workflows with Apache Airflow to automate executions.

Skills

Data Engineering

AWS services

Databricks

Apache Spark

SQL

Apache Airflow

MLOps workflows

CI/CD pipelines

Generative AI

Tools

AWS S3

AWS Glue

AWS Lambda

Amazon Redshift

Job description

A fast-growing analytics consulting firm is seeking an experienced Data Engineer to design and maintain scalable data pipelines on AWS. You will collaborate with data scientists and AI teams while managing data integration and infrastructure. The ideal candidate has over 8 years of experience with AWS services, expertise in data pipeline construction with Databricks and Apache Spark, and familiarity with modern AI applications. This role offers significant career development opportunities in a dynamic environment.