Senior AWS Data Engineer: AI-Driven Data Pipelines

Baanyan Software Services, Inc.; Jersey City (NJ); On-site; USD 120,000 - 180,000; Full time

Job summary

Baanyan Software Services, Inc. seeks a Senior Engineer with deep cloud and data experience in Jersey City, onsite. You will apply Python, PySpark, SQL, and data modeling to troubleshoot pipelines and build scalable APIs on AWS ECS, while leveraging CI/CD for automated delivery.

You will work with AWS services like ECS, Lambda, SNS, and DynamoDB, and use AI tooling to accelerate development and improve quality, collaborating across teams to optimize performance in a distributed environment.

Qualifications

• 8+ years of hands-on engineering experience in cloud platforms.
• Proficient in Python, PySpark, SQL, and data modeling.
• Experience designing APIs and deploying on AWS ECS.
• Exposure to CI/CD pipelines and DevOps practices.
• Familiarity with AI-assisted coding tools like GitHub Copilot.

Responsibilities

• Troubleshoot data pipelines and data structures in distributed environments.
• Develop and optimize SQL queries and implement SCD Type 1 & Type 2 data warehousing concepts.
• Design, develop, and deploy scalable APIs on AWS ECS.
• Work with AWS services including ECS, Lambda, SNS, and DynamoDB.
• Build, test, and deploy apps via CI/CD pipelines for automated delivery.
• Leverage AI-powered coding tools to accelerate delivery and improve code quality.
• Collaborate with cross-functional teams to resolve cloud infrastructure and performance issues.

Skills

Python

PySpark

SQL

Data modeling

CI/CD

GitHub Copilot

Tools

AWS ECS

AWS Lambda

SNS

DynamoDB

Job description

Baanyan Software Services, Inc. seeks a Senior Engineer with deep cloud and data experience in Jersey City, onsite. You will apply Python, PySpark, SQL, and data modeling to troubleshoot pipelines and build scalable APIs on AWS ECS, while leveraging CI/CD for automated delivery.

You will work with AWS services like ECS, Lambda, SNS, and DynamoDB, and use AI tooling to accelerate development and improve quality, collaborating across teams to optimize performance in a distributed environment.