Senior AWS Data Engineer

Baanyan Software Services, Inc.; Jersey City (NJ); On-site; USD 120,000 - 180,000; Full time

Job summary

Baanyan Software Services, Inc. seeks a Senior Engineer with deep cloud and data experience in Jersey City, onsite. You will apply Python, PySpark, SQL, and data modeling to troubleshoot pipelines and build scalable APIs on AWS ECS, while leveraging CI/CD for automated delivery.

You will work with AWS services like ECS, Lambda, SNS, and DynamoDB, and use AI tooling to accelerate development and improve quality, collaborating across teams to optimize performance in a distributed environment.

Qualifications

• 8+ years of hands-on engineering experience in cloud platforms.
• Proficient in Python, PySpark, SQL, and data modeling.
• Experience designing APIs and deploying on AWS ECS.
• Exposure to CI/CD pipelines and DevOps practices.
• Familiarity with AI-assisted coding tools like GitHub Copilot.

Responsibilities

• Troubleshoot data pipelines and data structures in distributed environments.
• Develop and optimize SQL queries and implement SCD Type 1 & Type 2 data warehousing concepts.
• Design, develop, and deploy scalable APIs on AWS ECS.
• Work with AWS services including ECS, Lambda, SNS, and DynamoDB.
• Build, test, and deploy apps via CI/CD pipelines for automated delivery.
• Leverage AI-powered coding tools to accelerate delivery and improve code quality.
• Collaborate with cross-functional teams to resolve cloud infrastructure and performance issues.

Skills

Python

PySpark

SQL

Data modeling

CI/CD

GitHub Copilot

Tools

AWS ECS

AWS Lambda

SNS

DynamoDB

Job description

Location: Jersey City, NJ (5 days onsite)

Duration: Long term

Experience: 8 yrs minimum

Job Description:

We are seeking an experienced Senior Engineer with strong programming and cloud platform expertise. The ideal candidate will have hands‑on experience across core AWS services, a solid background in Python, PySpark, SQL, and data modeling, along with proficiency in leveraging AI development tools (e.g., GitHub Copilot) to enhance engineering productivity.

Key Responsibilities:

• Investigate and troubleshoot data pipelines, demonstrating a strong understanding of data structures and distributed processing.
• Develop and optimize complex SQL queries; implement data warehousing concepts including Slowly Changing Dimensions (SCD Type 1 & Type 2).
• Design, develop, and deploy scalable, reliable APIs on AWS (ECS).
• Work extensively with core AWS services, including ECS, Lambda, SNS, and DynamoDB.
• Build, test, and deploy applications via CI/CD pipelines to ensure automated delivery.
• Utilize AI-powered developer tools (such as GitHub Copilot) to accelerate delivery and code quality.
• Collaborate with cross-functional teams to troubleshoot and resolve cloud infrastructure and application performance issues.

Required Skills & Qualifications:

• AWS Services: Hands‑on experience with AWS ECS, Lambda, SNS, and DynamoDB.
• Programming & Data: Proficient in Python with strong PySpark experience for data pipeline investigation and processing.
• Databases & Modeling: Solid understanding of SQL, data modeling concepts, and SCD (Type 1 & Type 2).
• API & Cloud Deployment: Proven experience building and deploying APIs on AWS / ECS.
• DevOps: Working knowledge of CI/CD processes and pipelines.
• AI Tooling: Experience using AI-assisted coding tools (GitHub Copilot, etc.).

Strong analytical, debugging, and problem-solving skills.