AWS Databricks Data Engineer

Ascendion; Gurugram District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Ascendion in India is seeking a data engineer to build scalable pipelines using Databricks, Azure/AWS, and PySpark. The role emphasizes optimizing SQL queries and developing robust ETL workflows with GitHub Actions and Jira in an Agile environment.

The candidate will design API integrations, develop SFTP pipelines, automate ingestion, and ensure reliable monitoring and error handling across data movement processes.

Qualifications

• SQL – Must Have
• Window functions (ROW_NUMBER, RANK, LEAD, LAG).
• joins and query optimization.

Responsibilities

• Build and maintain API integrations
• Develop SFTP pipelines and automated file ingestion
• Create error handling, notifications, and monitoring workflows
• Implement low-complexity ingestions (e.g., file drops, partner data shares)
• Maintain scripts and GitHub repositories
• Test pipelines and Document flows

Skills

SQL

Python

PySpark

Agile development

Tools

Databricks

Azure

AWS

GitHub Actions

Jira

Job description

JOB DETAILS:

Position - DATA ENGINEER

Relevant Experience - 4 to 7 years

Location Option – Pune / Gurgaon / Bangalore [ Manyata Tech Park, Nagavara]

Skills: Databricks, Azure / AWS, SQL, Python, PySpark, GitHub Actions, Jira, Agile development

SQL – Must Have

1. Window functions (ROW_NUMBER, RANK, LEAD, LAG).

2. joins and query optimization.

JD:

Specialized in building scalable pipelines using GitHub, optimizing ETL workflows using native Databricks capabilities and Azure/ Amazon web services

• Build and maintain API integrations
• Develop SFTP pipelines and automated file ingestion
• Create error handling, notifications, and monitoring workflows
• Implement low-complexity ingestions (e.g., file drops, partner data shares)
• Maintain scripts and GitHub repositories
• Test pipelines and Document flows