Data Engineer

Accion Labs; Pune District; Hybrid; INR 900,000 - 1,400,000; Full time

Benefits offered by this job

Hybrid Work

Great working Culture

Job summary

Accion Labs is seeking a Senior Data Engineer to design, develop and maintain scalable ETL/ELT data pipelines using Databricks, PySpark, Python, and SQL. You will integrate diverse source systems, optimize performance, and ensure governance across data workflows.

The role requires 2+ years delivering end-to-end data engineering projects, collaboration with analysts, architects, QA and reporting teams, and participation in release planning and production support. Hybrid work arrangement offered.

Qualifications

• Hands-on Databricks, PySpark, Python and SQL experience.
• Experience building scalable data engineering solutions and reusable frameworks.
• Minimum 2+ years delivering end-to-end data engineering projects.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build data processing solutions using Databricks, PySpark, Python, and SQL.
• Integrate multiple source systems with varying throughput and complexity.
• Code optimization, performance tuning, and troubleshooting of data workflows.
• Collaborate with cross-functional teams including business analysts, architects, QA, and reporting teams.
• Ensure data quality, integrity, governance, and compliance standards are maintained.
• Participate in code reviews, release planning, deployment activities, and production support.
• Create and maintain technical documentation, design artifacts, and runbooks.
• Identify risks proactively and propose mitigation approaches.
• Support continuous improvement initiatives and adoption of best engineering practices.

Skills

Databricks

PySpark

Python

SQL

Git/version control

Multi-system integration

Code optimization

scalable data engineering

End-to-end data projects

Education

Bachelors or Masters in CS/IT/Engineering

Tools

Databricks

Job description

Role & responsibilities

Key Responsibilities

• Design, develop, and maintain scalable and optimized ETL/ELT data pipelines
• Build and enhance data processing solutions using Databricks, PySpark, Python, and SQL
• Work on integration of multiple source systems with varying data throughput and complexity
• Perform code optimization, performance tuning, and troubleshooting of data workflows
• Collaborate with cross-functional teams including business analysts, architects, QA, and reporting teams
• Ensure data quality, integrity, governance, and compliance standards are maintained
• Participate in code reviews, release planning, deployment activities, and production support
• Create and maintain technical documentation, design artifacts, and operational runbooks
• Identify risks proactively and propose mitigation approaches
• Support continuous improvement initiatives and adoption of best engineering practices

Mandatory Skills

• Strong hands-on experience in:
• Databricks
• PySpark
• Python
• SQL
• Git/version control
• Experience working on projects involving multiple integration systems and high-volume data processing
• Strong expertise in code optimization and performance tuning
• Experience in building scalable data engineering solutions and reusable frameworks
• Minimum 2+ years of experience delivering one or more end-to-end data engineering projects

Good to Have Skills

• Data Modelling
• Dimensional Modelling
• Schema Design
• Experience with reporting/visualization tools such as Microsoft Power BI
• Exposure to cloud platforms such as AWS, Azure, or GCP
• Understanding of CI/CD pipelines and DevOps practices
• Experience working in Agile/Scrum delivery environments
• Experience in DLT (Delta Live Tables)

Soft Skills

• Strong attention to detail to ensure data accuracy and integrity
• Excellent communication and comprehension skills
• Clear and structured documentation practices
• Flexibility and adaptability to changing project environments and priorities
• Strong planning and prioritization skills with ability to meet timelines
• Ability to proactively identify risks and provide mitigation approaches
• Good conflict resolution and stakeholder collaboration skills
• Ownership mindset with proactive and independent execution capabilities
• Positive attitude with strong problem-solving approach

Experience Guidelines

• Senior Developer Data Engineer
• 36 years of relevant experience
• Strong architecture understanding and optimization skills
• Ability to mentor junior team members and drive delivery ownership

Preferred Qualifications

• Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or related field
• Relevant Databricks or cloud certifications are an added advantage

Preferred candidate profile

Experience Guidelines

• Senior Developer Data Engineer
• 36 years of relevant experience
• Strong architecture understanding and optimization skills
• Ability to mentor junior team members and drive delivery ownership

Perks and benefits

• Hybrid Work
• Great working Culture