Engineering Manager

Impelsys; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Impelsys Bengaluru seeks a seasoned data engineering leader to own end-to-end delivery of data-centric projects, driving new capabilities and large-scale changes to existing products. You will supervise internal and external development teams, translating business goals into prioritized technology deliverables across data pipelines and analytics.

The role requires strong expertise in ETL/ELT, data warehousing, Python, Airflow, AWS services, and leadership in Agile environments.

Qualifications

• Excellent understanding of enterprise data warehousing principles and ETL/ELT solutions.
• Experience with API data delivery/ingestion (REST, GraphQL).
• Experience with batch data delivery (csv, ODBC).
• Strong SQL skills with Redshift/PostgreSQL/MySQL/MS SQL Server.

Responsibilities

• Liaise with analysts and stakeholders to review requirements and identify best technical solutions for data ingestion/distribution tasks.
• Design data extraction and transformation logic using ETL/ELT technologies and open-source tools (e.g., Python, Airflow, AWS Glue).
• Supervise and coach development teams and vendors in implementing data pipelines and transformations.
• Ensure data extraction/transformation jobs run on schedule with data timeliness and quality.
• Build data quality metrics to identify anomalies and pipeline issues early.
• Report progress, risks and issues to line manager and senior stakeholders.
• Evaluate trends and technologies and present recommendations to senior management.
• Foster collaborative design/code/test plan reviews.
• Derive actionable insights from data using proactive measures and algorithms.

Skills

ETL/ELT

Data warehousing

Python

Airflow

AWS

Lambda

API gateways

REST APIs

GraphQL

SQL

Data pipelines

Leadership

Agile

GitHub

TravisCI

AWS Redshift

PostgreSQL

Tools

GitHub

TravisCI

Job description

This is an opportunity in which you will be responsible for overall implementation and delivery of projects and programmes, bringing new capabilities to the market, or implementing large scale change to existing products, covering the full lifecycle. You will oversee/manage the technicaldelivery management for a business area. You will supervise and coordinate the development teams (both internal employees and external partners) during their implementation. You will work closely with the businesses to understand their business objectives, product strategies and roadmaps and requirements so they can be continually translated into prioritised technology deliverables.

Cloud Integrations, Security

ECS/EKS, API Gateways, Route53/F5, VPC/ELB, REST / SOAP frameworks

Airflow, Glue, Lambdas, Redshift – with Node/Python.

• Liaise with business/data analysts and business stakeholders to review new requirements and enhancements and help identify the best technical solution for the data ingestion/distribution tasks
• Design data extraction and transformation logic based on prevailing ETL/ELT technologies, languages and open-source frameworks (e.g., Python, Airflow, AWS Data Wrangler, AWS SageMaker, AWS EMR, AWS Glue etc.)
• Supervise, coach and monitor the development teams and vendors in the implementation of designed data pipelines and transformations
• Ensure all the data extraction and transformation jobs are successfully scheduled and executed, to guarantee data timeliness and quality
• Design, build and run data quality metrics for early identification of anomalies and erroneous data pipeline executions
• Report progress, risks and issues to the linemanagerand other relevant stakeholders (e.g., business users, senior management team, leadership team etc)
• Evaluate new trends and technologies in the market and prepare suggestions and
• recommendations to be presented to the linemanagerand other members of the senior management team
• Drive a culture of collaborative reviews of designs, code and test plans.
• Ability to arrive at actionable insights leveraging the pro-active or pre-emptive measures and algorithms around the data driven decision.

What we’re looking for:

• Excellent understanding of enterprise data warehousing principles and ETL/ELT solutions
• Flexible and able to adjust to changing priorities in a fast-paced environment.
• Experience working on or with API’s for data delivery/ingestion, e.g., REST APIs, GraphQL, etc.
• Experience working on or with batch-based data delivery/ingestion paradigms, e.g., csv files, ODBC connections, etc.
• Experience in Code management tools (GitHub) Build and Deployment tool (TravisCI).
• Excellent knowledge and working experience on data management technologies and frameworks, preferably on Python, Airflow, AWS API Gateway, SNS, SQS, Lambda
• Good understanding of Lambda and Kappa Architecture patterns
• Ability to work with large and complex data sets, data lakes and data warehouses
• SQL query skills. Hands‑on experience with AWS Redshift, PostgreSQL and other database technologies like MySQL, Microsoft SQL Server, etc. and ability to write complex queries to extract/inject data into those databases
• Proven ability to manage a team of developers and to work in an objective oriented environment
• Experience with Agile methodology including WIP management, backlog grooming/prioritisation, reporting and dashboards.