Senior Data Engineer

OEC; Chennai District; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

OEC is seeking a Senior Data Engineer in Chennai to deliver scalable data pipelines, ETL processes, and data warehouse solutions across Azure and AWS. You will contribute as a key technical member, ensuring data quality, secure access, and cloud-optimized data platforms for stakeholders.

You will design pipelines, develop BI and reporting solutions using Power BI/Tableau, and collaborate with cross-functional teams to meet business needs. A strong background in SQL and cloud services is required.

Qualifications

• 6-10 years of experience in data engineering and reporting required.
• Bachelor’s degree in Information Technology, Computer Science, or related discipline.
• Strong proven track record of developing and testing database scripts, stored procedures, triggers, functions, SSIS Packages, AWS, Azure cloud services and other back-end processes to support system integration.
• Experience using BI/Analytics/Statistical tools like Power BI, Tableau, SSRS, SSAS, and Excel.
• Strong SQL skills, business intelligence tool expertise, AWS Cloud services, and report development skills.
• Hands-on experience with Azure cloud services including Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults for building data pipelines and secure secrets management.
• Hands-on experience with AWS cloud services including S3, Lambda, Glue, Step Functions, Redshift, Athena, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation for scalable data engineering solutions.
• Understanding of configuration, deployment, and database servers.
• Strong writing and verbal communication skills; ability to work collaboratively in a team.
• Preferred: Domain expertise in Automotive industry.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes across Azure and AWS.
• Own the design, development, and maintenance of enterprise BI and reporting solutions using tools like Power BI, Tableau, and Azure/Microsoft BI offerings.
• Develop and maintain the Enterprise Data Warehouse leveraging AWS and Azure cloud data warehouse solutions.
• Coordinate with management and end-users to evaluate business needs and optimize cross-cloud analytics solutions.
• Develop and execute comprehensive system and unit testing across Azure and AWS environments to ensure quality and compatibility.

Skills

Data engineering

ETL development

SQL proficiency

Cloud data pipelines

BI tools

Azure

AWS

Data warehousing

Stakeholder collaboration

Testing & QA

Education

Bachelor's degree in Information Technology or Computer Science

Tools

Azure Data Factory

Azure SQL

Azure Blob Storage

Azure Synapse Analytics

Power BI

Tableau

SSIS

SSRS/SSAS

AWS Glue

Redshift

S3

Lambda

SageMaker

Lake Formation

Job description

The Senior Data Engineer is responsible for delivering scalable data pipelines, ETL processes, data warehouse solutions, and BI reporting tools across Azure and AWS cloud platforms. This role serves as a key technical contributor, ensuring seamless data integration, high data quality, and secure access while collaborating with stakeholders to translate business needs into efficient, cloud-optimized data solutions.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes including database scripts, stored procedures, triggers, functions, Azure Data Factory pipelines, AWS Glue jobs, and other back-end processes to ensure efficient data extraction, transformation, loading, and seamless system integration across Azure and AWS cloud environments.
• Own the design, development, and maintenance of enterprise BI and reporting solutions including metrics, reports, analyses, and dashboards using tools like Amazon QuickSight and Microsoft Azure BI solutions to drive key business decisions; implement robust user access controls and data security measures across cloud environments.
• Assist with tabular and multi-dimensional modelling in addition to the development and maintenance of the Enterprise Data Warehouse leveraging both AWS and Azure cloud data warehouse solutions.
• Coordinate with management and end-users to evaluate business needs, anticipate opportunities for improvement in cross-cloud analytics solutions, identify alternate approaches that leverage the strengths and cost-optimization benefits of both AWS and Azure platforms, and present recommendations for approval and implementation.
• Develop and execute comprehensive system and unit testing across Azure and AWS environments, identify and fix defects, and validate results to ensure quality and compatibility between cloud platforms.

Skills & Qualifications

Must-Have

• 6 -10 years of experience in data engineering and reporting required.
• A bachelor’s degree from an accredited college or university is required, with a focus in Information Technology, Computer Science, or related discipline.
• Strong proven track record of developing and testing database scripts, stored procedures, triggers, functions, SSIS Packages, AWS, Azure cloud services and other back-end processes to support system integration.
• Experience using BI/Analytics/Statistical tools like Power BI, Tableau, SSRS, SSAS, and Excel.
• Strong SQL skills, business intelligence tool expertise, AWS Cloud services, and report development skills.
• Hands-on experience with Azure cloud services including Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults for building and orchestrating data pipelines, serverless integrations, and secure secrets management.
• Hands-on experience with AWS cloud services including S3, Lambda, Glue, Step Functions, Redshift, Athena, SNS, SQS, EventBridge, Event Bus, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation for building scalable data engineering solutions, event-driven architectures, ML workflows, and governance of data lakes.
• Understanding of configuration, deployment, and database servers.
• Strong writing and verbal communication skills. Ability to work collaboratively in a functional team environment.

Preferred

• Domain expertise in Automotive industry.