Senior Data Engineer

OEC; Chennai District; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

OEC is seeking a Senior Data Engineer to deliver scalable data pipelines and ETL processes across Azure and AWS, while ensuring data quality and secure access. You will drive BI reporting and collaborate with stakeholders to translate business needs into cloud-optimized data solutions.

The role requires 6–10 years of data engineering experience, strong SQL, and hands-on cloud experience with Azure and AWS services, including data warehousing and reporting tools such as Power BI and Tableau.

Qualifications

• 6–10 years of experience in data engineering and reporting.
• Bachelor's degree in Information Technology, Computer Science, or related discipline.
• Strong SQL skills and experience with BI/Analytics tools like Power BI and Tableau.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes across Azure and AWS.
• Develop and maintain enterprise BI and reporting solutions including dashboards and reports.
• Assist with data modeling and Enterprise Data Warehouse on multi-cloud platforms.
• Collaborate with stakeholders to evaluate business needs and optimize cross-cloud analytics.
• Develop and execute system and unit tests across cloud environments.

Skills

Data engineering

ETL development

SQL development

Cross-cloud design

Communication

Education

Bachelor's degree in IT/CS

Tools

Azure Data Factory

Azure Synapse Analytics

Azure SQL

AWS Glue

Redshift

SageMaker

Lambda

Job description

The Senior Data Engineer is responsible for delivering scalable data pipelines, ETL processes, data warehouse solutions, and BI reporting tools across Azure and AWS cloud platforms. This role serves as a key technical contributor, ensuring seamless data integration, high data quality, and secure access while collaborating with stakeholders to translate business needs into efficient, cloud-optimized data solutions.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processes including database scripts, stored procedures, triggers, functions, Azure Data Factory pipelines, AWS Glue jobs, and other back-end processes to ensure efficient data extraction, transformation, loading, and seamless system integration across Azure and AWS cloud environments.
• Own the design, development, and maintenance of enterprise BI and reporting solutions including metrics, reports, analyses, and dashboards using tools like Amazon QuickSight and Microsoft Azure BI solutions to drive key business decisions; implement robust user access controls and data security measures across cloud environments.
• Assist with tabular and multi-dimensional modelling in addition to the development and maintenance of the Enterprise Data Warehouse leveraging both AWS and Azure cloud data warehouse solutions.
• Coordinate with management and end-users to evaluate business needs, anticipate opportunities for improvement in cross-cloud analytics solutions, identify alternate approaches that leverage the strengths and cost-optimization benefits of both AWS and Azure platforms, and present recommendations for approval and implementation.
• Develop and execute comprehensive system and unit testing across Azure and AWS environments, identify and fix defects, and validate results to ensure quality and compatibility between cloud platforms.

Skills & Qualifications

Must-Have:

• 6 -10 years of experience in data engineering and reporting required.
• A bachelor's degree from an accredited college or university is required, with a focus in Information Technology, Computer Science, or related discipline.
• Strong proven track record of developing and testing database scripts, stored procedures, triggers, functions, SSIS Packages, AWS, Azure cloud services and other back-end processes to support system integration.
• Experience using BI/Analytics/Statistical tools like Power BI, Tableau, SSRS, SSAS, and Excel.
• Strong SQL skills, business intelligence tool expertise, AWS Cloud services, and report development skills.
• Hands-on experience with Azure cloud services including Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults for building and orchestrating data pipelines, serverless integrations, and secure secrets management.
• Hands-on experience with AWS cloud services including S3, Lambda, Glue, Step Functions, Redshift, Athena, SNS, SQS, EventBridge, Event Bus, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation for building scalable data engineering solutions, event-driven architectures, ML workflows, and governance of data lakes.
• Understanding of configuration, deployment, and database servers.
• Strong writing and verbal communication skills. Ability to work collaboratively in a functional team environment.

Preferred:

• Domain expertise in Automotive industry.