Senior Data Engineer - Azure Data Factory and SQL

UPS; Chennai District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading logistics company in Chennai is seeking a Senior Data Engineer to develop real-time data pipelines and manage data lifecycle activities. The ideal candidate will have experience with data warehousing, ETL tools, and cloud platforms. Qualifications include a Bachelor's degree in a relevant field and proficiency in statistical analysis languages. This permanent role offers an opportunity to contribute to innovative data solutions.

Qualifications

• Understanding of database systems and data warehousing solutions.
• Ability to scale data pipelines for throughput and compliance.
• Proficiency coding in statistical analysis languages such as Python, Java, Scala, C++.

Responsibilities

• Contribute to data engineering projects and build solutions.
• Collaborate effectively and produce data engineering documentation.
• Perform data analysis and present findings to stakeholders.

Skills

Database system understanding

Data lifecycle knowledge

Data pipeline scaling

Data platform building

Analytics reporting familiarity

Knowledge of algorithms

Cloud services familiarity

ETL knowledge

Machine learning understanding

API building capability

Statistical coding proficiency

Distributed systems basics

Education

Bachelor’s degree in MIS, mathematics, statistics, or computer science

Tools

Power BI

Looker

Qlik

Job description

Senior Data Engineer - Azure Data Factory and SQL

Join to apply for the Senior Data Engineer - Azure Data Factory and SQL role at UPS

Job Description

This position develops batch and real-time data pipelines using various data analytics processing frameworks in support of Data Science and Machine Learning practices. It assists in integrating data from internal and external sources, performs ETL conversions, facilitates data cleansing and enrichment, and manages full systems lifecycle activities from analysis to implementation. The role synthesizes disparate data sources to create reusable and reproducible data assets and supports the Data Science community through model feature tuning.

Responsibilities

• Contribute to data engineering projects and build solutions leveraging foundational knowledge in software development and data pipeline construction.
• Collaborate effectively, produce data engineering documentation, gather requirements, organize data, and define project scope.
• Perform data analysis and present findings to stakeholders to support business needs.
• Participate in integration of data for data engineering projects.
• Understand and utilize analytic reporting tools and technologies.
• Assist with data engineering maintenance and support.
• Assist in defining data interconnections between operational and business functions.
• Assist in backup and recovery and perform POC analysis.

Qualifications

• Understanding of database systems and data warehousing solutions.
• Understanding of data lifecycle stages: collection, transformation, analysis, secure storage, and accessibility.
• Ability to scale data pipelines for throughput, real-time predictions, insights, data security, regulations, and compliance.
• Experience building a data platform, ensuring secure data motion and at rest, automating compliance, and auditing.
• Familiarity with analytics reporting technologies such as Power BI, Looker, Qlik.
• Basic knowledge of algorithms and data structures for big picture data functions.
• Familiarity with cloud services platforms (GCP, Azure, AWS) and all data lifecycle stages.
• Understanding ETL tool capabilities and ability to load transformed data into databases or BI platforms.
• Familiarity with machine learning algorithms for predictions.
• Capability to build data APIs for data scientists and BI analysts.
• Proficiency coding in statistical analysis languages such as Python, Java, Scala, C++.
• Understanding basics of distributed systems.
• Educational background: Bachelor’s degree in MIS, mathematics, statistics, or computer science, or equivalent experience.

Employee Type

Permanent

UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.