D365 Data Engineer

Fa Etvl Saasfaprod1

India

On-site

INR 4,000,000 - 7,000,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fa Etvl Saasfaprod1 is seeking a Senior Data Engineer with 8-12 years of IT experience to design and build scalable data pipelines and enterprise data platforms in a cloud-first environment. You will lead ETL/ELT development, data warehousing, and lakehouse architectures while driving analytics and AI/ML initiatives.

You will collaborate with analysts and data scientists to understand requirements, enforce governance, and optimize performance across large-scale datasets in Azure and other cloud

Qualifications

  • 8-12 years of overall IT experience.
  • Minimum 5+ years in Data Engineering with hands-on SQL and Python.
  • Experience with cloud-based data platforms (Azure preferred).
  • Expertise in building data pipelines, ETL/ELT frameworks, and data warehouses.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and integration frameworks.
  • Build and optimize ETL/ELT processes for structured and unstructured data.
  • Develop and manage data warehouses, data lakes, and lakehouse architectures.
  • Implement data ingestion, transformation, and orchestration using cloud-native services.
  • Collaborate with analysts, scientists, and stakeholders to understand data needs.
  • Ensure data governance, security, and compliance standards are met.
  • Optimize query performance for large-scale datasets.
  • Design real-time and batch data processing solutions.
  • Support reporting, analytics, AI/ML initiatives, and data engineering initiatives.
  • Participate in architecture reviews and provide technical leadership.
  • Develop CI/CD pipelines and automate deployment for data platforms.
  • Mentor junior engineers and promote best practices.

Skills

Data Engineering
Data Modeling
ETL/ELT Development
Data Warehousing Concepts
Data Lake & Lakehouse Architecture
Data Migration & Data Integration
Real-Time Data Processing
Cloud Platforms
Azure Data Factory
Azure Synapse Analytics
Azure Data Lake Storage
Azure Databricks
Microsoft Fabric
AWS Glue
Redshift
EMR
S3
GCP BigQuery
Dataflow
Cloud Storage
Big Data Technologies
Apache Spark
Databricks
Hadoop Ecosystem
Kafka
Delta Lake
Databases
SQL Server
Oracle
PostgreSQL
MySQL
Snowflake
Azure SQL Database
Python
SQL
PySpark
Scala
Shell Scripting
Azure DevOps
Git
CI/CD Pipelines
Jenkins

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

Azure DevOps
Git
Jenkins

Job description

We are seeking a highly skilled Senior Data Engineer with 8-12 years of experience in designing, developing, and managing scalable data platforms and enterprise data solutions. The ideal candidate will have strong expertise in data engineering, cloud technologies, ETL/ELT development, data warehousing, and big data ecosystems. The candidate will play a key role in building modern data platforms, enabling advanced analytics, business intelligence, AI/ML initiatives, and data-driven decision-making across the organization.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines and data integration frameworks.
  • Build and optimize ETL/ELT processes for structured and unstructured data sources.
  • Develop and manage enterprise data warehouses, data lakes, and lakehouse architectures.
  • Implement data ingestion, transformation, and orchestration solutions using cloud-native services.
  • Collaborate with business analysts, data scientists, architects, and stakeholders to understand data requirements.
  • Ensure data quality, governance, security, and compliance standards are met.
  • Optimize database and query performance for large-scale datasets.
  • Design and implement real-time and batch data processing solutions.
  • Support reporting, analytics, AI/ML, and advanced data engineering initiatives.
  • Participate in architecture reviews and provide technical leadership to the data engineering team.
  • Develop CI/CD pipelines and automate deployment processes for data platforms.
  • Mentor junior engineers and establish engineering best practices.
Required Technical Skills
  • Data Engineering
  • Data Modeling (Dimensional & Relational)
  • ETL/ELT Development
  • Data Warehousing Concepts
  • Data Lake & Lakehouse Architecture
  • Data Migration & Data Integration
  • Real-Time Data Processing
  • Cloud Platforms (Any One or More)
  • Microsoft Azure Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Azure Data Lake Storage (ADLS)
  • Azure Databricks
  • Microsoft Fabric
  • AWSGlue Redshift EMR S3
  • Google Cloud Platform (GCP) BigQuery Dataflow Cloud Storage
  • Big Data Technologies Apache Spark Databricks Hadoop Ecosystem Kafka Delta Lake Databases SQL Server Oracle PostgreSQL MySQL Snowflake Azure SQL Database
  • Programming Skills Python SQL PySpark Scala (Preferred)
  • Shell Scripting
  • DevOps & Version Control Azure DevOps Git CI/CD Pipelines Jenkins
Required Experience
  • 8-12 years of overall IT experience.
  • Minimum 5+ years of experience in Data Engineering.
  • Strong hands-on expertise in SQL and Python.
  • Experience with cloud-based data platforms (Azure preferred).
  • Expertise in building data pipelines, ETL/ELT frameworks, and data warehouses.
  • Experience working with large-scale structured and unstructured datasets.
  • Knowledge of data governance, security, and compliance frameworks.
  • Experience in Agile/Scrum delivery models.
Preferred Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
  • Microsoft Certified: Azure Data Engineer Associate (DP-203).
  • Microsoft Fabric Certification.
  • Databricks Certified Data Engineer.
  • AWS or GCP Data Engineering Certifications.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Engineer - I
Senior Big Data Engineer - I

Mployee.me • Pune District

On-site
INR 3,500,000 - 7,000,000
Senior Data Engineer
Senior Data Engineer

Recro • Vadodara

On-site
INR 1,200,000 - 1,600,000
Data Engineer
Data Engineer

Techcarrot • Chennai

On-site
INR 1,500,000 - 2,100,000
Senior Data Engineer
Senior Data Engineer

SOTIIND SOTI India Private Ltd. • Ernakulam

On-site
INR 1,500,000 - 2,000,000
Lead Big Data Engineer
Lead Big Data Engineer

MetLife, Inc. • Pune District

On-site
INR 3,500,000 - 7,000,000
Data Engineer
Data Engineer

DataPhi • Pune District

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

QUESTK2 Technologies • Hyderabad

Hybrid
INR 1,400,000 - 2,300,000
Azure Data Engineer
Azure Data Engineer

Saisystems Technology • Pune District, Mumbai, Gurugram District

Hybrid
INR 2,400,000 - 4,200,000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Hybrid
INR 3,500,000 - 6,500,000
Data And Integration Engineer
Data And Integration Engineer

CirrusLabs, LLC • Hyderabad, Pune District, Bengaluru

On-site
INR 1,500,000 - 3,000,000