Azure Data Platform Lead — Spark, Synapse & ETL

HCL Technologies Limited

Northern (KY)

Hybrid

USD 90,000 - 125,000

Full time

2 days ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

AD&D insurance

Disability insurance

Employee assistance program

401(k) retirement plan

Paid time off - 10 days

Paid holidays - 10 days

Job summary

HCL Technologies Limited in the United States is seeking a Data Engineer with strong expertise in Azure data platforms and big data technologies to design, develop, and optimize scalable data pipelines and analytics solutions.

The role focuses on using Azure Synapse, Spark/PySpark, and SQL to deliver robust ETL/ELT processes, work with Cosmos DB and ADLS, and ensure data quality and operational stability across production deployments.

Qualifications

Hands-on experience with Azure Synapse Analytics.
Strong programming skills in Scala and Spark/PySpark.
Advanced SQL development and performance tuning experience.
Experience with Cosmos DB and Azure Data Lake Storage (ADLS).
Good understanding of data warehousing and big data concepts.
Strong problem-solving and communication skills.

Responsibilities

Design and develop scalable data ingestion and transformation pipelines.
Build and optimize ETL/ELT solutions using Azure Synapse, Spark/PySpark, and SQL.
Develop data processing frameworks using Scala and Spark.
Work with Cosmos DB and ADLS for data storage and management.
Create and optimize complex SQL queries for reporting and analytics.
Collaborate with business and technical teams to deliver data solutions.
Ensure data quality, performance tuning, and operational stability.
Support production deployments and troubleshoot data platform issues.