Senior Azure Data Engineer — Lakehouse & Pipelines (Remote)
MSR Technology Group
A complete application in a minute
Tailored resume and cover letter, ready to send.
Job summary
MSR Technology Group is seeking a hands-on Senior Azure Data Engineer to support a large-scale Enterprise Data Warehouse modernization. You will design scalable Azure data pipelines and modernize legacy ETL environments to support analytics, reporting, dashboards, and AI/ML use cases.
Ideal candidates will have strong Databricks, PySpark, SQL, ADLS Gen2, Delta Lake, and Azure Synapse experience, with migrations from Informatica PowerCenter to Azure.
Qualifications
- Strong Databricks and PySpark experience.
- Advanced SQL development and performance tuning.
- Experience with ADLS Gen2 and Delta Lake.
- Experience with Azure Synapse, Azure Databricks and/or Microsoft Fabric.
- Experience building enterprise ETL/ELT pipelines.
- Experience with Azure DevOps and CI/CD.
- Experience with modern Lakehouse architecture.
Responsibilities
- Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, Synapse and/or Microsoft Fabric.
- Develop and optimize PySpark notebooks and Python-based data processing solutions.
- Implement modern Lakehouse and Medallion architectures using ADLS Gen2, Delta Lake and Parquet.
- Develop and optimize complex SQL for large enterprise data environments.
- Support dimensional modeling, Data Vault, SCD and CDC patterns.
- Support legacy-to-cloud modernization, including Informatica PowerCenter to Azure Data Factory migrations.
- Troubleshoot and support critical production data pipelines.
Skills
Job description
MSR Technology Group is seeking a hands-on Senior Azure Data Engineer to support a large-scale Enterprise Data Warehouse modernization. You will design scalable Azure data pipelines and modernize legacy ETL environments to support analytics, reporting, dashboards, and AI/ML use cases.
Ideal candidates will have strong Databricks, PySpark, SQL, ADLS Gen2, Delta Lake, and Azure Synapse experience, with migrations from Informatica PowerCenter to Azure.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
