Remote Azure Data Engineer: ETL & PySpark on Synapse

Bluelight Consulting LLC; Mexico; Hybrid; PHP 5,552,127 - 8,636,643; Full time

Job summary

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will work with data scientists and analysts to deliver high-quality datasets for insights in a fast-paced environment.

The role emphasizes scalable data notebooks/pipelines, data warehousing concepts, and collaboration with cross-functional teams while upholding data governance and security standards. #LI-Remote

Qualifications

• ETL data engineering using Python (PySpark) to extract, transform, and load data.
• Experience with Azure Synapse Notebooks and Pipelines.
• Strong SQL skills; SparkSQL and MS SQL knowledge.
• Familiar with data governance, security, and best practices.
• Excellent communication and teamwork across disciplines.
• Degree or equivalent plus data engineering certs are a plus.

Responsibilities

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data warehousing structures and star schemas for analytics.
• Ingest data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for scalability and performance.
• Support data fabrics, lakes, delta lakes, and data catalogs.
• Collaborate with data architects on models and schemas.
• Implement data quality checks and validation processes.
• Identify bottlenecks and ensure ETL reliability against SLAs.
• Monitor jobs, troubleshoot issues, and document data flows.
• Work with cross-functional teams on data-related initiatives.
• Maintain data security and privacy compliance.

Skills

PySpark

Python

ETL

SQL

Data Warehousing

SparkSQL

Education

Bachelor’s degree in CS/IT or related field

Tools

Azure Synapse Analytics

Linked Services

Azure Key Vault

Git (Azure DevOps)

Power BI

Tableau

Job description

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will work with data scientists and analysts to deliver high-quality datasets for insights in a fast-paced environment.

The role emphasizes scalable data notebooks/pipelines, data warehousing concepts, and collaboration with cross-functional teams while upholding data governance and security standards. #LI-Remote