Azure Data Engineer: Synapse, PySpark & Power BI

Flintex Consulting Pte Ltd; Singapore; On-site; SGD 45,000 - 50,000; Full time

Job summary

Flintex Consulting Pte Ltd in Singapore is looking for a Data Engineer (Azure) to design and develop PySpark data pipelines, integrate data from diverse sources, and build analytical reports in Power BI. The role emphasizes Azure Synapse, Azure Data Explorer, and DevOps practices for robust data workflows.

You will work with SQL databases, data warehouses, and big data platforms to ensure secure access and scalable ingestion, with onsite hours from 8:30am to 6pm, Monday to Friday.

Qualifications

• Bachelor’s Degree in Computer Science or Engineering with 2 years of Azure Data engineering, Python, PySpark experience.
• Strong knowledge of Azure Synapse analytics for pipelines and orchestration.
• 1–2 years experience in Visualization design and development with Power BI, including row-level security.
• Solid SQL and data warehouse/ETL experience with PySpark and Python.
• Experience building ETL pipelines on cloud platforms (Azure/AWS), preferably Azure Synapse or Data Factory.
• Team player with good communication and problem-solving skills.
• DevOps experience preferred.

Responsibilities

• Design, review and development of PySpark scripts. Testing, troubleshooting of data pipelines, orchestration.
• Designing and developing reports and dashboards in PowerBI, setting up access control with row level security DAX query experience.
• Establishing connections to source data systems such as on-prem databases, IOT devices, APIs.
• Managing the collected data in appropriate storage/database solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc.
• Design, development of relevant data pipelines using PySpark, copy data activities for batch ingestion.
• Performing data integration e.g. using database table joins, or other mechanisms at an appropriate level as required by the analysis requirements of the project.
• Deployment of pipeline artifacts from one environment to the other using Azure Devops.

Skills

Azure Data Engineering

Python

PySpark

Big Data

Education

Bachelor’s Degree in Computer Science or Engineering

Tools

Azure Synapse

Power BI

Azure DevOps

SQL

Azure Data Factory

Hadoop

Job description

Flintex Consulting Pte Ltd in Singapore is looking for a Data Engineer (Azure) to design and develop PySpark data pipelines, integrate data from diverse sources, and build analytical reports in Power BI. The role emphasizes Azure Synapse, Azure Data Explorer, and DevOps practices for robust data workflows.

You will work with SQL databases, data warehouses, and big data platforms to ensure secure access and scalable ingestion, with onsite hours from 8:30am to 6pm, Monday to Friday.