Senior/Lead Data Engineer - Azure

Uplers; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A leading data solutions provider in Singapore seeks a Senior Data Engineer to spearhead teams and design data architectures. Responsibilities include working with Azure technologies and creating data lakes for effective data processing. Candidates should have strong skills in SQL, Python, and a background in data governance, with at least 6 years of relevant experience.

Qualifications

• At least 6 years of experience as a data engineer.
• Strong technical expertise in data models and data mining.
• Proficiency in distributed processing frameworks.

Responsibilities

• Design the architecture of new projects.
• Lead a team of Data Engineers.
• Establish a robust code framework.

Skills

SQL

Azure

Python

Spark

Docker

Kubernetes

ETL

Data Warehousing

Data Lake

Machine Learning

Education

Degree in Computer Science, Data Science, Mathematics, IT, or related fields

Tools

Azure Synapse

PySpark

Kafka

Job description

As a Senior/Lead Data Engineer with Blend360, you will be tasked with spearheading the data engineering teams and guiding them to the next level of excellence. Your primary responsibilities will include designing the architecture of new projects, selecting the appropriate tech stack, and planning development cycles with a focus on AGILE methodology. Additionally, you will play a crucial role in establishing a robust code framework that is both purpose-built and flexible enough to adapt to evolving business requirements.Collaboration with various stakeholders will be essential to gain a deep understanding of the data practitioners" needs and ensure scalable delivery. Leading a team of Data Engineers, you will be responsible for defining, building, and maintaining the Data Platform. Your role will involve working on constructing a Data Lake in Azure Fabric, processing data from multiple sources, and migrating existing data stores from Azure Synapse to Azure Fabric. Implementation of data governance and access control measures will also be part of your responsibilities.Furthermore, you will drive the end-to-end development efforts to deliver high-quality solutions within the specified timelines and in alignment with the architectural vision. Presenting technical solutions in business terms, communicating status updates, issues, and risks effectively, and contributing to critical initiatives such as Data Discovery, Data Lineage, and Data Quality will be key aspects of your role.To qualify for this position, you should have at least 6 years of experience as a data engineer, preferably in Azure Synapses, ADF, or relevant experience in Azure Fabric. A degree in Computer Science, Data Science, Mathematics, IT, or a related field is required. Strong technical expertise in data models, data mining, segmentation techniques, and familiarity with object-oriented libraries like Python or pySpark is essential. Proficiency in SQL, Spark, PySpark, Spark SQL, and distributed processing frameworks is crucial for building large-scale data pipelines.In addition, the ideal candidate should possess Azure Cloud experience, knowledge of data governance practices, and familiarity with CI/CD pipelines, Agile Methodologies, Docker, and Kubernetes. The ability to work independently, mentor junior resources, and lead a team of Data Engineers across different levels is highly desirable.If you are ready to take on a new challenge, thrive in a dynamic work environment, and elevate your career to new heights, we encourage you to apply for this exciting opportunity with Blend360. Join us in our mission to simplify and expedite the hiring process while supporting your career growth and development. We look forward to welcoming you to our team!,

Sign-in & see how your skills match this job

Sign-in & Get noticed by top recruiters and get hired fast

ETL, Hadoop, Spark, Kafka, Python, Scala, Java, Azure, Relational Databases, SQL, Data Warehousing, Snowflake, Analytical Skills, Communication Skills, Containerization, Docker, Kubernetes, Machine Learning, Data Analytics, Apache Kafka, DevOps,Data Engineer, Big Data Technologies, Confluent, Data Lake, PosgreSQL, Data Factory, Cloud Platforms, Google Cloud, NoSQL Databases, Redshift, Big Query, ProblemSolving Skills, Collaboration Skills, Full Stack Web Development, Java Technologies, Orchestration Tools, Data Streaming Technologies, Kinesis

Sr. SQL Developer

APTO SOLUTIONS - EXECUTIVE SEARCH & CONSULTANTS

5 to 9 Yrs

Maharashtra

Maharashtra +1

• MS SQL Server
• query optimization
• +9

  performance tuning, communication skills, MS SQL, entity framework,writing complex stored procedures for reporting, working with schema scripts , data warehouse environments, database debugging, Azure SQL

ETL, Hadoop, Spark, Kafka, Python, Scala, Java, Azure, Relational Databases, SQL, Data Warehousing, Snowflake, Analytical Skills, Communication Skills, Containerization, Docker, Kubernetes, Machine Learning, Data Analytics, Apache Kafka, DevOps,Data Engineer, Big Data Technologies, Confluent, Data Lake, PosgreSQL, Data Factory, Cloud Platforms, Google Cloud, NoSQL Databases, Redshift, Big Query, ProblemSolving Skills, Collaboration Skills, Full Stack Web Development, Java Technologies, Orchestration Tools, Data Streaming Technologies, Kinesis

Sr. SQL Developer

APTO SOLUTIONS - EXECUTIVE SEARCH & CONSULTANTS

5 to 9 Yrs

Maharashtra

Maharashtra +1

• MS SQL Server
• query optimization
• +9

  performance tuning, communication skills, MS SQL, entity framework,writing complex stored procedures for reporting, working with schema scripts , data warehouse environments, database debugging, Azure SQL