Lead Data Engineer (Databricks)

Uplers; Singapore; Hybrid; INR 65,000 - 95,000; Full time

Job summary

A leading company seeks a Lead Data Engineer with expertise in Databricks and a strong background in data engineering. The role involves designing scalable data solutions, collaborating with teams, and leveraging advanced technologies. Join a dynamic team dedicated to innovative data practices and professional growth.

Qualifications

• 7+ to 10 years of experience in data engineering, with focus on Databricks.
• Proven expertise in building and optimizing data solutions using Databricks.
• Excellent analytical, problem-solving, and communication skills.

Responsibilities

• Lead the design, development, and optimization of data solutions using Databricks.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Provide technical leadership and mentorship to junior engineers.

Skills

AWS Glue

Databricks

Azure Data Factory

SQL

Python

Data Modelling

ETL

Big Data Pipelines

Data Warehousing

Education

Bachelors or Master's Degree in Computer Science, Information Technology, or a related field

Tools

Databricks

Azure Data Factory

AWS Glue

Docker

Job description

Experience: 7+ years

Salary: INR hidden_mobile / year (based on experience)

Shift: (GMT+05:30) Asia/Kolkata (IST)

Opportunity Type: Hybrid (Pune)

Placement Type: Full time Permanent

Note: This is a requirement for one of Uplers' clients - Inferenz

What do you need for this opportunity

• Must have skills required: AWS Glue, Databricks, Azure Data Factory, SQL, Python, Data Modelling, ETL, Big Data Pipelines, Data Warehousing

Inferenz is Looking for:

• Position: Lead Data Engineer (Databricks)
• Location: Pune, Ahmedabad
• Required Experience: 7 to 10 years
• Preferred: Immediate Joiners

Job Overview

We are seeking an accomplished Lead Data Engineer with expertise in Databricks to join our dynamic team. This role is crucial for enhancing our data engineering capabilities and offers the chance to work with advanced technologies, including Generative AI.

Key Responsibilities

1. Lead the design, development, and optimization of data solutions using Databricks, ensuring they are scalable, efficient, and secure.
2. Collaborate with cross-functional teams to gather and analyze data requirements, translating them into robust data architectures and solutions.
3. Develop and maintain ETL pipelines, leveraging Databricks and integrating with Azure Data Factory as needed.
4. Implement machine learning models and advanced analytics solutions, incorporating Generative AI to drive innovation.
5. Ensure data quality, governance, and security practices are adhered to, maintaining the integrity and reliability of data solutions.
6. Provide technical leadership and mentorship to junior engineers, fostering an environment of learning and growth.
7. Stay updated on the latest trends and advancements in data engineering, Databricks, Generative AI, and Azure Data Factory to continually enhance team capabilities.

Qualifications

• Bachelors or masters degree in computer science, Information Technology, or a related field.
• 7+ to 10 years of experience in data engineering, with a focus on Databricks.
• Proven expertise in building and optimizing data solutions using Databricks and integrating with Azure Data Factory/AWS Glue.
• Proficiency in SQL and programming languages such as Python or Scala.
• Strong understanding of data modelling, ETL processes, and Data Warehousing/Data Lakehouse concepts.
• Familiarity with cloud platforms, particularly Azure, and containerization technologies such as Docker.
• Excellent analytical, problem-solving, and communication skills.
• Demonstrated leadership ability with experience mentoring and guiding junior team members.

Preferred Skills

• Experience with Generative AI technologies and their applications.
• Familiarity with other cloud platforms, such as AWS or GCP.
• Knowledge of data governance frameworks and tools.

How to apply for this opportunity

1. Click On Apply! And Register or Login on our portal.
2. Complete the Screening Form & Upload updated Resume
3. Increase your chances to get shortlisted & meet the client for the Interview!

About Uplers

Our goal is to make hiring reliable, simple, and fast. We help talents find and apply for relevant opportunities and support you during your engagement. Many more opportunities are available on the portal.

If you're ready for a new challenge and a great work environment, apply today. We look forward to hearing from you!