Databricks data Engineer

KPI Partners; Pune District, Bengaluru, Hyderabad; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

KPI Partners is seeking a talented and motivated Databricks Engineer to join our dynamic team. The ideal candidate will possess strong skills in data engineering and analytics, with a deep understanding of Databricks and its ecosystem.

Responsibilities include designing and implementing data pipelines, collaborating with data scientists, optimizing data infrastructure, and ensuring data quality across the lifecycle.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience with Databricks, Apache Spark, and cloud platforms such as AWS or Azure.
• Strong programming skills in Python, Scala, or SQL.
• Knowledge of data modeling, data warehousing, and database management systems.
• Familiarity with machine learning frameworks and tools is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Responsibilities

• Design and implement data pipelines and ETL processes using Databricks.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Optimize and maintain existing data infrastructure for performance and reliability.
• Develop and manage data models and frameworks to enhance data accessibility.
• Monitor, troubleshoot, and resolve technical issues related to Databricks and associated technologies.
• Ensure data quality and integrity throughout the data lifecycle.
• Stay up to date with the latest trends and technologies in data engineering and analytics.

Skills

Databricks

Apache Spark

Python

Scala

SQL

Education

Bachelor's degree in Computer Science/Information Technology

Tools

AWS

Azure

Job description

Description

KPI Partners is seeking a talented and motivated Databricks Engineer to join our dynamic team. The ideal candidate will possess strong skills in data engineering and analytics, with a deep understanding of Databricks and its ecosystem.

Responsibilities

• Design and implement data pipelines and ETL processes using Databricks.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Optimize and maintain existing data infrastructure for performance and reliability.
• Develop and manage data models and frameworks to enhance data accessibility.
• Monitor, troubleshoot, and resolve technical issues related to Databricks and associated technologies.
• Ensure data quality and integrity throughout the data lifecycle.
• Stay up to date with the latest trends and technologies in data engineering and analytics.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience working with Databricks, Apache Spark, and cloud platforms such as AWS or Azure.
• Strong programming skills in languages such as Python, Scala, or SQL.
• Knowledge of data modeling, data warehousing, and database management systems.
• Familiarity with machine learning frameworks and tools is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

If you are passionate about data engineering and eager to work in a fast-paced environment, we would love to hear from you. Join KPI Partners and help us drive innovation through data!