Databricks + Pyspark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite

PradeepIt Global Consulting Pvt Ltd.; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading tech consulting firm in Bengaluru is seeking a Data Engineer with expertise in Databricks, PySpark, and SQL, requiring 4 to 8 years of experience. The successful candidate will be responsible for developing and maintaining ETL processes, optimizing data pipelines, and collaborating with cross-functional teams. This onsite position offers an excellent opportunity for professionals aiming to advance their careers in a dynamic environment.

Qualifications

• 4-8 years of professional experience working with Databricks, PySpark, and SQL.
• Strong proficiency in ETL processes for large-scale data sets.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.

Responsibilities

• Collaborate with cross-functional teams to understand data requirements.
• Develop and maintain ETL processes with Databricks and PySpark.
• Optimize existing data pipelines for performance.
• Implement data quality processes for accuracy.

Skills

Databricks

PySpark

SQL

Education

Bachelor's degree in Computer Science, Engineering, or a related field

Job description

Databricks + PySpark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite

Job Openings Databricks + PySpark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite

About the job

Databricks + PySpark + SQL | 4 to 8 Years | IST Time | Bangalore | Onsite

Role: Databricks + PySpark + SQL

Year of Experience: 4-8 Years

Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
• Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
• Optimize and tune existing data pipelines to ensure optimal performance and scalability.
• Create and implement data quality and validation processes to ensure the accuracy of data.
• Work with stakeholders to understand business needs and translate them into actionable data solutions.
• Collaborate with the data science team to support machine learning model deployment and integration into production systems.
• Troubleshoot and resolve data-related issues promptly.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience working with Databricks, PySpark, and SQL in a professional setting.
• Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
• Experience with data modeling, data warehousing, and database design principles.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.