Databricks Engineer (Immediate Joiners Only- 3 to 15 Years)

GyanSys Inc.; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

GyanSys Inc. is seeking Databricks Engineers/Consultants to design, develop, and optimize scalable data pipelines on the Databricks Lakehouse Platform. The role involves collaborating with architects, analysts, and data scientists to deliver robust data solutions for analytics, reporting, and AI initiatives.

You will work across ETL/ELT processes, Delta Lake, and cloud environments (Azure/AWS/GCP), ensuring data quality, governance, and CI/CD deployment practices.

Qualifications

• Hands-on experience with Databricks Lakehouse Platform.
• Strong PySpark, Spark SQL, and Python expertise.
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
• Understanding of ETL/ELT, data warehousing, and data modeling.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and optimize data pipelines for structured, semi-structured, and unstructured data.
• Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
• Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
• Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
• Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
• Ensure data quality, governance, security, and compliance across data platforms.
• Implement CI/CD best practices and support deployment of Databricks solutions.
• Troubleshoot production issues and continuously improve platform performance.
• Create technical documentation and support knowledge-sharing initiatives.

Skills

Databricks Lakehouse Platform

PySpark

Apache Spark

Spark SQL

Python

Delta Lake

Databricks Workflows

Unity Catalog

ETL/ELT

Data Warehousing

Data Modeling

Azure

AWS

GCP

Git

Azure DevOps/GitHub

Education

Bachelor's or Master's degree in Computer Science/IT/Engineering

Tools

Git

Azure DevOps

GitHub

CI/CD practices

Job description

Employment Type: Full-Time

GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.

Job Summary

GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and optimize data pipelines for structured, semi-structured, and unstructured data.
• Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
• Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
• Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
• Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
• Ensure data quality, governance, security, and compliance across data platforms.
• Implement CI/CD best practices and support deployment of Databricks solutions.
• Troubleshoot production issues and continuously improve platform performance.
• Create technical documentation and support knowledge-sharing initiatives.

Required Technical Skills

• Hands-on experience with Databricks Lakehouse Platform
• Strong expertise in PySpark, Apache Spark, Spark SQL, and Python
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog
• Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
• Experience with Azure, AWS, or GCP cloud platforms
• Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
• Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases

Preferred Skills

• Experience with Medallion Architecture and Lakehouse concepts
• Exposure to Kafka, Event Hubs, or other streaming technologies
• Knowledge of Power BI or Tableau
• Understanding of Agile/Scrum methodologies
• Exposure to Microsoft Fabric is an added advantage

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

Experience

• Domain Experience: 3–5 Years

Preferred Certifications

• AWS Certified Data Analytics – Specialty
• Google Professional Data Engineer

Why Join GyanSys?

At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.