Senior Databricks Engineer

Psiog; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Psiog is a pure play software services specialist delivering technology services and solutions from its Chennai headquarters. The day-to-day development activities require knowledge of ETL concepts, SQL Server, and data modelling, with hands-on ADF and Databricks expertise.

You will engage with global clients and contribute to governance using Databricks Unity Catalog, SQL development, and SDLC practices. Secondary skills include Python, SSIS, and Azure DevOps, with opportunities to mentor and

Qualifications

• Experience with large-scale ETL development and data pipelines.
• Strong understanding of SQL Server and data modelling concepts.
• Hands-on with ADF, Databricks, and airflow in production environments.
• Familiarity with Unity Catalog for governance and security.

Responsibilities

• Develop scalable data pipelines and orchestrate workflows.
• Collaborate with customers to translate requirements into data models.
• Provide consultative options on project execution and best practices.
• Adhere to SDLC, version control, and CI/CD standards.

Skills

SQL Server

SQL query writing

Dimensional modelling

ETL concepts

ADF

Azure Databricks

Airflow

Databricks Unity Catalog

End-to-end ETL

SDLC practices

CI/CD

Source control/Repos

Python (bonus)

SSIS (bonus)

Azure DevOps (bonus)

Tools

ADF

Azure Databricks

Airflow

Databricks Unity Catalog

Azure DevOps

Source Control/Repos

Job description

Psiog is a pure play software services specialist focusing on delivering technology services & solutions in the areas of operational efficiency & customer experience. Headquartered in Chennai, India, Psiog services global customers in North America, EMEA, ANZ & APAC across a variety of industries such as Manufacturing, Energy & Utilities, Hi-Tech, Financial Services, Retail and Automobile. Psiog’s core expertise is in building, implementing, testing, integrating & maintaining applications leveraging a variety of cutting-edge tools & technologies.

Key service offerings for the mid-market segment are:

The day-to-day development activities will require knowledge of the following concepts

• ExpertlevelknowledgeinRDBMS(SQLServer)withclearunderstandingofSQLquerywriting,objectcreationandmanagementandperformanceandoptimisationofDB/DWHoperations.
  
• GoodunderstandingofTransactionalandDimensionalDataModelling,StarSchema,Facts/Dimensions,Relationships.
  
• GoodunderstandingofETLconceptsandexposuretotoolssuchasAzureDataFactory (ADF),AzureDatabricks,Airflow.
  
• In-Depth expertise in ADF and Databricks, including building scalable data pipelines, orchestrating complex workflows, implementing dynamic and parameterized pipelines, and optimising Spark-based data transfirmations for large-scale integrations.
  
• Hands-on experience with Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and secure management of data assets across multiple workspaces.
  
• Should have worked on at least 1 development lifecycle of one of the following:
  
• End-to-end ETL project involving the above-mentioned ETL tools.
  
• Ability to write and review test cases, test code, and validate code.
• Good understanding of SDLC practices , including:
• Source control
• Version management
• CI/CD practices
  

Requirements

From a project context

• Should have the ability to fully understand the context and use case of a project and develop a personal vision for it.
  
• Should be comfortable interfacing directly with customers on a daily basis.
  
• Should be able to communicate with functional users and translate requirements into tangible processes/models and documentation using available templates.
  
• Should be able to provide consultative options to customers on the best way to execute projects.
  

Should have a good understanding of project dynamics , including:

• Scoping
• Timeline planning
• Managing timelines in case of exceptions

Added Opportunities

• Opportunity to work as part of the Enterprise Data Management Centre of Excellence and contribute to the strategic growth of a fast-growing practice.
• Opportunity to mentor young, fresh minds from premier institutions.
• Exposure to multiple clients and projects simultaneously through the CoE model of working.

Secondary Skills

• Knowledge of Python is a bonus.
• Knowledge of SSIS is a bonus.
• Knowledge of Azure DevOps and Source Control/Repos is good to have.
  
• At Psiog, we believe people grow when opportunities do. You’ll be part of an ecosystem that encourages curiosity, innovation, and ownership.
• Work with global clients, and enterprise environments, enabling exposure beyond conventional delivery models.
• Accelerated career tracks with a faster roadmap to leadership for those who demonstrate capability and initiative.
• Opportunity to explore diverse technologies, projects, learning opportunities and domains, allowing you to shape your own growth path.
• An organization that celebrates passion alongside profession, encouraging creativity, art, and individuality.