Databricks Data Integration Engineer

Infovision Labs; Bengaluru; Hybrid; INR 3,000,000 - 5,000,000; Full time

Job summary

Infovision Labs in Bengaluru is seeking a seasoned Data Integration Engineer to lead robust data pipelines across ERP/CRM platforms. The role bridges business and technology, driving data integration while aligning with finance, operations, and sales teams.

The ideal candidate has 8+ years in data engineering, with Databricks, Azure data services, and enterprise applications experience. This is a hybrid role with opportunities to optimize data workflows and governance.

Qualifications

• Bachelor’s degree in CS/IS/Engineering or related field; Master’s preferred.
• 8+ years in data engineering, integration, or analytics with enterprise apps focus.
• Strong knowledge of Databricks, Spark, SQL, Python, Delta Lake.
• Hands-on experience integrating data from Salesforce, Oracle ERP, SAP, or other major platforms.
• Understanding of ERP/CRM processes (order-to-cash, procure-to-pay, lead-to-opportunity).
• Experience with Azure services (Data Lake, Data Factory, Key Vault, DevOps).
• Ability to translate business requirements into technical solutions; data governance and security awareness.

Responsibilities

• Collaborate with business and IT stakeholders to gather requirements and translate them into scalable data integration solutions.
• Design and implement ETL/ELT pipelines for connecting enterprise systems to cloud data platforms.
• Serve as liaison between data engineering and functional teams to align data mapping and validation logic.
• Build and optimize Databricks pipelines using Python, SQL, Delta Lake, and Spark."
• Ensure data models reflect ERP/CRM workflows and maintain data quality and traceability.
• Utilize Fivetran and Azure Data Factory to manage end-to-end integration processes.
• Manage CI/CD pipelines using Azure DevOps for reliable deployment of data workflows.

Skills

Stakeholder management

Cross-functional collaboration

Analytical thinking

Problem solving

Education

Bachelor's degree in Computer Science/Engineering/IS

Master's preferred

Tools

Databricks

Spark

SQL

Python

Delta Lake

Fivetran

Azure Data Factory

Job description

• Experience with Delta Live Tables, Unity Catalog, Delta Sharing, and Fivetran connectors.


• Background in working with business-facing stakeholders or cross-functional teams (e.g., finance, operations, sales).


• Knowledge of cloud data platforms (Azure, AWS, or GCP) and hybrid on-prem/cloud architectures.


• Agile and DevOps knowledge to support fast iteration and reliable deployment.


• Excellent written and verbal communication skills, capable of presenting both to technical and non-technical audiences.


• Ability to manage tasks across geographically distributed teams and complex enterprise environments.

Qualifications:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; Master’s preferred.


• 8+ years of experience in data engineering, integration, or analytics roles, with a focus on enterprise applications.


• Strong knowledge of Databricks, Spark, SQL, Python, and Delta Lake.


• Hands-on experience integrating data from Salesforce, Oracle ERP, SAP, or other major enterprise platforms. (optional)


• Solid understanding of ERP/CRM business processes (order-to-cash, procure-to-pay, lead-to-opportunity, etc.) (optional)


• Experience with Azure services (Data Lake, Azure Data Factory, Key Vault, DevOps).


• Ability to gather business requirements and translate them into technical solutions.


• Familiarity with data modeling, data governance practices, and security/access control strategies.


• Strong analytical and problem-solving skills with a collaborative mindset.

Roles and Responsibilities

We are seeking a Data Integration Engineer with deep expertise in Databricks, Azure data services, and enterprise applications (ERP & CRM) such as Oracle ERP, SAP, and Salesforce. This hybrid role is ideal for someone who can bridge the gap between business and technology, driving data integration efforts while aligning closely with functional teams to understand business processes, data requirements, and enterprise system logic.

The successful candidate will lead the development of robust data pipelines, facilitate stakeholder collaboration, and ensure smooth integration across internal systems and third-party platforms.

Key Responsibilities

• Collaborate with business and IT stakeholders to gather requirements and translate functional needs into scalable data integration solutions.


• Design and implement ETL/ELT pipelines for connecting and transforming data between enterprise systems (Salesforce, Oracle ERP, SAP) and cloud data platforms.


• Serve as a liaison between data engineering teams and functional teams (finance, sales, operations) to align on data mapping, usage, and validation logic.


• Build and optimize Databricks pipelines using Python, SQL, Delta Lake, and Spark for ingestion, transformation, and enrichment.


• Ensure data models reflect business logic and ERP/CRM workflows, maintaining data quality, consistency, and traceability.


• Utilize tools like Fivetran, Azure Data Factory, and custom connectors to manage end-to-end integration processes.


• Manage CI/CD pipelines using Azure DevOps for reliable deployment of data workflows and infrastructure.


• Maintain documentation for functional mappings, data flows, technical specifications, and system interfaces.


• Work with architects and security teams to implement and monitor data security, governance, and access control policies.


• Contribute to ongoing optimization of system performance, ensuring responsiveness and scalability of data solutions.


• Provide guidance and mentorship to junior engineers and support user acceptance testing (UAT) from a functional and technical perspective.


• Participate in cross-functional project planning and act as a subject matter expert for data from ERP/CRM platforms.