Databricks Architect

Hexaware Technologies; Pune District, Bengaluru, Hyderabad; Hybrid; INR 1,500,000 - 2,500,000; Full time

Job summary

Hexaware Technologies is looking for a Senior Data Engineer/Data Architect with strong expertise in Azure. The role involves designing and implementing data processing pipelines and leveraging Azure services for cloud-based data warehousing.

The ideal candidate should have over 15 years of experience with a proven track record in data migration, data governance, and high-performance coding. This position offers a hybrid work model and requires exceptional communication skills.

Qualifications

• 15+ years of experience in relevant fields.
• Strong experience in data migration and cloud-based data warehousing.
• Proven ability to analyze and enhance ETL pipelines.

Responsibilities

• Design and build real-time and batch data processing pipelines.
• Analyze, debug, and enhance existing ETL pipelines.
• Implement data governance frameworks.

Skills

Data discovery

Data analysis

Data migration

Data quality

Data integration

Azure Data Factory

Azure Databricks

Python

Data governance

Power BI

Job description

Experience : 15 - 18yrs

Work mode : Hybrid

Work location : Pune/Hyderabad/Bangalore/Chennai

Notice Period : Imm - 45 days

Role: Senior Data Engineer / Data Architect (Azure)

• 10+ years of experience in data discovery, data analysis, data quality, and data integration
• 7+ years of experience designing and building real-time, near real-time, and batch data processing pipelines
• Strong experience in data migration and cloud-based data warehousing, primarily on Microsoft Azure
• Ability to analyze, debug, and enhance existing ETL pipelines as well as design and develop new ones
• Hands-on experience with Azure Data Factory, Azure Databricks, Synapse Analytics, and other Azure services
• Expertise in data ingestion, transformation, and orchestration workflows
• Good understanding of data governance frameworks and tools (e.g., Purview)
• Proven experience in:
  • Designing data architecture frameworks
  • Troubleshooting performance issues in pipelines
  • Optimizing data processing solutions
• Experience in building metadata-driven data pipelines
• Strong knowledge of Azure ecosystem components:
  • Data Lake
  • Databricks
  • Synapse
  • Purview
• Working knowledge of Power BI for reporting and data visualization
• Programming experience in Python / PySpark (preferred)
• Ability to write high-performance, scalable, and maintainable code
• Strong communication and stakeholder management skills