Remote Azure Databricks Engineer | Python & SQL

Exavalu Solutions India Pvt Ltd; Poland; Remote; PLN 336,000 - 486,000; Full time

Job summary

Exavalu Solutions India Pvt Ltd is hiring for a remote Data Engineer role focusing on building robust ETL/ELT pipelines with Azure Databricks, Spark, and SQL. You will process and transform complex data using Python/PySpark and SQL, while managing data in ADLS Gen2 and Delta Lake for high performance.

The position offers a permanent remote working model, inviting candidates from diverse locations to contribute to analytics initiatives across Insurance, Healthcare, and Financial Services domains.

Qualifications

• Strong data engineering skills on Azure, ADF, Synapse and Databricks.
• Strong experience of Python/Pysprak, SQL.

Responsibilities

• Data Pipeline Development: Design, build, and optimize ETL/ELT pipelines using Azure Databricks, Spark, and SQL.
• Data Processing & Transformation: Use Python, PySpark, and SQL to clean, transform, and aggregate data for analytics.
• Azure Data Lake Management: Manage data storage and retrieval in ADLS Gen2.
• Delta Lake Implementation: Implement Delta Lake for ACID compliance and high-performance data lake ops.
• Integration with Azure Services: Integrate Databricks with ADF, Synapse, and Key Vault for security.
• Performance Optimization: Monitor and optimize Databricks clusters and Spark jobs.

Tools

Azure Data Factory

Delta Lake

Azure Data Lake Storage

Databricks

Azure Synapse

Job description

Exavalu Solutions India Pvt Ltd is hiring for a remote Data Engineer role focusing on building robust ETL/ELT pipelines with Azure Databricks, Spark, and SQL. You will process and transform complex data using Python/PySpark and SQL, while managing data in ADLS Gen2 and Delta Lake for high performance.

The position offers a permanent remote working model, inviting candidates from diverse locations to contribute to analytics initiatives across Insurance, Healthcare, and Financial Services domains.