Senior Data Engineer – Databricks

Aspire, Jordan; India; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Aspire, Jordan is seeking an experienced Data Engineer with Databricks to design, develop, and optimize scalable data pipelines and modern data platforms. You will collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to deliver reliable, high-quality data solutions that support analytics and BI initiatives.

We value strong Spark and PySpark expertise, SQL proficiency, and hands-on cloud experience (Azure, AWS, or GCP), plus data warehousing concepts and

Qualifications

• Bachelor’s degree in CS, IT, Engineering or related field.
• 5-7 years of Data Engineering experience.
• Hands-on Databricks experience.
• Proficient in Spark, PySpark and SQL.
• Cloud experience on Azure, AWS or GCP.
• Knowledge of data warehousing concepts and dimensional modeling.
• Experience with Git or similar version control.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Develop and manage data ingestion processes from multiple data sources.
• Process and analyze large-scale datasets with Apache Spark and PySpark.
• Design and maintain data models to support analytics and reporting.
• Optimize data pipelines for performance, accuracy, and quality.
• Collaborate with stakeholders to translate data requirements into technical designs.
• Implement data governance, security, and engineering best practices.
• Monitor, troubleshoot, and enhance data pipelines and workflows.
• Document technical designs, processes, and standards.
• Contribute to data architecture and engineering improvements.

Skills

Databricks

Apache Spark

PySpark

SQL

Cloud platforms

Data warehousing

Data governance

Data quality

ETL/ELT

Data ingestion

Big data

Airflow

CI/CD (data)

Git

Delta Lake

Lakehouse

Data modeling

Diagnostics & monitoring

Education

Bachelor’s degree in Computer Science, IT, Engineering

Tools

Delta Lake

Apache Airflow

Git

Job description

We are looking for an experienced Data Engineer with strong expertise in Databricks to design, develop, and optimize scalable data pipelines and modern data platforms.

The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and ETL/ELT processes, with a strong focus on building reliable, high-quality data solutions that support analytics and business intelligence initiatives.

The Data Engineer will collaborate closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver scalable, efficient, and well-governed data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Develop and manage data ingestion processes from multiple data sources.
• Process and analyze large-scale datasets using Apache Spark and PySpark.
• Design and maintain data models to support analytics and reporting.
• Optimize data pipeline performance and ensure data accuracy and quality.
• Collaborate with business and technical stakeholders to understand and translate data requirements.
• Implement data governance, security, and engineering best practices.
• Monitor, troubleshoot, and enhance existing data pipelines and data workflows.
• Document technical designs, processes, and data engineering standards.
• Contribute to the continuous improvement of data architecture and engineering practices.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 5-7 years of experience in Data Engineering or a similar role.
• Strong hands-on experience with Databricks.
• Strong proficiency in Apache Spark and PySpark.
• Strong SQL skills and experience working with relational databases.
• Experience with at least one major cloud platform: Azure, AWS, or GCP.
• Solid understanding of data warehousing concepts and dimensional modeling.
• Experience with version control systems such as Git.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Skills

• Experience with Delta Lake and Lakehouse architecture.
• Familiarity with AWS Glue or equivalent cloud data services.
• Experience with orchestration tools such as Apache Airflow.
• Knowledge of CI/CD practices for data engineering.
• Experience implementing data quality, governance, and monitoring solutions.
• Databricks or cloud platform certifications are a plus.

Experience Requirements

• 5-7 years of relevant Data Engineering experience.
• 2-3+ years of hands-on Databricks experience preferred.
• Proven experience building and optimizing production-grade data pipelines.