Databricks Engineer

Databricks Engineer
Remote Position
6+ Month Contract

Skilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures in an Azure environment.

Key Responsibilities:

1. Develop and maintain scalable data pipelines using Databricks, PySpark, and Python
2. Work with structured and unstructured data in cloud-based environments
3. Implement data transformation, cleansing, and integration solutions
4. Collaborate with data engineers, analysts, and stakeholders to meet business requirements

Requirements:

1. Strong experience with Databricks, Python, and PySpark
2. Hands-on experience with Apache Spark and big data processing
3. Proficiency in SQL and working with Azure cloud platform
4. Experience with ETL development and performance tuning
5. Knowledge of data lake, data warehouse, and data modeling principles

Metasys Technologies is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.