Databricks Engineer

Tror AI for everyone; Cleveland (OH); On-site; USD 120,000 - 160,000; Full time

Job summary

Tror AI for everyone in Cleveland, OH is seeking a Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

You will build and maintain data pipelines with Databricks, Spark/PySpark, Python, and SQL, and collaborate with architects, analysts, and stakeholders to deliver reliable, secure data platforms onsite four days a week.

Qualifications

• Databricks Certified Data Engineer Professional certification is required.
• Extensive experience with Databricks and Spark/PySpark.
• Proficient in Python and SQL development.
• Experience building enterprise-scale ETL/ELT data pipelines.
• Experience with cloud data platforms (Azure/AWS/GCP).
• Knowledge of Delta Lake and data warehousing/lake architecture.
• Strong troubleshooting and problem-solving skills.

Responsibilities

• Develop scalable data pipelines using Databricks, Spark, and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data transformations using Python and SQL.
• Work with cloud data platforms, data lakes, and enterprise data warehouses.
• Implement data quality, performance optimization, monitoring, and troubleshooting.
• Collaborate with data architects, analysts, developers, and stakeholders.
• Follow best practices for data security, governance, CI/CD, and deployment.
• Troubleshoot production issues and improve pipeline reliability and performance.

Skills

Databricks

Apache Spark/PySpark

Python

SQL

ETL/ELT pipelines

Cloud platforms (Azure/AWS/GCP)

Delta Lake

Data modeling / data warehousing /data

Troubleshooting

Databricks Certified Data Engineer Pro

Tools

Git

CI/CD

Databricks Workflows

Delta Live Tables

Unity Catalog

Azure Data Factory / AWS Glue

Job description

Job Title: Databricks Engineer
Location: Cleveland, OH
Work Arrangement: Onsite 4 days per week

Job Overview:

We are looking for an experienced Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Databricks, Apache Spark, and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data transformations using Python and SQL.
• Work with cloud data platforms, data lakes, and enterprise data warehouses.
• Implement data quality, performance optimization, monitoring, and troubleshooting.
• Collaborate with data architects, analysts, developers, and business stakeholders.
• Follow best practices for data security, governance, CI/CD, and deployment.
• Troubleshoot production issues and improve pipeline reliability and performance.

Required Skills:

• Strong hands-on experience with Databricks and Apache Spark/PySpark.
• Strong Python and SQL development skills.
• Experience building enterprise-scale ETL/ELT data pipelines.
• Experience with cloud data platforms such as Azure, AWS, or GCP.
• Knowledge of Delta Lake and Databricks data engineering capabilities.
• Strong understanding of data modeling, data warehousing, and data lake architecture.
• Excellent troubleshooting and problem-solving skills.
• Databricks Certified Data Engineer Professional certification MUST HAVE.
• Ability to work onsite in Cleveland, OH, 4 days per week.

Preferred Skills:

• Experience with Azure Data Factory / AWS Glue / similar orchestration tools.
• Experience with Git, CI/CD, and DevOps practices.
• Knowledge of Unity Catalog, Databricks Workflows, and Delta Live Tables.
• Experience working in Agile development environments.