Databricks Data Engineer: Scalable Pipelines Onsite

Tror AI for everyone; Cleveland (OH); On-site; USD 120,000 - 160,000; Full time

Job summary

Tror AI for everyone in Cleveland, OH is seeking a Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

You will build and maintain data pipelines with Databricks, Spark/PySpark, Python, and SQL, and collaborate with architects, analysts, and stakeholders to deliver reliable, secure data platforms onsite four days a week.

Qualifications

• Databricks Certified Data Engineer Professional certification is required.
• Extensive experience with Databricks and Spark/PySpark.
• Proficient in Python and SQL development.
• Experience building enterprise-scale ETL/ELT data pipelines.
• Experience with cloud data platforms (Azure/AWS/GCP).
• Knowledge of Delta Lake and data warehousing/lake architecture.
• Strong troubleshooting and problem-solving skills.

Responsibilities

• Develop scalable data pipelines using Databricks, Spark, and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data transformations using Python and SQL.
• Work with cloud data platforms, data lakes, and enterprise data warehouses.
• Implement data quality, performance optimization, monitoring, and troubleshooting.
• Collaborate with data architects, analysts, developers, and stakeholders.
• Follow best practices for data security, governance, CI/CD, and deployment.
• Troubleshoot production issues and improve pipeline reliability and performance.

Skills

Databricks

Apache Spark/PySpark

Python

SQL

ETL/ELT pipelines

Cloud platforms (Azure/AWS/GCP)

Delta Lake

Data modeling / data warehousing /data

Troubleshooting

Databricks Certified Data Engineer Pro

Tools

Git

CI/CD

Databricks Workflows

Delta Live Tables

Unity Catalog

Azure Data Factory / AWS Glue

Job description

Tror AI for everyone in Cleveland, OH is seeking a Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

You will build and maintain data pipelines with Databricks, Spark/PySpark, Python, and SQL, and collaborate with architects, analysts, and stakeholders to deliver reliable, secure data platforms onsite four days a week.