Databricks Data Engineer Onsite Only W2

Trebecon LLC; Charlotte (NC); On-site; USD 110,000 - 160,000; Full time

Job summary

Trebecon LLC in Charlotte, NC is seeking a Databricks Data Engineer to design and implement scalable data pipelines. You will develop ETL/ELT processes with PySpark and SQL, work with Delta Lake, and optimize Spark jobs.

You will build and maintain Databricks notebooks, ensuring data quality and performance in a collaborative, cross-functional environment. The role emphasizes cloud platform experience (Azure/AWS/GCP), version control, and CI/CD practices, with onsite work in Charlotte.

Qualifications

• Strong experience designing scalable data pipelines.
• Hands-on PySpark, Python, and SQL development.
• Experience with Delta Lake and data quality.
• Proficient in Git, CI/CD, and cloud platforms (Azure/AWS/GCP).

Responsibilities

• Design and develop scalable data pipelines using Databricks and Apache Spark.
• Develop ETL/ELT processes using Python/PySpark and SQL.
• Work with Delta Lake for data storage and processing.
• Build and optimize data workflows and notebooks in Databricks.
• Perform data transformation, cleansing, and validation.
• Optimize Spark jobs and SQL queries for performance.
• Work with cloud data platforms and storage services.
• Implement data quality, monitoring, and troubleshooting processes.
• Collaborate with data architects, analysts, and business teams.
• Follow best practices for Git, CI/CD, and data engineering.

Skills

Databricks

Spark / PySpark

Python

SQL

Delta Lake

ETL/ELT

Cloud platforms

Data warehouse concepts

Git & CI/CD

Troubleshooting

Performance tuning

Tools

Databricks notebooks

Delta Lake tooling

CI/CD pipelines

Job description

• Design and develop scalable data pipelines using Databricks and Apache Spark.
• Develop ETL/ELT processes using Python/PySpark and SQL.
• Work with Delta Lake for data storage and processing.
• Build and optimize data workflows and notebooks in Databricks.
• Perform data transformation, cleansing, and validation.
• Optimize Spark jobs and SQL queries for performance.
• Work with cloud data platforms and storage services.
• Implement data quality, monitoring, and troubleshooting processes.
• Collaborate with data architects, analysts, and business teams.
• Follow best practices for Git, CI/CD, and data engineering.

Role : Databricks Data Engineer

Location

Charlotte, NC – Onsite

Key Responsibilities

• Design and develop scalable data pipelines using Databricks and Apache Spark.
• Develop ETL/ELT processes using Python/PySpark and SQL.
• Work with Delta Lake for data storage and processing.
• Build and optimize data workflows and notebooks in Databricks.
• Perform data transformation, cleansing, and validation.
• Optimize Spark jobs and SQL queries for performance.
• Work with cloud data platforms and storage services.
• Implement data quality, monitoring, and troubleshooting processes.
• Collaborate with data architects, analysts, and business teams.
• Follow best practices for Git, CI/CD, and data engineering.

Required Skills

• Strong experience with Databricks
• Hands-on experience with Apache Spark / PySpark
• Strong Python and SQL
• Experience with Delta Lake
• Strong ETL/ELT and data pipeline development experience
• Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform
• Experience with data warehouse/lakehouse concepts
• Git and CI/CD experience
• Strong troubleshooting and performance-tuning skills