Databricks Developer

2027 Teqdata Inc.; Irving (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

2027 Teqdata Inc. is seeking a skilled Data Engineer with over 7 years of experience in data engineering. The ideal candidate will have deep technical knowledge in Databricks, Python, and Microsoft Azure, including building ETL pipelines.

Candidates should also possess strong SQL skills and familiarity with various databases. This position emphasizes hands-on experience optimizing data applications and conducting root cause analysis to enhance data processes.

Qualifications

• 7+ years of relevant and progressive data engineering experience.
• Deep knowledge in Databricks, Python, Scala, and Azure architecture.
• Hands-on experience with various data pipelines.

Responsibilities

• Develop batch ETL pipelines and optimize data applications.
• Perform root cause analysis on internal and external data.
• Leverage design patterns and CI/CD in data engineering practices.

Skills

Data engineering experience

Databricks

Python

Scala

Microsoft Azure

SQL knowledge

Job description

Job Description:

7+ years of relevant and progressive data engineering experience

Deep Technical knowledge and experience in Databricks, Python, Scala, and Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored procedures

Hands‑on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, Synapse, Data Lake, file‑based, SQL database)

Experience in engineering practices such as development, code refactoring, leveraging design patterns, CI/CD, and building highly scalable data applications and processes

Experience developing batch ETL pipelines; real‑time pipelines are a plus

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience working with Teradata is a plus