Data Engineer | Databricks & ADF ETL Architect (12M)

Valiant Technologies LLC

Richardson (TX)

On-site

USD 98,000 - 139,000

Full time

17 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC in Richardson, TX is seeking a Data Engineer with hands-on experience in Databricks and Azure Data Factory (ADF) to design, develop, and optimize data pipelines and ETL processes. You will work with SQL, PySpark/Python, and Azure cloud services to create scalable data architectures.

The role involves building and maintaining ETL/ELT workflows, integrating data from multiple sources into data warehouses or data lakes, and collaborating with cross-functional teams to

Qualifications

Experience with Databricks and Azure Data Factory (ADF).
Strong understanding of ETL/ELT concepts.
Good knowledge of SQL and data transformations.
Basic experience with Python or PySpark.
Understanding of Azure cloud services and data lake concepts.

Responsibilities

Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
Work with Databricks for data processing and transformation.
Write and optimize SQL queries for data extraction and transformation.
Work with PySpark or Python for large-scale data processing.
Integrate data from multiple sources into data warehouses or data lakes.
Monitor, troubleshoot, and optimize data pipelines.
Collaborate with teams to ensure data quality and reliability.

Skills

ETL/ELT concepts

SQL

Python/PySpark

Azure data lake concepts

Azure cloud services

Tools

Databricks

Azure Data Factory

Job description

The role involves building and maintaining ETL/ELT workflows, integrating data from multiple sources into data warehouses or data lakes, and collaborating with cross-functional teams to

Get your free, confidential resume review.

or drag and drop your file here.