Data Engineer

CloudBigD

Plano (TX)

On-site

USD 98,000 - 139,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD is seeking a Data Engineer in Plano, TX to design and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write efficient SQL, and leverage PySpark for large-scale data tasks.

The role involves integrating data from various sources into data lakes or warehouses, monitoring pipelines, and ensuring data quality across teams in a fast-paced environment.

Qualifications

  • Experience with Databricks and Azure Data Factory (ADF).
  • Solid ETL/ELT concepts and data transformations.
  • Proficient in SQL and data transformation techniques.
  • Basic Python or PySpark knowledge for large-scale processing.
  • Understanding of Azure cloud services and data lake concepts.

Responsibilities

  • Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
  • Work with Databricks for data processing and transformation.
  • Write and optimize SQL queries for data extraction and transformation.
  • Use PySpark or Python for large-scale data processing.
  • Integrate data from multiple sources into data warehouses or data lakes.
  • Monitor, troubleshoot, and optimize data pipelines.
  • Collaborate with teams to ensure data quality and reliability.

Skills

Databricks
Azure Data Factory (ADF)
ETL/ELT concepts
SQL
Python or PySpark
Azure cloud services & data lakes

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data Engineer
Location: Plano, TX
Duration: 12 Months + Extension
Bill Rate: $86/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are looking for a Data Engineer with experience in Databricks and Azure Data Factory (ADF) to develop, maintain, and optimize data pipelines and ETL processes.

Responsibilities:
  • Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
  • Work with Databricks for data processing and transformation.
  • Write and optimize SQL queries for data extraction and transformation.
  • Work with PySpark or Python for large-scale data processing.
  • Integrate data from multiple sources into data warehouses or data lakes.
  • Monitor, troubleshoot, and optimize data pipelines.
  • Collaborate with teams to ensure data quality and reliability.
Required Skills:
  • Experience with Databricks and Azure Data Factory (ADF).
  • Strong understanding of ETL/ELT concepts.
  • Good knowledge of SQL and data transformations.
  • Basic experience with Python or PySpark.
  • Understanding of Azure cloud services and data lake concepts.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Ethereum Technologies LLC • Plano (TX)

On-site
USD 118,000 - 136,000
Data Engineer
Data Engineer

Quantum Technologies. LLC • Plano (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Robotic Process Automation LLC • Plano (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Plano (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Plano (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Richardson (TX)

On-site
USD 101,000 - 136,000
Data Engineer
Data Engineer

Robotic Process Automation LLC • Richardson (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Richardson (TX)

On-site
USD 98,000 - 139,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Richardson (TX)

On-site
USD 72,000 - 118,000