Data Engineer

Shrive Technologies LLC; Texas; On-site; USD 120,000 - 160,000; Full time

Job summary

Shrieve Technologies LLC in Texas is seeking a data engineer to design and develop scalable data pipelines and ETL/ELT solutions on Azure. The role emphasizes Databricks, PySpark, SQL, Delta Lake, and end-to-end data integration.

You will optimize performance, implement CI/CD for data workflows, and collaborate with analytics teams to deliver reliable data products at scale.

Qualifications

• Experience designing scalable data pipelines on Azure.
• Deep knowledge of Databricks, PySpark, SQL, and Delta Lake.
• Familiarity with CI/CD for data workflows and Azure data services.

Responsibilities

• Design and develop scalable data pipelines and ETL/ELT solutions on Azure.
• Optimize data processing performance and ensure robust CI/CD for data workflows.

Skills

Databricks

PySpark

SQL

Delta Lake

Azure data services

data integration

performance optimization

CI/CD

Job description

Job Summary

Responsible for designing and developing scalable data pipelines and ETL/ELT solutions on Azure.

Mandatory skills: Databricks, PySpark, SQL, Delta Lake, Azure data services, data integration, performance optimization, and CI/CD.

Key Responsibilities

Responsible for designing and developing scalable data pipelines and ETL/ELT solutions on Azure. Mandatory skills: Databricks, PySpark, SQL, Delta Lake, Azure data services, data integration, performance optimization, and CI/CD.