Senior Data Engineer — Azure Data Lake & Spark Pipelines

Driveformpc; San Antonio (TX); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Health insurance

Paid time off

401k matching program

Educational reimbursement

Job summary

Driveformpc is seeking a Senior Data Engineer in San Antonio, Texas. In this role, you will design and optimize scalable data pipelines, collaborate with various teams, and ensure data security and quality.

The ideal candidate will have a Bachelor's Degree in Information Technology and at least 5 years of experience in data engineering, including strong skills in Python and SQL. The position offers a full-time role with opportunities for professional growth and benefits.

Qualifications

• 5+ years of relevant data engineering experience.
• Strong proficiency in Python, SQL, Spark, and orchestration tools.
• Ability to mentor and contribute to engineering standards.

Responsibilities

• Design, develop, and optimize scalable data pipelines.
• Collaborate closely with cross-functional teams.
• Implement best practices for data security and quality.

Skills

Python

SQL

Spark

Azure Data Factory

Databricks

Hadoop

NoSQL Databases

Data Privacy

Data Quality Management

Data Security

Education

Bachelor's Degree in Information Technology or related field

Tools

Azure Data Services

Databricks Workflows

ETL Processes

Big Data Technologies

Job description

Driveformpc is seeking a Senior Data Engineer in San Antonio, Texas. In this role, you will design and optimize scalable data pipelines, collaborate with various teams, and ensure data security and quality.

The ideal candidate will have a Bachelor's Degree in Information Technology and at least 5 years of experience in data engineering, including strong skills in Python and SQL. The position offers a full-time role with opportunities for professional growth and benefits.