Sr Data Engineer (with Azure and AWS)

Kellton; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

An established industry player is seeking a Sr. Data Engineer to lead ETL design and implementation using Databricks and PySpark. This remote role requires extensive experience in handling large data volumes and optimizing performance for PB-scale data processing. The ideal candidate will possess strong technical leadership skills and a solid understanding of data lake architecture and ETL processes. Join a forward-thinking team where your expertise will drive impactful data solutions in the health and human services sector.

Qualifications

• Over 9 years of IT experience with strong proficiency in PySpark and SQL.
• Experience with data lake architecture and ETL processes.

Responsibilities

• Design and implement ETL processes in Databricks using PySpark.
• Optimize performance for PB-scale data processing.

Skills

PySpark

SQL

ETL Processes

Data Lake Architecture

Data Quality Management

AZURE

Databricks

Spark

AWS Data Analytics Services

Job description

Direct message the job poster from Kellton

Sr. Technology Recruiter and Business Developer | Top Performer

We are looking for a Sr Data Engineer. If interested, please email your updated resume to [e-mail].

Details:

• Location: 100% Remote
• Focus: ETL Heavy - Data Engineer

Responsibilities include ETL design, development, and implementation in Databricks using PySpark and Delta tables. Experience with handling very large data volumes is preferred. No AI/ML work involved.

Qualifications:

• Over 9+ years of total IT experience
• Proficiency in PySpark and SQL coding
• Experience working with AZURE, Databricks, and Spark
• Knowledge of data lake architecture, ETL processes, and data quality management
• Some experience with AWS data analytics services
• Ability to optimize performance for PB-scale data processing
• Technical leadership experience is a must

Thanks,

Amita Tatiparti

Sr. Technology Recruiter

Harborside 5, Jersey City, NJ 07311

Additional Details:

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Information Technology
• Industries: Health and Human Services

Referrals can double your chances of interviewing at Kellton. Sign in to set job alerts for “Data Engineer” roles.