Senior Data Engineer

I.T. Solutions, Inc.

Foster City (CA)

Hybrid

USD 103,320 - 110,208

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Comprehensive benefits package

Equal employment opportunities

Job summary

A tech-focused firm in Foster City, CA is looking for a Data Engineer/Developer with expertise in Databricks, AWS, and advanced Python to design and optimize data pipelines. The ideal candidate will have a strong background in data processing, cloud infrastructure, and database management. This is a contract position for 18 months, requiring 3 days onsite. Competitive salary based on experience.

Qualifications

5+ years of experience in data engineering or related roles.
Strong expertise in Databricks, Apache Spark, and big data processing.
Proficiency in AWS services (S3, Redshift, Lambda, Glue, etc.).
Advanced knowledge of PL/QL and Oracle database management.
Experience with Starburst for federated query optimization.
Familiarity with Python for data integration and workflow automation.
Strong understanding of data modeling, ETL processes, and cloud architecture.
Excellent problem-solving skills and ability to work in agile environments.

Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
Implement ETL processes for structured and unstructured data across AWS cloud environments.
Optimize SQL and PL/QL queries for performance and reliability in Oracle databases.
Work with Starburst to enhance data federation and query optimization across multiple sources.
Monitor and troubleshoot data pipeline performance, ensuring high availability and efficiency.
Develop automation scripts for data ingestion, transformation, and validation.

Skills

Databricks

AWS

Advanced Python

PL/QL

Starburst

Oracle

Big data processing

Data modeling

ETL processes

Agile environments

Education

BS or MS in Computer Science

Tools

Apache Spark

Docker

Kubernetes

Job description

This range is provided by I.T. Solutions, Inc.. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$75.00/hr - $80.00/hr

Direct message the job poster from I.T. Solutions, Inc.

Recruitment Professional @ I.T. Solutions, Inc.

Job Title: SR. Data Engineer/Developer

Location: Foster City, CA (3 days onsite)

Job Type: 18 Months Contract

W2 contract/ No C2C

Job Summary:

We are seeking a highly skilled Data Engineer with deep expertise in Databricks, AWS, Advanced Python, PL/QL, Starburst, and Oracle to design, develop, and optimize data pipelines. The ideal candidate will have a strong background in big data processing, cloud infrastructure, and database management to support scalable and efficient data solutions.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
Implement ETL processes for structured and unstructured data across AWS cloud environments.
Optimize SQL and PL/QL queries for performance and reliability in Oracle databases.
Work with Starburst to enhance data federation and query optimization across multiple sources.
Collaborate with cross-functional teams to integrate Paytheon solutions into data workflows.
Ensure data security, compliance, and governance across all platforms.
Monitor and troubleshoot data pipeline performance, ensuring high availability and efficiency.
Develop automation scripts for data ingestion, transformation, and validation.

Required Skills & Qualifications:

5+ years of experience in data engineering or related roles.
Strong expertise in Databricks, Apache Spark, and big data processing.
Proficiency in AWS services (S3, Redshift, Lambda, Glue, etc.).
Advanced knowledge of PL/QL and Oracle database management.
Experience with Starburst for federated query optimization.
Familiarity with Python for data integration and workflow automation.
Strong understanding of data modeling, ETL processes, and cloud architecture.
Excellent problem-solving skills and ability to work in agile environments.

Preferred Qualifications:

BS or MS in Computer Science.
Life Siences experience is a big plus/
Certifications in AWS, Databricks, or Oracle.
Experience with containerization (Docker, Kubernetes).
Knowledge of CI/CD pipelines for data engineering.

The salary range provided for this contract role represents our good faith estimate for this position. Within the range, individual offers will vary based on the selected candidate's experience, industry knowledge, technical and communication skills, location and other factors that may prove relevant during the interview process (W2 or C2C). In addition to compensation, the company provides eligible W2 employees with a comprehensive and highly competitive benefits package.

I.T. Solutions, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Job Schedule

Seniority level