Senior Data Engineer - Hybrid, Scalable Pipelines

7Th Sky Tech; Palo Alto (CA); Hybrid; USD 170,000 - 210,000; Full time

Job summary

7Th Sky Tech in California seeks a Senior Data Engineer with 8+ years hands-on experience to design, build, and maintain scalable data platforms and pipelines. Core expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and distributed processing is required.

You will collaborate with Data Scientists, Software Engineers, and Analysts to deliver reliable, high‑performance data solutions and enable data-driven decision making.

Qualifications

• 8+ years of professional experience in Data Engineering.
• Strong programming experience with Python.
• Advanced SQL skills and query optimization.
• Hands-on ETL/ELT development and data pipeline design.
• Experience with distributed processing using Spark/PySpark.
• Familiarity with cloud data platforms (AWS, Azure, GCP).

Responsibilities

• Design and maintain scalable ETL/ELT data pipelines.
• Develop data ingestion from databases, APIs, files, and more.
• Architect data warehouses, data lakes, and lakehouse solutions.
• Work with Spark/PySpark for large datasets.
• Implement data quality, monitoring, and error handling.
• Collaborate with cross-functional teams on requirements.
• Mentor junior engineers and contribute to architecture.

Skills

Python

SQL

ETL/ELT

Spark / PySpark

Data Warehousing

Cloud Platforms (AWS/Azure/GCP)

Data Modeling

CI/CD / DevOps basics

Education

Bachelor's degree in CS/Engineering

Master's degree (preferred)

Tools

Databricks

Snowflake

Redshift

Synapse

BigQuery

Airflow

Git / CI/CD

Job description

7Th Sky Tech in California seeks a Senior Data Engineer with 8+ years hands-on experience to design, build, and maintain scalable data platforms and pipelines. Core expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and distributed processing is required.

You will collaborate with Data Scientists, Software Engineers, and Analysts to deliver reliable, high‑performance data solutions and enable data-driven decision making.