Senior Data Engineer: Cloud Pipelines & Data Warehousing

7Th Sky Tech; Dallas (TX); Hybrid; USD 120,000 - 170,000; Full time

Job summary

7Th Sky Tech is seeking a Senior Data Engineer with 8+ years of hands-on experience to design and maintain scalable data platforms and pipelines. You will work with Python, SQL, ETL/ELT, and cloud data warehousing to enable data-driven decision making.

The role requires strong skills in distributed processing (Spark), data modeling, and CI/CD practices. Collaborative cross‑functional work and mentorship are expected in a hybrid environment.

Qualifications

• 8+ years of professional data engineering experience.
• Proficient in Python and SQL with strong ETL/ELT skills.
• Experience designing scalable data pipelines and warehouses.
• Hands-on with Spark/PySpark and distributed processing.
• Strong cloud experience (AWS, Azure, GCP) and data warehousing knowledge.
• Experience with data governance, security, and quality frameworks.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data workflows using Python and SQL.
• Develop data ingestion from databases, APIs, files, and more.
• Design and maintain data warehouses, lakes, and lakehouse architectures.
• Work with large datasets using Spark/PySpark.
• Implement data quality, validation, monitoring, and error handling.
• Collaborate with cross-functional teams to meet business needs.
• Mentor junior engineers and contribute to architecture decisions.

Skills

Python

SQL

ETL/ELT

Spark/PySpark

Cloud platforms

Data warehousing

APIs

Git & CI/CD

Education

Bachelor's or Master's in CS/Eng

Tools

Databricks

Snowflake

Airflow

Kubernetes

Docker

Terraform

Jenkins / GitHub Actions

Azure Data Factory

AWS Glue

Job description

7Th Sky Tech is seeking a Senior Data Engineer with 8+ years of hands-on experience to design and maintain scalable data platforms and pipelines. You will work with Python, SQL, ETL/ELT, and cloud data warehousing to enable data-driven decision making.

The role requires strong skills in distributed processing (Spark), data modeling, and CI/CD practices. Collaborative cross‑functional work and mentorship are expected in a hybrid environment.