Data Engineer: Scalable Pipelines, Lakehouse & Real-Time

EdgeQ Technologies Private Limited

United States

On-site

USD 120,000 - 180,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

EdgeQ Technologies Private Limited is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure. You will collaborate with data scientists, analysts, and engineering teams to enable analytics and machine learning across the organization.

Responsibilities include building ETL workflows, optimizing data warehouses and lakehouse architectures, and implementing batch and real-time processing using Python, SQL, and Spark on AWS/Azure/GCP.

Qualifications

  • Bachelor's degree in Computer Science, IT, Engineering or related field.
  • 2-9 years of professional experience in data engineering.
  • Strong programming skills in Python, SQL and Spark/PySpark.
  • Hands-on experience with cloud platforms (AWS/Azure/GCP) and data warehouse technologies.
  • Proficiency in building and maintaining production-grade ETL pipelines.

Responsibilities

  • Design, develop and maintain scalable data pipelines and ETL/ELT workflows.
  • Build and optimize data warehouses, lakes, and lakehouse architectures.
  • Implement batch and real-time data processing using Python, SQL and Spark.
  • Manage cloud-based data infrastructure on AWS, Azure or GCP.
  • Ensure data quality, security, governance and monitor pipeline performance.
  • Collaborate with analytics, AI/ML and engineering teams to deliver reliable data solutions.

Skills

Python
SQL
Spark/PySpark

Education

Bachelor's degree in Computer Science, IT, Engineering or related field

Tools

AWS
Azure
GCP
dbt
Airflow
Snowflake
Databricks
Kafka

Job description

EdgeQ Technologies Private Limited is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure. You will collaborate with data scientists, analysts, and engineering teams to enable analytics and machine learning across the organization.

Responsibilities include building ETL workflows, optimizing data warehouses and lakehouse architectures, and implementing batch and real-time processing using Python, SQL, and Spark on AWS/Azure/GCP.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Build Scalable Pipelines & Cloud Data
Data Engineer: Build Scalable Pipelines & Cloud Data

EdgeQ Technologies Private Limited • Dallas (TX)

On-site
USD 100,000 - 160,000
Senior Data Engineer: Scalable ETL & Lakehouse Pipelines
Senior Data Engineer: Scalable ETL & Lakehouse Pipelines

Ethereum Technologies • San Jose (CA)

On-site
USD 130,000 - 200,000
Senior Data Engineer: Lakehouse Pipelines & Data Quality
Senior Data Engineer: Lakehouse Pipelines & Data Quality

Taskus India • United States

Remote
USD 140,000 - 190,000
Remote Cloud Data Engineer – ETL & Data Warehousing
Remote Cloud Data Engineer – ETL & Data Warehousing

EdgeQ Technologies Private Limited • New York (NY)

Hybrid
USD 85,000 - 160,000
Health insurance
Paid time off
Professional development
+1
AWS Data Engineer: Scalable Pipelines & Lakes
AWS Data Engineer: Scalable Pipelines & Lakes

Quantum Technologies LLC • Chicago (IL)

On-site
USD 120,000 - 170,000
Analytics Engineer: Build Scalable Data Pipelines
Analytics Engineer: Build Scalable Data Pipelines

EdgeQ Technologies Private Limited • San Francisco (CA)

On-site
USD 120,000 - 180,000
Data Engineer: Scalable Lakehouse & Real-Time Pipelines
Data Engineer: Scalable Lakehouse & Real-Time Pipelines

GSquared Group • Atlanta (GA)

On-site
USD 120,000 - 160,000
Data Engineer: Scalable Pipelines & AI Data Platforms
Data Engineer: Scalable Pipelines & AI Data Platforms

Resolve Tech Solutions • Irving (TX)

On-site
USD 110,000 - 150,000
Lead Data Engineer: Scale Data Lakes & Real-Time Pipelines
Lead Data Engineer: Scale Data Lakes & Real-Time Pipelines

Good co India • United States

Remote
USD 120,000 - 180,000
Big Data Engineer: Cloud, Spark & Real-Time Pipelines
Big Data Engineer: Cloud, Spark & Real-Time Pipelines

EdgeQ Technologies Private Limited • Chicago (IL)

Hybrid
USD 85,000 - 160,000
Health insurance
Paid time off
Professional development
+1