Data Engineer: Cloud Data Pipelines & Lakehouse

Creative Information Technology India; Falls Church (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

Creative Information Technology Inc is seeking a hands-on Data Engineer to design, develop, and optimize large-scale data pipelines for the Enterprise Data Warehouse and Data Lake solutions. You will implement ingestion, transformation, and integration workflows using PySpark on AWS, ensuring data quality and analytics readiness.

Responsibilities include building data architectures, coordinating with teams, and enforcing CI/CD and IaC practices to improve scalability and cost efficiency.

Qualifications

• Bachelor’s or master’s degree in CS/Stats/Math/Economics or related field.
• 3+ years of experience building data pipelines on AWS or equivalent cloud platforms.
• Proficient in Python and SQL; Spark (PySpark) experience.
• Experience with ETL processes and data architecture.

Responsibilities

• Design, build, and maintain data pipelines and infrastructure to support data-driven decisions.
• Develop data lakehouse architectures (data lake, data warehouse, data marts) for analytics.
• Implement data reliability, quality checks, and performance improvements.
• Collaborate with multiple teams and ensure security and compliance of pipelines.

Skills

Python

SQL

Apache Spark (PySpark)

ETL

Airflow

CI/CD

Terraform

AWS

AWS Glue

Delta Lake

Iceberg

Data Pipelines

Education

Bachelor’s or Master’s in CS/Stats/Math/Economics

Tools

AWS Glue

S3

Redshift

Athena

EMR

Iceberg

Delta Lake

Airflow

Job description

Creative Information Technology Inc is seeking a hands-on Data Engineer to design, develop, and optimize large-scale data pipelines for the Enterprise Data Warehouse and Data Lake solutions. You will implement ingestion, transformation, and integration workflows using PySpark on AWS, ensuring data quality and analytics readiness.

Responsibilities include building data architectures, coordinating with teams, and enforcing CI/CD and IaC practices to improve scalability and cost efficiency.