Senior ETL Engineer: Python, PySpark & Cloud Data Pipelines

Infinite Computer Solutions; Maryland; On-site; USD 110,000 - 160,000; Full time

Job summary

Infinite Computer Solutions is seeking an experienced ETL Developer with strong Python, PySpark, and FastAPI skills to design, build, and maintain scalable data integration solutions across enterprise platforms. You will work with MongoDB, Elasticsearch, Snowflake, MSSQL, and cloud services in AWS and GCP to ingest, transform, and load data, and expose RESTful APIs for data access.

You will collaborate with data engineers, architects, and analytics teams to deliver robust data pipelines,

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Equivalent work experience may be considered.
• 5+ years of experience in Data Engineering, ETL Development, or related roles.
• Strong experience developing ETL pipelines using Python and PySpark.
• Experience working in cloud-based data environments.
• Proven experience building REST APIs using FastAPI.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark.
• Extract, transform, validate, and load data from multiple sources.
• Build reusable data ingestion frameworks and automation utilities.
• Develop batch and near-real-time data processing solutions.
• Ensure data integrity, quality, and consistency across enterprise systems.
• Develop integrations with MongoDB, Elasticsearch, Snowflake, MSSQL.
• Create optimized data movement solutions between operational databases, cloud storage platforms, and analytical environments.
• Design and implement efficient data models and data loading strategies.
• Optimize SQL queries and database performance.
• Design and develop RESTful APIs using FastAPI for data ingestion/extraction/validation.

Skills

Python

PySpark / Apache Spark

SQL

Data transformation

Data quality

FastAPI

REST APIs

OpenAPI/Swagger

API security

Analytical thinking

Education

Bachelor’s degree in Computer Science/IT/Engineering

Tools

MongoDB

Elasticsearch

Snowflake

MSSQL

AWS

GCP

S3

GCS

Apache Spark

FastAPI (framework)

Job description

Infinite Computer Solutions is seeking an experienced ETL Developer with strong Python, PySpark, and FastAPI skills to design, build, and maintain scalable data integration solutions across enterprise platforms. You will work with MongoDB, Elasticsearch, Snowflake, MSSQL, and cloud services in AWS and GCP to ingest, transform, and load data, and expose RESTful APIs for data access.

You will collaborate with data engineers, architects, and analytics teams to deliver robust data pipelines,