Data Architect/Engineer#26-29107

Us Tech Solutions

Dallas (TX)

Hybrid

USD 120,000 - 180,000

Full time

2 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

US Tech Solutions is seeking a Senior Data Engineer contractor to lead onboarding and integration of datasets for Middle Office functions. You will design, build, and operationalize data pipelines using AWS, Spark/PySpark, and modern data lake technologies to deliver scalable data platforms.

The role requires hands-on experience with CI/CD, IaC, and data modeling, and you will shepherd datasets from requirements through to production-grade pipelines supporting enterprise analytics.

Qualifications

  • Senior Data Engineer with hands-on AWS data services experience.
  • Experience with Spark/PySpark, data lakes, and data pipelines.
  • Knowledge of CI/CD and IaC practices.

Responsibilities

  • Onboard and integrate datasets for Middle Office functions.
  • Design, develop and operationalize reliable data pipelines ingesting data from multiple sources.
  • Model and transform data for downstream consumption and make it available via scalable data platforms.
  • Produce production-ready, supportable data products or pipelines.

Skills

AWS Data
Spark / PySpark
Python
Airflow / MWAA
Data Modeling
CI/CD / IaC

Tools

Terraform
GitHub Actions
Git
AWS EMR
Glue / Data Catalog
S3 / Athena
Airflow

Job description

  • We are looking for an experienced Senior Data Engineer contractor to support the onboarding and integration of datasets used by Middle Office functions.
  • The successful candidate will be responsible for designing, developing, and operationalizing reliable data pipelines that ingest data from multiple sources, transform and model it for downstream consumption, and make it available through scalable data platforms.
  • This is a hands‑on engineering role requiring strong experience with AWS, Apache Spark/PySpark, modern data lake technologies, workflow orchestration, data modeling, and infrastructure‑as‑code/CI/CD practices.
  • The ideal candidate should be comfortable taking a dataset from initial requirements and source analysis through to a production‑ready, supportable data product or pipeline.
Duration: 12 Months Contract to hire
Position Overview
  • We are looking for an experienced Senior Data Engineer contractor to support the onboarding and integration of datasets used by Middle Office functions.
  • The successful candidate will be responsible for designing, developing, and operationalizing reliable data pipelines that ingest data from multiple sources, transform and model it for downstream consumption, and make it available through scalable data platforms.
  • This is a hands‑on engineering role requiring strong experience with AWS, Apache Spark/PySpark, modern data lake technologies, workflow orchestration, data modeling, and infrastructure‑as‑code/CI/CD practices.
  • The ideal candidate should be comfortable taking a dataset from initial requirements and source analysis through to a production‑ready, supportable data product or pipeline.
Required Technical Skills
  • AWS & Cloud Data Engineering: Strong hands‑on experience with AWS data and analytics services, particularly:
  • AWS EMR
  • AWS Glue and Glue Data Catalog
  • Amazon Athena
  • Amazon S3
  • AWS IAM and general AWS security concepts

The candidate should understand how these services work together when designing and operating enterprise‑scale data pipelines.

Spark & Big Data:
  • Expert‑level or strong hands‑on experience with:
  • Apache Spark
  • PySpark
  • Distributed data processing
  • Large‑scale dataset transformation and optimization
  • Spark performance tuning and troubleshooting
  • Partitioning and efficient data processing strategies

Strong experience working with modern data lake/table formats, particularly:

  • Apache Hudi
  • Apache Iceberg

The candidate should understand concepts such as schema evolution, partitioning, incremental processing, upserts, snapshots, and management of large analytical tables.

Python & Software Engineering: Strong programming skills in:
  • Python
  • PySpark

Candidate should consistently produce clean, modular, maintainable, and production‑quality code, with experience in:

  • Object‑oriented and modular design where appropriate
  • Unit and integration testing
  • Error and exception handling
  • Logging
  • Code reviews
  • Git‑based development workflows
Workflow Orchestration

Strong hands‑on experience with Apache Airflow or a comparable enterprise orchestration platform.

Candidate should be comfortable designing:

  • DAGs and workflow dependencies
  • Scheduling
  • Retry and failure‑handling strategies
  • Backfill and rerun processes
  • Monitoring and alerting
  • Parameterized and reusable workflows

Experience with Amazon MWAA is an asset.

Data Architecture & Modeling

Strong understanding of:

  • Data modeling
  • Data pipeline architecture
  • Data lake architecture
  • Schema design
  • Data partitioning
  • Incremental data processing
  • Historical data management
  • Data quality and reconciliation
  • Data lineage

Candidate should be capable of translating business requirements into a scalable technical data model and an operationally supportable data pipeline.

Infrastructure & CI/CD

Working knowledge of modern DevOps and infrastructure‑as‑code practices, including:

  • Terraform
  • GitHub Actions
  • Git
  • CI/CD pipelines
  • Automated testing and deployment
  • Environment configuration and promotion

The candidate does not need to be a dedicated DevOps engineer but should be comfortable working with infrastructure definitions and deployment pipelines as part of normal data engineering development.

Preferred Qualifications
  • Previous experience building data platforms or data products within financial services, asset management, capital markets, or investment management.
  • Experience supporting Middle Office, investment operations, risk, portfolio management, or trading‑related datasets.
  • Experience onboarding datasets from external vendors, APIs, files, databases, or enterprise data platforms.
  • Understanding of data governance, lineage, entitlement, security, and audit requirements in an enterprise environment.
  • Experience designing pipelines that process both historical and incremental/daily datasets.
  • Experience troubleshooting and optimizing large‑scale Spark workloads.
  • Experience operating production data pipelines with defined SLAs and operational support requirements.
Core Technology Stack
  • Cloud: AWS
  • Processing: Apache Spark, PySpark
  • Data Lake / Table Formats: Apache Hudi, Apache Iceberg
  • AWS Data Services: EMR, Glue, Athena, S3
  • Orchestration: Apache Airflow / MWAA
  • Programming: Python, PySpark
  • Infrastructure as Code: Terraform
  • CI/CD: GitHub Actions
  • Version Control: Git
Shift:(Hybrid, 4 days onsite)
About US Tech Solutions:

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement:

By applying, you acknowledge that AI‑assisted tools may be used during hiring.

IND01

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer # 26-28726
Data Engineer # 26-28726

Us Tech Solutions • Plano (TX)

On-site
USD 120,000 - 150,000
Senior Data Engineer- #26-25912
Senior Data Engineer- #26-25912

Us Tech Solutions • Lake Buena Vista (FL)

On-site
USD 95,000 - 135,000
Senior Data Engineer — AWS/Spark Data Platform (Contract)
Senior Data Engineer — AWS/Spark Data Platform (Contract)

Us Tech Solutions • Dallas (TX)

Hybrid
USD 120,000 - 180,000
Data Engineer
Data Engineer

Expert Technical Solutions • United States

Remote
USD 110,000 - 150,000
Senior Data Engineer- #26-28663
Senior Data Engineer- #26-28663

Us Tech Solutions • Lake Buena Vista (FL)

On-site
USD 110,000 - 150,000
Data Architect
Data Architect

Robotic Process Automation LLC • Atlanta (GA)

On-site
USD 140,000 - 190,000
Data Architect
Data Architect

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 150,000 - 210,000
Data Architect
Data Architect

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 140,000 - 200,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 170,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 190,000