Lead Data Engineer

York Solutions; United States; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

BCBS Medical Plans

Delta Dental

Eye Med Vision

Life Insurance

John Hancock 401(k)

Voluntary Insurance

Flexible Work

Career Growth

Job summary

York Solutions, LLC is seeking a Senior Cloud Data Engineer to build and support an AWS-based wealth data ingestion platform. The role focuses on validating large vendor data feeds, transforming data, and delivering standardized outputs for downstream enterprise consumers.

You will work with AWS-native services (Python, Lambda, Step Functions, S3, Aurora/Postgres), Terraform, and GitHub Actions to ensure reliable end-to-end ingestion and data quality across the platform.

Qualifications

• Proven ability to validate data end-to-end and troubleshoot ingestion issues.
• +
• Experience with AWS services and Python code in production data pipelines.

Skills

Python

AWS

Data ingestion

Data validation

ETL

Lambda

Step Functions

S3

Aurora/Postgres

Terraform

GitHub Actions

Tools

Terraform

GitHub Actions

Amazon S3

Aurora Postgres

Job description

Description This Senior Cloud Data Engineer will join a team building and supporting a new AWS-based wealth data ingestion platform. The platform receives large vendor data feeds containing brokerage, trust, account, ownership, and transactional information, processes and validates that data, and makes standardized outputs available to downstream enterprise consumers.

The environment is heavily AWS-native and currently leverages Python, Lambda, Step Functions, S3, Aurora/Postgres, Terraform, and GitHub Actions. Data arrives primarily through batch/vendor feeds and moves through an ingestion workflow that performs validation and transformation before publishing full and incremental datasets for downstream consumption.

Candidates should be comfortable validating data end-to-end, investigating failed or incomplete ingestion runs, working directly with AWS services and Python code, and understanding when different cloud storage/database patterns make sense. Financial-services or wealth-management data experience is strongly preferred, but deep data-engineering aptitude and the ability to learn the domain can substitute.

Benefits:

• BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program)
• Delta Dental plan with 2 free cleanings and insurance discounts
• Eye Med Vision with annual check-ups and discounts on lens
• Life and Accidental Death Insurance paid by company
• John Hancock 401(k) Retirement Plan with discretionary company match
• Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance.
• Flexible work environment with some remote working opportunities
• Strong fun and teamwork environment
• Learning, development, and career growth