Senior Data Engineer - Cloud-Native Data Platforms & AI

Archer; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Archer, in collaboration with Version 1, seeks a Senior Data Engineer to advance modern cloud-native data platforms for analytics and AI at scale. You will own end-to-end data pipelines, ensure production-grade quality, and help enterprise clients adopt governed data services.

You will design and operate pipelines on AWS, with Delta Lake/Medallion patterns, mentor engineers, and collaborate with data scientists and platform teams to deliver reliable, cost-efficient data solutions.

Qualifications

• 6–8 years of hands-on data engineering experience.
• Strong Databricks experience including Delta Lake and Medallion Architecture.
• Design, build and support scalable data pipelines from enterprise source systems.
• Develop data models and curated data products within the ISP data platform.
• Implement MDM, data quality controls, monitoring and remediation workflows.
• Nice to have: experience enabling ML/GenAI workloads and data tooling exposure.

Responsibilities

• Designing, building, and operating reliable data pipelines using modern ETL/ELT approaches.
• Engineering cloud-native data platforms on AWS with Azure exposure where required.
• Working with Databricks, PostgreSQL, Aurora, and distributed processing frameworks.
• Ensuring solutions are production-ready: secure, tested, observable, and cost-efficient.
• Optimising data performance, reliability, and data quality in live environments.
• Collaborating with analysts, data scientists, AI engineers, and platform teams.
• Mentoring junior engineers and contributing to shared standards and accelerators.

Skills

Databricks

AWS

Delta Lake

Medallion Architecture

Data pipelines

MDM

Data quality

AI integration

Tools

PostgreSQL

Aurora

Spark

Job description

Archer, in collaboration with Version 1, seeks a Senior Data Engineer to advance modern cloud-native data platforms for analytics and AI at scale. You will own end-to-end data pipelines, ensure production-grade quality, and help enterprise clients adopt governed data services.

You will design and operate pipelines on AWS, with Delta Lake/Medallion patterns, mentor engineers, and collaborate with data scientists and platform teams to deliver reliable, cost-efficient data solutions.