Senior Data Engineer - AI & Lakehouse Platform (Remote)

Onward Legal Innovation; Washington (District of Columbia); Remote; USD 170.000 - 200.000; Vollzeit

Zusammenfassung

Onward Legal Innovation is seeking a Senior Data Engineer to build and evolve an AWS data lake/lakehouse, ingest data from enterprise systems, and prepare analytics-ready datasets for AI/ML in a regulated environment.

This hands-on role requires shaping solutions amid ambiguity, collaborating with internal teams and vendors, and delivering scalable data platforms during a major data and AI transformation.

Qualifikationen

• 10+ years of enterprise data engineering experience.
• Experience with large-scale data transformation or cloud modernization.
• Strong hands-on AWS data platforms and services.
• Experience building data lakes, warehouses, lakehouse architectures.
• Strong ETL/ELT, SQL and Python skills.
• Experience with Airflow orchestration.
• Knowledge of Bronze / Silver / Gold architectures.
• Data quality, lineage, governance and metadata.
• Ability to turn ambiguity into scalable solutions.
• Experience with third-party vendors and technology partners.
• Background in enterprise, consulting, professional services or financial services.

Aufgaben

• Design and build scalable AWS-based data platforms and other data stacks.
• Build distributed processing workloads with EMR, Spark and Databricks.
• Consolidate data from multiple enterprise applications into central platforms.
• Build and optimize scalable ETL/ELT pipelines.
• Create curated, model-ready datasets for analytics, reporting and AI/ML.
• Implement data quality, lineage, metadata and governance standards.
• Collaborate with internal stakeholders and external vendors to shape solutions.
• Navigate changing requirements and bring structure to ambiguity.
• Help shape technical standards and mentor other data engineers.

Kenntnisse

10+ years experience

AWS data platforms

Data lakes / lakehouse

Databricks

Apache Spark

Python

SQL

ETL/ELT

Airflow

Data governance

Vendor collaboration

Tools

Amazon EMR

Databricks

Apache Spark

Jobbeschreibung

Onward Legal Innovation is seeking a Senior Data Engineer to build and evolve an AWS data lake/lakehouse, ingest data from enterprise systems, and prepare analytics-ready datasets for AI/ML in a regulated environment.

This hands-on role requires shaping solutions amid ambiguity, collaborating with internal teams and vendors, and delivering scalable data platforms during a major data and AI transformation.