Senior Cloud Data Engineer for AI Pipelines & Lakehouse

American Bureau of Shipping; Knoxville (AL); On-site; USD 110,000 - 160,000; Full time

Job summary

American Bureau of Shipping is seeking a Data Engineer to design, build, and maintain scalable data pipelines and lakehouse architectures to support analytics, reporting, and AI/ML workloads.

You will develop ETL/ELT processes across diverse data sources, ensure data quality, and support governance with lineage and cataloging practices. Strong collaboration with data scientists and engineers is essential.

Qualifications

• 8+ years of experience in data engineering with cloud pipelines.
• Degree in a technical field; Databricks certification preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines and lakehouse/data warehouse structures.
• Develop ETL/ELT workflows ingesting diverse data sources.
• Prepare datasets for feature engineering, model training, and AI initiatives.
• Implement data quality controls, validation, monitoring, and observability.
• Manage data integration across internal and external systems.

Skills

Python

SQL

Databricks

Cloud platforms

Data modeling

ETL/ELT

Spark

Docker

Kubernetes

Data governance

Data quality

Streaming data

Education

Bachelor's degree in a technical field

Tools

Databricks

Snowflake

Redshift

Docker

Kubernetes

AWS

Azure

Google Cloud

Job description

American Bureau of Shipping is seeking a Data Engineer to design, build, and maintain scalable data pipelines and lakehouse architectures to support analytics, reporting, and AI/ML workloads.

You will develop ETL/ELT processes across diverse data sources, ensure data quality, and support governance with lineage and cataloging practices. Strong collaboration with data scientists and engineers is essential.