Senior Data Engineer: AI/ML Pipelines & Lakehouse

American Bureau of Shipping (ABS); Knoxville (TN); On-site; USD 120,000 - 155,000; Full time

Benefits offered by this job

Medical insurance

Dental and vision insurance

401K plan with company match

Paid holidays

Paid vacation time

Job summary

American Bureau of Shipping (ABS) seeks a Senior Consultant I - Data Engineer to design, build, and maintain data pipelines and lakehouse architectures for analytics and AI/ML initiatives. You will work with clients and internal teams to deliver scalable ETL/ELT solutions on schedule and within budget.

Responsibilities include data governance, quality monitoring, and collaboration with project managers. Strong Python/SQL skills and cloud experience are required.

Qualifications

• Bachelor’s degree or the equivalent in work experience and training.
• 5 years of experience building data pipelines on cloud platforms such as AWS, Azure, or Google Cloud.
• Demonstrated experience designing and maintaining Lakehouse or data warehouse architectures (e.g., Databricks, Snowflake, Redshift, or equivalent).
• Proven experience supporting AI/ML workloads through feature engineering, data preparation, or embedding pipelines.
• Strong background in data governance, lineage tracking, and quality monitoring in production environments.

Responsibilities

• Provide technical and project support under the supervision of a project manager to deliver high-quality services on schedule and within budget.
• Assist with project planning, task sequencing, scheduling, research, data analysis, reporting, presentations, and quality assurance.
• Work effectively with clients and internal teams, manage multiple assignments, meet deadlines, and adapt to changing project needs.
• Support business development by building client relationships, identifying opportunities for additional services, contributing to proposals, and communicating client needs to project managers.
• Represent ABS Group through marketing activities, conference participation, technical whitepapers, and professional networking.
• Design, architect, and optimize data pipelines, lakehouse structures, and data models to support analytical reporting and AI/ML initiatives.
• Develop, implement, and maintain scalable ETL/ELT workflows using modern data platforms, cloud-native technologies, and data engineering best practices.
• Ensure data quality, pipeline reliability, and system performance through testing, monitoring, validation, and SLA-driven controls.

Skills

Python

SQL

Spark

Distributed data processing

Cloud platforms

Data governance

ETL/ELT

AI/ML data systems

Education

Bachelor's degree or equivalent

Tools

Databricks

Snowflake

Redshift

Docker

Kubernetes

Job description

American Bureau of Shipping (ABS) seeks a Senior Consultant I - Data Engineer to design, build, and maintain data pipelines and lakehouse architectures for analytics and AI/ML initiatives. You will work with clients and internal teams to deliver scalable ETL/ELT solutions on schedule and within budget.

Responsibilities include data governance, quality monitoring, and collaboration with project managers. Strong Python/SQL skills and cloud experience are required.