Data Engineering Lead: Cloud Data Architect & Pipelines

PHM; Northern (KY); Hybrid; USD 112,000 - 161,000; Full time

Job summary

PHM, a leading health media agency in the US, seeks a senior data platform engineer to design and support data warehouse and data lake solutions on Snowflake and Databricks. You will architect end-to-end pipelines and collaborate with analytics, BI, and AI/ML initiatives.

You will implement scalable data models, enforce governance, and optimize ETL/ELT processes using SQL, Python, Spark, and REST APIs. Strong database knowledge and cloud experience (AWS/Azure) are required.

Qualifications

• BS Degree in Computer Science, Information Technology or related field preferred.
• Minimum 5+ years of experience developing large scale complex database solutions.
• Demonstrated experience with BI database design.
• Ability to track and resolve database related incidents as well as requests.
• Strong understanding of database structures, theories, principles, and practices.
• Strong understanding of ETL and data warehouse principles.
• Good interpersonal, written and oral communication skills.
• Technical documentation skills.
• Ability to present complex ideas in user-friendly language.
• Self-motivated and directed, with keen attention to detail.
• Able to prioritize and execute tasks in a team-oriented, high-pressure environment.

Responsibilities

• Design and implement scalable data architecture across cloud platforms (e.g., Snowflake, Databricks).
• Define enterprise data models, schemas, and standards to support analytics, reporting, and AI/ML use cases.
• Architect end-to-end data pipelines for ingestion, transformation, and delivery of structured and unstructured data.
• Oversee development and optimization of ETL/ELT processes using SQL, Python, and Spark.
• Drive performance tuning across queries, pipelines, and storage to improve scalability and efficiency.
• Establish best practices for database design, indexing, and query optimization.
• Define and enforce data governance standards, including data quality, lineage, metadata, and access control.
• Ensure data integrity, consistency, and compliance with security and privacy requirements.
• Design and support scalable data products and reusable data assets aligned to business and client needs.
• Partner with BI teams to enable reporting and dashboarding solutions (e.g., Tableau, Power BI, Datorama).
• Support AI and advanced analytics initiatives through well-structured, accessible data.
• Partner with cross-functional teams to translate business requirements into technical solutions.
• Provide architectural guidance and mentorship to data engineers and analysts.
• Act as a key stakeholder in resolving complex data challenges and recommending improvements to the data ecosystem.
• Establish monitoring and performance standards for data pipelines and platforms.
• Ensure reliability of data processes, including handling failures and optimizing long-running jobs.
• Define SLAs and operational best practices for data availability and performance.

Skills

SQL

ETL

Data warehousing

JSON/XML/Parquet

Large datasets

Java/C#/R

REST APIs

Web & Digital marketing data

Education

BS in CS/IT or related

Tools

Snowflake

Databricks

SSIS

APIs

Job description

PHM, a leading health media agency in the US, seeks a senior data platform engineer to design and support data warehouse and data lake solutions on Snowflake and Databricks. You will architect end-to-end pipelines and collaborate with analytics, BI, and AI/ML initiatives.

You will implement scalable data models, enforce governance, and optimize ETL/ELT processes using SQL, Python, Spark, and REST APIs. Strong database knowledge and cloud experience (AWS/Azure) are required.