Senior Data Engineer - AI Pipelines & Data Governance

Socket.dev; Hanover (MD); On-site; USD 110,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Paid leave

Retirement

Job summary

SMX is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines powering AI, analytics, and reporting across the enterprise.

You will transform data from multiple sources into governed data products, own pipelines end-to-end, mentor engineers, and optimize for reliability and cost. Proficiency in SQL, Python, and ELT/ETL is required, with cloud/on-prem experience and a security clearance.

Qualifications

• Bachelor's degree in CS or related field; equivalent experience considered.
• 6+ years in data engineering or backend software with ownership of data pipelines.
• Security clearance required (Secret or higher).
• Proficient in SQL and Python; Java a plus.
• Hands-on experience building ELT/ETL pipelines across cloud and/or on-prem.
• Experience with cloud data platforms and warehouses (AWS/Azure/GCP; Snowflake, Redshift, Databricks).
• Experience with Spark, Airflow, or similar for distributed processing.
• Strong data modeling and governance concepts; integrating data from multiple sources.

Responsibilities

• Design, build, test, and maintain scalable data pipelines (ELT/ETL).
• Ingest, transform, and deliver data across cloud and on-prem systems.
• Implement data quality checks, lineage, and metadata management.
• Model and structure data to support API delivery and analytics/AI pipelines.
• Automate ingestion and transformation to improve scalability and reduce cost.
• Troubleshoot pipeline issues and ensure production reliability of data systems.
• Mentor junior engineers and contribute to engineering standards and best practices.
• Partner with analysts and architects to deliver production-ready datasets.

Skills

SQL

Python

Java

ELT/ETL

Cloud platforms

Airflow

Spark

Data modeling

Data governance

Education

Bachelor's degree in CS/related field

Tools

Snowflake

Redshift

Databricks

Job description

SMX is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines powering AI, analytics, and reporting across the enterprise.

You will transform data from multiple sources into governed data products, own pipelines end-to-end, mentor engineers, and optimize for reliability and cost. Proficiency in SQL, Python, and ELT/ETL is required, with cloud/on-prem experience and a security clearance.