Sr Data Engineer

SmartRecruiters, Inc.; Scottsdale, Northern (AZ, KY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

SmartRecruiters, Inc. is seeking a Senior Data Engineer to design, build, and maintain a modern data platform. This hands-on role requires delivering at scale, ensuring data quality, and collaborating across teams to support operational and analytical workloads.

The ideal candidate will have extensive experience with SQL, Python, and data warehousing, as well as expertise in cloud services like AWS, Snowflake, and Databricks. Hybrid onsite role in Scottsdale, AZ.

Qualifications

• Bachelor’s degree in CS, IT, or equivalent.
• 10+ years of experience in data engineering.
• Strong SQL with complex queries and windowing functions.
• Advanced Python for building robust pipelines and automation.
• Experience designing Data Warehousing with star schemas and slowly changing dimensions.
• Understanding of OLTP 3NF and denormalization for analytics.
• Experience with unstructured/semi-structured data (JSON, APIs).
• Hands-on with pipeline orchestration tools (Airflow/Prefect).
• Experience with 3rd party transformation tools (dbt, Talend, FiveTran).
• Proven success delivering scalable cloud-based data platforms (Snowflake/Databricks).
• AWS data services experience (S3, Glue, Redshift, Lambda, Secrets Manager).
• Regulatory compliance knowledge (PCI-DSS, GDPR, CPRA, SOX).
• Strong communication with technical and non-technical stakeholders.

Responsibilities

• Design, build, and maintain scalable data pipelines for batch and streaming workloads.
• Implement data validation frameworks ensuring accuracy and reconciliation across systems.
• Administer and optimize AWS, Snowflake, Databricks data services.
• Ensure compliance with PCI-DSS, GDPR, CPRA, SOX, and related regulations.
• Deliver proofs-of-concept to validate architectural improvements.
• Collaborate with audits and business teams to align data architecture with needs.
• Enable Tableau and other tools via well-structured data models and governance.
• Mentor team members and drive best practices across the data platform.
• Own projects end-to-end and deliver measurable results.
• Diagnose and resolve complex data issues quickly.

Skills

SQL proficiency

Python

Data warehousing

OLTP modeling

Data governance

Cloud platforms

Education

Bachelor’s degree in CS or related field

Tools

Airflow

Prefect

dbt

Talend

FiveTran

Snowflake

Databricks

AWS

Tableau

Job description

We are seeking a Senior Data Engineer with the technical expertise, architectural insight, and problem-solving skills to design, build, and maintain our modern data platform. The ideal candidate will be a hands-on engineer who can deliver at scale, ensure data quality, and work across teams to support both operational and analytical workloads.

Onsite Scottsdale Arizona

Hybrid role

Responsibilities

• Design, build, and maintain scalable data pipelines (ETL/ELT) for both batch and streaming use cases.
• Implement data validation and integrity frameworks, ensuring accuracy, completeness, and reconciliation across systems.
• Administer and optimize cloud-based data services (AWS, Snowflake, Databricks, etc.).
• Ensure compliance with data governance and regulations (PCI-DSS, GDPR, CPRA, SOX, etc.).
• Deliver proof of concepts and lightweight prototypes to validate architectural improvements.
• Collaborate with business units, audit teams, and stakeholders to align data architecture with organizational needs.
• Support reporting and analytics teams by enabling Tableau (or future-state tools) through well-structured data models and governance.
• Seek out new work proactively and mentor other team members.
• Own projects end-to-end and deliver measurable results.
• Diagnose and resolve complex data issues quickly.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or equivalent experience.
• 10+ years of experience in data engineering.
• Mastery of complicated SQL for loading data, including complex joins, subqueries, windowing functions, and common table expressions.
• Advanced proficiency in Python, developing and supporting robust pipelines, frameworks, and automation solutions.
• Proven history designing and managing Data Warehousing solutions including proper loading techniques, star schema modeling, slowly changing dimensions, and aggregate strategies.
• Strong understanding of OLTP modeling (3NF) and how to denormalize for performance or downstream use.
• Production experience with unstructured and semi-structured data (e.g., JSON, MongoDB, APIs) and integrating it into enterprise data ecosystems.
• Practical expertise implementing and optimizing pipeline orchestration with tools such as Airflow or Prefect.
• Experience implementing and optimizing 3rd party transformation tools such as dbt, Talend, or FiveTran.
• Demonstrated success in delivering scalable solutions using cloud-based data platforms like Snowflake or Databricks.
• Applied experience leveraging AWS data services (S3, Glue, Redshift, Lambda, Secrets Manager, etc.) in secure and cost-effective ways.
• Demonstrated ability to ensure compliance with regulatory requirements including PCI-DSS, GDPR, CPRA, CCPA, and SOX.
• Effective communication skills for engaging both technical and non-technical audiences and collaborating with business and audit stakeholders.
• Proven capability mentoring peers, promoting best practices, and contributing to team growth.
• High adaptability to changing requirements, emerging technologies, and competing priorities.
• Nice to have: Hands-on experience with Data Lake and Lakehouse technologies (e.g., Delta Lake, Iceberg, Hudi) for managing large-scale data assets.

This role is critical to our data engineering practice. We are looking for a hands-on leader who can operate in both structured and fast-changing environments while delivering high-quality, scalable solutions.

Additional Information

All your information will be kept confidential according to EEO guidelines.