Senior Data Engineer — Remote AI Pipelines Lead

SunnyData; United States; Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Remote first

Room to grow

Real learning

Horizontal by design

Job summary

SunnyData is seeking a Senior Data Engineer to design, build, and deploy scalable data pipelines that power AI and analytics for diverse client projects. You will work closely with internal teams and customers to capture requirements, implement robust data solutions, and ensure reliable data movement and quality across platforms.

You will mentor peers, influence technical decisions, and help customers achieve measurable outcomes through data-driven insights and scalable architectures.

Qualifications

• 5+ years of related experience in data engineering and data product development.
• Experience with data engineering tech such as Spark, Hadoop, or Kafka.
• Databricks platform experience in data engineering or ML ops is a plus.
• Data Science and ML technologies such as pandas, scikit-learn, and HPO.
• Data warehousing skills including SQL and OLTP/OLAP/DSS.
• Strong end-to-end data analytics workflow understanding.
• Excellent written and verbal communication; leadership with initiative.
• Knowledge of public cloud platforms AWS, Azure or GCP is a plus.
• Databricks Certification is a nice-to-have.

Responsibilities

• Support new and existing customers in their data engineering needs.
• Guide customers to make the best technical decisions to achieve their goals.
• Collaborate across multiple customer accounts to track and report on their progress.
• Design, build, and operationalize complex data solutions, transformations, and data quality.
• Analyze sources to determine value for analytical processes.
• Incorporate data governance, data security and data quality.
• Collaborate within and across teams to educate end users on data products/analytic environments.
• Perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity.
• Test data movement, transformation code, and data components.

Skills

Spark

Hadoop

Kafka

Databricks platform

pandas

scikit-learn

HPO

SQL

Data analytics workflow

leadership

communication

AWS

Azure

GCP

Databricks Certification

Education

Bachelor’s Degree in STEM

Tools

Databricks platform

Job description

SunnyData is seeking a Senior Data Engineer to design, build, and deploy scalable data pipelines that power AI and analytics for diverse client projects. You will work closely with internal teams and customers to capture requirements, implement robust data solutions, and ensure reliable data movement and quality across platforms.

You will mentor peers, influence technical decisions, and help customers achieve measurable outcomes through data-driven insights and scalable architectures.