Senior Data Engineer

SunnyData; United States; Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Remote first

Room to grow

Real learning

Horizontal by design

Job summary

SunnyData is seeking a Senior Data Engineer to design, build, and deploy scalable data pipelines that power AI and analytics for diverse client projects. You will work closely with internal teams and customers to capture requirements, implement robust data solutions, and ensure reliable data movement and quality across platforms.

You will mentor peers, influence technical decisions, and help customers achieve measurable outcomes through data-driven insights and scalable architectures.

Qualifications

• 5+ years of related experience in data engineering and data product development.
• Experience with data engineering tech such as Spark, Hadoop, or Kafka.
• Databricks platform experience in data engineering or ML ops is a plus.
• Data Science and ML technologies such as pandas, scikit-learn, and HPO.
• Data warehousing skills including SQL and OLTP/OLAP/DSS.
• Strong end-to-end data analytics workflow understanding.
• Excellent written and verbal communication; leadership with initiative.
• Knowledge of public cloud platforms AWS, Azure or GCP is a plus.
• Databricks Certification is a nice-to-have.

Responsibilities

• Support new and existing customers in their data engineering needs.
• Guide customers to make the best technical decisions to achieve their goals.
• Collaborate across multiple customer accounts to track and report on their progress.
• Design, build, and operationalize complex data solutions, transformations, and data quality.
• Analyze sources to determine value for analytical processes.
• Incorporate data governance, data security and data quality.
• Collaborate within and across teams to educate end users on data products/analytic environments.
• Perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity.
• Test data movement, transformation code, and data components.

Skills

Spark

Hadoop

Kafka

Databricks platform

pandas

scikit-learn

HPO

SQL

Data analytics workflow

leadership

communication

AWS

Azure

GCP

Databricks Certification

Education

Bachelor’s Degree in STEM

Tools

Databricks platform

Job description

We create the foundations for the AI future

Data and AI projects are easy to get excited about. Making them hold up in production is the hard part...

That's what we focus on: solid data engineering underneath, so the pipelines feeding AI actually work.

OUR TOOLS

Databricks and the modern data stack

We build on Databricks because it's the most complete data and AI platform out there, and it's only getting more central as AI moves faster. One platform for data engineering and AI/ML, cloud-native, scalable, and flexible enough to fit how a real business runs.

Our partners in tech

Alongside Databricks, we work with a focused set of partners: Fivetran, Prophecy, Monte Carlo, and Sigma, that plug straight into the Lakehouse and help us move fast without piling on complexity.

THE TEAM

The values driving us

Find a way

We focus on solutions, meeting challenges with grit and creativity.

Move with purpose

We act with urgency, stay focused on impact, and adapt quickly.

Own the outcome

We own both wins and misses, and treat every outcome as ours to shape.

Earn Trust

We show up with sincerity and integrity, communicating with respect and keeping our promises.

Win as One

We achieve success by actively sharing knowledge, collaborating openly, and lifting each other up.

JOIN US

Open positions

Location

United States

Employment Type

Full time

Location Type

Remote

Department

Delivery

At SunnyData, our mission is to help customers build a highly scalable architecture, robust data engineering pipelines, easy data consumption layers and more importantly build ML and AI applications to power their business and drive outstanding business outcomes. As a Senior Data Engineer, you will play a critical role during this customer journey. You will directly work with internal teams and customers to design, build and deploy data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning and business intelligence / insights.

The Impact You Will Have

You will be part of a team responsible for supporting new and existing customers in their data engineering needs.

You will guide customers to make the best technical decisions to achieve their goals

You will actively work across multiple customer accounts which you would need to track and report on their progress.

You will design, build, and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing /quality solutions.

You will analyze sources to determine value and recommend data to include in analytical processes.

You will incorporate core data management competencies including data governance, data security and data quality.

You will collaborate within and across teams to support delivery and educate end users on data products / analytic environments.

You will perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate.

You will test data movement, transformation code, and data components.

What We Look For

5+ years of related experience in data engineering and data product development.

Experience in one or more of the following:

Data Engineering technologies (e.g., Spark, Hadoop, Kafka)

Databricks platform - data engineering and/or ML ops experience would be a huge bonus

Data Science and Machine Learning technologies (e.g., pandas, scikit-learn, HPO)

Data Warehousing (e.g., SQL, OLTP/OLAP/DSS)

Solid understanding of the end to end data analytics workflow

Demonstrated track record of domain expertise including the ability to understand technical concepts and possess in-depth knowledge of immediate systems worked on

Strong verbal and written communication skills

Leadership - Intermediate leadership skills with a proven track record of self-motivation in identifying personal growth opportunities

Excellent time management and prioritization skills Knowledge of public cloud platforms AWS, Azure or GCP would be a plus

Nice to have: Databricks Certification

Education

Bachelor’s Degree in STEM related field or equivalent

Health Insurance : Employees and their eligible family members including spouses, domestic partners, and children are eligible for coverage from the first day of employment.

Paid Time Off :Start your career at SunnyData with a minimum of 15 days Paid Time Off annually, plus nine paid company Holidays.

An opportunity to grow your technical and people skills, lead teams on complex customer projects that are highly innovative and cutting edge. Great opportunity to grow in your career with the right level of focus, innovation and customer centricity with a high growth consulting company dedicated to Databricks.

Compensation Overview

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.

Our Commitment to Diversity and Inclusion:

SunnyData is dedicated to building a workforce that reflects the world around us. We are an equal opportunity employer committed to unbiased hiring practices. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity, disability, veteran status, or any other protected characteristic.

Why Join SunnyData?

Innovative Environment: Work with cutting-edge technologies and industry leaders in data engineering and AI.

Customer Impact: Make a real difference in how businesses leverage data for strategic decision-making.

Career Growth: Opportunities for professional development and career advancement.

Collaborative Culture: Join a supportive team that values collaboration and knowledge sharing.

We want to make sure your job search with SunnyData is a safe one. Here's how to tell it's really us: Genuine SunnyData recruiters reach only from @ sunnydata.ai addresses. If we ever loop in an outside recruiting partner, they'll say so upfront and identify SunnyData by name. We will never ask you for money, fees, or bank details at any point before your first day. Get a message that feels off? Don't click anything on it. Go straight to sunnydata.ai/careers to check our current openings and confirm what's real.

Some of our benefits

Here’s what you can count on as part of the team.

Remote first.

We meet our talent where they are. Work from anywhere, no relocation required.

Room to grow.

Mentorship from senior leaders, and real growth opportunities as we keep expanding.

Real learning.

Time and support to go deeper on the tools and problems you actually care about.

Horizontal by design, so hierarchy doesn't get in the way of being heard.

Specifics like healthcare, PTO, and other country-level details vary by location. We'll walk you through these additional benefits as you move through the process.