Senior Data Engineer — AI & ML Data Solutions Lead

SunnyData; United States; On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Health Insurance

Paid Time Off

Career growth in a cutting-edge data/M

Job summary

SunnyData is seeking a Senior Data Engineer to design, build, and deploy scalable data solutions that support AI, ML, and BI initiatives. You will collaborate with internal teams and customers to capture, transform, and utilize data for insights across multiple accounts.

You will lead complex data workflows, ensure data quality and governance, and guide technical decision-making to drive outcomes. A STEM degree is required, with strong communication and leadership skills.

Qualifications

• 5+ years of experience in data engineering and data product development.
• Experience with data engineering technologies such as Spark, Hadoop, Kafka.
• Databricks platform experience in data engineering and/or ML ops is highly desirable.
• Proficiency with data warehousing concepts and SQL.
• Strong understanding of end-to-end data analytics workflows.

Responsibilities

• Support new and existing customers in their data engineering needs.
• Guide customers to make the best technical decisions to achieve their goals.
• Actively work across multiple customer accounts and track progress.
• Design, build, and operationalize complex data solutions including data cleansing/quality.
• Analyze sources and determine value to include in analytics.
• Incorporate data governance, security, and quality practices.
• Collaborate across teams to educate end users on data products.
• Perform data and system analysis for defects and incidents of moderate complexity.
• Test data movement, transformation code, and data components.

Skills

5+ years of experience

Spark

Hadoop

Kafka

Databricks

pandas

scikit-learn

HPO

SQL

OLTP/OLAP/DSS

Leadership

Communication

Time management

AWS

Azure

GCP

Databricks Certification

Education

Bachelor’s Degree in STEM related field

Tools

Databricks

Job description

SunnyData is seeking a Senior Data Engineer to design, build, and deploy scalable data solutions that support AI, ML, and BI initiatives. You will collaborate with internal teams and customers to capture, transform, and utilize data for insights across multiple accounts.

You will lead complex data workflows, ensure data quality and governance, and guide technical decision-making to drive outcomes. A STEM degree is required, with strong communication and leadership skills.