Data Engineer - Databricks

Vaco Recruiter Services; Tampa (FL); On-site; USD 90,000 - 140,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401(k) retirement plan

Discretionary bonuses

Job summary

Vaco Recruiter Services is seeking a Data Engineer with strong Databricks expertise to modernize BI, design data pipelines, deploy ML solutions, and operationalize analytics across the organization. You will collaborate with product and engineering teams, mentor junior engineers, and ensure governance and security for large-scale ML workloads.

This on-site role in Tampa offers discretionary bonuses and benefits including medical, dental, vision, and a 401(k) plan.

Qualifications

• Degree in CS/Engineering/Statistics or related field.
• 5+ years in data engineering with production ML exposure.
• Experience building end-to-end data pipelines and ML workflows.

Responsibilities

• Design and maintain end-to-end data pipelines and integrations.
• Build and deploy ML models, monitor performance and drift.
• Implement data governance, security, and privacy best practices.
• Collaborate with product and engineering teams; mentor junior engineers.

Skills

SQL optimization

Kafka

Databricks

ML pipelines

MLOps

Data governance

Cross-functional collaboration

Mentoring juniors

Data security

Education

Bachelor's or Master's in CS/Engineering/Data Science

Tools

MongoDB

OpenSearch

Druid

Postgres

NiFi

Job description

We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine learning solutions, and operationalize intelligent analytics to drive decision-making across the organization. The ideal candidate blends data engineering best practices with applied machine learning, MLOps, and AI.

Key Responsibilities

Project Responsibility: End-to-end data pipelines and integrations

Technical Competencies:

• Advanced SQL optimization and complex query design
• Kafka streaming applications and connector development
• Databricks workflow development with medallion architecture
• Data governance implementation and compliance
• Performance tuning for large-scale data processing
• Data security and privacy best practices
• Apache NiFi pipeline development for invoice and PO processing
• Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, Postgres)
• Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models.
• Design and optimize data architectures for large-scale ML workloads
• Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases.

Soft Skills:

• Cross-functional collaboration with product and engineering teams
• Technical mentoring for junior data engineers
• Analytical thinking for complex data problems
• Stakeholder communication for data requirements
• Process improvement and efficiency focus
• Quality mindset for data accuracy and reliability Vendor Management:
• Direct communication with data platform vendors
• Evaluates vendor tools for specific data use cases
• Provides technical feedback on vendor product roadmaps
• Coordinates with vendors for data integration projects

Qualifications:

Bachelor’s/Master’s in Computer Science, Data Engineering, Statistics, or related field.

5+ years in data engineering; 2+ years applying ML in production.

• The individual may also be eligible for discretionary bonuses, and can participate in medical, dental, and vision benefits as well as the company’s 401(k) retirement plan.