Databricks Engineer

Openkyber; Atlanta (GA); Hybrid; USD 110,000 - 160,000; Full time

Job summary

Openkyber, LLC is seeking a data engineer to join a new AI-focused initiative. You will design scalable data models, optimize SQL, and build robust data pipelines in Databricks, using Python for automation and processing.

You will collaborate with cross-functional teams to translate data requirements into scalable solutions and ensure data quality across multiple sources, shaping the foundation for AI-driven capabilities.

Qualifications

• Strong experience with SQL, including complex query development and performance optimization.
• Solid Python programming skills for data engineering and automation.
• Hands-on experience with Databricks.
• Deep understanding of data modeling concepts and relational databases.
• Excellent analytical and problem-solving skills.

Responsibilities

• Design, build, and optimize scalable data models to support AI and analytics initiatives.
• Analyze complex datasets to understand relationships, dependencies, and business context.
• Develop and maintain efficient SQL queries, transformations, and data pipelines.
• Work within Databricks to prepare and organize data for AI and advanced analytics use cases.
• Utilize Python to support data engineering, automation, and data processing tasks.
• Collaborate with business and technical stakeholders to translate data requirements into scalable solutions.
• Ensure data quality, integrity, and consistency across multiple data sources.
• Apply strong analytical thinking to solve complex data challenges and improve overall data architecture.

Skills

SQL

Python

Databricks

Data modeling

Relational databases

Analytical thinking

Problem-solving

Communication

Job description

Hybrid Details:

3 days/week onsite remote Mondays and Fridays

Duration:

12 months to start

Job Description:

We are seeking an analytical and highly skilled Data Engineer to join an exciting new AI-focused initiative. This is not a traditional data engineering role-we're looking for someone who enjoys solving complex data problems, understands how data fits together, and can think critically about building high-quality data foundations for emerging AI solutions.

The ideal candidate combines strong technical expertise with an analytical mindset. They are naturally curious, thoughtful in their approach to problem solving, and able to understand relationships across large datasets to design scalable, well-structured data models. While experience with Python and Databricks is important, success in this role will be driven by exceptional SQL skills, data modeling expertise, and the ability to analyze data with a strategic perspective.

This is a unique opportunity to join a brand-new project from the ground up and help build the data foundation that will support AI-driven capabilities.

Key Responsibilities

• Design, build, and optimize scalable data models to support AI and analytics initiatives.
• Analyze complex datasets to understand relationships, dependencies, and business context.
• Develop and maintain efficient SQL queries, transformations, and data pipelines.
• Work within Databricks to prepare and organize data for AI and advanced analytics use cases.
• Utilize Python to support data engineering, automation, and data processing tasks.
• Collaborate with business and technical stakeholders to translate data requirements into scalable solutions.
• Ensure data quality, integrity, and consistency across multiple data sources.
• Apply strong analytical thinking to solve complex data challenges and improve overall data architecture.

Required Qualifications

• Strong experience with SQL, including complex query development and performance optimization.
• Solid Python programming skills for data engineering and automation.
• Hands-on experience with Databricks.
• Deep understanding of data modeling concepts, relational databases, and how data structures support reporting and AI initiatives.
• Excellent analytical and problem-solving skills with the ability to understand complex data relationships.
• Experience designing scalable, maintainable data solutions.
• Strong communication skills and the ability to work collaboratively within a cross-functional team.