Databricks Data Specialist, Raleigh, NC, US

Intellibee; Raleigh (NC); On-site; USD 80,000 - 110,000; Full time

Job summary

A leading data solutions provider is seeking a skilled Databricks Data Specialist in Raleigh, NC. You will focus on creating data aggregations and reports while collaborating with stakeholders. Ideal candidates will have strong experience with Azure Databricks, SQL, and Python, with excellent communication skills for cross-functional collaboration. Competitive compensation and benefits offered.

Qualifications

• 3+ years of hands-on experience designing, deploying, and managing Azure Databricks architecture.
• 3+ years of proficiency in SQL and Python for data transformations and dashboards.
• 5+ years of excellent communication skills in technical solutions.

Responsibilities

• Conduct comprehensive data analysis and ensure data quality and integrity.
• Leverage Spark SQL to analyze large datasets and write complex SQL queries.
• Collaborate with data engineers to deliver high-quality data products.

Skills

Azure Databricks

SQL

Python

Statistical analysis

Machine learning

Power BI

Data visualization

Data modeling

Data quality

Communication skills

Tools

Azure Databricks

Power BI

Job description

Databricks Data Specialist

NCDIT-T Web Systems is seeking a skilled Data Analyst with strong experience in Azure Databricks to support the creation of data aggregations, dashboards, and reports. The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI.In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating with stakeholders to ensure alignment between data solutions and business needs. You will work closely with a technical lead and participate in design discussions and planning with the broader development team.

Key Responsibilities:

• Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
• Collaborate closely with data engineers to design and deliver high-quality data products
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks\' native visualization tools to effectively communicate insights
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights
• Develop and implement predictive models, algorithms, and advanced analytical tools to address specific business challenges

Preferred:

• Databricks Data Analyst Associate Certification

Skill Matrix:

• Hands-on experience designing, deploying, and managing Azure Databricks architecture in enterprise environments Required 3 Years
• Strong understanding of data science concepts, including statistical learning and machine learning algorithms Required 3 Years
• Proficiency in SQL and Python for developing queries, data transformations, and interactive dashboards Required 3 Years
• Experience with techniques like dimensional modeling, entity-relationship modeling, normalization / denormalization, or Data Vault Required 3 Years
• Excellent communication skills with proven ability to collaborate with cross-functional teams and translate business needs into technical solutions Required 5 Years