Data Bricks DE with Azure

Fractal Analytics Inc.; California (MO); On-site; USD 120,000 - 140,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) Plan

11 paid holidays

Parental Leave

Job summary

Fractal Analytics Inc. is seeking an experienced Azure Databricks Data Engineer to design, develop, and maintain scalable cloud-based data platforms that support analytics and AI initiatives.

You will work with stakeholders, architects, data scientists, and application teams to deliver high-quality data solutions. The role focuses on building data pipelines, optimizing Spark workloads, and enforcing governance and security.

Qualifications

• 6-10 years of experience in Data Engineering and Analytics.
• Minimum 3+ years of hands-on experience with Azure Databricks.
• Strong experience with PySpark, SQL, and cloud-native data platforms.
• Experience building enterprise-scale data lakes and data warehouses.
• Knowledge of performance tuning and optimization techniques in Spark.
• Experience working in Agile delivery environments.

Responsibilities

• Design, build, and optimize scalable data pipelines using Azure Databricks.
• Develop ETL/ELT workflows for large-scale structured and unstructured datasets.
• Implement batch and real-time data processing using PySpark and Spark SQL.
• Build and maintain data ingestion frameworks from multiple data sources.
• Develop and manage data lake solutions using ADLS Gen2.
• Integrate data from cloud and on-premises systems into enterprise data platforms.
• Implement data quality, validation, and monitoring frameworks.
• Optimize Spark jobs for cost, scalability, and performance.
• Design dimensional models and support data warehouse initiatives.
• Collaborate with business users to understand reporting and analytics requirements.
• Automate deployment processes using CI/CD pipelines.
• Participate in architecture discussions and provide technical leadership to junior engineers.
• Ensure adherence to security, governance, and compliance standards.

Skills

PySpark

Spark SQL

Delta Lake

ETL/ELT Pipeline Development

Data Modeling

Data Warehousing Concepts

Data Governance and Data Quality

Python

SQL

Scala (Preferred)

Azure DevOps

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Synapse Analytics

Azure Key Vault

Azure Monitor

Azure DevOps

Job description

## Data Bricks DE with AzureApplylocations: Californiatime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: August 31, 2026 (22 days left to apply)job requisition id: SR-44622It's fun to work in a company where people truly BELIEVE in what they are doing!*We're committed to bringing passion and customer focus to the business.***Azure Databricks Data Engineer**Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.Please visit Fractal | Intelligence for Imagination for more information about Fractal.Please Note: We are not offering sponsorship at this time.**Role Overview**We are seeking an experienced **Azure Databricks Data Engineer** to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate will have strong expertise in Azure Data Engineering technologies, Databricks, data pipelines, data warehousing, and big data processing. This role involves collaborating with business stakeholders, architects, data scientists, and application teams to deliver high-quality data platforms that support analytics and AI initiatives.**Key Responsibilities*** Design, build, and optimize scalable data pipelines using **Azure Databricks**.* Develop ETL/ELT workflows for large-scale structured and unstructured datasets.* Implement batch and real-time data processing solutions using **PySpark** and Spark SQL.* Build and maintain data ingestion frameworks from multiple data sources.* Develop and manage data lake solutions using **Azure Data Lake Storage (ADLS Gen2)**.* Integrate data from cloud and on-premises systems into enterprise data platforms.* Implement data quality, validation, and monitoring frameworks.* Optimize Spark jobs for cost, scalability, and performance.* Design dimensional models and support data warehouse initiatives.* Collaborate with business users to understand reporting and analytics requirements.* Automate deployment processes using CI/CD pipelines.* Participate in architecture discussions and provide technical leadership to junior engineers.* Ensure adherence to security, governance, and compliance standards.**Required Technical Skills****Azure Services*** Azure Databricks* Azure Data Factory (ADF)* Azure Data Lake Storage Gen2 (ADLS)* Azure Synapse Analytics* Azure Key Vault* Azure Monitor* Azure DevOps**Data Engineering*** PySpark* Spark SQL* Delta Lake* ETL/ELT Pipeline Development* Data Modeling* Data Warehousing Concepts* Data Governance and Data Quality**Programming*** Python* SQL* Scala (Preferred)**DevOps & Automation*** Azure DevOps* Git* CI/CD Pipelines* Infrastructure as Code (Terraform preferred)**Required Qualifications*** Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.* 6-10 years of experience in Data Engineering and Analytics.* Minimum 3+ years of hands-on experience with Azure Databricks.* Strong experience with PySpark, SQL, and cloud-native data platforms.* Experience building enterprise-scale data lakes and data warehouses.* Knowledge of performance tuning and optimization techniques in Spark.* Experience working in Agile delivery environments.**Preferred Qualifications*** Azure Data Engineer Associate Certification (DP-203).* Experience with Unity Catalog and Databricks Workflows.* Knowledge of Delta Live Tables (DLT).* Experience supporting AI/ML workloads and data science teams.* Exposure to Snowflake, Power BI, or Microsoft Fabric.* Healthcare, Life Sciences, or Pharma domain experience is a plus.**Note:** The job description may be subject to modification based on business requirements and evolving project needs.**Pay:**The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: **$120,000 - $140,000**. In addition, you may be eligible for a discretionary bonus for the current performance period.**Benefits:**As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.*Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.*If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!Not the right fit? Let us know you're interested in a future opportunity by clicking *Introduce Yourself* in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!