Data Engineer

Brown & Brown, Inc.; Plano (TX); On-site; USD 95,000 - 135,000; Full time

Benefits offered by this job

Health benefits

401(k) plan

Employee stock purchase program (ESPP)

Student loan assistance

Tuition reimbursement

Paid time off

Job summary

Brown & Brown, Inc. in Plano, TX is seeking a Data Engineer to design, build, and operate modern data solutions supporting AI/ML, analytics, BI, and enterprise insights.

You’ll work with a collaborative team to create reliable, scalable data pipelines and data products across the development lifecycle. The role emphasizes production-ready pipelines, governance, and data quality, with opportunities to contribute to Databricks Lakehouse projects and cross-functional collaboration with product

Qualifications

• Bachelor’s degree in a STEM field or equivalent experience.

Responsibilities

• Design, develop, test, deploy, and support scalable batch and streaming data solutions.
• Build Databricks-native data engineering solutions using Delta Lake and Unity Catalog.
• Develop production-grade ingestion, transformation, and data-processing pipelines using Python, PySpark, SQL.
• Build governed data pipelines improving data accuracy, consistency, accessibility, and trust.
• Develop reusable components and automation to improve productivity and consistency.
• Implement data-quality validation, monitoring, and remediation for critical data assets.

Skills

Python

PySpark

SQL

Spark

Data modeling

Data governance

Problem solving

Communication

Education

Bachelor's degree in Computer Science or related STEM

Tools

Databricks

Delta Lake

Lakeflow Declarative Pipelines

Databricks Jobs

Auto Loader

Unity Catalog

Structured Streaming

Job description

Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers.

Brown & Brown is seeking a Data Engineer to join our growing team in Plano, TX! As a Data Engineer, you will play an important role in advancing our Data & AI Platform capabilities by designing, building, and operating modern data solutions that support AI/ML, analytics, business intelligence, and enterprise insights. You will work within a collaborative engineering team to develop reliable, scalable, and governed data solutions using modern cloud and lakehouse technologies. You will partner with engineers, product owners, architects, and business stakeholders to understand requirements and translate them into production-ready data pipelines and data products. This is a hands‑on engineering role with responsibility across the development lifecycle, including design, development, testing, deployment, monitoring, troubleshooting, and ongoing optimization of data solutions.

What Will You Do?

• Design, develop, test, deploy, and support scalable batch and streaming data solutions.
• Build Databricks-native data engineering solutions using Delta Lake, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, and Unity Catalog.
• Develop production-grade ingestion, transformation, and data-processing pipelines using Python, PySpark, Apache Spark, and SQL.
• Build reliable and governed data pipelines that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data.
• Develop reusable components, libraries, templates, and automation to improve engineering productivity and solution consistency.
• Implement data-quality validation, monitoring, observability, and remediation processes for critical data assets.
• Integrate data solutions with governance capabilities, including metadata, lineage, classification, certification, ownership, and access controls.
• Develop and maintain governed data assets supporting AI, Machine Learning, analytics, semantic models, APIs, Genie Spaces, and AI agents.
• Build and maintain workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and operational monitoring.
• Troubleshoot and optimize data workloads using Spark diagnostics, job logs, query plans, partitioning strategies, join optimization, and Adaptive Query Execution.
• Support production data solutions through monitoring, incident resolution, performance tuning, migrations, upgrades, and cost optimization.
• Participate in technical design discussions, code reviews, testing, and continuous improvement of engineering practices.
• Collaborate with product owners, architects, operations teams, and other engineers to resolve technical dependencies and deliver solutions.
• Maintain technical documentation for data pipelines, data models, operational procedures, and engineering solutions.

Required Qualifications

• Bachelor’s degree in computer science, Engineering, Mathematics, Information Systems, or a related STEM field, or equivalent education and professional experience.
• 4+ years of experience in data engineering, software engineering, or a related technical discipline, including experience developing and supporting production data solutions.
• Hands-on experience with Apache Spark/PySpark, Delta Lake, Python, and SQL.
• Experience building and supporting production batch and/or streaming data pipelines.
• Experience with Databricks capabilities such as Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, Delta Lake, and Unity Catalog.
• Experience developing ETL/ELT pipelines for ingesting, transforming, validating, and publishing enterprise data.
• Experience with workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and monitoring.
• Understanding of Unity Catalog and data governance concepts, including catalogs, schemas, tables, views, lineage, access controls, and permissions.
• Experience with Git and CI/CD practices and exposure to Infrastructure as Code technologies such as Terraform or Databricks Asset Bundles.
• Strong Python and SQL development skills with the ability to create maintainable, testable, and production-ready data solutions.
• Experience troubleshooting and optimizing Spark workloads using Spark UI, job logs, query plans, partitioning, and join optimization.
• Understanding of relational, dimensional, logical, and physical data modeling concepts.
• Experience working across the engineering lifecycle, from requirements and development through testing, deployment, monitoring, and production support.
• Strong problem‑solving and analytical skills with the ability to diagnose and resolve data and production issues.
• Strong written and verbal communication skills with the ability to collaborate effectively with technical and business teams.
• Experience working within Agile delivery models such as Scrum, Kanban, or SAFe.
• Advanced experience with Python and PySpark for data processing, automation, and reusable engineering components.
• Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.
• Experience with cloud storage technologies such as Azure Data Lake Storage Gen2, Amazon S3, OneLake, or Google Cloud Storage.
• Experience with modern data technologies such as Snowflake, Apache Iceberg, Apache Hudi, or BigQuery.
• Experience building ingestion pipelines using Databricks Auto Loader.
• Experience developing streaming solutions using Structured Streaming.
• Experience designing or consuming REST APIs and web services.
• Experience implementing data‑quality, metadata, governance, or lineage capabilities.
• Experience developing data products supporting AI, Generative AI, Machine Learning, semantic models, APIs, advanced analytics, Genie Spaces, or AI agents.
• Experience working with insurance and Health domain data.
• Practical experience using AI‑assisted development tools such as GitHub Copilot, Claude, or Databricks AI‑assisted development capabilities to improve engineering productivity.
• Strong experience building and supporting production‑scale Databricks Lakehouse solutions.
• Strong Python skills applied to reusable data engineering frameworks, automation, libraries, and utilities.
• Experience working with Delta Lake and modern lakehouse architectures.
• Experience developing governed datasets and data products for analytics, AI, and Generative AI use cases.
• Experience with automated testing, deployment pipelines, Infrastructure as Code, and modern software engineering practices.
• Demonstrated ability to troubleshoot complex data problems and improve the reliability, performance, and maintainability of existing solutions.
• A strong engineering mindset with an emphasis on quality, automation, observability, scalability, and continuous improvement.

Teammate Benefits & Total Well-Being

• Health Benefits: Medical/Rx, Dental, Vision, Life Insurance, Disability Insurance
• Financial Benefits: ESPP; 401k; Student Loan Assistance; Tuition Reimbursement
• Mental Health & Wellness: Free Mental Health & Enhanced Advocacy Services
• Beyond Benefits: Paid Time Off, Holidays, Preferred Partner Discounts and more.

Not reflective of all benefits. Enrollment waiting periods or eligibility criteria may apply to certain benefits. Benefit details and offerings may vary for subsidiary entities or in specific geographic locations.

Recruiting Vendor Disclosure Statement

Brown & Brown does not accept unsolicited resumes from external recruiters, recruitment vendors or employment agencies (“Recruiting Vendors”). Recruiting Vendors must have a valid written agreement and received prior written authorization from an authorized Brown & Brown representative before submitting candidates for any publicly posted role. Any unsolicited resumes submitted to Brown & Brown or its employees become the property of Brown & Brown, and no fees will be paid for such submissions. Additional information regarding this policy can be found on our careers page.

The Power To Be Yourself

As an Equal Opportunity Employer, we are committed to fostering an inclusive environment comprised of people from all backgrounds, with a variety of experiences and perspectives, guided by our Diversity, Inclusion & Belonging (DIB) motto, "The Power to Be Yourself". We think of ourselves as a team, so we have teammates - not employees. We strive to attract people who are competitive, driven, and disciplined.

Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers.

Founded in 1939 as a small, two-partner firm, Brown & Brown (NYSE: BRO) and our team of companies have grown into one of the world’s largest insurance brokerages while staying true to our foundation of trust, resilience, and delivering results. With a team that is as connected locally as it is globally, our high-performing, highly collaborative team delivers innovative risk and insurance solutions. We look for individuals who embrace our culture, thrive in a collaborative environment, are driven to grow and succeed, and are committed to always doing what is right. With a unique culture built on integrity, superior capabilities and grit, we value teamwork, trust and courage. We think of ourselves as a team, so we have teammates—not employees, and leaders—not managers. Everything we do is about the greater "WE"—never "me." While diverse in abilities and experience, we are all connected through our core values, a commitment to our local communities and a shared mission—always doing what is best for our customers. Brown & Brown and its affiliates maintain an internal recruiting team responsible for filling open roles posted to the public. In certain situations, Brown & Brown may supplement its internal capabilities by engaging external recruiting vendors and employment agencies (“Recruiting Vendors”). Recruiting Vendors are not authorized to submit resumes, share candidate data, or directly or indirectly contact Brown & Brown employees to present candidates for employment opportunities. The only exception applies to Recruiting Vendors with an active Valid Agreement (as defined below) that has been approved by Brown & Brown. In accordance with this policy, and to ensure appropriate authorization for sharing candidate personal information, Brown & Brown will not accept unsolicited resumes from any source other than Authorized Recruiting Vendors with a Valid Agreement in place who have been expressly invited to support a specific role. Any unsolicited resumes, incomplete submissions, or candidate data received through any means (including email or otherwise) will be considered the property of Brown & Brown. Brown & Brown will not pay any placement or related fees for unsolicited submissions or candidate data provided in violation of this policy. Such submissions may be used by Brown & Brown without any obligation to pay fees of any kind to Recruiting Vendors. A Valid Agreement is defined as a written contract signed by an authorized representative of Brown & Brown. In the absence of a Valid Agreement, Brown & Brown assumes no liability under any legal theory, including but not limited to breach of contract, breach of implied contract, tortious interference, quantum meruit, any/or any other contractual or equitable claims in connection with candidates identified through unsolicited submissions made in violation of this policy.