Senior Data Platform Architect - Databricks/AWS

Bloomberg Industry Group; Arlington (TX); On-site; USD 170,000 - 220,000; Full time

Job summary

Bloomberg Industry Group is seeking a senior data engineering leader to guide technical direction across teams, focusing on data analytics and integration solutions using Databricks and AWS. You will architect and deliver enterprise data platform components, BI services, and scalable software, while promoting best practices, governance, and high availability in a cloud-first environment.

Strong collaboration with clients and internal stakeholders to translate complex requirements into robust

Qualifications

• Bachelor’s degree in related field or equivalent experience.
• 7 years of software development experience and/or commensurate skills building commercial applications with modern software engineering principles and practices.
• Knowledge across multiple technical domains and an understanding of how and why technologies are deployed and utilized at INDG.
• A track record of building stability, performance, and scalability across major business-critical systems.
• A clear understanding of the relationship between complexity and cost and a record of successfully devising and implementing long-term strategies to lower it.
• Demonstrated experience building data pipelines, data quality, data governance, and analytics / BI solutions.
• Demonstrated expertise leveraging Spark, PySpark, Python, SQL, Databricks, Delta Lake, Unity Catalog and MLFlow.
• Demonstrated experienceof cloud technologiesi.e.AWS, Serverless, Event DrivenArchitecture, SOA,MicroServices,Microfrontend, CI/CD, Infrastructure as code, and other modern technologies.
• Demonstrated experienceof professional software engineering practices and the full software development life cycle, including coding standards, architecture/design patterns, code reviews, source control management, build processes, testing, and operations.

Responsibilities

• Provide technical leadership to define, evolve and implement the enterprise data platform architecture leveraging Databricks and AWS-native services.
• Architect, design and lead delivery of Business Intelligence and related analytics services
• Architect, design and deliver high-quality codebypromoting and definingINDGbest practices.
• Design, develop scalable, high availability, high performanceproductswith a deep understanding of front end and back‑end architectures leveraging AWS cloud infrastructure.
• Identify technology strategic growth opportunities that enable INDG to grow as a business.
• Lead cross team efforts and projects thatspan multiple domains and business units.
• Participate in providing technology roadmap/vision for the team.
• Collaborate with cross‑functional teams and communicate technical solutions to non‑technical people across the organization.
• Participate in special projects and performs other duties as assigned.

Skills

Databricks

Spark

PySpark

Python

SQL

Delta Lake

Unity Catalog

MLFlow

Data pipelines

Data governance

Analytics/BI

Cloud architecture

AWS

Education

Bachelor's degree

Tools

AWS

CI/CD

Infrastructure as Code

Event Driven Architecture

Serverless

Job description

Bloomberg Industry Group is seeking a senior data engineering leader to guide technical direction across teams, focusing on data analytics and integration solutions using Databricks and AWS. You will architect and deliver enterprise data platform components, BI services, and scalable software, while promoting best practices, governance, and high availability in a cloud-first environment.

Strong collaboration with clients and internal stakeholders to translate complex requirements into robust