Senior Software Data Architect

ComplexCare Solutions; United States; On-site; USD 172,000 - 200,000; Full time

Job summary

ComplexCare Solutions is seeking a Senior Software Data Architect to define and deliver next-generation data platforms, including lakehouse and data warehouse solutions. You will lead architecture and design of scalable data ecosystems powering advanced analytics, AI/ML, and BI capabilities across the organization.

You will collaborate across engineering, product, analytics, and business teams to model data, govern quality, ensure security (HIPAA), and drive enterprise-wide data architecture

Qualifications

• 15+ years of software engineering and data architecture experience
• 5+ years in a senior or lead architectural role
• Proven enterprise data platform design experience
• Deep knowledge of data modeling, ETL/ELT, and BI concepts
• Experience with cloud platforms (Azure preferred)
• Healthcare/regulatory domain background

Responsibilities

• Define and lead architecture of enterprise-scale data platforms (lakehouse, data warehouse)
• Design scalable data pipelines using Databricks and cloud-native architectures
• Establish enterprise data models and metadata management
• Drive data governance, quality, lineage, and cataloging (Unity Catalog)
• Architect robust data ingestion, transformation, and delivery pipelines (batch and streaming)
• Design systems for analytics, AI/ML, and self-service BI (Power BI)
• Ensure data accuracy, reliability, and performance across platforms
• Lead architecture reviews and governance across multiple product lines
• Mentor engineers and drive best practices in data architecture and DevOps

Skills

Data architecture

Databricks

Python

ETL/ELT design

CI/CD

Cloud platforms

BI reporting concepts

Leadership

Education

Bachelor’s degree in Computer Science/Software Engineering/IT

Tools

Databricks

Power BI

Spark SQL

Delta/Iceberg formats

Unity Catalog

PostgreSQL

MongoDB

Job description

We are more than just a healthcare company; we are a community of professionals driven by the knowledge that our success leads to a positive impact on the communities that we support.

At ComplexCare Solutions, you’ll play a crucial part in innovating solutions that empower health plan members and healthcare providers alike. Our collaborative environment fosters creativity and initiative, ensuring that every idea and effort contributes to meaningful change in the industry. Join us and become a part of a team that turns vision into action, making a tangible impact on the future of healthcare.

Overview: The Senior Software Data Architect is a strategic, hands-on leadership role responsible for defining and delivering next-generation data platforms, including enterprise data lakehouse and data warehouse solutions. This role leads the architecture, design, and evolution of scalable data ecosystems that power advanced analytics, AI/ML, and business intelligence capabilities. As a key member of the data engineering and platform team, this individual drives the development of modern data pipelines and frameworks leveraging Databricks technologies to enable high-quality, trusted, and actionable data for both internal stakeholders and external customers. This role requires deep collaboration across engineering, product, analytics, and business teams to define data models, enforce data governance, ensure data quality, and deliver insights that improve decision-making, forecasting, and operational outcomes. The Senior Software Data Architect also serves as a thought leader, establishing standards, mentoring teams, and influencing enterprise-wide data architecture strategy.

Duties and Responsibilities:

• Define and lead the architecture of enterprise-scale data platforms, including lakehouse, data warehouse, and real-time data processing frameworks.
• Design scalable, secure, and high-performance data pipelines using Databricks and modern cloud-native architectures.
• Establish enterprise data models, canonical data structures, and metadata management strategies.
• Drive adoption of data governance, data quality, lineage, and cataloging frameworks (e.g., Unity Catalog).
• Architect and enable robust data ingestion, transformation, and delivery pipelines (batch and streaming).
• Design systems that support advanced analytics, AI/ML, and self-service BI capabilities on Power BI or AI/BI Dashboards.
• Ensure data accuracy, completeness, consistency, and reliability across platforms.
• Identify and resolve data anomalies, performance bottlenecks, and pipeline inefficiencies.
• Partner with product, engineering, analytics, and business teams to gather requirements and translate them into scalable architecture solutions.
• Align data architecture with business strategy, reporting needs, and customer-facing analytics capabilities.
• Lead architectural reviews and provide governance across multiple systems and product lines.
• Establish and enforce best practices for data architecture, engineering, and platform design.
• Ensure compliance with enterprise policies, data privacy, security, and regulatory requirements (e.g., HIPAA).
• Evaluate and standardize tools, technologies, and third-party platforms across the organization.
• Drive continuous improvement through reusable frameworks, patterns, and automation.
• Act as a technical thought leader and mentor for engineers, architects, and data professionals.
• Provide guidance on architecture design, data modeling, system integration, and performance optimization.
• Lead knowledge sharing through design reviews, training sessions, and architecture forums.
• Influence engineering culture toward excellence in quality, scalability, and innovation.
• Proactively identify risks, dependencies, and architectural challenges and define mitigation strategies.
• Support end-to-end lifecycle: design, development, deployment, and operational support.
• Ensure production stability, observability, and scalability of data platforms.
• Drive automation, CI/CD, and modern DevOps practices for data engineering.
• Maintain compliance with ComplexCare Solutions (CCS) policies, procedures and mission statement.
• Ensure compliance with CCS standards, HIPAA regulations, and data security requirements.
• Adhere to all confidentiality and HIPAA requirements as outlined within CCS’s Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position.
• Fulfill those responsibilities and/or duties that may be reasonably provided by CCS for the purpose of achieving operational and financial success of the Company

Job Requirements:

• 15+ years of experience in software engineering and data architecture, with at least 5+ years in a senior or lead architectural role.
• Proven expertise in designing and implementing enterprise data platforms using modern lakehouse architectures on Databricks.
• Strong experience with distributed data processing and modern lakehouse technologies (e.g., Spark SQL, PySpark, Unity Catalog, Delta/Iceberg formats, Python, etc.).
• Experience building agents utilizing Databricks Agentic, AI/BI Dashboard, and Genie Spaces capabilities.
• Deep knowledge of data modeling, ETL/ELT design, and data warehousing and BI (Power BI) reporting concepts.
• Experience with relational and NoSQL databases (e.g., SQL Server, PostgreSQL, MongoDB, Cassandra, Hive).
• Experience supporting AI/ML, predictive analytics, and agentic models.
• Background in healthcare, risk adjustment, or regulated domains.
• Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also acceptable).
• Strong understanding of event-driven architecture, microservices, and data integration patterns.
• Experience with CI/CD pipelines, automated testing, and DevOps practices.
• Experience with Agile/Scrum and modern software delivery methodologies.
• Proven ability to troubleshoot complex system issues and optimize performance across distributed systems.
• Strong communication, stakeholder management, and leadership skills.

Education:

• Bachelor’s degree in Computer Science, Software Engineering, or Information Technology.

ComplexCare Solutions offers an attractive compensation and benefits package designed to support our employees.

Compensation Range: $171,500-$200,000

The Company is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, or any other protected characteristic under federal, state, or other applicable laws.