Data Architect

Harnham; New York (NY); On-site; USD 150,000 - 230,000; Full time

Job summary

Harnham is seeking a Data Architect in New York to lead the design and delivery of a modern Databricks-based data platform. You will drive migration initiatives and define future-state data architecture that supports analytics, AI, and business growth.

You will collaborate with finance, marketing, and other stakeholders to shape data strategy, owning foundational pipelines and frameworks to enable scalable, enterprise-grade data capabilities from day one.

Qualifications

• Experience designing and delivering Databricks-based data platforms.
• Proven success migrating large-scale data ecosystems to modern lakehouse architectures.
• Strong SQL and PySpark proficiency with performance optimization.

Responsibilities

• Lead design and delivery of a Databricks-based data platform in production.
• Drive large-scale migration initiatives and define future-state data architecture.
• Build scalable data foundations to support analytics, AI, and growth.
• Collaborate with stakeholders to shape data strategy.
• Own foundational data pipelines and frameworks to support growth.

Skills

Databricks

Lakehouse

PySpark

SQL

Terraform

CI/CD

Tools

GitHub Actions

Azure DevOps

Job description

• Lead the design and delivery of a modern Databricks-based data platform.
• Drive large-scale migration initiatives and define future-state data architecture.
• Build scalable data foundations to support analytics, AI, and business growth.
• Collaborate with technical and business stakeholders to shape data strategy.
• Opportunity to make a lasting impact on a significant data transformation programme.

This is an opportunity to work with some of the most ambitious organizations undertaking major cloud and data transformation programmes, leading complex Databricks initiatives that directly influence how businesses leverage data, AI, and analytics. If you enjoy solving challenging technical problems, influencing strategic decisions, and delivering modern lakehouse architecture that creates lasting business impact, this role offers a genuinely rewarding environment.

The Company

They are a specialist data and AI consultancy that helps enterprise organizations transform their analytics capabilities through modern cloud and data platforms. Their teams work closely with clients on large-scale migration, engineering, and architecture initiatives.

The Role

As a Data Architect, you will be:

• Help shape and build a brand-new data platform as the organization migrates away from a larger conglomerate platform, giving you the opportunity to influence the architecture from day one.
• Lead the assessment of existing data systems and design a scalable, future-state architecture.
• Partner with Finance, Marketing, and key business stakeholders to define data strategy and requirements.
• Own the creation of foundational data pipelines and frameworks that will support the new organization's growth.
• Join at a pivotal stage where your technical expertise and architectural decisions will have a lasting business impact.

Your Skills & Experience

The successful Data Architect will have the following skills and experience:

• Strong experience architecting and delivering Databricks solutions in production environments.
• Proven success leading large-scale migrations from legacy platforms such as Hadoop, Teradata, Oracle, Informatica, Synapse, or Snowflake to Databricks.
• Expertise with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, Structured Streaming, and data modelling frameworks.
• Advanced PySpark, SQL, and Apache Spark knowledge, including performance optimization, workload isolation, and streaming architectures.
• Hands-on experience implementing CI/CD and infrastructure as code using technologies such as Terraform, Databricks Asset Bundles, GitHub Actions, or Azure DevOps.
• Strong consulting and stakeholder management skills, with experience leading technical delivery across enterprise data transformation programmes.