Senior Data Solutions Architect: Lakehouse & Big Data

United States Digital Space LLC; Sydney; On-site; AUD 180,000 - 230,000; Full time

Job summary

United States Digital Space LLC is seeking a Specialist Solutions Architect (Data Engineering and Warehousing) to guide cloud data transformations across diverse use cases.

You will lead production data pipelines, mentor engineers, and align technical roadmaps with the company Data Intelligence Platform for scalable lakehouse architectures and BI-ready workloads.

Qualifications

• 8+ years in a technical role with deep expertise in data ingestion, streaming, and big data solutions.
• Experience building data-driven use cases (risk modeling, fraud detection, LTV).
• Advanced query tuning, data governance, and MPP warehousing; migration from EDW to cloud platforms.

Responsibilities

• Lead technical direction for large-scale data warehousing and BI workloads.
• Architect end-to-end data pipelines with performance testing and optimization.
• Develop expertise in data lake technologies and data ingestion/workflows.

Skills

Data ingestion

Streaming technologies

Performance tuning

Troubleshooting

Data warehousing

Data observability

SQL

Python

Scala

Java

AWS

Azure

GCP

Delta Lake

Spark

Kafka

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent

Tools

Spark

Kafka

Delta Lake

Redshift

Snowflake

Synapse

EMR

Splunk

Elastic

Sentinel

AWS

Azure

GCP

Job description

FEQ327R358

As a Specialist Solutions Architect (SSA) - Data Engineering and Warehousing, you will guide customers through cloud data engineering transformations across a wide variety of use cases.

In this customer-facing role, you will collaborate with and support Solutions Architects. This requires hands-on production experience with large-scale data engineering technologies and lakehouse architecture. The SSA teams help customers navigate evaluations and successfully plan production for their business intelligence workloads while aligning their technical roadmap with the the company Data Intelligence Platform.

As a deep go-to expert reporting to the Specialist Field Engineering Manager, you will continue to strengthen your technical skills through mentorship, continuous learning, and internal training programs. In this role, you will establish yourself as a leader in the data engineering and warehousing specialty.

**The impact you will have:**

• Provide technical leadership to guide strategic customers to successful implementations on big data projects and large-scale data warehousing workloads.

• Prove the value of the the company Intelligence Platform for customer workloads by architecting production workloads, including end-to-end pipeline load performance testing and optimization.

• Architect production-level data pipelines, including end-to-end pipeline load performance testing and optimization.

• Become a technical expert in an area such as data lake technology, big data streaming, or big data ingestion and workflows.

• Assist Solution Architects with more advanced aspects of the technical sale, including custom proof of concept content, estimating workload sizing, and custom architectures.

• Provide tutorials and training to improve community adoption (including hackathons and conference presentations).

• Contribute to the the company Community.

What we look for:

• 8+ years of experience in a technical role with deep expertise across the following areas:

• Software / Data Engineering: Hands-on experience with data ingestion, streaming technologies (e.g., Spark Streaming, Kafka), performance tuning, troubleshooting, and debugging Spark or other big data solutions.

• Data Applications Engineering: Experience building data-driven use cases, such as risk modeling, fraud detection, and customer lifetime value (LTV).

• Data Warehousing: Advanced query tuning, troubleshooting, data governance, and debugging MPP data warehouses or big data solutions. Experience migrating workloads from EDW systems (e.g., traditional SQL, Redshift, Snowflake, Synapse, EMR) across OLAP & OLTP workloads.

• Data Observability: Experience with SIEM tools (e.g., Splunk, Elastic, Sentinel), telemetry/high-velocity log ingestion, and anomaly detection.

• Proven track record of maintaining, scaling, and extending production data systems to evolve with complex business needs.

• Deep expertise across multiple core data engineering domains, including:

• Designing and scaling cost-efficient, high-performance data workloads (ETL/ELT, analytics) in cloud environments.

• Building and migrating large-scale data pipelines, including batch, CDC (Change Data Capture), and streaming ingestion.

• Migrating on-premises or Hadoop-based data systems to modern cloud platforms (AWS, Azure, GCP).

• Developing and managing modern lakehouse and warehouse systems, including Delta Lake technologies, data modeling, governance, and BI integration.

• Production programming experience in SQL and at least one of the following: Python, Scala, or Java.

• Strong familiarity with cloud infrastructure providers (AWS, Azure, or GCP) is highly desirable.

• Degree or Equivalent: Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent professional experience.

• 3+ years of customer-facing experience in a pre-sales or post-sales technical role.

• Ability to meet expectations for technical training and role-specific milestones within 6 months of hire.

• Willingness to travel up to 30% as needed.

About the company

the company is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the the company Data Intelligence Platform to unify and democratize data, analytics and AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow the company onTwitter,LinkedInandFacebook.

**Benefits

**At the company, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

Our Commitment to Diversity and Inclusion

At the company, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at the company are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

ComplianceIf access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.