Senior Data Engineer

TekWissen LLC; Bellevue (WA); On-site; USD 150,000 - 210,000; Full time

Job summary

TekWissen LLC is seeking an experienced Senior Data Engineer in Bellevue, WA to design and implement production-grade data solutions for Identity Resolution and large-scale customer data initiatives. The candidate will work onsite on a 7-month temporary assignment, delivering scalable pipelines and optimizing Spark performance.

The role requires strong Python and SQL skills, extensive experience with Azure Databricks, PySpark, and ADF, and the ability to drive solutions from design through

Qualifications

• 7+ years of Data Engineering experience.
• Proven experience working with very large-scale datasets, preferably 1B+ records.
• Strong hands-on experience with Azure Databricks and PySpark.
• Strong Python and SQL skills.
• Experience with Azure Data Factory (ADF) and Azure data services.
• Strong understanding of distributed processing and Spark performance optimization.
• Experience delivering production-grade, scalable data solutions.
• Ability to identify technical constraints early and make timely technical decisions.
• Strong problem-solving and communication skills.

Responsibilities

• Design and optimize large-scale data processing solutions capable of operating at 1B+ record scale.
• Develop scalable data pipelines using Azure Databricks, PySpark, Python, and ADF.
• Optimize Spark workloads including large-scale joins, partitioning, shuffling, data skew, memory, and compute utilization.
• Design and improve solutions for Identity Resolution, Entity Resolution, Record Linkage, Deduplication, or similar high-volume matching problems.
• Evaluate technical approaches against production data volumes and infrastructure constraints.
• Identify and communicate scalability and environment constraints early and recommend viable alternatives.
• Perform performance and scalability testing using production-like workloads.
• Build reliable data pipelines with appropriate validation, error handling, monitoring, and recovery mechanisms.
• Collaborate with architects, engineers, data scientists, and stakeholders to deliver solutions from design through production.

Skills

Python programming

SQL

Data engineering

Distributed data processing

Tools

Azure Databricks

PySpark

Azure Data Factory

Cosmos DB

Kafka

Job description

Overview:

TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services

Position:

Senior Data Engineer

Location:

Bellevue, WA, 98008

Duration:

7 Months

Job Type:

Temporary Assignment

Work Type:

Onsite

Job Description:

• We are seeking an experienced Senior Data Engineer to design, build, and optimize production-grade data solutions supporting Identity Resolution (IDR)and large-scale customer data initiatives.
• The ideal candidate will have proven experience delivering data solutions at billion-record scale, with strong expertise in Azure Databricks, PySpark, Python, Azure Data Factory, and distributed data processing.
• The role requires strong production-scale engineering judgment-the ability to identify technical and scalability constraints early, evaluate alternatives quickly, and deliver tested, scalable, and production-ready solutions.
• Experience with Identity Resolution or comparable high-throughput matching systems is highly preferred.

Key Responsibilities

• Design and optimize large-scale data processing solutions capable of operating at 1B+ record scale.
• Develop scalable data pipelines using Azure Databricks, PySpark, Python, and ADF.
• Optimize Spark workloads including large-scale joins, partitioning, shuffling, data skew, memory, and compute utilization.
• Design and improve solutions for Identity Resolution, Entity Resolution, Record Linkage, Deduplication, or similar high-volume matching problems.
• Evaluate technical approaches against production data volumes and infrastructure constraints.
• Identify and communicate scalability and environment constraints earlyand recommend viable alternatives.
• Perform performance and scalability testing using production-like workloads.
• Build reliable data pipelines with appropriate validation, error handling, monitoring, and recovery mechanisms.
• Collaborate with architects, engineers, data scientists, and stakeholders to deliver solutions from design through production.

Required Qualifications

• 7+ years of Data Engineering experience.
• Proven experience working with very large-scale datasets, preferably 1B+ records.
• Strong hands-on experience with Azure Databricks and PySpark.

Strong Python and SQLskills.

• Experience with Azure Data Factory (ADF) and Azure data services.
• Strong understanding of distributed processing and Spark performance optimization.
• Experience delivering production-grade, scalable data solutions.
• Ability to identify technical constraints early and make timely technical decisions.
• Strong problem-solving and communication skills.

Preferred Qualifications

• Experience with Identity Resolution / Entity Resolution / Record Linkage / Deduplication / Fuzzy Matching.
• Experience with Cosmos DB and low-latency APIs.
• Experience with Azure Functions or Azure Web Apps.
• Experience with Event Hub, Kafka, or Spark Structured Streaming.
• ML experience related to matching or customer data.
• Exposure to Generative AI, LLMs, RAG, or Agentic AI.
• Telecommunications or large-scale customer data experience.

TekWissen Group is an equal opportunity employer supporting workforce diversity.