Senior Data Engineer: Real-Time, Scalable Pipelines

Tech Junction Ltd; Seattle (WA); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Tech Junction Ltd in Seattle, WA is seeking an experienced Data Engineer to design, build, and optimize distributed data pipelines for real-time and batch workloads, delivering low-latency data to analytics teams.

You will own end-to-end data workflows, tune queries, manage large-scale stores, and collaborate with data scientists and software engineers, ensuring scalable architectures and robust data governance.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline.
• Minimum of 5 to 7+ years of professional software and data engineering experience specializing in big data systems.
• Strong hands-on expertise in distributed data engineering, scalable data pipelines, and cloud data platforms.
• Proven practical proficiency in both real-time data streaming (e.g., Kafka, Spark Streaming) and batch data processing.
• Deep technical knowledge of database query optimization, indexing, and performance tuning in large-scale environments.
• Strong troubleshooting background with proven experience conducting Root Cause Analysis (RCA) on production failures.
• Exceptional analytical, problem-solving, and cross-functional communication capabilities.
• Mandatory legal eligibility to work in the United States with local presence in Seattle, WA or remote capability as applicable.

Responsibilities

• Design, build, test, and maintain scalable distributed data pipelines for real-time streaming and batch processing workloads.
• Develop and optimize big data architectures to handle massive throughput and low-latency data processing.
• Execute rigorous query optimization, performance tuning, and resource allocation across distributed data stores.
• Perform thorough Root Cause Analysis (RCA) and resolve complex data pipeline failures and latency bottlenecks.
• Integrate large-scale data lakes and data warehouses with enterprise data governance and security frameworks.
• Collaborate with cross-functional data scientists, analytics engineers, and software developers.
• Implement automated data quality checks, schema validation, and continuous integration pipelines.
• Maintain comprehensive technical documentation, data lineage graphs, and architectural diagrams.

Skills

Distributed data

Real-time streaming

Batch processing

Query optimization

Root Cause Analysis

Cross-functional communication

Troubleshooting

Education

Bachelor’s degree in CS/IT/Data Engineering

Tools

Kafka

Spark Streaming

Snowflake

dbt

Airflow

Spark

Hadoop

Docker

Kubernetes

Job description

Tech Junction Ltd in Seattle, WA is seeking an experienced Data Engineer to design, build, and optimize distributed data pipelines for real-time and batch workloads, delivering low-latency data to analytics teams.

You will own end-to-end data workflows, tune queries, manage large-scale stores, and collaborate with data scientists and software engineers, ensuring scalable architectures and robust data governance.