Senior Data Engineer & Analytics Lead

TekStream Solutions; United States; Remoto; USD 140.000 - 190.000; Tempo pieno

Descrizione del lavoro

TekStream Solutions in the United States is seeking a Senior Data Engineer & Analytics Lead to support a high-impact federal data and analytics program. This hands-on role focuses on building scalable data platforms, production-grade pipelines, and improving data quality.

You'll collaborate with analytics and ML teams, develop Data Vault 2.0 and dimensional models, and work with Azure Databricks, PySpark, Python, SQL, and Delta Lake. The candidate must be eligible for U.S.

Competenze

• 8+ years in data or analytics engineering.
• Strong data modeling and pipeline design skills.
• Experience translating business needs into scalable analytics solutions.

Mansioni

• Design, build, and maintain scalable ETL/ELT data pipelines across systems.
• Model data with Data Vault 2.0, dimensional modeling, and analytics models.
• Work with Azure Databricks, PySpark, Python, SQL, and Delta Lake.
• Implement data quality, reconciliation, deduplication, and validation.
• Support Power BI datasets, semantic models, and analytics solutions.
• Optimize pipelines and queries for performance, reliability, and cost.
• Participate in code reviews, CI/CD, source control, and deployments.
• Collaborate with data scientists, ML engineers, architects, analysts, and partners.
• Create and maintain runbooks, data dictionaries, pipeline specs, diagrams.
• Provide technical leadership and review partner solutions for production readiness.

Conoscenze

Data engineering leadership

Data modeling

Technical communication

Strumenti

Azure Databricks

PySpark

Python

SQL

Delta Lake

Power BI

Unity Catalog

Git / CI/CD

Descrizione del lavoro

Remote | United States | Full-Time | W-2

Clearance: U.S. Citizenship required; ability to obtain Public Trust

We are seeking a Senior Data Engineer & Analytics Lead to support a high-impact federal data and analytics program. This is a hands-on role for someone who enjoys building scalable data platforms, developing production-grade pipelines, improving data quality, and working closely with analytics and machine learning teams.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines across multiple source systems and data formats.
• Develop data models using Data Vault 2.0, dimensional modeling, and Gold-tier analytics models.
• Work extensively with Azure Databricks, PySpark, Python, SQL, and Delta Lake.
• Implement data quality, reconciliation, deduplication, and validation processes.
• Support Power BI datasets, semantic models, and analytics solutions.
• Optimize data pipelines and queries for performance, reliability, and cost.
• Participate in code reviews, CI/CD, source control, and production deployments.
• Collaborate with data scientists, ML engineers, architects, analysts, and external partners.
• Create and maintain technical documentation, data dictionaries, pipeline specifications, diagrams, and runbooks.
• Provide technical leadership and review partner-developed solutions to ensure production readiness.

Required Qualifications

• 8+ years of experience in data engineering or analytics engineering.
• 3+ years of experience with Azure Databricks or a comparable lakehouse platform.
• Strong hands-on experience with SQL, Python/PySpark, Spark, ETL/ELT, and data modeling.
• Experience with Data Vault 2.0 and/or dimensional modeling.
• Experience with Delta Lake, orchestration, data quality, and performance tuning.
• Familiarity with Unity Catalog, Git/source control, CI/CD, and automated deployments.
• Experience supporting Power BI or enterprise analytics platforms.
• Strong technical communication and documentation skills.
• Ability to meet required federal suitability, security, and access requirements.

Preferred

• Experience with Impact Level 5 (IL-5) or higher environments.
• Azure Data Engineer or Databricks certification.
• Experience with ServiceNow, government financial, audit, or regulated data.
• Experience with Infrastructure as Code and Databricks Asset Bundles.