Sr. Data Engineer

DTN (Data Transmission Network); Town of Texas (WI); Hybrid; USD 109,400 - 145,800; Full time

Benefits offered by this job

Remote work model (position dependent)

Unlimited PTO

6% 401K matching

Learning platform access

Job summary

DTN is seeking a Senior Data Engineer to drive ingestion, quality, reliability, and governance of data across enterprise platforms. You will support modern batch and real-time streaming architectures, enabling customers and internal stakeholders to access trusted, scalable data solutions.

You will design, build, and operate high-throughput data pipelines, leverage Kafka and Kinesis, and collaborate on cloud-native data platforms with a focus on security and governance.

Qualifications

• 7+ years in data engineering with batch and streaming pipelines.
• Experience designing streaming architectures and real-time processing.

Responsibilities

• Deliver trusted data sets for customers and internal stakeholders.
• Design and maintain batch and real-time data pipelines.
• Architect and manage event streaming using Kafka and Kinesis.
• Ensure data quality, governance, and security across platforms.
• Document data engineering processes and standards.

Skills

Data pipelines

Python

SQL

Apache Kafka

AWS Kinesis

Cloud architectures

Docker

Kubernetes

CI/CD

Data governance

Education

Bachelor’s degree in Computer Science or related field

Tools

Snowflake

AWS

Git

Job description

Job Description

DTN is seeking a results‑driven Senior Data Engineer to support the ingestion, quality, integrity, reliability, and governance of data across our enterprise platforms. This role plays a critical part in advancing DTN’s modern batch and real‑time streaming data architecture while enabling customers and internal stakeholders to leverage trusted, scalable, and secure data solutions.

Responsibilities

• Deliver trusted data sets and services from complex data sources and environments to support DTN customers and internal stakeholders.
• Support the development and delivery of modern data and analytics architecture through batch and streaming data integration, acquisition, and management solutions.
• Design, build, and maintain batch and real‑time streaming data pipelines and ingestion processes that ensure data quality, reliability, and scalability.
• Architect and manage high‑throughput event streaming solutions utilizing Apache Kafka and Amazon Kinesis.
• Support customer and partner data infrastructure needs by troubleshooting technical issues and optimizing data environments.
• Contribute to the continuous improvement of data management standards, practices, and architectural patterns.
• Document data engineering processes, standards, and best practices to promote adoption across teams.
• Ensure data governance, security, and compliance requirements are incorporated into solution delivery.
• Identify opportunities to automate processes, reduce complexity, and improve operational efficiency through innovative data solutions.
• Develop reference architectures, standards, and documentation to support consistent approaches to data acquisition, transformation, storage, and analytics consumption.

Qualifications

• 7+ years of data engineering experience with batch and streaming pipelines, data ingestion, ETL/ELT processes, or 2+ years of software engineering experience.
• Proven experience designing and implementing streaming data architectures, message brokering, and real‑time event processing using Apache Kafka and AWS Kinesis.
• 4+ years of cloud experience, preferably across multiple cloud platforms.
• Strong programming skills in Python or other modern development languages such as Java or Go.
• Experience with ETL processes, SQL development, and data transformation workflows.
• Experience working with relational databases such as Oracle, PostgreSQL, or MySQL.
• Experience with AWS cloud services and cloud‑based data platforms such as Snowflake or AWS‑native solutions.
• Ability to design solutions that support data transformation, governance, workload management, and complex data structures.
• Experience with cloud architectures, highly available systems, and scalable solutions.
• Familiarity with Agile development methodologies and CI/CD practices.
• Experience with Docker and Kubernetes environments.
• Bachelor’s degree in Computer Science or equivalent experience.

Additional Qualifications

• Experience with stream processing frameworks such as Apache Flink or Spark Streaming.
• Experience with front‑end technologies such as React, Angular, or Vue.
• Experience developing RESTful APIs using Node.js or Python.
• Experience consuming REST and GraphQL APIs.
• Strong understanding of source control and versioning practices using Git.
• Experience supporting enterprise data and analytics platforms in cloud‑native environments.

Benefits and Compensation

• Competitive Salary (Targeted hiring base pay range: $109,400 – $145,800).
• Unlimited PTO.
• Flexible working hours.
• Remote work model (position dependent).
• Competitive Medical, Dental and Vision Insurance Plans.
• 6% 401K matching.
• Unlimited access to 13,000+ courses via learning platform to support employee career advancement.
• Employee Assistance Program (EAP).
• Opportunity for market‑competitive variable pay and benefits.

Equal Opportunity Employer

DTN is an Equal Opportunity Employer. We welcome and encourage applicants of all backgrounds, including minorities, women, veterans, and individuals with disabilities.