Senior Data Platform Engineer

NationsBenefits; United States; Remote; USD 140,000 - 160,000; Full time

Job summary

An innovative firm is seeking a Senior Data Platform Engineer to contribute to a transformative Enterprise Data Platform initiative. This role involves implementing robust Azure cloud infrastructure, developing streaming data services, and establishing best practices in collaboration with cross-functional teams. You will play a vital role in driving technical direction, optimizing data handling, and ensuring compliance with security measures. Join this forward-thinking company to work with cutting-edge technologies and shape the future of data-driven solutions in a collaborative environment.

Qualifications

• 5+ years of experience in data engineering with Azure cloud services.
• Strong expertise in streaming data technologies like Kafka and Event Hub.

Responsibilities

• Implement Azure-based data platform infrastructure and streaming data services.
• Contribute to DevOps practices including CI/CD pipelines and automated testing.

Skills

Data Engineering

Azure Cloud Services

Python Programming

Kafka

Event Hub

DevOps Practices

CI/CD Implementation

Apache Airflow

Data Security

Communication Skills

Education

Bachelor's degree in Computer Science

Bachelor's degree in Information Technology

Tools

Databricks

Azure Services

Kafka

Event Hub

Airflow

Job description

This range is provided by NationsBenefits. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$140,000.00/yr - $160,000.00/yr

Direct message the job poster from NationsBenefits

Senior TAQ Specialist at Nations Benefits

Job Title: Senior Data Platform Engineer

Location: Remote

Position Overview:

As a Senior Data Platform Engineer, you will be a key contributor to our new Enterprise Data Platform initiative, working under the guidance of a platform architect. You will help implement robust, scalable Azure cloud infrastructure that supports our data ecosystem, including streaming data services, operational databases, and secure data handling capabilities. In this role, you will help drive technical direction and establish best practices while collaborating with cross-functional teams to deliver platform components that meet business requirements.

Key Responsibilities:

1. Collaborate with the platform architect to implement Azure-based data platform infrastructure supporting the organization's data services.
2. Develop and maintain streaming data services using technologies such as Kafka and Event Hub within our Azure environment.
3. Contribute to DevOps practices implementation including CI/CD pipelines, infrastructure-as-code, and automated testing for platform components.
4. Configure and optimize Databricks environments according to architectural guidelines.
5. Develop cloud-native solutions for data ingestion, processing, and delivery using Azure services, Airflow orchestration, and Python.
6. Help establish and implement monitoring, alerting, and logging systems for platform components.
7. Assist in implementing security controls and compliance measures for sensitive data handling, with focus on PII masking capabilities.
8. Provide technical expertise and recommendations for platform enhancements and best practices.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5+ years of hands-on experience in data engineering.
• 3+ years of working with streaming data technologies such as Kafka or Event Hub.
• Strong expertise in Azure cloud services relevant to data platforms.
• Experience working with and managing a Databricks environment.
• Experience with DevOps practices including infrastructure-as-code and CI/CD implementation.
• Extensive Python programming skills for automation and data processing.
• Experience with Apache Airflow for workflow orchestration.
• Demonstrated ability to implement secure data environments.
• Strong communication skills and ability to collaborate effectively with technical and non-technical stakeholders.

Preferred Qualifications:

• Experience working with global teams across different time zones.
• Knowledge of HIPAA or PCI compliance requirements in cloud environments.
• Experience with PII data handling and security controls.
• Proficiency with cloud monitoring and observability tools.

Join our team to help build a next-generation data platform that will power our organization's data-driven initiatives while working with cutting-edge cloud technologies in a collaborative environment.