Senior Data Engineer

Software Resources, Inc.; Lake Buena Vista (FL); Hybrid; USD 110,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company match

Short-term disability

Life insurance with AD&D

Job summary

Software Resources, Inc. seeks a Senior Data Engineer in Lake Buena Vista, FL with a hybrid work setup. The role centers on designing, building, and deploying data engineering systems and ETL/ELT pipelines, with on-site presence Monday through Thursday and remote Fridays.

You will collaborate with stakeholders to gather data requirements, define source-to-target mappings, develop data validation scripts, and monitor pipelines using SQL and Python across environments with DevOps practices.

Qualifications

• 2+ years of ELT/ETL development experience.
• 5+ years building ELT/ETL pipelines with SQL and Python.
• 2+ years developing and maintaining data pipelines with a framework such as Apache Flink, Apache Beam, or Kafka Streams.
• Experience with understanding business domains to gather data requirements and data design solutions.
• Experience in multiple environments (Dev, QA, Prod) with DevOps deployment practices.
• Strong database design knowledge with PostgreSQL or Snowflake.
• Experience managing code with GitLab or GitHub.

Responsibilities

• Gather and refine data requirements with stakeholders.
• Define source-to-target data mappings to support integration efforts.
• Develop and review data validation scripts to ensure data quality.
• Design, implement, and monitor ETL and ELT data pipelines.
• Produce datasets used as inputs for analytical models and visualizations.
• Participate in technical reviews to ensure high quality deliverables.
• Develop an understanding of business domains to inform assigned work.
• Communicate data engineering progress to project leadership.

Skills

ELT/ETL development experience

Data modeling

DevOps practices

Communication

Education

Bachelor's degree in CS or related field

Tools

Snowflake

SQL

Python

Apache Flink

Apache Beam

Kafka Streams

Docker

Kubernetes

AWS

Databricks

PostgreSQL

GitLab

GitHub

Job description

This contract Senior Data Engineer opportunity is based in Lake Buena Vista, FL, with a hybrid work arrangement. The role centers on designing, building, and implementing data engineering systems and ETL/ELT pipelines, with on-site presence required Monday through Thursday and remote work available on Fridays.

Responsibilities

• Collaborate with stakeholders to gather and refine data requirements.
• Define source-to-target data mappings to support integration efforts.
• Develop and review data validation scripts to ensure data quality.
• Design, implement, and monitor ETL and ELT data pipelines.
• Produce datasets used as inputs for analytical models and visualizations.
• Participate in technical reviews to ensure high quality deliverables.
• Develop an understanding of business domains and processes to inform assigned work.
• Communicate data engineering progress to project leadership.
• Actively contribute to meetings and discussions with the project team.

Requirements

• Bachelor's degree in Computer Science, Mathematics, Software Engineering, or a related field, or equivalent experience.
• Minimum of 2 years of experience in ELT/ETL development.
• 5+ years of experience building ELT/ETL pipelines using SQL and Python.
• 2+ years developing and maintaining data pipelines with a framework such as Apache Flink, Apache Beam, or Kafka Streams.
• Experience and understanding of one or more business domains to assist in gathering and refining data requirements and data design solutions.
• Experience developing in multiple environments (Dev, QA, Prod) and implementing DevOps procedures for code deployment and promotion.
• Strong database design knowledge and proficiency with platforms such as PostgreSQL or Snowflake.
• Experience managing and deploying code using GitLab or GitHub.
• Ability to articulate solutions and communicate complex technical concepts to non-technical team members.

Technologies

• Snowflake
• SQL
• Python
• Apache Flink
• Apache Beam
• Kafka Streams
• Docker
• Kubernetes
• AWS
• Databricks
• PostgreSQL
• GitLab
• GitHub

Benefits

• Medical, dental, and vision coverage
• 401(k) with company match
• Short-term disability
• Life insurance with AD&D