Senior Data Engineer - Python, SQL, AWS & Snowflake

Beacon Hill; Orlando (FL); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with match

Job summary

Beacon Hill is seeking a highly skilled Senior Data Engineer to design, develop, and optimize enterprise-scale data pipelines and cloud-based data solutions. The ideal candidate will have extensive Python, SQL, ETL/ELT experience and a strong understanding of modern cloud data engineering technologies.

The role requires hands-on development on large-scale datasets, with a focus on end-to-end data pipeline architecture, ingestion, transformation, storage, and downstream integration.

Qualifications

• 5+ years hands-on Python and SQL experience developing complex data pipelines.
• Strong Data Engineering experience designing, building, optimizing, and maintaining ETL/ELT pipelines.
• Experience with large datasets and enterprise environments with high-volume ingestion and processing.
• Deep understanding of end-to-end data pipeline architecture and integration points.
• Experience with cloud-based data engineering solutions, preferably AWS (Azure/GCP OK).
• Hands-on development background with troubleshooting, performance optimization, and production delivery.
• Excellent communication and collaboration with technical and business stakeholders.
• AWS: familiarity with storage, compute, configuration management, and data services.
• Snowflake: SQL transformations, data workflows, and cloud data warehouse optimization.
• Apache Airflow: orchestration, scheduling, and monitoring of pipelines.

Responsibilities

• Design, develop, and optimize enterprise-scale data pipelines.
• Build cloud-based data solutions and ensure scalable data architectures.
• Collaborate with stakeholders to deliver end-to-end data engineering solutions.
• Troubleshoot and optimize performance of data pipelines and pipelines-related infra.

Skills

Python

SQL

ETL/ELT

Cloud data

AWS

Snowflake

Airflow

Big data

Tools

GitLab

Docker

API integration

Generative AI tools

Agentic AI

Job description

Position Overview

Seeking a highly skilled, hands-on Senior Data Engineer to design, develop, and optimize enterprise-scale data pipelines and cloud-based data solutions. The ideal candidate will have extensive experience with Python, SQL, ETL/ELT development, and large-scale data processing, along with a strong understanding of modern cloud data engineering technologies.

Looking for a true hands-on engineer with strong technical depth, not someone whose experience is primarily focused on data science, analytics, or high-level architecture.

Ideal Candidate Profile

The ideal candidate is a technically strong Senior Data Engineer who has worked on large-scale enterprise projects and can demonstrate significant hands-on development experience.

They should be able to explain not only how they use Python, SQL, and cloud technologies, but also how these technologies work together to deliver complete, scalable data engineering solutions.

Candidates should have experience managing complex data pipelines, processing substantial data volumes, and collaborating directly with business and technical stakeholders.

Strong communication skills, problem-solving abilities, and a collaborative approach are essential.

Must-Have Qualifications

• 5+ years of hands-on Python and SQL experience, with demonstrated expertise developing complex data engineering solutions and production pipelines.
• Strong Data Engineering experience, including designing, building, optimizing, and maintaining enterprise-scale ETL/ELT pipelines.
• Experience working with large datasets and complex enterprise environments, including high-volume data ingestion, transformation, and processing.
• Strong understanding of end-to-end data pipeline architecture, including how ingestion, orchestration, transformation, storage, and downstream systems integrate.
• Experience with cloud-based data engineering solutions, preferably AWS, although Azure or GCP experience will be considered.
• Strong hands-on development background, with the ability to troubleshoot technical issues, optimize performance, and independently deliver production-ready solutions.
• Excellent communication and collaboration skills, with experience working directly with technical teams, business stakeholders, and cross-functional partners.
• AWS: Experience with cloud storage, compute, configuration management, and data engineering services.
• Snowflake: Hands-on experience developing SQL transformations, managing data workflows, and optimizing cloud data warehouse solutions.
• Apache Airflow: Experience orchestrating, scheduling, and monitoring complex data pipelines.

Preferred Technical Skills

• GitLab: Experience with source control, collaborative development, and CI/CD workflows.
• Docker: Experience with containerized development and deployment.
• API Integration: Experience developing or consuming APIs for data ingestion and integration.
• Generative AI Tools: Familiarity with AI-assisted coding, development automation, and engineering productivity tools.
• Agentic AI: Exposure to AI agents or AI-driven development workflows is a plus.
• Revenue Management/Pricing Data: Previous experience supporting revenue management, pricing systems, or related data platforms is beneficial but not required.

Interested candidates may submit their resumes online or call at 310-906-4780 for further information regarding the position.

Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.

California residents:

Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

Company Profile

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.

Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.bhsg.com.

Benefits Information

Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.