Lead Data Engineer (AWS, Azure, GCP)

CapTech

Philadelphia (Philadelphia County)

On-site

USD 120,000 - 150,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Generous PTO

Health coverage

Disability insurance

401(k) Matching

Learning & Development opportunities

Mental health and well-being platform

Job summary

A leading consulting firm is seeking a Cloud Data Engineer to help design and implement data solutions. The ideal candidate has over 5 years of experience in data engineering on cloud platforms and is proficient in ETL technologies. This full-time role offers a collaborative environment and a comprehensive benefits package, including generous PTO and health coverage.

Qualifications

5+ years of experience delivering data engineering solutions on cloud platforms.
Advanced level proficiency with at least one ETL/Data Orchestration technology.
Expertise in SQL and database design.

Responsibilities

Design, implement, and maintain modern data pipelines.
Provide technical leadership and collaborate within and across teams.
Stay current with the latest cloud technologies.

Skills

Building and operating distributed systems

Data engineering solutions on cloud platforms

ETL/Data Orchestration technologies

Cloud-based data warehousing solutions

SQL or NoSQL databases

Programming languages (Python, Java, etc.)

DevOps tools familiarity

Big data concepts

Provide technical leadership

Education

Cloud certification on any platform

Tools

AWS

Azure

GCP

Job description

Overview

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Qualifications

Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets
5+ years of experience delivering data engineering solutions on cloud platforms
5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)
Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL Server, Oracle, Aurora, Presto, BigQuery)
Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)
5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira)
Fundamental understanding of big data, open source, and data streaming concepts
Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
Experience providing technical leadership and mentoring other engineers in data engineering space
Cloud certification on any platform a plus

Additional Information

We offer career paths based on your skills and passions with customizable progression and a comprehensive benefits package to support you.
Benefits include generous PTO, health coverage, disability insurance, paid family leave, and extended benefits.
Learning & Development – certification and tuition support, digital on-demand learning, mentorship, and skill development paths
Modern Health – mental health and well-being platform with 1:1 care, group support, and self-serve resources
Carrot Fertility – inclusive fertility and family-forming coverage
Fringe – stipend program for personalized lifestyle benefits
Employee Resource Groups – diversity and inclusion initiatives
Philanthropic Partnerships – opportunities to engage in partnerships and pro-bono projects
401(k) Matching – generous matching with no vesting period

Equal Opportunity & Visa

CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness. We strive to create a diverse environment where each employee can bring unique ideas, backgrounds and experiences to the workplace. For more information about Diversity, Inclusion and Belonging efforts, please contact Laura Massa directly via email lmassa@captechconsulting.com. At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

Seniority level