Senior Cloud Data Engineer - Build Scalable Pipelines

CapTech Consulting; Atlanta (GA); Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Flexible work environment

Learning & Development

Modern Health

401(k) Matching

Fringe benefits

Job summary

CapTech Consulting is seeking a Data Engineer to design, build, and optimize data pipelines across cloud platforms. You will work with clients to translate requirements into scalable data architectures and collaborate with product owners and SMEs to deliver reliable data solutions.

CapTech emphasizes collaboration, continuous learning, and hands-on leadership across teams. Join a firm that values modern datawarehousing, big data, and open-source tooling to drive decision-making for Fortune 100

Qualifications

• Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets.
• 5+ years of experience delivering data engineering solutions on cloud platforms (AWS, Azure, GCP).
• 5+ years of experience implementing modern designs using cloud-based solution/platforms (AWS, Azure, GCP).
• Advanced level proficiency with at least one ETL/Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion).
• Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks.
• 5+ years of experience with SQL or NoSQL databases (PostgreSQL, MySQL, SQL Server, Oracle, Aurora, Presto, BigQuery).
• Expertise with SQL, database design/structure and data structures (star, snowflake schemas).
• 5+ years of experience with at least one programming language (Python, Java, R, C/C++, Shell).
• Familiarity with DevOps tools (Git, Jenkins, CI/CD, Jira).
• Fundamental understanding of big data, open source, and data streaming concepts.

Responsibilities

• Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
• Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
• Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
• Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
• Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

Skills

Data engineering

Cloud architectures

SQL/NoSQL

ETL/Orchestration

Programming (Python/Java)

DevOps familiarity

Big data concepts

Technical leadership

Tools

Azure Data Factory

SSIS

Informatica

Talend

Databricks

Snowflake

Redshift

BigQuery

Git

Jenkins

CI/CD

Databricks

Job description

CapTech Consulting is seeking a Data Engineer to design, build, and optimize data pipelines across cloud platforms. You will work with clients to translate requirements into scalable data architectures and collaborate with product owners and SMEs to deliver reliable data solutions.

CapTech emphasizes collaboration, continuous learning, and hands-on leadership across teams. Join a firm that values modern datawarehousing, big data, and open-source tooling to drive decision-making for Fortune 100