Data Engineer (Data Build Tool, 5-7 yrs)

Archer; Bengaluru; On-site; INR 2,790,000 - 3,906,000; Full time

Job summary

Archer, in collaboration with Accenture, seeks an experienced Data Engineer to design, build, and maintain scalable data pipelines on a modern cloud data platform. You will work with dbt, Python, and orchestration tools to deliver robust data models across Bronze/Silver/Gold layers, while enforcing standards through custom macros.

You will also implement CI/CD for dbt and Python packages, collaborate with data architects, and apply best practices in data modeling and quality.

Qualifications

• DBT mastery with macros, tests and hooks.
• Strong Python for data ingestions and transformations.
• Experience orchestrating with Dagster or Airflow/Astronomer.
• CI/CD pipelines with GitLab and YAML automation.
• Understanding Medallion architecture (Bronze/Silver/Gold).
• SQL proficiency and Snowflake/AWS data services exposure.
• Familiarity with data quality frameworks like Great Expectations.

Responsibilities

• Design, build, and maintain dbt data models across Medallion layers.
• Develop custom dbt macros to enforce standards and reduce duplication.
• Write production-grade Python for data ingestion and processing.
• Build, schedule, and monitor data pipelines with Dagster/Astronomer.
• Implement CI/CD pipelines in GitLab for tests and deployments.
• Collaborate with data architects to translate business requirements into models.

Skills

dbt Core/Cloud

Python

Dagster/Astronomer (Airflow)

GitLab CI/CD

SQL

AWS data services

Great Expectations

AI-assisted tools (Q, Kiro)

Education

15 years full time education

Tools

Dagster

Astronomer

dbt

Job description

Project Role

Data Engineer

Archer is collaborating with Accenture to connect them with exceptional professionals for this role.

Project Role Description

Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Professional Requirements

• Must Have Skills: Data Build Tool
• Good To Have Skills: NA

Minimum: 5 Year(s) Of Experience Is Required

Educational Qualification :15 years full time education

Data Engineer (Contract)

Duration: 6 months (with potential to expand capacity) Engagement: Starting with 1 resource

Role Overview

We are seeking an experienced Data Engineer to build and maintain robust, scalable data pipelines on our cloud data platform.

You will work within a modern Medallion architecture, delivering high-quality, well-tested data models and pipelines using dbt, Python, and modern orchestration tools.

Key Responsibilities

• Design, build, and maintain dbt data models across Bronze, Silver, and Gold layers of a Medallion architecture
• Develop custom dbt macros to enforce modeling standards, reduce code duplication, and improve team productivity
• Write production-grade Python code for data ingestion, transformation, and processing workflows
• Build, schedule, and monitor data pipelines using orchestration platforms such as Dagster and Astronomer (Apache Airflow)
• Implement and manage CI/CD pipelines in GitLab for automated testing, linting, and deployment of dbt projects and Python packages
• Collaborate with data architects and analytics engineers to translate business requirements into clean, performant data models and pipelines
• Apply data modeling best practices including normalization, slowly changing dimensions, and star/snowflake schema design where appropriate
• Leverage AI-assisted development tools such as Amazon Q and Kiro to accelerate pipeline development

Required Skills

• Expert-level proficiency in dbt (Core or Cloud), including advanced features such as custom macros, hooks, tests, and packages
• Strong Python development skills, including writing modular, testable, and maintainable code for data engineering use cases
• Experience building and managing orchestrated workflows using Dagster and/or Astronomer (Apache Airflow), including DAG authoring, sensors, and dependency management
• Strong experience with CI/CD pipelines using GitLab, including .gitlab-ci.yml authoring and pipeline optimization
• Solid understanding of data modeling principles and experience implementing Medallion (Bronze/Silver/Gold) architecture
• Proficiency in SQL and experience working with cloud data warehouses (Snowflake preferred)
• Exposure to AWS data services (S3, Glue, Lambda) in a data pipeline context
• Familiarity with data quality frameworks such as Great Expectations or dbt tests
• Familiarity with AI-assisted development tools (Amazon Q, Kiro, or similar)

Nice to Have (will be mandatory skill set for future adds)

• Experience with PySpark for distributed data processing at scale

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences.All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law.Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.