Senior Data Engineer (DBT)

Blackbuck Insights; Bengaluru; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Blackbuck Insights is seeking a senior data engineer with 8+ years of hands-on software development experience. The role focuses on building data pipelines using Apache Airflow, DBT, and Snowflake SQL, while leveraging cloud platforms (Azure/GCP/AWS) for data integration, warehousing, and ETL tasks.

Strong Python/SQL skills and collaboration across teams are essential. The ideal candidate thrives in a fast-paced environment, enjoys problem solving, and is comfortable with on-call rotations to

Qualifications

• 8+ years of hands-on experience in software development, with a bachelor's degree in a relevant field of study.
• Experience creating DAGs, building Airflow custom operators and hooks.
• Strong knowledge of cloud technologies and distributed computing, specifically with Azure or Google Cloud Platform (GCP) or AWS
• Solid background and hands-on experience in BI, Data Warehousing, and ETL projects
• In-depth experience with Python and SQL, foundational technologies essential for data processing and manipulation
• Experience using version control, CI/CD, and automation tools
• Experience with data quality and data cleansing.
• A proactive, curious mindset with a creative approach to problem-solving and a willingness to participate in an on-call escalation rotation as needed
• Excellent collaboration skills with a focus on building strong, effective relationships across teams
• Strong on DBT with Snowflake SQL.
• Snowflake SQL Writing SQL queries against Snowflake Developing scripts, Python, etc. to doExtract, Load, and Transform data.
• Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.
• Complex problem-solving capability.
• Hands-on experience with Apache Airflow for orchestrating complex data workflows.
• Must be analytic, creative and self-motivated.
• ETL tool DBT, Advanced SQL along with good Python scripting skill Data Modelling and source totarget mapping skills.

Skills

Apache Airflow

Airflow DAGs

Cloud platforms

Python

SQL

DBT

Snowflake SQL

Snowflake

ETL

Data Warehousing

Data Quality

CI/CD

On-call rotation

Team collaboration

Data Modeling

Education

Bachelor's degree in a relevant field

Tools

Snowpipe

Snowflake

Job description

BBI is a global data engineering consulting firm that empowers clients to effectively scale and modernize. We combine engineering fundamentals and innovative tools to execute business-critical, end-to-end projects on-time and on-budget. We offer expert services across Data Integration, Data Modernization, Data Migration, Data Architecture, Platform Support, and Application Services. Our goal is to provide business value in the most effective way for our clients so clients can focus on growth.

Job Description

8+ years of hands-on experience in software development, with a bachelor's degree in a relevantfield of study

• Experience creating DAGs, building Airflow custom operators and hooks.
• Strong knowledge of cloud technologies and distributed computing, specifically with Azure orGoogle Cloud Platform (GCP) or AWS
• Solid background and hands-on experience in Business Intelligence (BI), Data Warehousing, andETL projects
• In-depth experience with Python and SQL, foundational technologies essential for dataprocessing and manipulation
• Experience using version control, CI/CD, and automation tools
• Experience with data quality and data cleansing.
• A proactive, curious mindset with a creative approach to problem-solving and a willingness toparticipate in an on-call escalation rotation as needed
• Excellent collaboration skills with a focus on building strong, effective relationships across teams
• Strong on DBT with Snowflake SQL.
• Snowflake SQL Writing SQL queries against Snowflake Developing scripts, Python, etc. to doExtract, Load, and Transform data.
• Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks,Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.
• Complex problem-solving capability.
• Hands-on experience with Apache Airflow for orchestrating complex data workflows.
• Must be analytic, creative and self-motivated.
• ETL tool DBT, Advanced SQL along with good Python scripting skill Data Modelling and source totarget mapping skills.