Engineer Data Services

Tata Consultancy Services; San Antonio (TX); On-site; USD 80,000 - 100,000; Full time

Job summary

Tata Consultancy Services is seeking an Engineer for Data Services specializing in Snowflake and DBT. The role involves building scalable data models, optimizing ETL/ELT pipelines, and ensuring data quality and security. Candidates should have over 6 years of experience and a strong background in data management. This is a full-time position focused on enhancing data workflow efficiency within the IT Services and Consulting sector.

Qualifications

• 6+ years of experience in Data Services, specifically with Snowflake and DBT.
• Strong understanding of data optimization, security, and validation processes.
• Mid-senior level expertise in data infrastructure development.

Responsibilities

• Design and implement scalable DBT models and ensure quality data management.
• Develop ETL/ELT pipelines and optimize SQL queries for performance.
• Collaborate with cross-functional teams to enhance data processing workflows.

Skills

Snowflake

DBT

SQL Optimization

Data Management

ETL/ELT Pipelines

Job description

Join to apply for the Engineer Data Services role at Tata Consultancy Services

1 week ago Be among the first 25 applicants

Join to apply for the Engineer Data Services role at Tata Consultancy Services

Get AI-powered advice on this job and more exclusive features.

Job Title : Engineer Data Services - Snowflake

Experience Required - 6 + Years

Must Have Technical/Functional Skills

Snowflake, DBT

Roles & Responsibilities

Snowflake & DBT Infrastructure Development

• Design and implement scalable, modular, and reusable DBT models.
• Develop incremental and snapshot models to optimize data processing and reduce compute costs
• Implement Common Table Expressions (CTEs), materialized views, and table strategies to enhance performance.
• Define and implement DBT tests.
• Develop custom DBT macros.
• Optimize SQL queries for performance and cost efficiency.
• Develop and manage ETL/ELT pipelines using Snowflake’s capabilities like Snowpipe, Streams, and Tasks.
• Model Deployment:
• Ensure the smooth operation of deployed models by monitoring performance and identifying potential issues.
• Manage DBT projects using Git, ensuring proper version control and collaboration.
• Set up CI/CD pipelines to automate testing, validation, and deployment of DBT models
• Set up data sharing, masking, and encryption as needed.
• Data Management:
• Maintain comprehensive DBT documentation for models, sources, and transformations.
• Ensure the quality and integrity of data used in dbt models by implementing data validation and cleaning processes.
• Implement data security measures to protect sensitive data.
• Ensure transparency in data workflows by maintaining well-documented YAML files.
• Monitoring and Optimization:
• Set up alerting mechanisms for failures in DBT transformations.
• Create and monitor jobs using Control M for dbt models.
• Monitor execution times, identify performance bottlenecks, and apply optimizations.
• Ensure end-to-end data pipeline reliability, from ingestion to transformation and reporting.
• Collaboration and Communication:
• Work closely with cross-functional teams, including data scientists, software engineers, and DevOps engineers.
• Develop and maintain documentation for Snowflake infrastructure and dbt workflows.
• Present findings and recommendations to stakeholders through clear and effective communication.
  
  

Salary Range - $80,000 to $100,000 per year

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Sign in to set job alerts for “Data Engineer” roles.

San Antonio, TX $112,597.33-$152,810.66 4 weeks ago

San Antonio, TX $144,768.00-$209,109.33 4 weeks ago

Software Engineer, Entry to Junior Level

San Antonio, TX $78,800.00-$136,100.00 2 weeks ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Software Engineer (automated program analysis)

Software Engineer II - Application Development

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.