Data Engineer

Tata Consultancy Services; Chennai; On-site; INR 600,000 - 900,000; Full time

Job summary

Tata Consultancy Services is looking for a Data Engineer with 3-5 years of experience in data engineering and data warehousing. The successful candidate will be responsible for building data pipelines, optimizing performance, and collaborating with data scientists to deliver data solutions. This full-time Associate-level role is situated in Sriperumbudur, Tamil Nadu.

Qualifications

• Experience level of 3 to 5 years in data engineering or related fields.
• Strong proficiency in SQL, NoSQL, ETL tools, and BigQuery.

Responsibilities

• Design, implement, and maintain data pipelines to load data into warehouses.
• Collaborate with data scientists to design data models and ensure data quality.
• Optimize data pipelines and queries for performance.

Skills

SQL

NoSQL

ETL tools

BigQuery

Python

Java

Job description

Direct message the job poster from Tata Consultancy Services

Technical hiring @Tata Consultancy Services .

EXP***3-5 years

Experience

• Experience level of 3 to 5 years in data engineering, data warehousing, or a related field.
• Experience with dashboarding tools like plx dashboard and looker studio
• Experience with building data pipelines, reports, best practices and frameworks.
• Experience with design and development of scalable and actionable solutions (dashboards, automated collateral, web applications).
• Experience with code refactoring for optimal performance.
• Experience writing and maintaining ETLs which operate on a variety of structured and unstructured sources.
• Familiarity with non-relational data storage systems (NoSQL and distributed database management systems).

Skills

• Strong proficiency in SQL, NoSQL, ETL tools, BigQuery and at least one programming language (e.g., Python, Java).
• Strong understanding of data structures, algorithms, and software design principles.
• Experience with data modeling techniques and methodologies.
• Proficiency in troubleshooting and debugging complex data-related issues.
• Ability to work independently and as part of a team.

Responsibilities

• Data Pipeline Development: Design, implement, and maintain robust and scalable data pipelines to extract, transform, and load data from various sources into our data warehouse or data lake.
• Data Modeling and Warehousing: Collaborate with data scientists and analysts to design and implement data models that optimize query performance and support complex analytical workloads.
• Cloud Infrastructure: Leverage Google Cloud and other internal storage platforms to build and manage scalable and cost-effective data storage and processing solutions.
• Data Quality Assurance: Implement data quality checks and monitoring processes to ensure the accuracy, completeness, and consistency of data.
• Performance Optimization: Continuously monitor and optimize data pipelines and queries for performance and efficiency.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand their data needs and deliver solutions that meet their requirements.
• Experience Cloud Storage or equivalent cloud platforms
• Knowledge of BigQuery ingress and egress patterns
• Experience in writing Airflow DAGs
• Knowledge of pubsub,dataflow or any declarative data pipeline tools using batch and streaming ingestion
• Other GCP Services: Vertex AI

Interested candidates can apply !!!

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting, Software Development, and Technology, Information and Media

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Sign in to set job alerts for “Data Engineer” roles.

Sriperumbudur, Tamil Nadu, India 5 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.