Data Engineer

Tata Consultancy Services; Addison (TX); On-site; USD 95,000 - 120,000; Full time

Benefits offered by this job

Discretionary annual incentive

Comprehensive medical coverage (health

Family support: parental leaves

Insurance options: auto & home

Job summary

Tata Consultancy Services in Addison, TX seeks a senior data engineer to lead complex data solutions for cyber security data, shaping architecture, and guiding teams in delivery.

You will work with Hadoop/Cloudera, Hive, Spark, PySpark and cloud platforms, ensuring robust data pipelines, quality controls, and timely delivery. 8+ years in data engineering is required along with leadership experience.

Qualifications

• Minimum 8+ years hands-on data engineer/software development experience.
• Experience with big data processing systems like Hadoop and Cloudera.
• Experience with Python and SQL; UNIX experience is essential.
• Cloud services/technologies such as AWS or Azure.
• Experience guiding junior engineers toward delivery and project success.
• Familiarity with cybersecurity data, preferably vulnerability data management.
• Experience with CI/CD pipelines and version control (Bitbucket).
• Knowledge of data engineering principles and SDLC.

Responsibilities

• Ensure design/engineering approach for complex data solutions is consistent across flows.
• Lead prototyping and evaluation of new toolsets; conduct research.
• Build and maintain data pipelines, data structures, and metadata management.
• Develop data transformations, data quality controls, and workload management.
• Collaborate with teams to align data architecture with requirements.
• Mentor junior engineers and coach CI-CD practices like branching, PRs, and release notes.
• Document deployment and support information; ensure delivery cadence.
• Identify gaps in data management standards and drive remediation.

Skills

Hands-on data engineering

Leadership & mentoring

Python

SQL

Unix

Cloud platforms

Data governance/SDLC

Vulnerability data management

CI/CD

Stakeholder communication

Education

Bachelor's in Computer Science

Tools

Hadoop

Cloudera

Hive

Spark

PySpark

HBase

Elastic

Bitbucket

Job description

Objective Of Role

This role is responsible for leading complex efforts to develop and deliver complex data solutions to accomplish cyber security technology and business goals. Key responsibilities include code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytics data systems. They guide stakeholders, Product Owners, and Software Engineers through the design and execution processes. These individuals provide technical thought leadership based on the significant experience they have built through implementing multiple complex data solutions, and their knowledge of the interaction across multiple data flows and systems.

Job Description

Must Have Technical/Functional Skills

Primary Interactions

• Business partners and stakeholders
• Product Owner
• Scrum Master Development Team Feature Lead Architect Domain Community of Practice Data Scientists

Required Skills

• Minimum 8+ years hands‑on data engineer/Software development exp (at least 5 years of onsite exp)
• Experience with big data processing systems like Hadoop, Cloudera etc
• Experience with one or more of the programming languages like Python (Modular python programming exp)
• Strong SQL and UNIX experience
• Hadoop
• Hive, Spark , Pispark
• Proven experience with technology leadership guiding junior engineers towards project completion and deliveries
• Experience with cyber security domain, preferably vulnerability data management
• 8+ years of hands‑on data engineer/software development
• Ability to switch from technology leadership to hands on coding when requiredExperience with big data processing systems like Hadoop, Cloudera, etc.
• Experience with Cloud Services\Technologies like AWS, Azure, etc.
• Experience with one or more of the programming languages like Python
• Strong SQL and UNIX experience
• Experience with data stores like HIVE, HBase Elastic
• Experience with code versioning systems like Bitbucket
• Experience with CICD pipelines
• Good knowledge on Data engineering principles and SDLC process
• Ability to detect early and articulate with business partners the challenges and gaps in requirements

Experience

Minimum 8+ years

Roles & Responsibilities

• Ensure that the design and engineering approach for complex data solutions is consistent across multiple flows and systems.
• Conduct research, designs prototyping and other exploration activities such as evaluating new toolsets.
• Utilize multiple architectural components in design and development of client requirements.
• Maintain, improve, clean and manipulate data for the operational and/or analytics data systems.
• Constantly looking for better ways of solving technical problems and designing the solution without being afraid of challenging the status quo.
• Collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement and subsequently implemented accurately.
• Assemble large, complex data sets that meet functional/ non‑functional requirements.
• Build processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management.
• Define and build data pipelines that enable faster, better, data‑informed decision‑making within the business.
• Contribute to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause.
• Document and communicate required information for deployment, maintenance, support, and business functionality.
• Adhere to team delivery/release process and cadence pertaining to code deployment and release.
• Identify gaps in data management standards adherence and work with appropriate partners to develop plans to close gaps.
• Lead concept and experimentation testing, and synthesize the results to validate and improve analytical solution.
• Define key performance indicators and internal controls.
• Mentor more junior Data Engineers and coach team members in the delivery/release CI‑CD events – (for example, branching timelines, pull requests, issue triage, merge/conflict resolution, and release notes).

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Qualifications

BACHELOR OF COMPUTER SCIENCE

Salary Range

$95,000-$120,000 a year