Senior Engineer - IT Data [T500-26635]

ANSR; Hyderabad; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

ANSR in Hyderabad is looking for a skilled data engineer with extensive experience in designing and implementing data solutions using Azure technologies. The ideal candidate will lead efforts in data analytics, migration, and engineering, contributing significantly to decision-making processes through insightful analytics.

With 5+ years in cloud development and Agile methodologies, the role involves collaboration across teams and mentoring others in technical skills. Candidates must possess a Bachelor's degree in Computer Science or a related field.

Qualifications

• 5+ years of experience in software development (Agile, DevOps).
• 5+ years of data analytics experience using SQL.
• 5+ years of cloud development and data lake experience, primarily in Microsoft Azure.

Responsibilities

• Work closely with teams to design, implement, and support analytics solutions.
• Implement data migration and data engineering solutions.
• Provide technical leadership and collaborate within a team environment.

Skills

CICD (ADO / Github Actions)

Pyspark

SQL

Python

API Development

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field

Tools

Azure Data Lake Storage

Azure Data Factory

Azure Databricks

Teradata

SQL Server

Azure Functions

Job description

This list is intended to reflect the current job but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so, observing, of course, any legal obligations including any collective bargaining obligations.

Responsibilities

• Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
• Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools
• Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
• Provide technical leadership and collaborate within a team environment as well as work independently
• Be a part of a DevOps team that completely owns and supports their product
• Implement batch and streaming data pipelines using cloud technologies
• Leads development of coding standards, best practices and privacy and security guidelines
• Mentors' others on technical and domain skills to create multi-functional teams

All You Will Need For Success

Minimum Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field (or equivalent experience).
• 5+ years of experience in software development (Agile, DevOps), designing, developing, and implementing large-scale applications or data engineering solutions.
• 5+ years of data analytics experience using SQL and working with data platforms like Teradata, Cassandra, MongoDB, Oracle, SQL Server, Snowflake, ADLS, and Azure Data Explorer.
• 5+ years of cloud development and data lake experience, primarily in Microsoft Azure (EventHub, Data Factory, Databricks, Blob Storage, Power BI, Azure Functions, etc.).

Preferred Qualifications

• 5+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
• 5+ years data analytics experience using SQL
• 3+ years full-stack development experience, preferably in Azure
• 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
• 3+ years of Teradata Vantage development and administration
• Airline Industry Experience

Mandatory Skills

• CICD (ADO / Github Actions)
• Pyspark
• SQL
• Python
• API Development

Skills, Licenses, and Certifications

• Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers
• Expertise in providing practical direction within the Azure Native cloud services
• Spark Certification (preferred)
• Combination of Development, Administration & Support experience in several of the following tools / platforms required: Scripting: Python, Spark, Unix, SQL
• Azure Data Explorer. Administration skills a plus
• BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana
• Data Governance and Privacy: Alation, Monte Carlo, Informatica and BigID