Opening For Data and AI Engineer

Tekskills Inc.; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tekskills Inc. is seeking an experienced Data Engineer to build end-to-end data pipelines and analytics solutions in Azure environment. You will collaborate with data architects and analytics teams to deliver scalable data platforms and APIs.

The role requires 7+ years in DWBI with strong SQL, Python, Spark, Scala, and Databricks experience, plus familiarity with GenAI concepts. Energy/adtech/asset-intensive domain exposure is a plus. Bengaluru-based role with collaboration across teams.

Qualifications

• Total IT Industry DWBI experience of 7+ years.
• Experience in Azure cloud platforms.
• Ability to define and develop data integration patterns and pipelines.
• Strong knowledge of data modelling, data warehousing, and BI concepts.
• Experience with Data Lake, Databricks, Data Factory, BI Dashboard and BI projects.
• At least 4 years experience in SQL/PostgreSQL and BI solutions with 3rd party integrations.
• Experience with Spark, Scala, Python, SQL scripting languages, NoSQL, and cloud technologies (Azure).
• Familiar with GenAI concepts like RAG and LangChain to collaborate with data scientists.

Responsibilities

• Build end-to-end data pipelines including collection, transformation, quality and integration.
• Collaborate with design and business teams to identify data requirements and assemble large data sets.
• Design, implement and tune analytics solutions meeting business and technical needs.
• Work with data architects to ensure data model integrity.
• Create data tools for analytics and data science teams.
• Support data solutions with DevOps collaboration.
• Develop APIs with data analysts/scientists.
• Provide weekly status reports to client and Infosys managers.
• Be self-motivated, detail-oriented, and proactive about AI trends.

Skills

Data pipelines

Azure

SQL

Python

Spark

Scala

BI concepts

GenAI concepts

Education

Bachelor or Masters degree in CS/IT

Tools

Databricks

Azure Data Factory

SQL

Spark

Scala

Python

ADLS

Job description

Description:

Main Responsibilities:

• Build end-to-end data pipelines including data collection, transformation, quality and integration solutions to facilitate Client data & analytics solutions.
• Collaborate with solution design and business requirements teams to identify data requirements and assemble large, complex data sets that meet the requirements
• Design, implement and fine-tune analytics solutions that meet business and technical requirements
• Work collaboratively with the Client data architect to ensure data model integrity
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Create data tools for analytics and data scientist teams that assist them in building and optimising the data models and solutions
• Work with the DevOps engineer to support the consistent operation of data & analytics solutions
• Work closely with the data analysts & data scientists to design and develop APIs
• Weekly and need basis Status reporting to Client and Infosys managers
• Self-motivated, able to work independently, and attention to details
• Curious about emerging AI trends and their implications for data engineering

7 - 12 years

Academic Qualification:

• Bachelor or Masters degree in a related field (e.g. computer science, information technology, etc.)

Professional Experience

• Total experience of 7+ years in IT Industry in DWBI.
• Experience in Azure cloud platforms and technology
• Ability to define and develop data integration patterns and pipelines
• Strong knowledge of data modelling, data warehousing, and BI concepts
• Experience with Data Lake, Databricks, Data Factory, BI Dashboard, and BI implementation projects
• At least 4 years experience in SQL/PostgreSQL, data and BI solutions with integration to 3rd party tools
• Experience working with application server software (e.g. ERP), Spark, Scala, Python, SQL scripting languages, relational databases (e.g. SQL DB/DW), NoSQL platforms (e.g. HBase, MongoDB, Cassandra), cloud technologies (e.g. Azure)
• Highly experienced with processing large and complex datasets and building end-to-end data pipelines using on-premise or cloud-based data platforms
• Experienced in coding in data management, data warehousing or unstructured data environments
• Experience in the energy sector or other asset-intensive industries will be highly regarded
• Experience in using coding assistants (e.g. GitHub Copilot) for uplifting productivity in development
• Familiar with GenAI concepts like RAG, orchestration frameworks like LangChain and LlamaIndex, vector databases etc. to collaborate efficiently with data scientists and ML engineers in AI use cases

Mandatory skills* Databricks, Azure Data Factory, SQL, Spark, Scala, Python, ADLS, Familiar with GenAI concepts