Lead Data Engineer

VXI Global Solutions; Tamil Nadu; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading data engineering firm is seeking a Data Engineer in Tamil Nadu, India. As part of the team, you will design and implement data pipelines, collaborate with cross-functional teams, and ensure high data quality. The ideal candidate should have over 8 years of experience, proficiency in SQL and Python, and a strong understanding of ETL processes. Join a dynamic team driving innovation in data management and apply now!

Qualifications

• 8+ years' experience as a data engineer or similar role.
• Strong understanding of distributed computing frameworks.
• Experience with relational and NoSQL databases.
• Understanding of data optimization and security best practices.

Responsibilities

• Design and maintain scalable data pipelines.
• Collaborate with stakeholders to understand data needs.
• Implement data models for analytics and reporting.
• Ensure data quality through validation and monitoring.

Skills

SQL

Python

Data modeling

ETL processes

Apache Spark

Git

Data visualization tools

Cloud platforms

Education

Bachelor's degree in Computer Science or related field

Tools

SQL Server

AWS Redshift

Tableau

Airflow

Job description

Data Engineer

We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.

As a Data Engineer at VXI Global Solutions, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support our customer experience and management initiatives. You will collaborate with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure data quality and integrity. This is an exciting opportunity to work with cutting-edge technologies and shape the future of data-driven decision-making at VXI Global Solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and store data from various sources.
• Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
• Implement data models and schemas to support analytics, reporting, and machine learning initiatives.
• Optimize data processing and storage solutions for performance, scalability, and cost-effectiveness.
• Ensure data quality and integrity by implementing data validation, monitoring, and error handling mechanisms.
• Collaborate with data analysts and data scientists to provide them with clean, reliable, and accessible data for analysis and modeling.
• Stay current with emerging technologies and best practices in data engineering and recommend innovative solutions to enhance our data capabilities.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven 8+ years' experience as a data engineer or similar role.
• Proficiency in SQL, Python, and/or other programming languages for data processing and manipulation.
• Experience with relational and NoSQL databases (e.g., SQL Server, MySQL, Postgres, Cassandra, DynamoDB, MongoDB, Oracle), data warehousing (e.g., Vertica, Teradata, Oracle Exadata, SAP Hana), and data modeling concepts.
• Strong understanding of distributed computing frameworks (e.g., Apache Spark, Apache Flink, Apache Storm) and cloud-based data platforms (e.g., AWS Redshift, Azure, Google BigQuery, Snowflake).
• Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker, Apache Superset) and data pipeline tools (e.g., Airflow, Kafka, Data Flow, Cloud Data Fusion, Airbyte, Informatica, Talend) is a plus.
• Understanding of data and query optimization, query profiling, and query performance monitoring tools and techniques.
• Solid understanding of ETL/ELT processes, data validation, and data security best practices.
• Experience in version control systems (Git) and CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills to work effectively with cross-functional teams.

Join VXI Global Solutions and be part of a dynamic team dedicated to driving innovation and delivering exceptional customer experiences. Apply now to embark on a rewarding career in data engineering with us!

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

IT System Data Services