Data Engineer

SachCloudy Solutions, Pune; Maharashtra; On-site; INR 900,000 - 1,700,000; Full time

Job summary

SachCloudy Solutions in Pune is seeking a skilled Data Engineer to design, develop, and maintain data infrastructure for large-scale datasets. You will partner with data scientists, analysts, and stakeholders to ensure data availability, reliability, and performance.

The role emphasizes ETL, data governance, and collaboration across teams, with a focus on security, privacy, and scalable architectures to enable informed decision-making.

Qualifications

• Experience designing scalable data pipelines.
• Experience with ETL (Extract, Transform, Load) processes.
• Familiarity with data governance, data quality, and privacy practices.

Responsibilities

• Design, build, and maintain scalable data pipelines to ingest, process, and transform large datasets from multiple sources.
• Develop and maintain ETL processes, ensuring data quality and consistency across platforms.
• Collaborate with data scientists, analysts, and teams to translate data requirements into technical solutions.

Job description

Job Description: We are looking for a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining the infrastructure required for efficient collection, storage, and analysis of large-scale data sets. You will work closely with data scientists, analysts, and other stakeholders to ensure data availability, reliability, and performance, enabling the organization to make informed decisions.

Key Responsibilities:

• Data Infrastructure Development:
  • Design, build, and maintain scalable data pipelines to ingest, process, and transform large datasets from multiple sources.
  • Implement data storage solutions, such as data lakes, warehouses, and cloud-based systems, ensuring they meet business needs.
• Data Management & Governance:
  • Develop and maintain ETL (Extract, Transform, Load) processes for moving data between systems.
  • Ensure data integrity, quality, and consistency across platforms, implementing best practices for data governance.
• Collaboration & Integration:
  • Collaborate with data scientists, analysts, and other teams to understand their data requirements and translate them into technical solutions.
  • Integrate data from various internal and external data sources, including APIs, databases, and third-party systems.
• Performance & Optimization:
  • Monitor data infrastructure performance, identifying areas for optimization and cost-saving opportunities.
  • Implement data partitioning, indexing, and optimization techniques to improve query and data processing performance.
• Security & Compliance:
  • Ensure that data architecture meets all security and compliance requirements, including data privacy standards such as GDPR.
  • Develop and enforce policies for data access and usage, maintaining audit logs and other compliance records.
• Innovation & Continuous Improvement:
  • Stay updated on emerging data engineering technologies, frameworks, and best practices.
  • Contribute to the improvement of data processes, automation, and tooling across the organization.

Job Category: Data Engineer

Job Type: Full Time

Job Location: Pune