Associate Manager - Data Engineer

Beghou Consulting LLC; Hyderabad; On-site; INR 3,000,000 - 5,200,000; Full time

Job summary

Beghou Consulting LLC is seeking a senior data engineer to drive data-driven commercial initiatives in pharma and life sciences. You will lead cross-functional teams, design scalable data pipelines, and contribute to data warehouse development across global projects.

The role demands 7–9 years of experience with Python/PySpark, Databricks, SQL databases, and familiarity with AI/LLM integrations; strong communication and project leadership are essential.

Qualifications

• 7 to 9 years of professional data engineering experience.
• Experience with Python including PySpark.
• Experience with relational databases (PostgreSQL, Oracle, MySQL, Snowflake).
• Experience on Databricks platform and Unity Catalogs.
• Experience with AI LLM integrations.
• Web app development with FastAPI, ReactJS, CSS/HTML preferred.
• Ability to manage multiple projects across platforms.

Responsibilities

• Lead cross-functional project teams to deliver high-quality client deliverables.
• Provide strategic guidance on project direction, resources, and timelines.
• Define project scope and development strategies with leadership.
• Contribute to Beghou's internal data warehouse build.
• Apply data engineering and CI/CD best practices across projects.
• Analyze data, synthesize findings, and present actionable insights.
• Manage projects as primary client contact with minimal oversight.
• Develop and optimize data processes and reporting pipelines.
• Coordinate with global teams to ensure seamless execution.
• Contribute to business development and internal initiatives.
• Mentor junior team members and foster growth.

Education

Bachelor’s or advanced degree

Tools

Python

PySpark

Databricks

Databricks Unity Catalog

Databricks SDK

PostgreSQL

Oracle

MySQL

Snowflake

FastAPI

ReactJS

CSS/HTML

Job description

Beghou brings over three decades of experience helping life sciences companies optimize their commercialization through strategic insight, advanced analytics, and technology. From developing go-to-market strategies and building foundational data analytics infrastructures to leveraging artificial intelligence to improve customer insights and engagement, Beghou helps life sciences companies maximize performance across their portfolios. Beghou also deploys proprietary and third-party technology solutions to help companies forecast performance, design territories, manage customer data, organize, and report on medical and commercial data, and more. Headquartered in Evanston, Illinois, we have 10 global offices.

Our mission is to bring together analytical minds and innovative technology to help life sciences companies navigate the complexity of health care and improve patient outcomes.

This role supports the conceptualization, execution, and integration of data-driven projects for commercial efforts in the pharmaceutical and life sciences industries. As a subject matter expert, you will drive innovation and creative solutions within various work streams and provide thought leadership. You will lead project teams and play a pivotal role in guiding internal stakeholders toward project success.

We'll Trust you to:

• Lead cross-functional project teams in the design and development of high-quality deliverables for clients.
• Provide strategic advice on project direction, resource management, and timelines, while assuming responsibility for key data analytics tasks to support internal teams and clients.
• Collaborate with leadership to define project scope, approach, and development strategies.
• Contributes to Beghou’s internal data warehouse build.
• Demonstrates knowledge of data platform components (warehouse, monitoring, etc.) and data engineering (ETL design, schema design, etc.) and CI/CD best practices.
• Analyze data, synthesize findings, and develop actionable insights, communicating results to both internal and external teams.
• Independently manage projects, handling client communications, meeting facilitation, and timelines, serving as a primary point of contact with minimal oversight.
• Develop and optimize data processes, utilizing coding where necessary to facilitate efficient data handling and reporting.
• Coordinate with global and diverse teams to ensure seamless project execution.
• Engage in business development activities and contribute to internal firm initiatives to drive organizational growth.
• Provide mentorship and guidance to junior team members, overseeing their professional development and encouraging continuous improvement and innovation within the team.

You’ll Need to have:

• Bachelor’s or advanced degree with 7 to 9 years professional experience in data engineering using python including use of PySpark.
• Experience with relational database technologies, such as PostgreSQL, Oracle, MySQL, Snowflake.
• Experience working on Databricks platform. Strong expertise in configuring/creating/managing Databricks Unity Catalogs/tables, Databricks SDK, cluster and data pipeline setup and using Databricks AI skills. Experience working with other Databricks components is added advantage.
• Experience working with AI LLM integrations.
• Experience in web application development using Fast API, React JS, CSS/HTML is preferred.
• Experience in designing, developing and managing multiple projects in different platforms.
• Strong proficiency in Microsoft Office tools (Word, PowerPoint), with advanced expertise in Excel.
• Excellent analytical and quantitative skills, with a proven ability to solve complex problems.
• Exceptional communication skills, both written and verbal.
• Demonstrated organizational, time management, and project management skills, with the ability to lead teams and manage multiple projects simultaneously.
• Strong ability to collaborate, adapt quickly, and work effectively in a fast-paced environment.
• Familiarity with industry best practices in data analytics within the pharmaceutical sector.

At Beghou Consulting, you'll join a highly collaborative, values-driven team where technical excellence, analytical rigor, and personal growth converge. Whether you're passionate about AI innovation, building commercialization strategies, or shaping the next generation of data-first solutions in life sciences, this is a place to make an impact!

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.