Software Engineer - II
India Remote·Posted yesterday
pythonkubernetesawsspark
At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle. Visit h1.co to learn more about us. As a Software Engineer on the Insights Engineering team, you will play a key role in building scalable data pipelines and enrichment workflows that transform raw client data into accurate, actionable insights. With minimal guidance, you will focus on data ingestion and enrichment, ensuring seamless integration of client data from diverse sources (CSV, Parquet, JSON, APIs) while tackling challenges related to scalability, data quality, and standardization. WHAT YOU'LL DO AT H1 You will collaborate with a multidisciplinary team including, data engineers, product managers, and business stakeholders, to gather materials and understand user needs. Your contributions will be crucial in providing optimal solutions that align with both our product goals and specific user needs, all while ensuring timely delivery. You will: - Build and maintain scalable and reliable data pipelines that support the team’s enrichment workflows. - Integrate enriched data from core platforms into broader data systems, applying necessary transformations and aligning with business requirements. - Contribute to code reviews, holding a high bar for quality and aligning with organizational engineering guidelines. - Follow development workflows, including coding, testing, deployment, and monitoring, to ensure quality and efficiency. - Work collaboratively with team members and escalate issues appropriately when challenges arise. - Contribute to the understanding and execution of tasks with a strong focus on accuracy, scalability, and performance. ABOUT YOU You have strong hands-on technical skills and experience in data engineering, with a track record of building and maintaining scalable data systems and pipelines. You excel at solving data engineering challenges and contributing to innovative solutions. - Experience developing and optimizing data workflows, applying business logic for data enrichment, and addressing technical challenges with creative solutions - Strong knowledge of building and scaling data infrastructure, including integration with core platforms - Experience working with data quality challenges and implementing validation mechanisms - Self-motivated with the ability to manage tasks and collaborate effectively within a team - Ability to align work with broader organizational goals and contribute to strategic initiatives - Proactively identifies potential risks and helps implement solutions early in the project lifecycle - Eager to learn, grow, and contribute to a collaborative, high-performing engineering team REQUIREMENTS - 4- 6 years of experience in data engineering, specializing in building scalable data pipelines and enrichment processes, with a track record of working with large datasets, including ingestion, transformation, and optimization - Proficiency in Spark, Python, and SQL for building scalable data processing pipelines - Hands-on experience with Kubernetes for container orchestration and deployment -Hands - on experience with Elasticsearch - Strong background in AWS, including services such as S3, Lambda, ECS, and RDS for data infrastructure - Experience with AWS EMR and Databricks to optimize large-scale data workflows Not meeting all the requirements but still feel like you’d be a great fit? Tell us how you can contribute to our team in a cover letter!