Senior Program Manager, Data Annotation and GenAI Quality
Skills
- Proficiency with annotation tools like Encord, Dataloop, SageMaker.
- Experience with RLHF methodologies and prompt-response evaluation.
- Strong analytical skills in developing QA frameworks and dashboards.
- Excellent cross-team collaboration and stakeholder management skills.
Responsibilities
- Lead and oversee global annotation operations ensuring timely and accurate data labeling.
- Develop and enforce quality assurance frameworks including inter-annotator agreement and RLHF.
- Collaborate closely with engineering, machine learning, and product teams to align annotation efforts.
- Optimize annotation tools and workflows for efficiency, accuracy, and cost-effectiveness.
- Monitor and report on performance metrics such as throughput, accuracy, and COGS.
- Recruit, train, and mentor a diverse team of annotators and specialists.
Education
- Bachelor’s degree in a relevant field required.
- Advanced degree preferred.
Benefits
- Medical, dental, and vision insurance.
- 401k retirement plan.
- Flexible paid time off and company-paid holidays.
- Monthly commuter subsidies.
- DoorDash subsidies for meals.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Experienced Project Manager needed at Charah Solutions to lead power generation construction projects emphasizing safety, quality, and execution.
Drive the planning and execution of large-scale data center projects as a Technical Program Manager at NVIDIA in Santa Clara, CA.
Lead impactful engagement and development initiatives as the Women’s Philanthropy and Events Manager at Shalom Austin, fostering meaningful connections in the Jewish community.
Lead cutting-edge cloud projects and manage AWS-based enterprise solutions in a dynamic DoD environment with Booz Allen.
Lead the technical production team at CD PROJEKT RED to drive engineering clarity and success for Project Sirius, a multiplayer game in The Witcher universe.
Lead audit execution and strategy for medical disability examinations at CATHEXIS, combining regulatory expertise and project management in a high-impact government contracting environment.
Lead Program Planner role at Anoka County to oversee social services grants and contracts while supporting community-focused programs in a hybrid work setting.
Lead hardware project management for cutting-edge defense technologies at Anduril Industries, advancing national security solutions in an innovative environment.
Contribute to transformative civil construction projects at San Diego International Airport as a Technical Coordinator with a focus on project delivery and technical collaboration.
Drive and scale technical enablement programs at OpenAI to empower technical GTM teams and ensure successful AI deployments.
Drive project success as a Project Administrator at Arcadis, managing project setups and financial processes within a leading global consultancy.
A Sr. Manager role at Kyowa Kirin leading strategic governance and data standards for the Planisware platform within clinical and R&D operations.
Drive strategic project planning and department leadership as a Senior Project Manager at Emory Healthcare in Atlanta, GA.
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
