Annotation Operations Lead - Modeling
Business Operations – Strategy and Operations
remote: London
added Tue Oct 24, 2023
Apply to CohereWhy this role?
The Annotation Operations Lead is responsible for building and managing Cohere’s team of annotators and reviewers who develop and deliver high-quality training data critical to the development of Cohere's flagship retrieval-augmented generation (RAG) product. You will join a small and effective team who support Cohere’s data collection efforts.
Your day-to-day will include helping stakeholders translate their data needs into actionable tasks, running daily stand up and being the on the ground support for the annotators, working on projects to iteratively improve the way we run this program.
As an Operations Lead you will:
- Scale the RAG teams annotation output while improving quality and effectiveness of their work
- Partner with internal stakeholders to decide on staffing and hiring strategy to meet roadmap requirements, as well as work with external vendors to enrich our data pipeline as needed
- Own individual and team-wide performance management of our RAG annotators, including partnering with the Data Ops team to continuously improve our performance management KPIs, plans, and processes
- Run and develop onboarding for new RAG annotators, as well as identifying opportunities and tools for ongoing education to up-skill, coach, and improve team
- Test-iterate regularly by running pilots and experiments, and stay up-to-date on industry trends and best practices
- Assist with building library of high-quality prompts or prompt chains to accomplish a wide variety of tasks
You might be a good fit if you:
- Have 2+ years experience leading a nimble team or complex project group before with great results in a tech-focused role
- Are resourceful, focused, and highly-organized
- Are known as an inclusive, effective and motivating communicator
- Are ready to spend 4 days onsite each week in our London office with our Annotator team
- Bonus points if you are an incredible writer - you are a word nerd, might love linguistics and are hyper-fixated on getting every comma in the right place
If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.
We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants of all kinds and are committed to providing an equal opportunity process. Cohere provides accessibility accommodations during the recruitment process. Should you require any accommodation, please let us know and we will work with you to meet your needs.
Our Perks:
🤝 An open and inclusive culture and work environment
🧑💻 Work closely with a team on the cutting edge of AI research
🍽 Free daily lunch
🦷 Full health and dental benefits, including a separate budget to take care of your mental health
🐣 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK
🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
🏙 Remote-flexible, offices in Toronto, Palo Alto, San-Francisco and London and co-working stipend
✈️ 6 weeks of vacation
Note: This post is co-authored by both Cohere humans and Cohere technology.
Who are we?
We’re a small, diverse team working at the cutting edge of machine learning. At Cohere, our mission is to build machines that understand the world and to make them safely accessible to all. Language is at the crux of this, but it can be difficult and expensive to parse the syntax, semantics, and context that all work together to give words meaning. The Cohere platform provides access to Large Language Models through its APIs that read billions of web pages and learns to understand the meaning, sentiment, and intent of the words we use in a richness never seen before.
We've raised our Series B, signed a multi-year partnership with Google Cloud, and we are focused on bringing our technology to market. We will partner with customers so they can build natural language understanding and generation into their products with just a few lines of code.
We’re ambitious — we believe our technology will fundamentally transform how industries interact with natural language. And we have the technical chops to back it up - Cohere’s CEO, Aidan Gomez, is a co-author of the groundbreaking paper “Attention is all you need”, and was previously part of Google Brain. Our entire technical team is world-class.
We are focused on creating a diverse and inclusive work environment so that all of our team members can thrive. We welcome kind and brilliant people to our team, from wherever they come.