As part of this role, you will

• Build extensions to existing open source LLMs such as adding support for function templates.
• Push the boundaries of existing LLM applications (e.g. building cutting edge question answering applications)
• Develop features to enable production deployment of LLMs (e.g. what does CI for LLMs look like? How do you do evals of LLMs)
• Work on systematically improving the quality of LLM Application
• Jointly define your own projects as the ecosystem evolves.
• Work closely with the first 50 users of the things you build.
• Help us build a world class company.

We'd love to hear from you if you have:

• 3+ years of experience working as an an applied scientist, research engineer or software engineer focused on LLMs.
• You enjoy coding for 50% or more of your time.
• Solid fundamentals in algorithms, data structures, system design
• Domain expertise in LLMs and generative AI.

Bonus points!

• Experience working with systems engineering aspects of LLMs (e.g. distributed training, autoscaling inference etc)
• Experience with approaches to LLM model improvement and fine tuning (such as LoRA and RLHF)
• Published research in the Gen AI space
• Experience using Ray

Compensation

• At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.