Research Log #013

In: research-log

Welcome to the Research Log, where we share weekly progress on Manifold’s research projects and also the “Pulse of AI”: breakthroughs that are happening in the broader research community we’re excited about!

Interested in contributing or just learning more? Check out the Github or join the conversation on Discord.

NEKO Project

The NEKO Project aims to build the first large scale, Open Source "Generalist" Model, trained on numerous modalities. You can learn more about it here. We’ve made some meaningful progress in the past week:

Text Prediction:

We’ve closed the loop on evaluating our text prediction objective in the NEKO codebase, check out those changes here. Thanks to Bhavul Gauri for leading this work!

Data Sampling:

Our control team has improved sampling performance by nearly 2 orders of magnitude, unlocking huge gains in our ability to train. The new sampling implementation also allows for parallelism over tasks and prefetching data. Implementation to be shared soon! Thanks to Daniel Lawson for making this happen!

AgentForge Project

In the AgentForge project, we’re continuing our survey of various agent approaches, both with LLMs and in other areas of ML. We’re currently reviewing the Gorilla model and paper, and think it is an exciting approach to making progress with tool use models.

Pulse of AI

If you want to see more of our updates as we work to explore and advance the field of Intelligent Systems, follow us on Twitter, Linkedin, and Mastodon!

More from Manifold Research Group
Great! You’ve successfully signed up.
Welcome back! You've successfully signed in.
You've successfully subscribed to Manifold Research Group.
Your link has expired.
Success! Check your email for magic link to sign-in.
Success! Your billing info has been updated.
Your billing was not updated.