Manifold Research Group tackles ambitious, high-impact research problems that traditional institutions overlook—those too engineering-intensive for academia and too exploratory for industry. Inspired by coordinated research models like ARPAs and FROs, we coordinate focused, cross-functional teams and a large asynchronous research contributor pool to systematically pursue and deliver paradigm-shifting science and technology.
MultiNet v2.0: Cross-Domain Multimodal Benchmarking
MultiNet v2.0 is a next-generation benchmark designed to test whether multimodal models truly understand tasks across fundamentally different action domains, or simply overfit to specific interfaces.
We construct puzzle environments where agents must perceive, reason about causal structure, plan, and act. Each task is presented across multiple action domains, including discrete grid environments, 3D physics simulations, and natural language interfaces. The task semantics remain identical, while the interface changes.
This allows us to directly measure whether models generalize across action spaces. Success across domains indicates real understanding; failure reveals interface-specific overfitting.
The Role
OS Team members form the core of Manifold Research Group. As an OS Research Fellow, you will contribute to building the 3D action domain for MultiNet v2.0.
In this role, you will be responsible for:
- Designing and implementing 3D simulation environments for puzzle-based tasks
- Building interaction systems involving navigation, object manipulation, and physics-based dynamics
- Encoding consistent task semantics across environments to align with other action domains
- Developing clean and extensible APIs for agent interaction and evaluation
- Supporting integration with evaluation pipelines and experiment infrastructure
Qualifications
Outstanding research emerges from individuals who can execute quickly while maintaining strong system design. For this role, we are looking for:
- Strong software engineering skills, particularly in Python
- Experience with simulation environments (e.g., Unity, MuJoCo, PyBullet, Isaac Gym, or similar)
- Familiarity with 3D environments, physics simulation, and agent interaction systems
- Ability to design clean abstractions and modular, extensible systems
- Comfort working in ambiguous problem settings with evolving specifications
Expectations
There are a few key expectations and clarifications regarding the OS Research Team:
- Contribute approximately 10 hours per week to ensure meaningful progress and deep engagement with our projects. Flexibility around life commitments is understood; clear, proactive communication helps us support each other.
- Our working language is English, and strong proficiency is required to clearly communicate technical concepts without confusion or misunderstanding.
- This is a volunteer effort; none of us receive compensation of any kind—including monetary payment, academic credit, or other formal incentives. Our commitment is driven entirely by shared passion for impactful research.
More information on OS Research Team expectations is available here.
We look forward to seeing your application, and hopefully working together soon!