AI for Science & Safety Nodes RFP:
I. Local Compute
Supercharging open science research could benefit from both open models and open compute (see more on why here). An independent AI science and safety ecosystem is critical for evaluating, red-teaming and securing AI capabilities as well as for driving research into critical scientific questions that are not on a frontier lab product roadmap. However, currently, most projects rent compute which is problematic for security reasons but also because prices are increasing and access may not be reliable in the future. Thanks to improvements in open models, the open research ecosystem would be ready to carry serious science and safety work; what the ecosystem sorely lacks is infrastructure: sovereign and secure compute.
Application deadline: 31st October 23:59 PDT
1. Building and scaling local compute setups
In the last 18 months, there has been a lot of progress in open AI models and researchers no longer need to rely on closed models. However the open compute side of the open AI movement is lagging behind. There are 5 companies holding 71% of the world’s AI compute. If researchers rely on APIs and external compute only, it exposes them to risks like data exposure, steep price increases as frontier lab competition increases or losing access to compute altogether if hyperscalers or the govt decides it could be used better elsewhere.
Compute may become an essential resource over the next few years. As we are approaching a world where AI is becoming indispensable to think, work and pursue goals in the world, access to compute means access to agency in the world. Guaranteeing that individuals have a say in this world, means guaranteeing them access to compute and the most secure way to do this is by making it easy for them to own and control their own compute.
What we’re looking for: This might mean building local compute clusters that come in different sizes and configurations, are easy to set up and run, and work across a variety of connectivity and electricity environments. Well thought-out projects would create blueprints for easy yet secure cluster management, as well as models for bringing down the cost, like selling idle compute on OpenRouter or connecting to larger community clusters. The ultimate proposal would treat this as a business case, creating not only a cost-effective prototype cluster for individuals to setup and use but also for a scalable business case for building, selling, and distributing such clusters at scale, radically lowering the barriers to entry for lay people to secure their own compute.
Why it matters: Foresight has been in the openness business for a while; our co-founder Christine Peterson coined the term “open source software” in 1998. While open source and open compute can be dangerous in some ways, centralization also comes with its own risks. We think there is nuance here. Open access to compute is important for open science as well as safety, security and to make sure the average person has a say in how our future unfolds. The time for laying the foundations for broad access to that future is now, while compute is still available and affordable – relative to next year’s prices.
Example projects and deliverables:
- A prototype AI cluster that an average person can easily deploy or replicate in their own home
- Software that sets up and runs the Node without the need for expert knowledge
- Economic models for the user that show how the hardware can pay for itself
- A business case for distributing AI clusters for different energy and connectivity configurations at scale
- A pilot deployment for individuals or communities
FAQ
Proposals are first reviewed in-house for fit and quality. Strong submissions are sent to technical advisors for further evaluation. If your proposal advances, we may follow up with written questions or a short call. If you choose to opt into Lightcone Commons sharing, Foresight may also share selected applications with Lightcone Commons for evaluation, and possible additional funding consideration.
Unfortunately, due to the number of applications we receive, we are unable to provide individual feedback to unsuccessful applicants.
- Alignment with the specific RFP focus area: the degree to which the project addresses the selected focus area as outlined in the RFP
- Impact on reducing existential risks from AI: the extent to which the project can reduce existential risks associated with AI, focusing on achieving significant advancements within short timelines.
- Feasibility within short AGI timelines: the project’s ability to achieve meaningful progress within the anticipated short timeframes for AGI development. We prioritize projects that can demonstrate concrete milestones and deliverables in the next 1-3 years.
- AI-first work: Instead of large team budgets, this means smart allocation of resources and compute to automate workflows.
- Capability to execute: the qualifications, experience, and resources of the applicant(s) to successfully carry out the proposed work. Strong teams with proven expertise in the field will be prioritized.
- High-risk, high-reward potential: the level of risk involved in the project, balanced with the potential for substantial, transformative impact on the future of AI safety. We encourage speculative, high-risk projects with the potential to drive significant change if successful.
- Requirement for open source: We require the work product (code, data, and outputs) of the funding to be open-sourced.
- We fund both short-term and longer projects. Grants are typically paid in one lump sum. However, for larger projects spanning multiple years, payments may be made in tranches, with each subsequent tranche contingent upon the successful completion and reporting of previous milestones.
- We can fund overhead costs up to 10% of direct research costs, where these directly support the funded work.
- Successful applicants must pass our due diligence process, which includes confirming your connections to Foresight Institute, sharing any ongoing criminal proceedings, bankruptcy, tax documents etc., and sharing an itemized budget, project plan and organizational documents.
- By accepting funding, grantees agree that we may list their project on our website and share the project title and project lead on for example social media. If you prefer for your project to remain private, please inform us.
- Grants are subject to basic reporting requirements. Grantees are expected to submit brief progress updates at regular intervals, describing use of funds and progress against agreed milestones.
- Tax obligations vary by country and organization type. Applicants are responsible for understanding and complying with any applicable tax requirements.