What
The Whole Earth Codec is an innovative autoregressive, multimodal foundation model that redefines the concept of observatories by focusing inward on Earth itself. This project shifts from the traditional cosmos-oriented observatory to a distributed planetary observatory that uses ecological and environmental data. By integrating various streams of data from across the biosphere into a singular, comprehensive model, the Whole Earth Codec aims to enable the planet to observe and understand itself on an unprecedented scale.
Who
Connor Cook, Christina Lu, and Dalena Tran as part of Antikythera
Where & When
?
Why
The motivation stems from the necessity to broaden the observational scope of AI models to encompass non-human, ecological data, to unlock a form of planetary intelligence or sapience. By doing so, the project anticipates fostering a deeper, more nuanced understanding of Earth’s systems and their interconnections.
How
- Sensing Layer: Utilizing a global network of sensors to gather diverse ecological data, from bioacoustic signals to atmospheric conditions, creating a comprehensive dataset that spans the non-human realms of the planet.
- Cross-Modal Integration: Developing an AI model capable of processing and synthesizing multimodal data into a unified representation of Earth, allowing for the detection of patterns and correlations across different types of ecological information.
- Generative and Analytical Capabilities: Beyond analysis, the model harbors the potential to generate predictive models and creative solutions for ecological management and conservation, from optimizing weather patterns to designing resistant crop genomes.