Home · Technology · Oct 15 archive

Meta and Apple Collaborate on Muse Spark OpenChatGPT for Macs

Confirmed

Technology Desk

In Short: Meta and Apple are working together to optimize Meta's new Muse Spark Open AI model for high-end Macs, offering developers a powerful tool for coding and complex tasks.

Apple and Meta Team Up: Meta's 816B Muse Model Runs on Mac Studio
YouTube — IFF

Meta and Apple have announced a collaboration to optimize Meta's new Muse Spark Open AI model for high-end Macs, allowing developers to run the model locally without relying on cloud servers.

The Muse Spark Open model, which boasts 816 billion total parameters, is designed to excel in long-horizon tasks, complex software engineering, and multi-step reasoning.

YouTube — IFF YouTube

According to Meta, the model was optimized to run on Mac Studio with M5 Ultra, and two Mac Studios can behave like one supercomputer with a terabyte of unified memory.

Apple's MLX framework splits the model across connected Macs, which communicate over Thunderbolt 5, enabling efficient processing.

Developers need either two Mac Studios with 512GB of unified memory each or four with 256GB each to run the model, with a total cost exceeding $40,000.

In Apple's tests, four Mac Studios generated more than 36 tokens per second, showcasing the model's performance.

The Muse Spark Open model's weights are available for download on Hugging Face, Amazon SageMaker AI, and Google Cloud Model Garden.

Meta CEO Mark Zuckerberg announced the collaboration on X, expressing excitement about the model's performance on Mac Studios.

Apple CEO John Ternus praised the collaboration, noting that it pushes the boundaries of on-device AI.

The companies have been collaborating for several months, and representatives declined to comment on whether this is the start of a deeper relationship.

What this adds

The hardware requirements for running the Muse Spark Open model differ between sources, with some accounts suggesting the need for more Mac Studios.

Meta's Muse Spark Open model is described as the most capable US open-weight model to date, offering transparency and flexibility that closed-source models do not.

The collaboration between Meta and Apple marks a significant step in the development of on-device AI capabilities, potentially reducing reliance on cloud services for complex AI tasks.

Background

Meta has launched the Muse Wonder AI model, a follow-up to its earlier Muse Spark models, as part of its ongoing efforts to revitalize its artificial intelligence division.

Meta has launched its MuseOpenAI's ChatGPT on the iPad, expanding its availability beyond the iPhone and Mac.

What's confirmed

What's still developing

Sources