Elon Musk releases Python code for Grok

[tholden]

This could make the entire knowledge base of thunderbolts searchable with natural language at a stroke and it's free, due to Elon Musk's distrust of corporate approaches to AI. Bargains do not get better than that....

=======================================================

----- Forwarded Message -----

Elon Musk STUNNING Reveal of Grok | NOT aligned, MUCH Bigger, Open Source. There is no doubt left...

https://www.youtube.com/watch?v=AcxAYo4QyeQ

Open Release of Grok-1

https://x.ai/blog/grok-os

March 17, 2024

We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.



This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue.



We are releasing the weights and the architecture under the Apache 2.0 license.



To get started with using the model, follow the instructions at github.com/xai-org/grok.

Model Details



Base model trained on a large amount of text data, not fine-tuned for any particular task.

314B parameter Mixture-of-Experts model with 25% of the weights active on a given token.

Trained from scratch by xAI using a custom training stack on top of JAX and Rust in October 2023.

[tholden]

Python is an interpreted language as opposed to compiled languages like C++. Having the code means being able to use the product...