Pinned Tweet
The BLOOM model is now officially released!
Read more here: bigscience.huggingface.co/blog/bloom
Find the model here: huggingface.co/bigscience/blo…
Read more here: bigscience.huggingface.co/blog/bloom
Find the model here: huggingface.co/bigscience/blo…
BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at
bigscience.huggingface.co/blog/bloom
hf.co/bigscience/blo…
6
58
248
BigScience Large Model Training retweeted
The Bloom paper is out. Looks like it's doing worse than current GPT3 API in zero-shot generation tasks in English but better than other open-source LLMs & better than all in zs multi-lingual (which was the main goal). Proud of the work from the community! arxiv.org/abs/2211.05100
12
104
586
BigScience Large Model Training retweeted
Crosslingual Generalization through Multitask Finetuning 🌸
Demo: huggingface.co/bigscience/blo…
📜 arxiv.org/abs/2211.01786
💻github.com/bigscience-wor…
We present BLOOMZ & mT0, a family of models w/ up to 176B params that follow human instructions in >100 languages zero-shot. 1/7
Demo: huggingface.co/bigscience/blo…
📜 arxiv.org/abs/2211.01786
💻github.com/bigscience-wor…
We present BLOOMZ & mT0, a family of models w/ up to 176B params that follow human instructions in >100 languages zero-shot. 1/7
9
74
277
The super-fast inference solutions are finally here for all to use:
Learn how you can get under 1msec per token generation time with BLOOM 176B model!
Not one, but multiple super-fast solutions including Deepspeed-Inference, Accelerate and Deepspeed-ZeRO!
huggingface.co/blog/bloom-inf…
1
2
26
BigScience Large Model Training retweeted
What do @StabilityAI @EMostaque #stablediffusion & @BigscienceW Bloom - aka the coolest new models ;) - have in common?
They both use a new gen of ML licenses aimed at making ML more open & inclusive while keeping it harder to do harm with them. So cool!
huggingface.co/blog/open_rail
They both use a new gen of ML licenses aimed at making ML more open & inclusive while keeping it harder to do harm with them. So cool!
huggingface.co/blog/open_rail
8
35
174
BigScience Large Model Training retweeted
The Technology Behind BLOOM Training🌸
Discover how @BigscienceW used @MSFTResearch DeepSpeed + @nvidia Megatron-LM technologies to train the World's Largest Open Multilingual Language Model (BLOOM):
huggingface.co/blog/bloom-meg…
Discover how @BigscienceW used @MSFTResearch DeepSpeed + @nvidia Megatron-LM technologies to train the World's Largest Open Multilingual Language Model (BLOOM):
huggingface.co/blog/bloom-meg…
8
147
596
BigScience Large Model Training retweeted
BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at
bigscience.huggingface.co/blog/bloom
hf.co/bigscience/blo…
bigscience.huggingface.co/blog/bloom
hf.co/bigscience/blo…
29
752
2,641
BigScience Large Model Training retweeted
🌸@BigscienceW BLOOM's intermediate checkpoints have already shown some very cool capabilities!
What's great about BLOOM is that you can ask it to generate the rest of a text - and this even if it is not yet fully trained yet! 👶
🧵 A thread with some examples
What's great about BLOOM is that you can ask it to generate the rest of a text - and this even if it is not yet fully trained yet! 👶
🧵 A thread with some examples
A milestone soon to be reached 🚀💫
Can't wait to see the capabilities and performance of this long-awaited checkpoint!
What about you? Have you already prepared some prompts that you want to test? ✏️
5
25
143
For 111 days, we've enjoyed world-class hardware stability and throughput thanks to the hard work of our friends at @Genci_fr, @INS2I_CNRS, Megatron & DeepSpeed. Having reached our objective earlier than expected, we'll keep training for a few more days. Stay tuned, more soon ;)
3
25
299