Top Tweets for #BigCodeProject

over 3 years ago

Come learn about what it took to build #BigCodeProject #StarCoder and about our newest model (yes, another one). There will also be a few demos of apps built by the #Community. Webinar starts at 09:00 PST today. #OpenAccess #Responsible #Transparency #Code #LLM

over 3 years ago

Reminder that the online session is starting in 90min and we have an exciting model we'll release as well! Link: https://t.co/Ofv1p8PayW

2

26

7

2

10K

0

3

1

0

615

over 3 years ago

🗓️SAVE THE DATE: Our next #BigCodeProject webinar takes place on Thursday, JUNE 8th. BigCode has raised the bar on transparency and open governance in partnership with the machine learning and open source communities towards the responsible development and use of Code LLMs, and we’re looking forward to sharing more of the incredible work and contributions. Please do reach out if you’ve built something off StarCoder and would like to share your demo.

over 3 years ago

Next week we'll host an online session about how StarCoder was built and show-casing interesting demos that people have built since! Date: Thursday June 8th, 6-7:30pm CEST (9-10:30am PST) Link: https://t.co/jZKCIg6Vvs If you have an interesting demo to present please reach out!

3

41

13

9

8K

0

2

0

151

over 3 years ago

Call for collaborators: Help us improve the #BigCodeProject Code LLM evaluation harness, by adding more benchmarks and features ✨ #OpenScience #OpenSource #OpenAccess

over 3 years ago

Introducing the BigCode Evaluation Harness for Code LLMs: https://t.co/InCoQoc28O Inspired by the lm-evaluation-harness from @AiEleuther, it ensures ease-of-use, reproducibility and efficiency. Let’s explore its key features 🧵:

BigCodeProject's tweet photo. Introducing the BigCode Evaluation Harness for Code LLMs:

https://t.co/InCoQoc28O

Inspired by the lm-evaluation-harness from @AiEleuther, it ensures ease-of-use, reproducibility and efficiency. Let’s explore its key features 🧵: https://t.co/ltAoiDiMOg

2

165

40

65

32K

0

4

6

0

2K

over 3 years ago

Today is an important day for the #BigCodeProject. We published our Governance Card that provides an unprecedented level of transparency into the development that went into the StarCoder model we announced last week, and more. While each of the outputs from the project was released with supporting technical data sheets, research papers, licenses and/or terms of use, we felt the need to increase transparency into what it took to pull off such a global collaboration. In case you missed it, BigCode is an open-scientific collaboration jointly led by @ServiceNowRSRCH and @huggingface, working towards the responsible development and use of Large Language Models for Code. As of today, we have more than 800 members in the BigCode community from more than 65 countries. We could not have done this without the support and contributions of everyone involved, as it really does take a village - this is the power of Community. Together we have built and given back what we hope will further the BigCode Mission to inspire others to continue developing generative AI, responsibly. Useful links: ⚖ Governance Card: https://t.co/mq98ZZ0u9H 💫 StarCoder Model Card: https://t.co/fyxpLpDhWS 🎅 SantaCoder Model Card: https://t.co/9Ldhj0xPSy 📑 The Stack Dataset Card: https://t.co/gZyeivzg62 📜 BigCode Open RAIL-M v1 License: https://t.co/Dgo9i9X627 For links to ALL the BigCode datasets, models, governance tools, demos and more, see: https://t.co/vKJpmDP3YX Thank you to @ServiceNow and #HuggingFace for supporting this project, and to @harmdevries77 and @lvwerra for leading it, and @Thom_Wolf and @NicolasChapados for your support. Most important, thank you to everyone from the BigCode community and our special guests that joined our Working Group meetings for Legal, Ethics, Governance over the last year. Special thanks to @harmdevries77 , Jennifer Robinson, @Carlos_MFerr , @LoubnaBenAllal1 , @lvwerra , @jen_gineered, @sebpaquet , @YJernite for the contributions to the Governance Card. #ai #community #research #development #collaboration #project #data #aimodels #legal #ethics #governance #generativeai #llm #code #openaccess #opensource #openscience #opengovernance #openinnovation

over 3 years ago

BigCode was organized around the value of openness; open sharing of datasets and models, and also transparency of the project organization, motivations, and decisions! We're making all this information available in our new Governance Card 📚 1/4 🧵 https://t.co/51G08CwPmZ

1

68

11

10

19K

0

16

5

1

2K

over 3 years ago

The #BigCodeProject was formed as an open scientific collaboration working towards the responsible development and use of Large Language Models for Code. In the spirit of open governance, the community has now published a Governance Card for the project. #AI #Transparency

Science&Technology🖖 @sakhaleta

over 3 years ago

BigCode was organized around the value of openness; open sharing of datasets and models, and also transparency of the project organization, motivations, and decisions! We're making all this information available in our new Governance Card 📚 1/4 🧵 https://t.co/51G08CwPmZ

1

68

11

10

19K

0

6

0

1

751

over 3 years ago

@TolokaAI @BigCodeProject @huggingface @ServiceNowRSRCH Impressive collaboration! 🤝 Can't wait to read all about it. #AI #BigCodeProject #MachineLearning #Collaboration

0

2

1

0

87

over 3 years ago

Congratulations to @LoubnaBenAllal1 and our fellow contributors from the #BigCodeProject on this best paper award today at the Deep Learning 4 Code #DL4Code workshop at #ICLR2023.

over 3 years ago

Congratulations to the @BigCodeProject contributors on receiving the best paper award for “🎅 SantaCoder - Don’t reach for the Stars!”, today at the @DL4Code workshop held at @iclr_conf. Amazing work and well deserved recognition. Workshop: https://t.co/5xSzqMvUA2

1

14

3

0

2K

0

9

3

0

795

over 3 years ago

Proud to have led the working group for Legal, Ethics, Governance on #BigCodeProject. Very grateful to all the community that leaned in and to @harmdevries77 @lvwerra @Carlos_MFerr @YJernite for all the collaborations and contributions.

over 3 years ago

Introducing: 💫StarCoder StarCoder is a 15B LLM for code with 8k context and trained only on permissive data in 80+ programming languages. It can be prompted to reach 40% pass@1 on HumanEval and act as a Tech Assistant. Try it here: https://t.co/4XJ0tn4K1m Release thread🧵

BigCodeProject's tweet photo. Introducing: 💫StarCoder

StarCoder is a 15B LLM for code with 8k context and trained only on permissive data in 80+ programming languages. It can be prompted to reach 40% pass@1 on HumanEval and act as a Tech Assistant.

Try it here: https://t.co/4XJ0tn4K1m

Release thread🧵 https://t.co/wZj6B2KKZE

69

3K

624

2K

882K

0

17

3

0

1K

Harm de Vries @harmdevries77

over 3 years ago

Interesting insights on determining the Compute-Optimal Model Size from @harmdevries77 and researchers on the #BigCodeProject -> #LLM #Compute #Chinchilla #ScalingLaws

over 3 years ago

This analysis is the result of discussions with many amazing collaborators at the @BigCodeProject. Come join us if you're interested in these research topics!

2

24

0

1

8K

0

2

0

335

Bertrand Duflos @BertrandDuflos

over 3 years ago

The #BigCodeProject is gaining momentum

over 3 years ago

It’s exciting to see the @Europarl_EN Innovation Lab team taking interest in the #BigCodeProject - this validates our Mission. We’ve already had 13k+ downloads of The Stack since Oct’22 and 🎅SantaCoder 5k+ in the first 30d since 🎄. https://t.co/8t4T4LRTA2 #OpenGovernance #AI

0

2

0

617

0

2

0

239

over 3 years ago

It’s exciting to see the @Europarl_EN Innovation Lab team taking interest in the #BigCodeProject - this validates our Mission. We’ve already had 13k+ downloads of The Stack since Oct’22 and 🎅SantaCoder 5k+ in the first 30d since 🎄. https://t.co/8t4T4LRTA2 #OpenGovernance #AI

Fabien Benetou @utopiah

over 3 years ago

What's better about @BigCodeProject is that it's properly open, not "just" convenient with a chat interface or popular. That means you get to understand how it's done, in particular what data (including potentially yours) is being used, cf https://t.co/rULetztwCs

utopiah's tweet photo. What's better about @BigCodeProject is that it's properly open, not "just" convenient with a chat interface or popular.

That means you get to understand how it's done, in particular what data (including potentially yours) is being used, cf https://t.co/rULetztwCs https://t.co/Z6tYOFNZa4

0

42

9

14

11K

0

2

0

617

almost 4 years ago

Exciting work from the #OpenScience #BigCodeProject community. 400+ Researchers from >30 countries since Sep 26, 2022. Lots of work still to be done including training 10B+ Code LLMs. Researchers can join the collaboration here: https://t.co/DpKElS5ZWl #ResponsibleAI

almost 4 years ago

We release all models and intermediate checkpoints on the Hugging Face Hub and load the via the revision: https://t.co/H87RplxG8F The compute for these experiments was sponsored by @ServiceNowRSRCH's research cluster.

BigCodeProject's tweet photo. We release all models and intermediate checkpoints on the Hugging Face Hub and load the via the revision:

https://t.co/H87RplxG8F

The compute for these experiments was sponsored by @ServiceNowRSRCH's research cluster. https://t.co/WWqy1ygwLf

1

19

0

1

4K

0

7

4

0

2K

almost 4 years ago

Just in time for the holiday break, we’ve released a bunch of surprise gifts from the BigCode Community! There’s a lot of work that went into these efforts by the #BigCodeProject - THANK YOU to everyone involved. Read the thread below for details. #OpenSource #ResponsibleAI

Catherine Martin @cathe_martin

almost 4 years ago

Announcing a holiday gift: 🎅SantaCoder - a 1.1B multilingual LM for code that outperforms much larger open-source models on both left-to-right generation and infilling! Demo: https://t.co/jypW1SF75t Paper: https://t.co/YV3pzUbYOr Attribution: https://t.co/aE22O79Hnp A🧵:

BigCodeProject's tweet photo. Announcing a holiday gift: 🎅SantaCoder - a 1.1B multilingual LM for code that outperforms much larger open-source models on both left-to-right generation and infilling!

Demo: https://t.co/jypW1SF75t
Paper: https://t.co/YV3pzUbYOr
Attribution: https://t.co/aE22O79Hnp

A🧵: https://t.co/W7uuoifbvH

9

823

196

257

264K

0

4

0

431

almost 4 years ago

Come by @ServiceNowRSRCH booth for a discussion with our Researcher Harm de Vries. He will present his poster about the Big code initiative and responsible development of large language models for code. #NeurIPS2022 #bigcodeproject

cathe_martin's tweet photo. Come by @ServiceNowRSRCH booth for a discussion with our Researcher Harm de Vries. He will present his poster about the Big code initiative and responsible development of large language models for code. #NeurIPS2022 #bigcodeproject https://t.co/qL3ffWDbQX

0

14

3

1

0

almost 4 years ago

The Stack just doubled in size! #OpenSource #Dataset #Research #Announcement #BigCodeProject

almost 4 years ago

Today we are releasing The Stack v1.1! 🚀 We added more data, included more programming languages, and extended the list of permissive licenses used. https://t.co/dqtSxQH2Pt Also the first batch of opt-out requests was removed from the dataset.

BigCodeProject's tweet photo. Today we are releasing The Stack v1.1! 🚀

We added more data, included more programming languages, and extended the list of permissive licenses used.

https://t.co/dqtSxQH2Pt

Also the first batch of opt-out requests was removed from the dataset. https://t.co/8ytGhYNp5K

2

159

42

23

0

1

2

0

almost 4 years ago

If you’ve contributed to #OpenSource in the past, there’s a chance your code is in The Stack dataset & will be used to train Large Language Models for code. Use “Am I in The Stack?” with your GitHub account to check your status or opt-out.👇🏻 #BigCodeProject #ResponsibleAI #LLM

almost 4 years ago

Is your code in 📑 The Stack? Check if your repositories are in the dataset and a large language models for code will learn from them! https://t.co/ZesJyn416s You don't want your code to be part of The Stack? Follow the opt-out instruction and we'll remove it!

4

59

23

9

0

2

0

almost 4 years ago

"Am I in The Stack?" is an open governance tool from the #BigCodeProject for developers to search for their source code repositories that are included in The Stack dataset. Learn more in the #Announcement 🧵below.

almost 4 years ago

Is your code in 📑 The Stack? Check if your repositories are in the dataset and a large language models for code will learn from them! https://t.co/ZesJyn416s You don't want your code to be part of The Stack? Follow the opt-out instruction and we'll remove it!

4

59

23

9

0

3

2

0