Sovolt

We are building things together.

[Sovolt @EricDelobel]

Creating is hard and also the best fulfillment source ever.

😎Watch : imagine a desirable future
🎯Catch : design the experience
🦸Make : create your playground
🤩Scale : push what's growing

🧵(1/4) Here is full framework to navigate through the creation waves 👇

[Sovolt @EricDelobel]

@lovable Bug as well : i am clicking editing and can't edit anything at all. BTW thanks for that !!

[Sovolt @EricDelobel]

@elonmusk The autocratie lions may lies in empathie sometimes. It's not a core feature by default. But life magicaly circle back when needed.

[Sovolt @EricDelobel]

@acwangpython @ExaAILabs Hum.. Yes and no. Anyway ! Good insights for the pm exa team 😉

[Sovolt @EricDelobel]

@acwangpython @ExaAILabs Please learn a bit about how llm's and embeddings works ;)

[Sovolt @EricDelobel]

@minchoi @sama And docs from url 🤩

[Sovolt @EricDelobel]

@TurpentineMedia @labenz @WilliamBryk @ExaAILabs Hey Guys ! It's the smarter and precise audio flow i haven't years for years. You are really into something. And it's really pleasant to see this powerfull vision & energy shared with an API first logic. Thanks for that ;)

[Sovolt @EricDelobel]

@sama Isn't the purpose of chatgpt? 🙄🙂

[Sovolt @EricDelobel]

@abacaj And opus, despite the cost, is really magic with large context!

[Cameron R. Wolfe, Ph.D. @cwolferesearch]

Looking for something to talk to your family about while you’re home for the holidays? Why not give them a clear, accessible explanation of ChatGPT? Here’s a simple, three-part framework that you can use to explain generative language models to (almost) anyone…

TL;DR: We can explain ChatGPT pretty easily by focusing on three core ideas.

1. Transformer architecture: the neural network architecture used by LLMs.
2. Language model pretraining: the (initial) training process used by LLMs.
3. The alignment process: how we teach LLMs to behave to our liking.

Although AI researchers might know these techniques well, it is important that we know how to explain them in simple terms as well! AI is no longer just a research topic, but rather a topic of public interest.

Why is this important? Generative AI has now become a popular topic among both researchers and the general public. Now more than ever before, it is important that researchers and engineers (i.e., those building the technology) develop an ability to communicate the nuances of their creations to others. A failure to communicate the technical aspects of AI in an understandable and accessible manner could lead to widespread public skepticism (e.g., research on nuclear energy went down a comparable path) or the enactment of overly-restrictive legislation that hinders forward progress in our field.

(1) Transformers: Most recent generative language models are based upon the transformer architecture. Although the transformer was originally proposed with two modules (i.e., an encoder and a decoder), generative LLMs use a decoder-only variant of this architecture. This architecture takes as input a sequence of tokens (i.e., words or subwords) that have been embedded into a corresponding vector representation and transforms them via two repeated operations:

- Masked self-attention: looks at other tokens in the sequence (i..e, those that precede the current token).
- Feed-forward transformation: transforms each token representation individually.

These two operations each play a distinct and crucial role. By stacking several blocks of masked self-attention and feed-forward transformations on top of each other, we get the neural network architecture that is used by most generative LLMs today.

(2) Pretraining: Self-supervised learning refers to the idea of using signals that are already present in raw data to train a machine learning model. In the case of generative language models, the most commonly-used objective for self-supervised learning is next token prediction, also known as the standard language modeling objective. Interestingly, this objective—despite being quite simple to understand—is the core of all generative language models. To pretrain a generative language model, we first curate a large corpus of raw text (e.g., from books, the web, scientific publications, and much more) to use as a dataset. Starting from a randomly initialized model, we then pretrain the LLM by iteratively performing the following steps:

1. Sample a sequence of raw text from the dataset.
2. Pass this textual sequence through the decoder-only transformer.
3. Train the model to accurately predict the next token at each position within the sequence.

“Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users.” - from InstructGPT

(3) Alignment: After pretraining, the LLM can accurately perform next token prediction, but its output is oftentimes repetitive and uninteresting. The alignment process teaches a language model how to generate text that aligns with the desires of a human user. To align a language model, we first define a set of alignment criteria (e.g., helpful and harmless). To instill each of these alignment criteria within the model, we perform finetuning via supervised finetuning (SFT) and reinforcement learning from human feedback (RLHF), which together form the three-step technique for alignment proposed by InstructGPT.

For more details on each of these three components, see the links in the replies.

[Sovolt @EricDelobel]

🧪 I'm excited to share that I'll be learning something new about AI for 100 days as part of the #100DaysOfAI challenge! Starting January 1st!

Join me via @100DaysAI!

https://t.co/JveZiWQVSL

[Victor M @victormustar]

Free AI (closed) vs Free AI (open source)

[Sovolt @EricDelobel]

@_JimmyNeutrino @ProperPrompter 😂😂

[Sovolt @EricDelobel]

@ProperPrompter 😂🤦🫣

[Together AI @togethercompute]

Access Mixtral with the fastest inference performance anywhere! Up to 100 token/s for $0.0006/1K tokens — to our knowledge the fastest performance at the lowest price!

Mixtral-8x7b-32kseqlen @MistralAI & DiscoLM-mixtral-8x7b-v2 are live on Together API!

https://t.co/cpJ6tnshD1

[Dr. Apolotary @parhelion318]

@MistralAI Mistral is quickly becoming my most favorite AI company

[Florian S @airesearch12]

@JThomasBurgess @MistralAI

[Balaji @balajis]

Why do you hate the boat so much?

[Sovolt @EricDelobel]

@deoetnatura @BrianJJi The key is that everyone does already! It's the maximisation equation (different for everyone) that is often not revealed or counter intuitive.

[Sovolt @EricDelobel]

@LinusEkenstam Civilization indeed :) And all of that powered by the soundblaster card ^^

[Sovolt @EricDelobel]

@matt_mazzega @tinkso_com @bubble Génial ! :)