Shivam

AI Builder & Founder | Shipping Agents/Platforms | | Freelancer | DMs open

[govi @kirtandopamine]

stop blaming GitHub

there are ~180M accounts pushing an ungodly amount of pure, industrial-grade slop every day,

just picture the combined storage + egress!!

the platform is carrying humanity’s collective unfinished side-projects.

show some respect

[Shivam @shivam_danny]

@TheCoderShow @AnthropicAI I am a power user, I was also contacted by Amol Avasare (Growth lead) for feedback on new models.
I would like to volunteer.

[Shivam @shivam_danny]

@JacobCounsell Is this for real! Yeah count me in...
https://t.co/129OhVSUlQ

[Shivam @shivam_danny]

@sickdotdev @JamesBuildsTech Distribution exists in the world of content

[Shivam @shivam_danny]

Demoed TARS by https://t.co/129OhVSUlQ at the Claude Code Showcase.
AI agent that talks to your business data on WhatsApp — charts, insights, recommendations.
Response was overwhelming, Coming Soon 🚀

Shoutout to @GrowthX_Club & @PiyushDinde for hosting this event.

[Shivam @shivam_danny]

@ChitrakShivalik Hi @ChitrakShivalik , we at https://t.co/129OhVSUlQ do exactly that.
Ahmedabad/Pune offices. Send me your contact information, if you're interested

[Shivam @shivam_danny]

@TheCoderShow @claudeai Hey Sumeet, founder myself - https://t.co/129OhVSUlQ
Travelling to Ahmedabad for next 4 days. I can help organizing this also have a place as well, up for a meetup this week?

[Alex Albert @alexalbert__]

Over these next few years it's going to become more and more important that you resist letting slop consume you.

Keep creating. Keep learning. Keep thinking.

[Shivam @shivam_danny]

@WhatsupFranks @elonmusk Hopefully never, let opus thrive

[Shivam @shivam_danny]

@perbu @svpino SEs eventually need to wrtie clean and consice code for their feature/product. Converting a messy notebook to a shippable code is nightmare. Issues with integration, containerization. Don't get me started.

[Shivam @shivam_danny]

@svpino If you could give some practical examples then it would make some sense.

[Bindu Reddy @bindureddy]

The Ongoing Case For Open Source LLMs
Custom LLMs, long context, and efficient inference

Some folks believe that training open-source LLMs is a losing battle and a complete waste of time.

They argue that the gap between closed models like GPT-4 and open models like Llama will widen and these open-source models may never catch up.

Yes, closed models like Google's Gemini or Open AI's Gobi promise to be way more powerful than GPT-4, so what hope does open source have?

To start with inference on GPT-4 is very expensive. These very large models may be performant but aren't cost-effective. At Abacus, we routinely use fine-tuned versions of LLama-2 and smaller models when we need to run 1M+ API calls a day for standard enterprise applications Q/A, summarization, and NLP at scale. GPT-4 would cost > $100K a day in these cases.

Instruct-tuned LLMs can match the performance of GPT-4 for a specific task. Instruction tuning is a technique that aims to improve the capabilities and controllability of LLMs. It involves further training these models on a dataset consisting of (instruction, output) pairs in a supervised manner. This bridges the gap between the next-word prediction objective of LLMs and the users' objective of having LLMs adhere to human instructions.

For example, we have instruct-tuned open-source models for tasks like Q/A, NER, and classification. These instruct-tuned models are better at generalizing the task to new data and can do so in a resource-efficient manner.

Another shortcoming of currently available closed models like GPT-4 is that they have relatively short context lengths. 8K tokens are default and this means that you can't pass it large documents and ask it to extract the results from there.

Luckily the open-source community has been busy solving practical problems like this. Earlier this week, the paper LongLoRA introduced an ultra-efficient fine-tuning approach to significantly extend the context windows of pre-trained LLMs.

LongLoRA adopts LLaMA2 7B from 4k context to 100k, or LLaMA2 70B to 32k on a single 8x A100 machine, and basic implementation only takes 2 lines of code.

Open-source LLMs have been the focus of the GPU-poor and constraining resources typically have magical effects - efficient, elegant, and simple innovations that solve the problem!

Open-source LLMs have emerged as cheap and efficient alternatives for enterprise AI use cases and will continue to play an important role in the space.

Some have argued that open-sourcing LLMs is dangerous and they may be misused by bad actors.

There is no historical precedent for this argument.

Traditionally, open-source technology has spurred innovation, transparency, and the creation of safe and robust systems. Linux, triumphed over Unix in the OS world, largely because it is open-source and has a huge developer community.

Open source promotes collaboration, community oversight, rapid iteration, and benchmarking all essential for responsible AI development. Open-source developer communities tend to be great at detecting and plugging vulnerabilities.

Disappointingly, big players like OpenAI (despite their name) and Google, haven't open-sourced a lot of their technology. Luckily for the open-source community, Meta has created accessible open-source LLMs. In spite of Meta open-sourcing the powerful 70B LLama-2., the doomsday scenarios outlined by the anti-open-source crowd haven't come true.

Finally, multimodal LLMs (MLLM) are around the corner and if the GPU-rich won't outsource a MLLM, we can always enhance an existing open-source LLM and convert it into a multi-modal model.

In summary, open-source LLMs play a role in the real-world application of AI and are crucial for the democratization of this technology, transparency, and AI alignment

[Shivam @shivam_danny]

@helloiamleonie About Hindi being so rich language🙂

[Shivam @shivam_danny]

@rowancheung @SnoopDogg @ddl_vid1 get this

[Liron Shapira @liron]

Everyone's job description after GPT-5

[Shivam @shivam_danny]

@Xabhi_FCB @SaveVideo_Bot @SaveToNotion

[Allie K. Miller @alliekmiller]

Every AI person I know is beyond exhausted.

[Shivam @shivam_danny]

@Ultra_Suristic Not that other teams they played against didn't get penalties. Also not that they didn't score other than penalties. False metric

[Helen Toner @hlntnr]

If you spend much time on AI twitter, you might have seen this tentacle monster hanging around. But what is it, and what does it have to do with ChatGPT?

It's kind of a long story. But it's worth it! It even ends with cake 🍰

THREAD: