skunkworks

OSS ai research community building basement agi

[skunkworks @skunkworks_ai]

RobotArena is live today!

Led by @sumo43_, RobotArena is an ELO-based 🤖 Robot-Action Model benchmark that allows you to test models directly in your browser.

Check it out here: https://t.co/Ix0d2CdKdk

Special thanks to @HIVEDigitalTech for their compute support!

[skunkworks @skunkworks_ai]

@sumo43_ @HIVEDigitalTech Do give us feedback/ideas on how to expand RobotArena further👇

[skunkworks @skunkworks_ai]

RobotArena is live today!

Led by @sumo43_, RobotArena is an ELO-based 🤖 Robot-Action Model benchmark that allows you to test models directly in your browser.

Check it out here: https://t.co/Ix0d2CdKdk

Special thanks to @HIVEDigitalTech for their compute support!

[skunkworks @skunkworks_ai]

We’d like to thank @HIVEDigitalTech for their reliable compute support in enabling open source AI research @skunkworks_ai for this project and beyond. Feel free to reach out to us if you want to contribute or accelerate your open source AI research with compute!

[skunkworks @skunkworks_ai]

Reasoning is an integral component of capable and competent AI models. We’re releasing one of our first reasoning data subsets for the benefit of the open source community. More data to be released along with some of our reasoning models.
https://t.co/YkvGs9XusJ

[nisten🇨🇦e/acc @nisten]

Made a tiny-frankenstein of TinyLlama @LeopolisDream
Works great even at 942Mb size.
Full model, secret sauce and custom gguf quants included. @skunkworks_ai @far__el
https://t.co/8Es9v8BMcW

[Far El @far__el]

quick question- should we open source failed projects too?

[skunkworks @skunkworks_ai]

@arbius_ai Amazing!

[Far El @far__el]

Good tutorial for using @skunkworks_ai BakLLaVA!

[cocktail peanut @cocktailpeanut]

Mirror: A hackable AI-powered Mirror on Your Laptop.

Mirror is a simple yet powerful web app that runs 100% locally, where the AI (@ggerganov's llama.cpp + @skunkworks_ai's Bakllava) constantly watches your webcam feed and sends you messages.

And you can try it too, right now.

[nisten🇨🇦e/acc @nisten]

👀bakLLaVA vision AI can read xrays with only 6Gb of RAM @far__el @skunkworks_ai
Easy code colab to run it on your own via @ggerganov ./server below👊

Looking to train fully opensource model for cancer tissue detection next 🩺
If anyone can clear the gunk of bureacracy & just provide that data dear god please do.

Crazy part is.. model wasn't even trained for this purpose, general image data was limited to 384:384px, yet it can read🤯words.. and reason.

Colab server: https://t.co/rlfR5zccNj (gotta make a free ngrok account to open gguf webserver remotely )
Github: https://t.co/R6JHuV1ieJ
Hugginface: https://t.co/2AZIiAHOMn
Quantized ggml downloads: https://t.co/P7jGe6KjyK
Thank you @imhaotian for building and opensourcing the orignal LLaVA vision-llama code that we used to train on top of @MistralAI 7b with.

[skunkworks @skunkworks_ai]

@togethercompute @ontocord @Sentdex @laion_ai @alignment_lab @ClementDelangue @huggingface Please do check out the OG LLaVA implementation by @imhaotian!
Here: https://t.co/oTMt2CZTmm

[skunkworks @skunkworks_ai]

BakLLaVA-1 is now available to everyone. We show Mistral-7B with vision outperforms Llama-2 13B on several tasks, but we've only scratched the surface. BakLLaVA-2 is cooking with a larger corpus and significant architectural improvements/innovations.

https://t.co/ag4SX1i0V2

[skunkworks @skunkworks_ai]

As always, thank you to our compute sponsor @togethercompute and to our collaborators @ontocord @Sentdex @laion_ai @alignment_lab . We can't wait to show you what we're up to with the next updates!

Demo for BakLLaVA-1 coming soon. (@ClementDelangue @huggingface 👀)

[skunkworks @skunkworks_ai]

@AdarrabYoussef Not hard for BakLLaVA-1!
BakLLaVA-2 will be a different story 😉

[skunkworks @skunkworks_ai]

@AdarrabYoussef BakLLaVA-1's code is a fork of https://t.co/oTMt2CZTmm
adapted for Mistral-7B. Here's our repo (although some updates coming over the next day to clean up and incorporate some new features we added)
https://t.co/PvFpKQgDqq

[Together AI @togethercompute]

Our first large H100 cluster (4424 GPUs) starts coming online today! Available as sub-clusters configured for pretraining models. We plan to prioritize the startups and research institutions. 🚀👾

Request access: https://t.co/JyEbNM20DS

[skunkworks @skunkworks_ai]

We're getting hundreds of access requests every day since we announced BakLLaVA v1 🚀

We'll open the flood gates shortly. Stay tuned.

[skunkworks @skunkworks_ai]

@felix_red_panda @thukeg @vilm_hq V1 is out in the next day 🚀🚀🚀

[skunkworks @skunkworks_ai]

This model was forged thanks to the generous support from @togethercompute.

We'll continue to push the multimodal model further in collaboration with @ontocord @cliangyu_ @laion_ai @alignment_lab with an even more powerful v2 coming soon.

[skunkworks @skunkworks_ai]

BakLLaVA 1 can successfully see! And we're not even half way through our run 👀

The base model is a Mistral 7B, so this is possibly the first @MistralAI vision model! Model is hosted here and will be fully released soon: https://t.co/ag4SX1i0V2