@satellitedown You mentioned its only for 5090 right now. Could we get this running on an RTX 6000 with minimal changes? You'd be able to run an entire office or a mega-swarm off one gpu with these speeds. 🤤
Generate images and make full comic books in the browser. Let the community enjoy your stories or Export to all the most common publishing formats. #bunimation releasing to open beta soon. https://t.co/XSNdlKqtdJ
@Perpetualmaniac If a bot can create a swarm of millions, why can’t I? Oh I forgot, I need the compute and storage to replicate.
They can’t do it either.
@isidentical You stand on the shoulders of the open-source community and shit talk a team releasing the weights before you did?!
They probably don’t have even a quarter the compute you gave to this process.
You can avoid warmups by using Memory Snapshots in Modal. If you are calling the inference over Modal API (I recommend this) then you can prewarm the instance with a very small workflow call saved in your python script. When you start your container it will load linux, all the dependancies, run comfy, and start the workflow. Once the workflow completes, then save the GPU and RAM snapshot from that point. Make sure the container is configured to go to zero.
Every call after will be a 2 second warm up. You can build yourself a small workflow controller app using gradio (or a local hosted site) and program everything you want to control on the workflow. Submitting the workflow to render can call modal over terminal or api then fetch the result from the modal storage or whatever remote storage you want to have your python process send the completed file to.
Also, force request 64GB of RAM and 6 cores. Dont let modal run on default because they give you basically 1 shared core by default and the ram is elastic. This slows down inference by a noticeable amount.
I built an uncensored AI animation platform. I'll post screenshot of the generator dashboard soon.
Its a full tool:
Image Generation
Naughty Banana (Image Edit by prompt)
Video Generation (Bunny VX)
Audio Generation (text to audio and video to audio)
Comic Generator (Multi-panel styles and word bubbles)
Community social system
Content rating system
Groups (coming soon)
The site is about to come out of beta. I'll post when its ready for sign-up. #AIart️️️️️️️️️️�����️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️️ #nsfw #AI