Top Tweets for #InstructVideo
🎯Align GenAI with Human Preference🎯
#InstructVideo instructs video diffusion models with human feedback by reward fine-tuning, enhancing the video generation quality/aesthetics
- Project: https://t.co/1vILMrZEkI
- Paper: https://t.co/vYO9wnMIf5
- Code: https://t.co/UcDH4OmTu9
Alibaba announces InstructVideo: Instructing Video Diffusion Models with Human Feedback
paper page: https://t.co/6mg9XheORk
Diffusion models have emerged as the de facto paradigm for video generation. However, their reliance on web-scale data of varied quality often yields results that are visually unappealing and misaligned with the textual prompts. To tackle this problem, we propose InstructVideo to instruct text-to-video diffusion models with human feedback by reward fine-tuning. InstructVideo has two key ingredients: 1) To ameliorate the cost of reward fine-tuning induced by generating through the full DDIM sampling chain, we recast reward fine-tuning as editing. By leveraging the diffusion process to corrupt a sampled video, InstructVideo requires only partial inference of the DDIM sampling chain, reducing fine-tuning cost while improving fine-tuning efficiency. 2) To mitigate the absence of a dedicated video reward model for human preferences, we repurpose established image reward models, e.g., HPSv2. To this end, we propose Segmental Video Reward, a mechanism to provide reward signals based on segmental sparse sampling, and Temporally Attenuated Reward, a method that mitigates temporal modeling degradation during fine-tuning. Extensive experiments, both qualitative and quantitative, validate the practicality and efficacy of using image reward models in InstructVideo, significantly enhancing the visual quality of generated videos without compromising generalization capabilities.
Thanks to @_akhaliq for featuring our work! InstructVideo addresses key challenges in video generation by integrating human feedback into video diffusion models. Excited to see how InstructVideo advances AI-driven video creation! 🚀 #AI #VideoGeneration #InstructVideo
Alibaba announces InstructVideo: Instructing Video Diffusion Models with Human Feedback
paper page: https://t.co/6mg9XheORk
Diffusion models have emerged as the de facto paradigm for video generation. However, their reliance on web-scale data of varied quality often yields results that are visually unappealing and misaligned with the textual prompts. To tackle this problem, we propose InstructVideo to instruct text-to-video diffusion models with human feedback by reward fine-tuning. InstructVideo has two key ingredients: 1) To ameliorate the cost of reward fine-tuning induced by generating through the full DDIM sampling chain, we recast reward fine-tuning as editing. By leveraging the diffusion process to corrupt a sampled video, InstructVideo requires only partial inference of the DDIM sampling chain, reducing fine-tuning cost while improving fine-tuning efficiency. 2) To mitigate the absence of a dedicated video reward model for human preferences, we repurpose established image reward models, e.g., HPSv2. To this end, we propose Segmental Video Reward, a mechanism to provide reward signals based on segmental sparse sampling, and Temporally Attenuated Reward, a method that mitigates temporal modeling degradation during fine-tuning. Extensive experiments, both qualitative and quantitative, validate the practicality and efficacy of using image reward models in InstructVideo, significantly enhancing the visual quality of generated videos without compromising generalization capabilities.
Last Seen Hashtags on Sotwe
japanesehandjob
Seen from Indonesia
nolimit filter:native_video
Seen from Turkey
sexgayviet
Seen from Vietnam
bokep chindo
Seen from Singapore
oc
MOMSON (*******)************************************+filter:native_video
Seen from Turkey
danieljones
Seen from Colombia
รับงานศรีราชา
Seen from Thailand
Goonslop
Seen from Switzerland
3dporn
Seen from United States
Most Popular Users

Elon Musk 
@elonmusk
240.1M followers

Barack Obama 
@barackobama
119.3M followers

Donald J. Trump 
@realdonaldtrump
111.6M followers

Cristiano Ronaldo 
@cristiano
109.2M followers

Narendra Modi 
@narendramodi
106.9M followers

Rihanna 
@rihanna
97.3M followers

NASA 
@nasa
92.1M followers

Justin Bieber 
@justinbieber
90.6M followers

KATY PERRY 
@katyperry
86.9M followers

Taylor Swift 
@taylorswift13
80.7M followers

Lady Gaga 
@ladygaga
72.3M followers

Kim Kardashian 
@kimkardashian
69.4M followers

Virat Kohli 
@imvkohli
68.7M followers

YouTube 
@youtube
68.6M followers

Bill Gates 
@billgates
63.5M followers

The Ellen Show
@theellenshow
62.5M followers

CNN 
@cnn
61.9M followers

Neymar Jr 
@neymarjr
61.3M followers

X 
@x
60.9M followers

Selena Gomez 
@selenagomez
60M followers


