UE 5.9 preview 1 now ships with a new plugin I worked on called AnimGenOffline (name might change) which allows you to guide animations at high level and use AI to generate the actual frames. This integrates that functionality into Sequencer.
As initial plugin into this system we integrated NVidia's Kimodo. But the system itself is not limited to this. Basically any algo that generates pose data over time can integrate with it.
You can draw splines and make characters follow them, type a style in text, set target key poses at certain frames, etc. You can pose your character directly with Control Rig and retargeting is all handled automatically.
You can also type: "Use Kimodo to generate an animation of a drunk person walking forward and save it as an Animation Sequence asset in /Game/Anims/DrunkWalk".
Weights still have to be downloaded from Huggingface (goes automatically after creating an account and read-only token etc). We're working on making that easier too.
It can run on basically any PC, but for fastest generation you need a Geforce 3xxx series or better. And probably Windows only for now, although I haven't tried on other platforms yet.
This is just the start of course!
Worked on this with @FredNilsson
Will show some videos soonish, or share some community videos.