I've had thoughts about this too and aside from the horns they also tie into each other thematically as well.
Columbina has a soft spot for humans while Jester despises humanity. She sees the world through a hopeful lens while Jester is much more cautious and cynical.