Open-source alternatives to jev are pretty shit (like CLM). They may be on par on some benchmarks, but jev feels more intelligent: it can generalise over any task without much drop in performance compared to LLMs.
I feel they have some novelty in their architecture; it’s not just an added MLP over an existing transformer/LLM, or the way they process context.