@ValerioCapraro … It could also be prompt transformation, training data, fine-tuning, filtering, or whatever. It would be very intriguing to apply your benchmark in a structured way to an open model like OLMo (@allen_ai), then explicitly adapt it using different methods and benchmark it again.
@ValerioCapraro Thank you very much for your study — it is a valuable piece of work and I hope you can publish it soon. Whether human feedback alignment (RLHF, DPO, etc.) led to these results is unfortunately still highly speculative, with such non-transparent and closed systems like ChatGPT…
@emilymbender@_KarenHao That is so disgusting. If we genuinely had LMs 🦜 that could “understand” or were “artificially generally intelligent”, this wouldn’t be required.
@SashaMTL I am not always happy with the “foundation model” as it is not “foundational” in the complete/representative sense.
It seems like ONE INSTANTIATION of a house foundation to be tested and improved, yet to be completed.
I prefer probabilistic (or stochastic 🦜😉) base model more.
@emilymbender Why do we call these hyped LLMs “large” at all?
When is an LM “large”? Yes, this № of parameters and training data thing.
I try hard to avoid “large” because it is not clear (to me) when a probabilistic/neural LM is “large,” and I refrain from conveying that “large” is better.
I just got back from Nigeria where we have a wonderful HIV chatbot project for young adults, and then some "cross-thinking" fools praise the work of an HIV denier who bit the dust. This is so disgusting...
Ich bin zuversichtlich, dass es uns gemeinsam mit den HIV Betroffenen und den Expertinnen und Experten in Nigeria gelingen wird, die Lebensqualität mit HIV durch Conversational AI zu verbessern. Drückt uns die Daumen🤞! #AI#ArtificialIntelligence#HIV#chatbot#FHNWmoments
Mit künstlicher Intelligenz zu mehr Lebensqualität: Ein neues Forschungsprojekt entwickelt einen Chatbot zur gezielten Unterstützung von HIV-betroffenen Personen in Nigeria.
#FHNWmoments
https://t.co/qPBCNFH7vC
@FedorovMykhailo@Globecast Get Tor, get Snowflake so that Russians know what is really going on in Ukraine and not just Putin's propaganda. This article tells you how ... https://t.co/oe1nzv3n1N
@marko_kovic Ich halte das «Geschäftsmodell» für den wichtigsten und (meist) unterschätzten Treiber. Meiner Meinung nach hängen ganze Existenzen von Verschwörungstheorien und Desinformation ab.
Da scheint mir jemand wirklich frustriert zu sein – einfach nur ekelerregend dieser Artikel von Michael Bubendorf über @marko_kovic. Wer ist da "der psychisch Kranke"?
--
https://t.co/y95c00xX4m