This paper has the right idea: use symbolic logic for discrete reasoning and lean on deep learning models for perception and common-sense intuition. https://t.co/9lP8eDZKkO
I expect to see a lot more progress along these lines in the coming months / years.
latent codes are isometric => zero-shot stitching of independently trained encoders/decoders... cool stuff!
one day we're gonna wake up and discover deep learning is secretly just some kernel methods in a trench coat
Excited to release our work on Goal MisGeneralisation (GMG)! In GMG, a model trained with a correct reward function pursues undesirable goals. E.g. this agent competently gets negative rewards.
Blog: https://t.co/y9tAAbLWEp
Paper: https://t.co/lFADb7pCyB
https://t.co/bToRP17VIE
Neural networks often pack many unrelated concepts into a single neuron – a puzzling phenomenon known as 'polysemanticity' which makes interpretability much more challenging. In our latest work, we build toy models where the origins of polysemanticity can be fully understood.
You can tell crypto is a great investment because of all the billboards and TV ads telling you to buy it (~$1B ad spend in 2021).
Those paying for the ads want to share with you the fabulous profits to be made in crypto. They definitely don't need you to be their exit liquidity.
Over the past 10 years, AI has specialized into two domains.
"Applied AI" where the goal is to ship products with real-world impact.
"Make-believe AI" where the goal is to ship press releases to convince investors and the public that what you're doing is important.
I'm hearing disturbing rumors that a number of fabulously rich men are turning out to be very right-wing and are seeking to buy up media outlets in order to increase their political influence and shore up their views. This is unprecedented and no one could have predicted it.
Asked a ML researcher friend what would convince her that large models aren't "just reflecting their data" - she said understanding novel similes and metaphors.
Here's one that GPT-3 basically nailed - but it's probably not fully novel. Other suggestions?
Introducing #AlphaCode: a system that can compete at average human level in competitive coding competitions like @codeforces. An exciting leap in AI problem-solving capabilities, combining many advances in machine learning!
Read more: https://t.co/yaXfMWtEfe 1/
Has anyone noticed that the one-trick-pony theory of "surveillance capitalism" can't offer any critique of "Web3"/crypto? At best, it would embrace them as a form of "humane" informational capitalism - the "creator economy" and all that - which is finally reasserting itself.
omfg this conversation between a researcher and a QAnon-primed GPT-3 model (AI language generator). The researcher is asking the questions; GPT-3 is answering them.
https://t.co/vzWIVqUQzX