Generic LLMs answer medical questions confidently. They're also often wrong.
We fine-tuned one on PubMed literature with gradients sdk. Now it agrees with the peer-reviewed answer.
3 lines of Python:
pip install gradientsio
Alignment should probably begin and end with "don't kill everyone", let it learn the rest
Most would not appreciate an immortal super-entity aligned to 1720s human values
Would 2200 appreciate one aligned to 2020s human values?
@RandolphCarterZ @made_by_chris However the kind of super-optimizer I am thinking of is ignorant of it's own reward function so maybe capping these systems is sufficient.
@RandolphCarterZ @made_by_chris You don't think it's possible that super-intelligence and super-optimizers are different evolutionary paths and we might accidentally find ourselves on the wrong one?
new research from OpenAI used gpt4 to label all 307,200 neurons in gpt2, labeling each with plain english descriptions of the role each neuron plays in the model.
this opens up a new direction in explainability and alignment in AI, helping make models more explainable and potentially easier to align.
https://t.co/k8FkDAygDT
(I still think AI risk is a huge deal, by the way. I suspect some people think I'm a total AI risk skeptic, but I'm not. I just don't give human extinction from AI >50% chance.)
In this post @robbensinger neatly lays out the argument for a very high likelihood of AI doom. I probably disagree with premise 2b the most. It depends on what counts as "full value loading" but I've not been persuaded that it's "~impossibly difficult".
https://t.co/eERwb6KwpE
here is an alternative path for society: ignore the culture war. ignore the attention war. make safe agi. make fusion. make people smarter and healthier. make 20 other things of that magnitude.
start radical growth, inclusivity, and optimism.
expand throughout the universe.
the creative power of the world is breathtaking to watch.
each time our tools get a little better and a little bit more accessible, our creations improve more than we imagine possible.