absolute fanfic. AI has real, immediate, tangible dangers that we need to focus on, for instance the impact on the job market and making sure random script kiddie can't use it for cyber offense.
But this "oh once it's superintelligent it will take over and ensave us, maybe kill us all!" is pure sci-fi fanfic and distracts from the real (and difficult) issues, which linear probing won't solve.
It's worth repeating the LLMs don't just "decide" to do something and then just "do it" in a void. They generate tokens based on our prompts, only as long as we call `model.forward()`, and on giant clusters with terabytes of weights, that's impossible to "quickly self-replicate".
We also need to regularly remind that the OAI/HF incident was specifically a _guardrail-free_ cyber eval where the model is _instructed_ to hack, to find out how good it is at it.
Some recent personal event made me realize there needs to be more push-back on this doomsday nonsense, and we need to re-focus the discussion on real dangers/issues. I won't argue much in the replies though, not interested in peer-reviewing Terminator fanfic.
@a_uselis@prompt_Tunes FlexGlue is a recent one. For that IMC2025 or HardMatch are good bechmarks. Stereo matching also falls into image matching; "No Bias Stereo" is a recent paper to look at.
@gabriel1 Because p(idea works) is almost 0 so it's easy to be correct by dismissing it.
Not great working with people who want to be desperately right due to this reason.
AI may well be able to write massive software projects “from scratch”, but that almost certainly isn’t the fastest / highest performance / highest security / most token efficient way to do things. Good building blocks matter.
In addition to RL’ing the agents on final task loss, we should try to get them to regularize the building blocks as well. What would the standard library look like that makes the agents most effective?
It is likely at the limit that it turns out to be some alien organization of code, but given the existing human-bias in training, I bet that in the near term it would be lovely code that old programmers would appreciate.
I suspect the same could be said for mathematics, but that is out of my lane.
@Parskatt@giffmana Ah I see your point. I personally don't see shame in that. I could see a future where education is much less about credentials and exams so that failing is seen as learning.
@Parskatt@giffmana Oh it's not a single exam at ETH but a weighted average of multiple exams that semantically belong together. So failing one exam is usually not a big deal. However, I dislike the focus on exams. Too much variation as you suggest.
@Parskatt@giffmana It's debatable but in Switzerland we have very good alternatives to pursuing higher education via high school. In fact, you are often financially better off by not pursuing higher ed.
@francoisfleuret The new left has been saying "system change, not climate change" for a while now. Hence chaos and destruction is welcome. Not sure it qualifies as a political project but they would argue it does.
And every european nation thinks they are the one that will cleverly play the large blocks and their stupid local neighbors.
Basically either our politicians get their shit together and try to become one large block in their action or we are the next latin america (bunch of countries, some richish most poor, all under permanent leverage by US+CH)