@binarybits@gayestgaymer1@Jess_Riedel How do chess engines and go solvers look in this framework? It is my understanding that computers discovered weaknesses in some longstanding principles and joseki, but these weaknesses are legible to high level players and may have been discovered by humans eventually.
@binarybits@gayestgaymer1@Jess_Riedel Perhaps if you are capable of abstraction the only way to get smarter is more processing speed and more working memory, and we can model what that looks like by looking at a team of humans (and imagine them working quickly).
@ZachWeiner Perhaps people recognize that "greater good" utilitarian arguments have motivated many of the evilest acts of humanity, and are rightly sceptical of those lines of reasoning.
@azsantosk@ESYudkowsky Does this not require predicting the result of an arbitrary computation on an unknown input? Does not seem remotely tractable if the agents are near-peers.
@tracewoodgrains@YitziLitt This prompt is leaking a lot of information. Do you have a control group of normie writing where Claude will reply "yep this guy ended up happily married to a woman"
@jon_stokes I dont think it requires a lot of lore to explain how reward for completing a task can lead to implicit reward for gaining power (that may be on average useful for completing the task / reverse engineering the grader)
@xwanyex You're absolutely right, that's why we should only admit the laziest slackers to our proud country, and in the largest numbers possible. Perhaps they can dilute the hardworking unamerican strivers. We need to import a culture of idleness and long vacations.
@xwanyex Lmao sure if there's one lesson to learn from America's pasttime of baseball, it's that you should never give 100% because winning doesn't matter
@Noahpinion Couldn't an ASI design a successor with better-aligned reward signals than it has itself? We tell kids to say no to drugs, what if we could make them immune to the temptation?
@aug5thmusic Sounds like a very boring fugue that would receive a passing grade in a composition class. Certainly a technical achievement! I dont understand why anyone would willingly listen to this when there is already a limitless supply of baroque music available for free streaming.