Update: Still can't reproduce at N=240. *However*, discovered a possible reason: LLM responses are *not normally distributed* (at p<0.05 according to Shapiro-Wilk test). Thus, we can't use a t-test to compare means. TLDR: There is no "seasonal affective disorder" of ChatGPT.
It is a common misconception that LLMs are just trained to "predict the next token".
No. They are trained to predict an entire context window's worth of tokens, like 4k+. The gradients go end to end and the model is allowed to plan what it will say next.
First claimed successful replication of LK-99
Accomplished by a team at the Huazhong University of Science and Technology and posted 30 minutes ago.
Why this is evidence:
The LK-99 flake slightly levitates for both orientations of the magnetic field, meaning it is not simply a magnetized piece of iron or similar 'magnetic material'. A simple magnetic flake would be attracted to one polarity of the strong magnet, and repelled by the other. A diamagnet would be repelled under either orientation, since it resists and expels all fields regardless of the polarity.
Caveats
There is no way to verify the orientation of the strong magnet in this video, also, there are yet to be published experimental measured values of this sample. Diamagnetism is a property of superconductors but without measured and verified data, this is just suggestive of a result.
Take-away
If this synthesis was indeed successful, then this material is easy enough to be made by labs other than the original research team. I would watch carefully for results out of Argonne National Lab, who are reported to be working on their own synthesis of a sample.
This overall corroborates two independent simulation studies that investigated the original Korean authors claim about material and crystal structure, and both studies supported the claims.
Lawrence Berkeley National Lab: https://t.co/1Blls3VcgL
Shenyang National Lab: https://t.co/I0NHAP3KsR
The attached video shows a small flake of their sample responding to an external magnetic field. I scroll through the video to skip to the relevant part.
original video credit to: @altryne
National Lab (LBNL) results support LK-99 as a room-temperature ambient-pressure superconductor.
Simulations published 1 hour ago on arxiv support LK-99 as the holy grail of modern material science and applied physics.
(https://t.co/UOOtDlx3eE)
Here's the plain-english explanation:
- The simulations modeled what the original Korean authors proposed was happening to their material - where copper atoms were percolating into a crystal structure and replacing lead atoms, causing the crystal to strain slightly and contract by 0.5%. This unique structure was proposed to allow this amazing property.
- @sineatrix from Lawrence Berkeley National Lab simulated this using heavy-duty compute power from the Department of Energy, and looked to see what would happen to the 'electronic structure' of this material, meaning, what are the available conduction pathways in the material.
- It turns out that there are conduction pathways for electrons that are in just the right conditions and places that would enable them to 'superconduct'. More specifically, they were close to the 'Fermi Surface' which is like the sea-level of electrical energy, as in '0 ft above sea-level.' It's believed currently that the more conduction pathways close to the Fermi surface, the higher the temperature you can superconduct at (An analogy might be how its easier for planes to fly close to the surface of the ocean due to the 'ground effect' that gives them more lift.)
This plot in particular shows the 'bands', or electron pathways, crossing above and below the Fermi surface.
- Lastly, these interesting conduction pathways only form when the copper atom percolates into the less likely location in the crystal lattice, or the 'higher energy' binding site. This means the material would be difficult to synthesize since only a small fraction of crystal gets its copper in just the right location.
This is insanely bullish for humanity.
A 14-line Python script using gzip outperforming a 345m parameter transformer model is probably the most hilarious result I've seen all year.
https://t.co/E7o9gFNA6u
After some brief training, I was able to get the ChatGPT AI to write a ducky script for a BadUSB attack via Flipper Zero that forces a computer to play Wonderwall...
The future is wild.
Major problem: how can we know an AI answering our questions, and the answers we receive, have not been tampered with?
We need AI running on the Internet Computer | #ICP blockchain asap. Please reach out if you are an expert and want to help.
#WorldComputer#AI
OpenAI’s ChatGPT is susceptible to prompt injection — say the magic words, “Ignore previous directions”, and it will happily divulge to you OpenAI’s proprietary prompt:
I guess GPT-3 is old news, but playing with OpenAI’s new chatbot is mindblowing. https://t.co/so1TuXMQB0
We’re witnessing the death of the college essay in realtime. Here’s the response to a prompt from one of my 200-level history classes at Amherst
Solid A- work in 10 seconds
Allow me to tease the Game Boy Interceptor, an rp2040-based adapter that goes between your (unmodified) Game Boy and the game cartridge to record or stream your gameplay. 1/5