Winter is coming. Evals are coming.
Everyone’s shipping cool demos.
But it’s all about experience definition and rigorous eval.
New post: Evaluation Is the Product
https://t.co/rnxlwfYNZ9
It is clear open source models and harnesses are having a moment. There's a few factors at work
1/ It is now obvious that you can catch up to near-SOTA performance and do so with a clear training lineage. See:@thinkymachines Inkling launch today.
2/ There are several well-funded, talented teams building open weight models now in the US and abroad. Along with the explosing of other near SOTA models (Grok/Cursor, Muse Spark), it is clear we are going to have a diverse ecosystem of models atleast on coding and agentic use.
3/ Organizations are increasingly looking for control over how their data is used and are willing to trade off some access to frontier level tokens for this control. Organizations and countries are increasingly nervous about the frontier labs potentially competing with them down the road and don't want their data to enable a future competitor.
4/ Open source is a slider: you could bring your own open harness, your evals, your business context and are free to pick and choose your model of choice.
5/ Companies have now actively shifted from "how do we get our people to use tokens" to being uncomfortable with their token cost ballooning without a clear line to revenue.
6/ Geo-politically, countries will be weighing open weight models as a way to get frontier-level tokens inside controlled environments that may not be otherwise possible.
All of this leads to more choice for all of us !
Every mammal learns by playing, and AI is just the newest thing to play with. Do we raise a generation of makers who build with it — or consumers it’s built for?
https://t.co/YQHovzhQUS
Everyone agrees AI shouldn't decide for us.
Fewer ask what happens when it's in a room where we all disagree — and still has to do something.
Not an alignment problem you solve once. It's an interaction model you design every time: https://t.co/7dLkhwltvJ
We're building AI that people and organizations can shape and make their own. AI should extend our will and judgment instead of neglecting it; enabling that is the technical challenge we are working to solve.
https://t.co/Bi558y4vqD
I’m on the job market for 2023 full-time UX Researcher roles! I do HCI and CSCW research on topics such as digital P2P payments, live-streaming, and social VR using both qual and quan methods!
Info on other related positions (e.g., research scientist) is also appreciated!
01.22.12 ⇢ 01.22.22
tenure in immersive technology (vr/ar/xr –“metaverse")
10 yrs ago, chair of department took a chance on me for an @nsf fellowship that evolved into an ar glasses grant
grateful to those who support, routinely check in, and have provided guidance.
Spread the word! I have 2 positions open for a paid, summer REU experience on accessibility and AR. Apply by Feb 23
Apply here: https://t.co/1WXIqGfd3l
Big thanks to @VUEngineering and @MSFTResearch dissertation grant for their support!
I've been seeing a ton of kids and families get VR this Christmas which makes me so excited 😎here are a few findings from my dissertation on Youth and VR. https://t.co/zqJtIuBRYV or read the abbreviated version in the thread below.
@SpedTechGS@kentbye hmm i don't have findings relating directly to education in tradtional learning but my findings do support that kids love immersive learning building things, making games, interacting in 3D spaces etc.
1/ I agree with @washingtonpost tech journalist @WillOremus that we haven't achieved an interoperable Metaverse yet, but I disagree with his assessment that we won't anytime soon as it depends on how you define a minimal viable Metaverse.
TREAD comparing Metaverse frameworks 👇
@BlueIvyRedWorld Efforts to increase safety are increasing, although it may seem like nothing is being done. Since i started on this dissertation (a few years ago) to now, there has been significant increases towards safer VR for kids.
I've been seeing a ton of kids and families get VR this Christmas which makes me so excited 😎here are a few findings from my dissertation on Youth and VR. https://t.co/zqJtIuBRYV or read the abbreviated version in the thread below.
I've been seeing a ton of kids and families get VR this Christmas which makes me so excited 😎here are a few findings from my dissertation on Youth and VR. https://t.co/zqJtIuBRYV or read the abbreviated version in the thread below.
Three themes i'd suggest reading are towards the end of the document:
-Modern Playground for the Digitally Intuitive
-Social VR: the Ultimate Social Developmental Tool
-Design Recommendations for a Safe, Equitable, and Emotionally Fulfilled Metaverse