The AI-GENIE paper is now PUBLISHED at Behavior Research Methods (FREE link in the comments), by the @Psychonomic_Soc ! In this paper we are not only setting Generative Psychometrics in stone, but we are showing a full pipeline from Item Generation using LLMs to FULL in-silico Structural Validity of the Items, after removing redundant and unstable items! Finally, we show that the in-silico dimensionality matches EXACTLY the dimensionality obtained in nationally representative samples for the best model! The appendix provides the benchmark for newer models, including the open-source GPT models from OpenAI! Big congratulations to @larafromUVA , for this is the first paper out of her PhD work.
Are you in the Tokyo area on July 19th and want to be part of a FREE IN-PERSON WORKSHOP in Generative Psychometrics with AI-GENIE in R? Check this awesome opportunity below. Thanks to the generosity of Kunisato-Sensei (@KunisatoY) and to Senshu University!