Date | Section Updated | Summary of Changes |
May 5 2024 | Project launched | Key sections on AI Psychometric Foundations added including definitions, reasons for progress, LLM training data, and bias. Section on Methods and Tools added including Moral Foundations motivating example with semantic construct validation; |
June 5 2024 | Embedding based psychometric analyses updated. | Sections in psychometric analyses added, including semantic item alignment and pseudo-discrimination factor structure. |
July 5 2024 | Seedling case study added | Seedling is a 50 million parameter GPT-2 style LLM trained from scratch on 10 GB of OpenWebText using Amazon Web Services. The full script is available from the Seedling case study page. |
September 6 2024 | New sections on LLM Emergence and LLM Alignment added. | Section explaining the concept of emergence in AI and its relevance to psychometrics; section added on the ideas behind alignment with a detailed discussion of Reinforcement Learning from Human Feedback (RLHF). |
Return home
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
