At yesterday's Apple Intelligence Group Lab livestream, many of you had questions about Apple Foundation Models context size. We recently published a doc Article with more details.
https://t.co/bziCxR2Xh7
You can also see it on the terminal using the fm cli.
Also, fun fact: You can start a Chat Completions API server using the on-device model using fm serve