Frank Proctor

Following research in AI and ML. Student of the sciences.
'Ignorance is fatal, Mr Garrett.'

[Frank Proctor @FEProctor]

Congratulations to @mohitban47 and Ron Alterovitz on being honored with distinguished professorships. Their work has been national attention for @unccs. Well done!

https://t.co/Md5xgHumki

[Mohit Bansal @mohitban47]

Had a great time speaking at @indoml_sym & meeting students+faculty+researchers (overall, kudos to organizers+volunteers on an excellent program)! 🙂

Talked about our long journey on Multimodal Generative LLMs:

(1) Unified/Universal Multimodal Learning for Generalizability, Shared Knowledge, Efficiency:
LXMERT ➡️ VL-T5 ➡️ TVLT ➡️ UDOP ➡️ CoDi1+CoDi2

(2) LLM Planning/Programming for Interpretable+Controllable+Faithful Multimodal Generation:
VPGen ➡️ DiagrammerGPT ➡️  VideoDirectorGPT

(3) Evaluation of Multimodal Generation Models for Fine-grained Skills, Faithfulness, Social Biases:
DALL-Eval ➡️ VPEval ➡️ Davidsonian Scene Graph

[Mohit Bansal @mohitban47]

Honored and excited to give a keynote at @aaclmeeting!

I'll be talking about various challenging aspects of Multimodal Generative LLMs: unification, faithfulness, interpretability+evaluation, efficiency.

Looking forward to the conference + seeing everyone in Bali 🏖️🌊 #AACL2023

[Frank Proctor @FEProctor]

Congratulations @peterbhase, that's quite an achievement!

[Mohit Bansal @mohitban47]

Congrats to @peterbhase for 'Outstanding Area Chair' award at #ACL2023nlp 🙂

On a related note, he will be on the faculty market this year, so definitely look out for him 👉 https://t.co/Sdh98LKgzr

#ProudAdvisor

[The TWIML AI Podcast @twimlai]

Today we’re joined by Mohit Bansal (@mohitban47), Professor at @unccs, to discuss his work on the unification of language and vision models, the advancement he’s seen in multimodal models, challenges of evaluation in generative AI, and much more!
🎧https://t.co/TTZATK2uaV

[UNC Computer Science @unccs]

🚨🔥 Exciting blog coverage 👇 of Microsoft-UNC collaboration on "Composable Diffusion (CoDi)", a novel generative-AI model that can generate any-to-any combination of modalities (text, audio, image, video) ➡️ https://t.co/vQGu8idugc

@ZinengTang @mohitban47 @yzy_ai @MSFTResearch

[Frank Proctor @FEProctor]

@mzrascoff @3blue1brown @Stanford Grant Sanderson's @3blue1brown math videos are brilliant and I love this advice to @stanford math grads about how to choose what problems they should work on.

[Frank Proctor @FEProctor]

So pleased to hear that @jaeh0ng_yoon will be joining @unccs @uncnlp as a postdoc this fall.

[UNC Computer Science @unccs]

More reasons to celebrate here at @unccs 🎉🎉

We are thrilled to welcome Jaehong Yoon (@jaeh0ng_yoon | https://t.co/I1kB3B0Hfj) as a Postdoc in @uncnlp from KAIST! Excited for the collaborations in store for this accomplished team.

@UNC @UNCResearch @unccollege

[Frank Proctor @FEProctor]

Hong Kong author Dorothy Tse and @natascha_bruce discuss Tse's new novel "Owlish" at @Foyles in Charing Cross Rd London July 3.
https://t.co/9AFEEi2mTa…

[Jennifer Feeley @jenniferfeeley.bsky.social @JenniferLFeeley]

Vancouver area friends: Dorothy Tse & James Shea will be giving a talk on HK literature in translation on 15 June at 3:00 pm at UBC library https://t.co/lXy1lfrt23

[Frank Proctor @FEProctor]

More great news from @unccs @uncnlp. Welcome to Chapel Hill @HuaxiuYaoML!

[Mohit Bansal @mohitban47]

🎉🥳 Excited to have @HuaxiuYaoML joining us (from @StanfordAILab) very soon this August 2023! Welcome to the @unc @unccs @uncnlp family, Prof. Huaxiu!! Looking forward to many awesome collaborations😀

PS. Students applying for spring/fall2024 PhD admissions, take note below 👇

[Frank Proctor @FEProctor]

Cool paper from @ZinengTang introducing his innovative multimodal AI model, #CoDi.
https://t.co/reKjbLNlL9
@unccs @uncnlp

[Zineng Tang @ZinengTang]

🖼️🎞️🔊📄Excited to introduce Composable Diffusion (CoDi), a new generative-AI foundation model that can take any combo of input modalities & generate any combo of output modalities (text, audio, image, video)!
https://t.co/tXIp4xV53x
@yzy_ai @ChenguangZhu2 @mohitban47 🧵👇
#CoDi

[Frank Proctor @FEProctor]

Awesome to hear that @EliasEskin is joining @mohitban47 and the @uncnlp team! We look forward to following your work on human-machine communication, using language to improve AI agents, and more.

[Elias Stengel-Eskin @EliasEskin]

After an amazing 5 years as a PhD student at @jhuclsp, I'm incredibly excited to announce that I'm joining @mohitban47's lab @uncnlp and @unccs as a Postdoctoral Research Associate!
Looking forward to many exciting collaborations with the amazing students and faculty there

1/2

[Frank Proctor @FEProctor]

Great to see @unccs @uncnlp continuing to add talented faculty. Welcome @TianlongChen4

[Mohit Bansal @mohitban47]

🎉🎉 Welcome to the @unc @unccs @uncnlp family, Prof. @TianlongChen4!! Looking forward to having you here soon & to the many fun collaborations 😀

PS. Students applying for fall2024 PhD admissions, take note 👇

[Mohit Bansal @mohitban47]

🎉🎉 Welcome to the @unc @unccs @uncnlp family, Prof. @TianlongChen4!! Looking forward to having you here soon & to the many fun collaborations 😀

PS. Students applying for fall2024 PhD admissions, take note 👇

[Frank Proctor @FEProctor]

Congratulations @RhiannonGiddens! Well-deserved accolade for a pioneering work!

[alisonmfriedman @AlisonMFriedman]

OMAR, co-commissioned by @UNCPerformArts and @Spoletousa , just won @PulitzerPrizes for #music
https://t.co/sMNSzVw3R5

[Frank Proctor @FEProctor]

Congratulations to @CatawbaCollege and @ABIves on getting to carbon neutral! That's a big milestone and I hope other institutions will follow.

[Catawba College @CatawbaCollege]

Proud to be the FIRST Certified Carbon Neutral Institution of the Southeast! 🥳📷. Huge shoutout to @NC_Governor and @2ndNaturePrez for their support through this process. Let’s keep raising the bar for campus sustainability! #GoCatawba #carbonneutral
https://t.co/MDQ6aDD32M

[Frank Proctor @FEProctor]

This will be a fascinating interdisciplinary project @UNC

[Frank Proctor @FEProctor]

Great, detailed look at how @iamcccc is implementing its ambitious plan for training North Carolina's future workforce, from @ChathamNR
https://t.co/UJh51Cc3Lb