Hasan Murat Akinci

throwing onions at proxies 🧅 @journie_ai

[Yann LeCun @ylecun]

LLMs obviously have *some* understanding of what they read and generate.
But this understanding is very limited and superficial. Otherwise, they wouldn't confabulate so much and wouldn't make mistakes that are contrary to common sense.

I have argued, since at least 2016, that AI systems need to have internal models of the world that would allow them to predict the consequences of their actions, and thereby allow them to reason and plan.
Current Auto-Regressive LLMs do not have this ability, nor anything close to it, and hence are nowhere near reaching human-level intelligence.
In fact, their complete lack of understanding of the physical world and lack of planning abilities puts them way below cat-level intelligence, never mind human-level.

AR-LLMs can accumulate large amounts of textual knowledge (if only approximately) and can retrieve it with appropriate context (if only approximately). More than a cat, certainly.

But how is that any 10 year-old can learn to clear up the dinner table and fill up the dishwasher in one shot, whereas we are nowhere near having robots capable of learning this in any amount of time.
Obviously, we are still missing something really big to reach human-level AI.

I have written where I think AI research should go over the next decade or two to bridge that gap:
https://t.co/yqWEubV9id

All my talks of the last couple of years have been on "objective driven AI architectures" which are an attempt to bridge that gap while making AI systems controlable, safe, and subservient to humanity. E.g. this one:
https://t.co/2QTDpXWjzy

[No Context Brits @NoContextBrits]

BBC iPlayer asking if you have a TV license.

[No Context Brits @NoContextBrits]

Throwback to the time the BBC asked Rage Against The Machine not to swear during a live broadcast.

[Hasan Murat Akinci @hmakinci]

@onurvarol @BilimAkademisi @Tubitak devam canim hocam 👏

[Onur Varol @onurvarol]

Bugun @sabanciu de @Temel_Kotil hocayi dinleme sansimiz oldu. Uzun zamandandir dinledigim en motive edici konusmaydi.

Bana ITUde 2008de quadrocopter icin calistigimiz, binalar soguk olunca UV lambalarla isindigimiz geceleri hatirlatti. O gunlerin heyecanini herkes yasar umarim

[🌧 ren。 @non_philosophy]

idk, Western media people kinda being a little bit racist right now 😳 (a thread)

[Hasan Murat Akinci @hmakinci]

@erhancelik @Besiktas 🖤🤍🦅

[Hasan Murat Akinci @hmakinci]

@aydoghdu @Besiktas 🖤🤍🦅

[Hasan Murat Akinci @hmakinci]

@aycanify yaparim 😀

[Hasan Murat Akinci @hmakinci]

https://t.co/bLD94bXMpm

[zaкovsкa @sanjazakovska]

Devs watching QA test the product

[Lysandre @LysandreJik]

🤗/transformers: v4.0.0 is out!

- For the first time, fast tokenizers are by default in AutoTokenizers & pipelines (Amazing effort by @Thom_Wolf and @moi_anthony)
- SentencePiece becomes an optional dependency
- T5 and mT5 are out @lintingxue @colinraffel @PatrickPlaten

[PyTorch @PyTorch]

PyTorch Lightning 1.0.0 is now available. This is the final stable API to train and deploy models at scale, without the boilerplate. Read more about this release below: https://t.co/9zozqQWOCL

[Hasan Murat Akinci @hmakinci]

@imaginecurve @Barclays 3 notifications for the same "transaction". Google Pay, Curve, Barclays. 21st century 🤦‍♂️ something is wrong here..

[MIT CSAIL @MIT_CSAIL]

Stay at 127.0.0.1
Wear a 255.0.0.0

[Tony "Abolish ICE" Arcieri 🦀🌹 @bascule]

Trying a horrible experiment...

Which will the Twitter algorithm pick: Mitch McConnell or Barack Obama?

[Sasha Rush @srush_nlp]

Thread: Last week, a list of 100 important NLP papers (https://t.co/PUHTvKCuiI) went viral. The list is okay, but it has almost *no* papers with female first authors.

NLP is rich with amazing female researchers and mentors. Here is one paper I like for each area on the list:

[XKCD Comic @xkcdComic]

COVID Risk Chart https://t.co/vMd39yBHWQ https://t.co/NspbdIpYMq

[Hasan Murat Akinci @hmakinci]

true

[Sebastian Ruder @seb_ruder]

Why You Should Do NLP Beyond English

7000+ languages are spoken around the world but NLP research has mostly focused on English. In this post, I give an overview of why you should work on languages other than English.

https://t.co/Nj0hk61ZXA