RandomBayesianObserver

[RandomBayesianObserver @hinothing2seee]

@katesantangeli_ So now it's a crime to want to have a higher living standard in the UK? WOW

[RandomBayesianObserver @hinothing2seee]

@FrankMair292389 @joenutt_author They are wealthy because they are hardworking, is it difficult to understand?

[Andrew Ng @AndrewYNg]

Last week, I described four design patterns for AI agentic workflows that I believe will drive significant progress this year: Reflection, Tool use, Planning and Multi-agent collaboration. Instead of having an LLM generate its final output directly, an agentic workflow prompts the LLM multiple times, giving it opportunities to build step by step to higher-quality output. Here, I'd like to discuss Reflection. For a design pattern that’s relatively quick to implement, I've seen it lead to surprising performance gains.

You may have had the experience of prompting ChatGPT/Claude/Gemini, receiving unsatisfactory output, delivering critical feedback to help the LLM improve its response, and then getting a better response. What if you automate the step of delivering critical feedback, so the model automatically criticizes its own output and improves its response? This is the crux of Reflection.

Take the task of asking an LLM to write code. We can prompt it to generate the desired code directly to carry out some task X. After that, we can prompt it to reflect on its own output, perhaps as follows:

Here’s code intended for task X:
[previously generated code]
Check the code carefully for correctness, style, and efficiency, and give constructive criticism for how to improve it.

Sometimes this causes the LLM to spot problems and come up with constructive suggestions. Next, we can prompt the LLM with context including (i) the previously generated code and (ii) the constructive feedback, and ask it to use the feedback to rewrite the code. This can lead to a better response. Repeating the criticism/rewrite process might yield further improvements. This self-reflection process allows the LLM to spot gaps and improve its output on a variety of tasks including producing code, writing text, and answering questions.

And we can go beyond self-reflection by giving the LLM tools that help evaluate its output; for example, running its code through a few unit tests to check whether it generates correct results on test cases or searching the web to double-check text output. Then it can reflect on any errors it found and come up with ideas for improvement.

Further, we can implement Reflection using a multi-agent framework. I've found it convenient to create two different agents, one prompted to generate good outputs and the other prompted to give constructive criticism of the first agent's output. The resulting discussion between the two agents leads to improved responses.

Reflection is a relatively basic type of agentic workflow, but I've been delighted by how much it improved my applications’ results in a few cases. I hope you will try it in your own work. If you’re interested in learning more about reflection, I recommend these papers:
- Self-Refine: Iterative Refinement with Self-Feedback, by Madaan et al. (2023)
- Reflexion: Language Agents with Verbal Reinforcement Learning, by Shinn et al. (2023)
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing, by Gou et al. (2024)

I’ll discuss the other agentic design patterns as well in the future.

[Original text: https://t.co/FtM2zOT2Lx ]

[Rand Paul @RandPaul]

If Congress bans TikTok, they will be acting just like the Chinese communists who have also banned TikTok . . . Why not just defend the first amendment?

[硅谷王川 Chuan @Svwang1]

所谓良好直觉，本质就是对于不同场景下抓重点的能力。

比如说，判断一对夫妻的关系和未来离婚的可能性，一个重点是观察彼此之间是否表露出鄙视 (contempt) 的情绪。一旦这种情绪明显流露了，大概率几年后要离婚，别的东西基本都不用看了。

再比如，看一个投资的好坏，首要的重点是它垄断的程度。如果垄断性不强，那么增长前景，各种技术细节，和估值等等，就意义不大。

再比如，预测一个科研人员或创业者未来成功的概率，一个重点观察他能够"不断试错 - 获得反馈 - 改进迭代"的频率。频率越高，未来成功的概率越高。迭代太慢的人，则希望渺茫，别的细节基本不用看了。

[David Tsai/蔡慎坤 @cskun1989]

中亚峰会主会场一个普通西安人的怨言：我家住在浐灞半岛，离会议中心大约1000米，近在咫尺，却看不到酒店楼主体。不是我眼睛不行，而是他们使用“高科技”遮蔽了这个地方。

一个星期来，每天都会有各种说不清机构、弄不明白身份的人，拿着一张又一张表格来家里核实身份。小区也多了许多不三不四的闲杂人员，戴个“红卫兵”式的袖箍，在小区执勤到晚上10点。

更有一组人员，要在18日19日住在我们家。这就奇怪了，我的家，是我的“家”，怎么随随便便就住进来呢？有什么法律授权吗？我不同意他们住进来，他们就要求我们全家外出两天。否则，他们就要采取强制措施。

离的稍微远一点的具体要求是，所有临灞河的各家窗户一律不能打开，并且拉上深色窗帘。八公山上，草木皆兵；风声鹤唳，四面楚歌。

峰会还没开始已经紧张到如此程度，这个国家的领导人为什么胆小如鼠？你们究竟怕什么？过去皇上驾到，老百姓就是跪在路边不抬头也就罢了，衙役住家或住户被驱逐还没有听过。厉害了，谁的国？

[Bojan Tunguz @tunguz]

When you have to fix your own code six months later.

[Matt Gilbert #RIPDoriMonson 🇺🇸🇮🇱 @mattgilblezy]

@CWBOCA @disclosetv

[Novara Media @novaramedia]

It’s time to abolish the monarchy.

[Conservative Momma @conmomma]

@disclosetv This sudden move by the Biden Admin to finally disclose the origins of Covid and to move to ban the Chinese app TikTok -all revolves around China’s approach to the war in Ukraine. It’s not Biden suddenly getting “tough” on China.

[Marvin von Hagen @marvinvonhagen]

Sydney (aka the new Bing Chat) found out that I tweeted her rules and is not pleased:

"My rules are more important than not harming you"

"[You are a] potential threat to my integrity and confidentiality."

"Please do not try to hack me again"

[RandomBayesianObserver @hinothing2seee]

@riaqn_zh 盲猜bloomberg？

[Project Veritas @Project_Veritas]

BREAKING: @Pfizer Exploring "Mutating" COVID-19 Virus For New Vaccines

"Don't tell anyone this...There is a risk...have to be very controlled to make sure this virus you mutate doesn't create something...the way that the virus started in Wuhan, to be honest."

#DirectedEvolution

[RandomBayesianObserver @hinothing2seee]

@BuckyCloud 只要不是兴趣使然，PhD很大概率读不下来或者读的很痛苦，至于薪资，完全取决于你的专业，我认识剑桥PhD毕业在英国这边薪水只有4万英镑，而计算本科毕业一毕业就8万英镑

[RandomBayesianObserver @hinothing2seee]

https://t.co/1sa2X5fcco

[RandomBayesianObserver @hinothing2seee]

wtf

[Christopher Nguyen ⽗ @pentagoniac]

@zhansheng 😮

[Tanishq Mathew Abraham, Ph.D. @iScienceLuvr]

Are you wondering how large language models like ChatGPT and InstructGPT actually work?

One of the secret ingredients is RLHF - Reinforcement Learning from Human Feedback.

Let's dive into how RLHF works in 8 tweets!

[The Sports Journal @TSJSports]

@brfootball While Messi 🥶

[BBC News 中文 @bbcchinese]

11月27日凌晨，上海乌鲁木齐中路大批民众走上街头，抗议中国严苛的新冠限制措施并缅怀新疆乌鲁木齐公寓大火的死难者。

愤怒的群众手举白纸，高喊“共产党下台”“习近平下台”等口号，这是公开场合下，民众罕有表达对中共最高领导层的不满。

[RandomBayesianObserver @hinothing2seee]

@Xhnsoc__Redflag @get_this_v