Roy

[Roy @xwlin_roy]

We’re hiring Ant Star candidates(https://t.co/hZ98HPj95F) and research interns at Ant Group to work on AI security red-teaming and defense.
If you’re interested in AI + Security research, send your CV to [email protected]

[Roy @xwlin_roy]

New paper: "ICON: Intent-Context Coupling for Efficient Multi-Turn Jailbreak Attack"

We find LLM safety constraints are significantly relaxed when malicious intent is coupled with a semantically congruent context.

97.1% ASR across 8 LLMs.

https://t.co/GgRUaCz13B

[Roy @xwlin_roy]

@YuZheng0404 congrats!

[Roy @xwlin_roy]

@danis_jiang You are welcome, bro.

[Roy @xwlin_roy]

@Yuantest3 Done!

[Roy @xwlin_roy]

@KafeiEths 用雷霆线更快，20m以内搞定。

[Roy @xwlin_roy]

Our framework website: https://t.co/USO0UBKN2a

[Roy @xwlin_roy]

Thrilled to announce our collaborative effort with @jiahaoyu04 & @xingxinyu on breaking LLM barriers! Introducing GPTFuzzer, our innovative fuzzing framework that streamlines the creation of jailbreak templates for red-teaming LLMs. Preprint: https://t.co/QCWoR9nGHs

[Roy @xwlin_roy]

Our framework consistently achieves impressive attack success rates. Notably, even when initialized with failed human-written prompts, our method still manages to achieve an attack success rate of over 90% against well-aligned models like ChatGPT and Llama-2.

[Roy @xwlin_roy]

We finished all web3 challenges as expected, but one web2 caught us off guard.

[Roy @xwlin_roy]

Our team 0xdd took 5th place in @MetaTrustLabs CTF.

[Roy @xwlin_roy]

This is a good start for us to explore the security field of Web3 ecology. Thanks to my team members!!!

[Roy @xwlin_roy]

It involves precise program analysis of JavaScript and C/C++ to identify the necessary system call list for the app, and then employs a seccomp-based defense solution with thread-level syscall whitelist to defend against attacks such as arbitrary code execution. "

[Roy @xwlin_roy]

Our joint work with @zju_ethan has been accepted by ACM CCS 2023. Congratulations Wenya and Wang Gao!

[Roy @xwlin_roy]

This work focuses on reducing the attack surface of Node.js server-side applications.

[Roy @xwlin_roy]

@moyix @JohnDunlap2 Can you share the transcript?

[Roy @xwlin_roy]

@drootkit123 我们组主要是漏洞挖掘🫡

[Roy @xwlin_roy]

@YuZheng0404 @BenjaminKim0920 @IEEESSP @NDSSSymposium @acm_ccs But the early-reject date of S&P is after the second cycle deadline of CCS, lol

[Roy @xwlin_roy]

This internship needs base in Hangzhou.