Konstantin Berlin

AI and cybersecurity researcher @robustintelligence. Formerly, head of AI @Sophos. Views are my own.

[Konstantin Berlin @kberlin]

@joshua_saxe @rharang It's not plagiarism if it changes a few words.

[Konstantin Berlin @kberlin]

@rharang I had a very conservative friend tell me a long time ago that public scientific funding is a waste of money since you can just read publications from China if you ever need to figure it out.

[Konstantin Berlin @kberlin]

@CamlisOrg Very accessible. I really liked the presentation.

[Konstantin Berlin @kberlin]

@CamlisOrg Everyone on the team was super excited about this project. Not sure what it means that our attack project was getting way more external interests than any defense work.

[Konstantin Berlin @kberlin]

@CamlisOrg Benchmarking LLMs is really hard, yet important because there are so many choices. My feelings are that most common benchmarkers leaked into training already. Happy to see new type of benchmarks by my team (now former) on this. @AdarshKyadige and the rest.

[Konstantin Berlin @kberlin]

@CamlisOrg Excited to see @tamasV2, my and @SPBergeron work being presented.

[Camlis Org @CamlisOrg]

First talk of the session: "Web content filtering through knowledge distillation of Large Language Models" by Tamas Voros!

[Konstantin Berlin @kberlin]

@aphillippy Where are you going?

[Konstantin Berlin @kberlin]

@biggiobattista Basically, I don't think worst-case threat modeling is super productive in the security space. There are only limited number of problems that can be realistically solved under those constraints. I think it encourages paralysis and does not move the conversation.

[Konstantin Berlin @kberlin]

@biggiobattista I know we talked about it before. I just find this conversation very distracting. Basically: "I know we cannot solve the current basic X problem in security, but did you know that your non-working model can also be adversary attacked by this super convoluted method?"

[Konstantin Berlin @kberlin]

@joshua_saxe You lock the content behind a paywall or a registration page with terms and conditions that prevent scraping.

[Konstantin Berlin @kberlin]

@joshua_saxe Why wouldn't everyone just move behind some registration wall?

[Camlis Org @CamlisOrg]

Reminder to submit your full length paper or extended abstract by Friday, August 4th to be considered for this year's conference! https://t.co/aqD9dIvChb

#CAMLIS2023 #LLMs #Analytics #Statistics #DataScience #infosec

[Konstantin Berlin @kberlin]

@generatorman_ai @joshua_saxe Not sure what you mean here. It is about how the open internet will look like in a few years. The business model has been ads, so either lawsuits win out or the open internet. Just a statement of reality not morality. As a content creator I would be very worried.

[Konstantin Berlin @kberlin]

@generatorman_ai @joshua_saxe The concern is about LLMs, but it is hard and expensive to make a good one. However, with an open source model exploitation of the learned data for profit is much easier for a random person.

[generatorman @generatorman_ai]

@kberlin @joshua_saxe Why is this a concern about open-source models rather than language models in general?

[Konstantin Berlin @kberlin]

@joshua_saxe I used it multiple time to help build a custom travel itinerary. The major attractions do not really change much over a few years. This is one of the obvious cases for LLM over search, but the content it uses to learn the itinerary was obviously meant to be behind ads.

[Konstantin Berlin @kberlin]

Check out a quick writeup about our work on LLM for web classification.

https://t.co/vhqZDgswHd

[Sophos X-Ops @SophosXOps]

For more, see the full report, which links to the SophosAI paper. https://t.co/I25oFvYCbJ