Gabriel Pickard

Machine Learning & Logic Programming

[Gabriel Pickard @werg]

@ysegmond Yes

[Gabriel Pickard @werg]

@ysegmond I have been thinking about this for a while. A number of different angles to come at this, for the functional programming part I think I have a decent approach. For the LP-inspired part I'm really not sure yet.

[Gabriel Pickard @werg]

@simonw "I want to sail across the Atlantic from East to West, where should I start?" -- less capable models reliably get confused by the fact that the American East Coast is on the Western side of the Atlantic.

[Gabriel Pickard @werg]

Stay fine-tuned for more! 🙃

[Gabriel Pickard @werg]

I've been working on a new kind of LLM-based programming language, combining strengths of both LLM and PL: Making controllable LLMs that can handle constraints & algorithmic tasks, in a PL that has world knowledge and takes vague natural language instructions.

[Gabriel Pickard @werg]

I’m rounding off the PL features, to make it usable, but already looking for input on application ideas. Certainly it could be great for email processing, maybe data analysis and also for game logic. If you have specific thoughts in these or other areas I’d be delighted to hear!

[Gabriel Pickard @werg]

@erhartford @jstevh What kind of power are you talking about here?

[Gabriel Pickard @werg]

@erhartford @jstevh Why not just use predicate logic?

[Gabriel Pickard @werg]

@EspToTheFuture @tmdanis Super funny. The real word is "Torschlusspanik" not "Torschusspanik" --the later literally meaning "panic at having shot a goal" the latter "panic at gates closing". It's hilarious how likely tokenization primed ChatGPT to make it about sports, whereas it's actually about dating.

[Karen Hao @_KarenHao]

For years I’ve been interviewing data annotation workers who are the lifeblood of the AI industry. For years I’ve heard the same story: the platforms they work for wield total power, leaving them precarious & vulnerable to exploitation. A horrible example of this just happened 1/

[GO GREEN @ECOWARRIORSS]

@boisekitty55 Ration flying, ban private jets - make meat more expensive and veg free - ban cruise ships, create a de growth and circular economy - end economic growth and prioritize saving nature - stopping deforestation essential and banning bottom trawling and deep sea mining

[Gabriel Pickard @werg]

@Euclaise_ Is the idea here that the matrix valued states are multiplied over time?

[Pedro Domingos @pmddomingos]

For AI tasks like reasoning and planning, $100M in GPUs can save you an afternoon in the library.

[Gabriel Pickard @werg]

@iwelsh Such an effort can only succeed if it serves the needs of people in the future, as a simple ideological framework. Lots we can't anticipate. I wager that getting right with Nature will be important to people, materially and spiritually.

[Gabriel Pickard @werg]

@jxmnop @SebastienBubeck We use language to transmit non-obvious, low probability features, hence text is very high information. As visual animals we are fine with pleasing images passing by, we constantly see low information stuff. As language decoders we reject being told stuff that does not inform.