gareth woodall

Technology and Compute

[gareth woodall @quasintalg]

Hi is this a real account
@TravelodgeUKA4

[gareth woodall @quasintalg]

@SuccessTeam_09 Hello I have DM

[gareth woodall @quasintalg]

Hey I booked a stay with you today but need to amend days, unfortunately I am getting no help when I call. My CC has told me to reach out
@TravelodgeUK

[gareth woodall @quasintalg]

@TravelodgeUK Hello Lynette, the room is booked but I would like to correct the dates. I cannot manage this in the booking online. Please help

[Jack Smillie @jackyapping]

@CPhilpOfficial Oh so the French can monitor and control boat activity in the channel? Interesting

[gareth woodall @quasintalg]

@GamersNexus

[Martin Lewis @MartinSLewis]

I've just got the latest energy bill predictions. The average of 3 sources show the Price Cap rising 5.1% on 1 Oct - as the last week has seen very high wholesale rates. An annualised rise of £93 on a typical bill.

If this happens it will wipe out any household savings from the VAT cut during that Price Cap period (those on fixes will still see a 4.8% reduction).

[gareth woodall @quasintalg]

@RedFoxCrypto I run Qwen 27B IQ4XS plenty of room for context

[Daniel Han @danielhanchen]

Gemma-4 QAT just dropped! We found if you naively convert from QAT Q4_0 BF16, you will lose accuracy since the conversion to llama.cpp has a different lattice.

Unsloth dynamic GGUFs recovers most of it!
26B-A4B: 85.6% top-1 % from 70.2% (+15.4%)
31B: 96.7% from 87.9% (+8.8%)

[Kemi Badenoch @KemiBadenoch]

Today I have met Lucy, Mark and Katie, Henry Nowak’s mother, father and stepmother. Their courage is extraordinary.

They have endured the most appalling loss, it is a life sentence for them.

They have also faced the agonising decision to release the harrowing body-worn camera footage, knowing how painful it would be and how strongly people would react. They did so because they want truth, accountability and change.

They have asked that we work across political parties and religions to rebuild trust in the police. That trust has been broken because of what happened, and I agree with them on that.

We must also be prepared to examine, carefully and seriously, religious practices or exemptions that permit the carrying of dangerous weapons in public, and other activities that are not conducive to the public good. We also need to examine where the law needs to change.

Henry’s family do not want anger to tear communities apart. They are a family who have friends across faith and race, and so did Henry. His family want his memory to help bring our society together.

Everyone knows I have strong views about how we should deal with equality under the law. What the family agreed with me on is that we need to bring common sense back, and that is what we should all be fighting for.

I promised the family that we will work to ensure there is a positive legacy for Henry out of this tragedy.

That is my focus now.

[Georgi Gerganov @ggerganov]

Highlighting recent advances in multi-GPU and tensor parallel support in llama.cpp

Over the last few months llama.cpp maintainers and engineers from NVIDIA collaborated to improve the multi-GPU performance in ggml. This resulted in significant performance gains on RTX systems and laid the groundwork for hardware-agnostic tensor parallelism in ggml.

For more information on this and other advancements in the low-level inference engine of llama.cpp, check the technical blog by @NVIDIARTXSpark below

[Google Gemma @googlegemma]

Meet Gemma 4 12B!

A unified, encoder-free multimodal model designed to bring high-performance intelligence directly to your laptop, and released under an Apache 2.0 license.

Bridging the gap between edge efficiency and advanced reasoning. Here is what’s new with Gemma 4 12B: 👇

[Austin @a_5t_n]

@ShabanaMahmood This you 👇
https://t.co/KnvWSGpLd4

[Rupert Lowe MP @RupertLowe10]

How many more young British men and women are going to die? Bleeding in the street, alone and terrified. Cuffed, in a pool of their own blood. Begging for help.

How many more parents are going to stand there, and say that they couldn’t help their children in their dying moments? Apologising to their dead children because they couldn’t stop it from happening?

How many more?

This is going to happen again, and again, and again.

It’s happening right now, in every city across the country.

Rape. Sexual torture. Even worse. Mass industrial abuse of British children.

Henry Nowak is one of thousands and thousands and thousands.

Innocent young men and women put through the most unimaginable pain, because our country has failed to do what needs to be done.

Because children have been sacrificed to death in order to appease foreign cultures that have no place in our country.

I have had enough - of all of it.

I am going to look back in anger.

I urge you all to do the same.

[Elon Musk @elonmusk]

Release the body camera videos

[gareth woodall @quasintalg]

@sudoingX I hit #3 the other week tmux is great. This week I setup forgejo on a server, can you add any tips to #4 before I hit that?

[gareth woodall @quasintalg]

@HardwareUnboxed @RouaniJihad @neh_r8 @JayzTwoCents

[gareth woodall @quasintalg]

@StevenHeathen @ConanExiles This ^

[gareth woodall @quasintalg]

@witcheer @sudoingX I was using q8k q4v and 10000 context and decent results too will check this config out tonight.

[gareth woodall @quasintalg]

@ShenHuang I found same (settled on similar model quant from unsloth and llama.cpp). Waiting for any extras 👍