Martin Thwaites

Developer Advocate @honeycombio, #o11y activist, Microsoft MVP, Triager for #OpenTelemetry #dotnet #MVPBuzz

[Martin Thwaites @MartinDotNet]

Quick reminder that people are still finding the fediverse, so keep coming back to you contact lists on the various sites you follow them to see their new handles.

Mine is @[email protected]

[Martin Thwaites @MartinDotNet]

@davidfowl "It depends"... for critical software, I don't think it adds an abstraction layer. For everything else, I think it really does.

[Martin Thwaites @MartinDotNet]

@eddiejaoude I think we do it pretty well, none of us actually feel like "devrel".

We just... do what needs to be done.

A lot of "DevRel" people get really precious about what devrel is, and lose focus on the fact that the job is relationships inside and outside the org.

[Martin Thwaites @MartinDotNet]

Can confirm, seeing this on the stage was amazing

[Corey Quinn @QuinnyPig]

This slide transition from my #o11ycon keynote just might be the greatest slide transition I’ve ever pulled off as a speaker.

[Martin Thwaites @MartinDotNet]

@aHev @davidfowl @kellabyte @aspiredotdev You are definitely missing a lot of the project if thats your view.

Logs, traces, events, metrics, profiles, SDKs, global semconv, local semconv, proxies, schemas, validations, protocols.

Naming headers isn't even otel, that's W3C.

[Martin Thwaites @MartinDotNet]

@kellabyte @davidfowl @aspiredotdev Thats not an "otel" problem, it's a tracing problem

Otel as a project is way more than tracing. For your specific usecase, I'd advice looking at the events spec, its more aligned to emitting "start/end"

Between logs, events, metrics, traces and profiles, we've got you covered

[Martin Thwaites @MartinDotNet]

@Aaronontheweb OpenCode+ollama+gaming GPU is surprisingly effective.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb Qualcomm is my long term bet to be honest, even longer is Qant but thats more like a 5 year thing.

There's a lot riding on the next generation of the halo platforms (beyond gorgon). APU and NPU combinations are the future.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb Yeah this is how the MBP is staying ahead in portable inference.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb This is the whole ball game right now.

Model choice, context size, quantitative, etc. This is what will make or break a good experience with LLMs and everyone else is trying to one shot everything with Opus 4.6 (or even 4.7).

The concurrency stuff is the hard part imo.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb Theres an Instruct model that might be better for that. I can't remember which is have loaded for it, I can check later.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb I have a strix halo with 128GB, just a single one. I would love me some DGXs, or any of the DB10s.

[Martin Thwaites @MartinDotNet]

@davidfowl Protocol is stable now, thats the part that matters for Aspire ;)

[Martin Thwaites @MartinDotNet]

@Aaronontheweb Interesting, although i was more interested in your personal hardware. The prefill and TPS can only really come from behind the openai endpoint as its not exposed to the caller.

Those ones I'd love to see them have gen_ai semconv tracing and metrics.

I shall try it next week.

[Martin Thwaites @MartinDotNet]

@Aaronontheweb @AkkaDotNET @htmlcsstoimage @getsdkbin I should show you the new canvas for doing those investigations with visuals and human interaction. Not to say Netclaw can't do a good investigation.

[Martin Thwaites @MartinDotNet]

@davidfowl I've been toying with the idea of hooking up wispr flow to Copilot during these meeting with the prompt "any time a feature is discussed, spawn a sub-agent to build it and update the agent as the discussion unfolds, when the work is pushed to a PR, tag everyone in slack".

[Martin Thwaites @MartinDotNet]

@davidfowl I'm pretty sure it runs

docker-compose build && docker-compose push

/joke

[Martin Thwaites @MartinDotNet]

@davidfowl Does asking my AI Coding Agent to deploy everything count?