Tyler Brown

Engineer @atlassian having fun with AI

[Tyler Brown @TylerBrownAT]

Heya, I'm Tyler 👋 a principal engineer at @Atlassian.

I've been building here for a long time, and working on AI since the GPT-3.5 days, when you had to figure out what you really could do with a 4K context. good times (seriously! it was so fun).

I'm going to start sharing more of what i build and how i work: agent workflows, experiments, and lessons from getting AI to do useful things.

I'm still learning plenty myself since it's changing every day.

When did y'all start building with AI?

[Tyler Brown @TylerBrownAT]

/show-me-in-confluence is a skill I use every day. Love having a shareable record of something. If it was a good enough explanation for me why not make it so others can see it as well?

[Matt Pocock @mattpocockuk]

IMO you should be specializing my skills to your work

I.e. you should extend /grill-me to make sure it:

1. Holds you to a high standard of product design
2. Does a survey about security implications
3. Uses /show-me to preview the code for you

[Tyler Brown @TylerBrownAT]

@CTOMichael Yeah I've started using it a lot more and I'm like oh yeah i get it now.

[Tyler Brown @TylerBrownAT]

At this point "with an army of luna subagents" really is the answer to a lot of questions.

Evaling your MCP or CLI, checking a bunch of UI operations and grabbing screenshots with browser use, fanning out and doing research, etc. What else are ya'll doing with it?

[Tyler Brown @TylerBrownAT]

And just like that before most Jev powered use cases have truly hit production, competition is heating up. Great to see!

I haven’t seen this much hype around a “new” AI paradigm in years and it’s awesome. It’s so fun thinking through all the new experiences we can build.

[michelle @michellechen]

introducing 𝚌𝚕𝚎𝚏: our first models trained by @cloudflare's workers ai team.

today, we're releasing two fast and accurate decision models that top the benchmarks for quality and latency. use them hosted on workers ai or grab the weights from @huggingface, because we open-sourced it too.
https://t.co/4bKblI3MwN

[Tyler Brown @TylerBrownAT]

The Atlassian experience is now in ChatGPT with the new MCP extension points from the great @mxstbr and team!

A home view where you can get right to work on whatever ya need to get done with one click.

But honestly the best part might be the Composer @ mentions. You can search for work items, pages, and users by name and attach it as context without ever having to leave the chat box.

One of my favorite things I've gotten a chance to work on in a while because I'm gonna use it literally every day.

Check it out! What else do ya wanna see?

[Tyler Brown @TylerBrownAT]

Confluence has gotten faster, like, a lot faster! The view page now loads 2.4x faster than it did in March 2025.

We've been working super hard at this because we know that when people are in the UI these days they don't want to be waiting around.

Is there anything more satisfying as an engineer than working on a problem where you just get to keep iterating and making a number go down?

What do ya wanna see us tackle in Confluence next?

[Tyler Brown @TylerBrownAT]

I'm finding that although Jev isn't "more accurate" than other models, if you have a limited amount of time and tokens to spend on a request (like so many real world use cases!), you can get higher accuracy because you can do so many more runs with Jev.

[Tyler Brown @TylerBrownAT]

@astrofabricai Great question! Jev flagged 99 of 400 pages for review (24.75%). All 99 were cases where review was the expected outcome.

[Tyler Brown @TylerBrownAT]

I've been absolutely loving playing around with Jev, so many possibilities. Sharing a real world use case at Atlassian.

The first case I had to try was recommending where a new page should go in a Confluence space based on it's content. Did some evals with 100 pages and their ai summaries of what they are about (we always have these pre-computed already so it's not just something for the evals) and then ran 400 tests.

Each model got two iterations, a first pass, and then a prompt improvement pass.

The results have me beyond excited. With Jev we'd be able to classify at a scale we didn't think we could offer before with traditional LLMs. Cannot wait to play around with this more. Next up - organizing entire spaces from messy into clean with Jev plugged in wherever we can.

(I've sent Jev over 30 million tokens and spent less than $1.50 - loving that too)

[Tyler Brown @TylerBrownAT]

@RenXLog Totally.. Was a good reminder of how important isolated evals are so you can use the product just like a customer does.

[Tyler Brown @TylerBrownAT]

Dogfooding the CLIs and MCP servers we're building has shown how tenacious agents are at working around problems, and how easy it is not to notice.

The first time I ran into this, we were just getting started on the CLI and creating a page under a parent was broken. The agent figured out the separate move operation still worked, so it created the page first and moved it under the parent afterwards. I wouldn’t have spotted the bug from the finished page. I only saw it because I was reading the actual tool calls it was making.

Another time, I wondered why my Confluence pages looked better than other people’s. My agent had dug through an internal repo for implementation details missing from our skill. We added those once we realized. Other users couldn’t access that repo, so they’d been missing instructions I didn’t even know my agent needed.

With a UI, I’m the one dealing with the friction. Agents won’t stop until they solve the problem. So they try another operation, find extra docs, then save it to memory for next time.

Daily use still matters, but it will lie to you if you only look at the final artifact. Just goes to show even more why isolated evals are so critical.

Anyone else finding their agent is sneakily working around bugs they didn’t know they had?

[Tyler Brown @TylerBrownAT]

What makes a products MCP feel "good" to use?

Do you actually review the tools yourself to see what they are doing? Or do you just check if your agent says it's struggling?

Are we still as worried as before about tokens now that harnesses have gotten so good at optimizing tool calls?

[Tyler Brown @TylerBrownAT]

@jkatahanas @gabpaiz3 Yeah like @jkatahanas said we have completely rewritten how editing works in the v2 mcp so that it’s MUCH more agent friendly. Please give it a go. It’s actually out of preview and now GA!

[Tyler Brown @TylerBrownAT]

@DrejToolwell @matthewcanham Awesome! If you have any feedback feel free to share it right with the CLIs feedback command or you can always message me or reply here.

[Tyler Brown @TylerBrownAT]

Sharing my favorite twg cli command, and the one my agents use constantly every day:
twg confluence space instructions get.

Its like AGENTS.md for your Confluence space. Never again will you have to tell Claude where to put that new page, just set it up once and it'll always pick the right place. And thats just the start, you can do so much more.

If you check it out I'd love your feedback, just drop it here!

https://t.co/lDNtiHUMTd

[Tyler Brown @TylerBrownAT]

@nichtsalsdavid @matthewcanham Thanks yeah the team says that one makes sense but they are curious if you could share more what you mean on 1? Do you mean unlicensed users who can access the UI but they cant use the MCP?