Brim Data

The company behind Zed a schema-less, fully-typed data lake
- a pipeline query language
- a unified family of data tools: zq, zed, zui

[Brim Data @brimdata]

The little UI details...

Also, we're working on bringing an "inspector" view to the Zui detail pane in the right sidebar, much like the "inspector" view in the main results, but for only the selected value. Stay tuned.

[James Kerr @specialCaseDev]

This was hard to get right...

#react #webdev #css #UI

[Brim Data @brimdata]

Love this quote from a happy zq user! We expect Zed is going change some norms in the data world.

#DataEngineering #DataScience

[Brim Data @brimdata]

We are now creating Apple silicon builds for Zui.

We previously only built for Intel and relied on Rosetta to run on the “M” chips. If you are on a newer Mac, you’ll enjoy a performance boost thanks to our friends in Cupertino.

You can find your platform on our download page.

[Brim Data @brimdata]

@wgeary What software was used to create this?

[Brim Data @brimdata]

@simongerman600 This is beautiful.

[Brim Data @brimdata]

Red squiggly lines!

The Zui app can now detect errors in the query and mark them up within the query editor as you’re writing. It can underline your semantic errors in addition to syntax problems.

Thanks to @MattNib for the /query/describe endpoint.

#datascience #dataviz

[Brim Data @brimdata]

@bibryam Perfect description. Although Java & Kubernetes can actually die and the world would be just fine.

[Brim Data @brimdata]

@samcodes_io So true.

[Brim Data @brimdata]

@gunnarmorling Why do we think that everything must do everything?

[Brim Data @brimdata]

Fresh off the build servers!

A new Zed and Zui release.

Here are the best parts:

1. Inline Editor Errors
2. Apple Silicon Support
3. Redesigned Settings
4. JSON Pretty Print CLI Option

Read the details on the Brim Data Blog: https://t.co/lCaoJs75l2

[Steven McCanne @SteveMcCanne]

@ankrgyl @datadoghq @splunk @braintrustdata Turns out you can build a high performance, vectorized query engine (development underway) where data self-organizes around its types instead of externally defined schemas. We call this super-structured data. https://t.co/ZWRitPFOaC

[Brim Data @brimdata]

@joe_hellerstein Boring software to news reporters means stable, finished, heavily relied upon software to developers.

[Brim Data @brimdata]

And as for Zed, we've got language improvements. like nameof() supporting type values and
better scoping in user-defined operators.

The buffer size for "line" input also got bumped up to 25MB.

Full release notes here: https://t.co/42cJF47C9F

[Brim Data @brimdata]

Zui got a big upgrade to the "export results" workflow.

You can now export the results of a query to a new pool, an existing pool , or even your clipboard's paste buffer!

Full release notes here:
https://t.co/UGiEGakkM6

[Brim Data @brimdata]

It's a release day! We've got fresh versions of Zed and Zui up at https://t.co/sPtsuddwCS

Zui 1.7
Zed 1.15

[Brim Data @brimdata]

Pull up the export modal with the keyboard shortcut CmdOrCtrl+Shift+E

[Brim Data @brimdata]

Data has been incredibly easy to load into Zui, now it's just as easy to export it.

Our latest Zui Insiders build includes the option to export the results of a query into a new or existing pool.

Export to Pool Demo

[Brim Data @brimdata]

The whole point of schemas and tables is to have data type certainty. As soon as you put data in a JSON column however, all certainty is lost.

There is even an entirely different query language within SQL you must use to interact with the JSON columns.

If your foundation is built on table schemas, it begins to crack under the weight of complex types like arrays and objects.

With a system like Zed which supports first-class types for primitive and nested data, type certainty returns. Schemas become simple policies determining if data is of a given type, not gatekeepers of saving bytes to disk.

With Zed, the types allow for schemas rather than schemas allowing for types. What an exciting world to work in!

[Brim Data @brimdata]

Here we explore an entire day of public #GitHub activity about (2GB compressed) with Zui and Zed's fuse() aggregator.

With a 4 word query, we can see the "schema" for each GitHub event type.

Zed is a powerful tool for exploring unfamiliar datasets.

[Brim Data @brimdata]

The zed language now has the "grok()" function.

Use it to turn lines of text into structured records.

Here's a syslog example: