It can take months to perform the preparation steps that underlay the mind-boggling numbers quoted in this post.
https://t.co/j8vuL8wNKx has reduced that to a week and change, and getting shorter every day.
So if semantic objects aren't schema objects like tables and columns, what are they?
In short, they are units that link a concept in the real world to data in the database when those concepts need to be modeled as logic rather than as a column.
You heard that right... 1/n
Schema vs Semantic Layer vs Context Layer
The semantic layer isn’t just a layer of semantic information on top of your schema (database objects).
It’s also new layer of objects that do not neatly “fit” within the rigid confines of data structures.
Instead, they align to reality, to the nouns and their characteristics, and how they interact via verbs.
The objects are organized by an ontology, and are operationalized in the semantic layer.
And all of these are extensively described for humans and machines in the context layer.
Data is in the schema. Semantic objects are defined in an ontology and operationalized via a semantic layer that binds semantic objects to schema objects. And all of these things, their characteristics and proper usage, are described in the context layer.
That is why our tool is called https://t.co/TBEWa1IYzH. It’s where the schema meets the semantic.
Bad news: AI in data doesn't work without context.
More bad news: Context does not exist because humans can't stand to constantly update it, so the context layer must be automated.
Good news: It already is. https://t.co/mOiNtxsnCi
the super hard relational benchmark: a benchmark that ai can't solve on its own.
we put everything difficult about enterprise data into a single benchmark, and we're building what we hope is the most effective way to automate getting the context layer enterprise ai needs.
Enterprise data warehouses are where AI performance claims go to die. Existing benchmarks hand models the metadata they need, like foreign keys, column descriptions, evidence hints, and test little more than the ability to write correct SQL.
it's frustrating how many people "succeed" in life by simply copying what others are doing
that's not how variance works.
you're aiming low, you just don't understand it.