@mim_djo@SQLGene It's like saying you should drive a BMW instead of Mercedes. Why? What's the reason apart from personal preference? And saying "just because it's better" is not enough in my opinion.
@mim_djo@SQLGene Of course...I don't think that's the point Eugene is asking about though. As consultants we're trying to provide the best guidance for our customers, and "do it because MS says so" is not great guidance without proof.
@SQLGene@mim_djo Open source but not open source, welcome to the new world Eugene. Matter of time before somebody reverse engineers the algorithm though...I think in this case it's all about the Vertipaq engine and how to make it perform outside of using its own proprietary file format.
@SQLGene@mim_djo Agreed, but I don't think they can do that without giving away some secrets. They ultimately want to give people a reason to use Fabric over any other Data Lake platform, and "Direct Lake" would be one of the few reasons.
@SQLGene@mim_djo I think this is fundamentally the reason for v-order. They couldn't get the Vertipaq engine to perform adequately on Delta Lake with the standard compression & sorting.
@SQLGene@mim_djo My guess, and a very uneducated one for that matter, is that the MS claim that suggests they can get similar performance from direct lake means:
By using their own sorting and compression (v-order), they get very close to the internal Vertipaq file format.
1/2
Do it for your country πΏπ¦ #proudlysouthafrican
How to Braai: Starting the Fire https://t.co/CczPA0BUNa
A feast of culture, braai and fine wine
https://t.co/hk5NqPqevk
The evolution of SAβs Heritage Day https://t.co/6nunE7ngyf
#desmondtutu#southafrica#ubuntu#28twelve
@AndyLeonard All different, depending on the market basket. I think for the top 100 items people buy (usually Basket A) it's probably that, but others it could be as high as 100%.