vigneshc

Engineering @ Azure Streaming

[vigneshc @vigneshc]

New blog post.
https://t.co/nqGEDzkqX6

[Yingjun Wu 🤘 @YingjunWu]

The world wants a much better compaction tool for @ApacheIceberg (and all other table formats). Running @ApacheSpark for compaction is overly complicated!

[vigneshc @vigneshc]

@YingjunWu @mooncakelabs @duckdb @ApacheIceberg Also, unlike delta support which leverages delta rust kernel from delta repository, iceberg plugin seems to be all in ducksb repo. Not sure how this would evolve in future and keep up with iceberg features.

[vigneshc @vigneshc]

@YingjunWu @mooncakelabs @duckdb @ApacheIceberg Ducksb for iceberg is very appealing. It has core aspects missing at the moment, but being worked on.

Catalog support is in PR, https://t.co/TyXnqckJAu
Write are not supported yet, makes it harder to use beyond adhoc querying.

[vigneshc @vigneshc]

@andrewlamb1111 Is the use cases for the rust iceberg library to make other rust based systems like datafusion work well with iceberg?

[Chris @criccomini]

SlateDB 0.3.0 is out! 65 PRs with 10 first-time contributors:

- Atomic batch writes
- Transactions foundation
- Checkpoints foundation
- Index/bloom filter caching
- Prefix encoding
- TTL
- Fizzbee proof
- Error improvements
- Throttling improvements

https://t.co/UmdNwtibG8

[vigneshc @vigneshc]

@gunnarmorling Netherite, engine behind azure durable function is another example.
My notes on the paper, https://t.co/ynFccLQ6fQ

[RisingWave @RisingWaveLabs]

🚨GET SET AND REGISTER NOW! Join RisingWave, @motherduck @confluentinc on Nov 21st for ICEBERG STREAMING ANALYTICS MEETUP
👀Don’t miss out on the latest in streaming analytics and a chance to connect with the data community! 👇
https://t.co/CrvIl4NF5P
#DataStreaming #Meetup #Analytics #Kafka #SQL

[vigneshc @vigneshc]

@debasishg This podcast is a different take on watermark by @MatthiasJSax

https://t.co/bOAxqpOfFb

[vigneshc @vigneshc]

@debasishg Few more.

One SQL to rule them all, https://t.co/A0K4SHCJor . It has a concrete definition of how watermark and time varying relations work together.

This video, I think is about how these concepts took shape in snowflake https://t.co/wW0P8jMvey

[vigneshc @vigneshc]

Very good concept, awesome songs and documentary.

[Sanjay Subrahmanyan @sanjaysub]

Anbenum Peruveli is an album that is a result of days of talking, discussing, jamming, recording, remote recording & delivering. It was 11 months back when I approached Sean Roldan with a proposal to do an album of Vallalar songs. It was a project that was conceived & commisioned by Vignesh Sundaresan & his Onemai Foundation. As we sat & discussed on what we wanted to do, Sean suggested we form a band specially for this purpose. He wanted to go totally old school – get the band together, jam around, come up with the songs before recording. The first meeting was with Sean, Vikram (Guitar) & Ramkumar (Drums) at Beachville café. As we bounced ideas we knew we were on to something. I was the old fogey desperately wanting to get out of my comfort zone. Sean was the brain who would put it together. Vikram & Ramkumar were seasoned professionals who realized what this could be and where it could take us. We needed a bass player to complete the circle & Vikram suggested Shalini Mohan from Bangalore.
The driving force to the whole experience was Sean & his restless, boundless energy and creativity. We were not even sure what genre we were aiming for. Just mentioning rock, celtic, jazz, blues in the conversation resulted in phrases, grooves, beats & notes taking form. It was a wonderful process of creation with a composer leading it & the band following suit adding a note here or an idea there. At the end when we sat & finished the whole recording sessions & heard the first scratch it was one of the most fulfilling of experiences.
Of course more work was to be done. Kalyani Nair joined the project to assist in the arrangements & remote recording with an orchestra in Macedonia & Celtic folk instruments at Abbey Road studios, London. The whole process was also simultaneously video documented by a team lead by Director Rafiq Ismail. The result is the documentary film that was released. Besides the team also created 6 music videos of the songs visually showcasing the brilliant creative interpretations by different artists and artistic forms. The website https://t.co/eQ9i4mt4qU will house the entire project including the album, music videos & the documentary film.

[Delta Lake @DeltaLakeOSS]

Capture Event Hubs data in #DeltaLake format with Stream Analytics no-code editor! ➡️ https://t.co/DYuJhWsutp

#oss #opensource #linuxfoundation #streamanalytics

[vigneshc @vigneshc]

@taggy @prasanna_says @remarkablepaper Did you end up buying it?

[vigneshc @vigneshc]

@pankaj Was listening to similar one in spotify, mission ISRO by Harsha Bogle.
Would love to watch this when it is in prime video or netflix!

[vigneshc @vigneshc]

Two videos about technical presentations. https://t.co/azkX2egqAW
https://t.co/muS7OLggVc

[vigneshc @vigneshc]

Post about Reading research for software engineers by @MarcJBrooker.
https://t.co/YmNBvJFy55
I use reading groups as motivation and for discovery. Summarizing in a journal helps with retention and future reference for me.

[vigneshc @vigneshc]

Great read on challenges with distributed remote teams by @jsensarma. Lot of it also applicable to remote work for centralized teams in recent times. https://t.co/U30gEzufcc

[vigneshc @vigneshc]

@krishashok @krtgrphr Is salem junction an audio podcast? Where can I get previous episodes?

[vigneshc @vigneshc]

Great podcast on a deep tech startup @niramaianalytix covering practical challenges, cultural factors in addition to tech. Very interesting company and team.

[Indian Startup Show @Indianstartupsh]

#podcast Dr. Geetha Manjunath @niramaianalytix on changing the way cancer is detected & being one of the top deep tech #startups in #India

w/t
- AI/ML models
- B2C sales lifecycles
- AI for river blindness
- Thermal imaging
- Startup advice!
- Scaling

https://t.co/JLugWUkHTw

[vigneshc @vigneshc]

@MohapatraHemant @LadyAshBorg @lightspeedee @LightspeedIndia Would love to listen to this one and the one by balajis. Is there is a plan to make the audio available somewhere?