Apache Wayang

Apache Wayang is the API of AI, cross-platform data processing to train large models. Star / fork us on GitHub:

[Apache Wayang @apachewayang]

Apache Wayang isn’t just limited to FedML and Data Federation; it also enhances our taste and lifestyle. Solving real world data science problems!

https://t.co/EndvJUCuaR

[Apache Wayang @apachewayang]

@mapredit Thank you, and all other committers and contributors to make this happen. Over four years research, testing, coding. FedAI is coming! Open source always wins.

[map/reduce @mapredit]

@apachewayang 1.0.0 build successful! The backbone for AI, decentralized data processing to access data in silos a dev can't reach typically.

[map/reduce @mapredit]

@apachewayang v. 1.0.0 successfully compiled. The backbone for ASI / AGI infrastructure, devs can now reach data which is typically not in reach, like protected silos, and execute processing at the source, in-situ. FedAI is coming soon!

[Apache Wayang @apachewayang]

LLM's struggle to show their business benefit. Why? Data access. AI needs the right data, in a suitable format at the right time. Read how @apachewayang helps to solve that: https://t.co/NiRUbnSr45

[Apache Wayang @apachewayang]

Our newest blogpost, written by Wayang developer Juri Petersen, explains how python works with Apache Wayang, and how we enable JSON conform UDF within a wayangPlan. #data #opensource #apachewayang
https://t.co/P9hU3Oi6ra

[Apache Wayang @apachewayang]

Read part 1 of the blog series, written by Dr. Mirko Kämpf from ecolytiq, about implementing a cross-organization decentralized data processing scenario. #apachewayang #kafka #data
https://t.co/XIJsaqX9uT

[Apache Wayang @apachewayang]

EarthObservation / ESA / Copernicus: AGORA plugin (Apache Wayang): https://t.co/50Z0bV594M

[Apache Wayang @apachewayang]

Integrate AI with IoT, the federated way:
https://t.co/cDBxwG39pT

#iot #spark #bigdata

[Apache Wayang @apachewayang]

We updated our website -> https://t.co/cDeJgGKtvX <-. More documentation, much more easier to contribute and add PRs.

[Apache Wayang @apachewayang]

Apache Wayang now enables AI/ML training and inference in Spark for federated learning at the enterprise level. The team just merged PR388: https://t.co/Q7iLT3wkdf

[Apache Wayang @apachewayang]

@DatabloomAI Thank you!

[Apache Wayang @apachewayang]

We merged 380: #380 Added a new plugin to support different jdbc platforms and multiple instances of same DBMS. Wayang now adds support for multiple spark and jdbc context in one wayangPlan().
https://t.co/L9LsTvWf2q

[Apache Wayang @apachewayang]

ML4ALL implementation merged, it's the code to our reseach paper, now merged and fully operable.
https://t.co/snPcEIITSL

[Apache Wayang @apachewayang]

Now you can run kmeans natively on sparkML! This improvement speeds ML operations massively up. Additionally, with wayang you can have multiple _different_ spark version in one plan, that makes wayang really powerful for cross-spark ML.

https://t.co/kiYS6edmOx

[Apache Wayang @apachewayang]

Apache Wayang: A Unified Data Analytics Framework - research paper now released with Sigmod Record => https://t.co/WJnSHEuVCs

[Apache Wayang @apachewayang]

Wayang AgoraEO Plugin: The Framework for Scalable EO Workflows

"We recently proposed AgoraEO, a decentralized, open, and unified ecosystem, where users can find EO elements, compose cross-platform EO pipelines, and execute them efficiently.
https://t.co/ETYDN88Ekx

[The ASF - Apache Software Foundation @TheASF]

#CommunityOverCode NA, our flagship event, is only TWO MONTHS away! Join us in Halifax 🇨🇦 for four days of sessions, with tracks focusing on Search, Big Data, Streaming, IoT, Community, Fintech, and more.

🎟️ Register now! https://t.co/cF3gWLPgok

[Apache Doris @doris_apache]

#DynamicPartitioning in Apache Doris
It means to automatically create and delete data partitions based on the user-specified rules. You can enable it upon data creation and specify the partition TTL (time to live) in the statement.

#database #DataScience #Analytics #SQL

[Scalytics @scalyticsAI]

Apache Wayang enables cross platform data processing, star it via: https://t.co/JYXkjJlOjT #dataprocessing #bigdata #analytics #hybridcloud #developers via @apachewayang