Flow PHP

The most advanced data processing framework for #PHP by @norbert_tech

[Norbert Orzechowicz @norbert_tech]

https://t.co/jXMPANwOFd - first results of @flowphp benchmarks against DuckDb 2.0 / Spark 4.0 / Polars 2.1

PHP is not the most spectacular, but it's not far behind other and in some places even beats them 💪

[Norbert Orzechowicz @norbert_tech]

whats being removed is inefficient data format 😅 Just simply converting csv to parquet will give you that.

And if you by any chance work with #php you should check @flowphp which can convert 80mlns csv rows with schema inference into parquet in few seconds 😏

[Norbert Orzechowicz @norbert_tech]

Something BIG is coming to Flow #PHP with next release 💪

[Norbert Orzechowicz @norbert_tech]

Next release @flowphp is going to be fully schema driven! Historically extractors could yield different schema per batch.
Now all extractors are going to be self descriptive, meaning they always yields rows with the same shape.
Thanks to this we can know the output schema 👇

[Norbert Orzechowicz @norbert_tech]

If he would go with @flowphp there would be no outage, no memory abuse, just clean, light, stable stream of data moving it from oneplace to another. We also do support KeySet pagination style natively

https://t.co/aOL6k5n2No we even have a blueprint that has it all in one place

[Norbert Orzechowicz @norbert_tech]

I'm very excited to announce the launch of #Flow PHP Work-Shop

https://t.co/8IMRhW6cEr

The goal is to make some extra money to cover costs of building Flow.

Flow has always been Open Source, and now you can help me keep it this way!

[Norbert Orzechowicz @norbert_tech]

Flow #PHP just got much faster, it also received it's own dedicated binary, immutable, self descriptive and evolving data format, called Floe.

You can read more about it at our latest blog post: https://t.co/7aeGyxu3Fv

[Norbert Orzechowicz @norbert_tech]

Flow #PHP 0.41.0 is out!
I managed to put together a quick blog post summarizing the most important changes / additions.

Read more at: https://t.co/u6i0HyNU68

[Flow PHP @flowphp]

DX was never better! 🤩

[Norbert Orzechowicz @norbert_tech]

I migrated entire Flow #PHP into Mago Linter / Formatter / Analyzer.

What before was taking more than a minute now takes 5 seconds.

One tool replaced 3 providing insane performance boost. Since Mago is also very strict it helped me to improve Flow code quality 💪

[Norbert Orzechowicz @norbert_tech]

Working with #PHP, #PostgreSql and #Symfony?
You might want to check https://t.co/AR3nTtZJXa

- query builder with full syntax support
- migrations
- define your schemas in php/yaml
- SQL AST Parser
- Client that supports static analysis types narrowing

[Norbert Orzechowicz @norbert_tech]

Apache Arrow extension for #PHP is now available also as precompiled binaries.

Just download the right one from:

https://t.co/zLjvfiQw02

and enjoy parquet performance/efficiency unseen anywhere in PHP when it comes to files 💪

[Flow PHP @flowphp]

Arrow C++ #PHP Parquet extensio is going to be a performance game changer 🚀

[Norbert Orzechowicz @norbert_tech]

flow-php/parquet got another significant performance boost 🚀
The next step is to create an extension for apache arrow cpp and make parquet in #php even faster!

[Flow PHP @flowphp]

We also moved all our examples to playground!
Now each of them can be executed directly in the browser :)

Layout of documentation also got slightly better

[Norbert Orzechowicz @norbert_tech]

Flow #PHP 0.33.0 was just released 🎉

This update was mostly about stabilization of flow-php/telemetry package and bug fixes.

Please find a full list of changes at: https://t.co/vXkyrOghMI

[Flow PHP @flowphp]

Because PHP can into data 💪

[Norbert Orzechowicz @norbert_tech]

I wrote a new blog post about how to approach preparing data for analysis in distributed transactional systems.

https://t.co/mknuhntfFw

Available in: 🇵🇱🇺🇸🇩🇪🇫🇷🇪🇸

[Flow PHP @flowphp]

Join and learn how to process data like a pro! 💪

[Never Code Alone @nevercodealone]

Big data, small data, every data #php

[Norbert Orzechowicz @norbert_tech]

1/9 🧵

Parquet is an amazing file format, almost like an immutable database in a single file.
One of the cool features is that each column can have different encoding and compression.

Let's take a look at Delta Binary Packed encoding.

[Flow PHP @flowphp]

Help us decide! 🤗

[Norbert Orzechowicz @norbert_tech]

I'm working on adding Match/Switch feature to Flow #PHP for even better DX.
I'm a bit on the fence with DSL since `match` and `case` are reserved keywords.

Looking for more creative ideas ❤️

https://t.co/A8auIcn4MJ

[Norbert Orzechowicz @norbert_tech]

I'm still working on redesigned types system for Flow #PHP.
You can check my progress here: https://t.co/v39yFtLI0z

I'm mostly focused on simplifying types and turning them into fully standalone package that helps with types assertions and coercions

[Norbert Orzechowicz @norbert_tech]

Version 0.15.0 is here! 🎉

Heads up: There's a BC break—schema-related classes have shifted to a new namespace. Dive into our upgrade docs for the scoop.

Spotlight on this release: Exciting updates for Dbal and Google Sheets Adapters.

Get the full rundown: https://t.co/o7awQQYP8D

[Flow PHP @flowphp]

Processing large database based datasets is going to be much faster with this key set extractor 💪

[Norbert Orzechowicz @norbert_tech]

Diving into Flow #PHP with a fresh Doctrine DBAL Extractor! Say goodbye to sluggish limit/offset and hello to speedy key-set pagination. 🚀

Mark your calendars for Monday’s release!

Check it out: https://t.co/bTqbSQWcsM