Flow PHP

The most advanced data processing framework for #PHP by @norbert_tech

[Flow PHP @flowphp]

DX was never better! 🤩

[Norbert Orzechowicz @norbert_tech]

I migrated entire Flow #PHP into Mago Linter / Formatter / Analyzer.

What before was taking more than a minute now takes 5 seconds.

One tool replaced 3 providing insane performance boost. Since Mago is also very strict it helped me to improve Flow code quality 💪

[Norbert Orzechowicz @norbert_tech]

Working with #PHP, #PostgreSql and #Symfony?
You might want to check https://t.co/AR3nTtZJXa

- query builder with full syntax support
- migrations
- define your schemas in php/yaml
- SQL AST Parser
- Client that supports static analysis types narrowing

[Norbert Orzechowicz @norbert_tech]

Apache Arrow extension for #PHP is now available also as precompiled binaries.

Just download the right one from:

https://t.co/zLjvfiQw02

and enjoy parquet performance/efficiency unseen anywhere in PHP when it comes to files 💪

[Flow PHP @flowphp]

Arrow C++ #PHP Parquet extensio is going to be a performance game changer 🚀

[Norbert Orzechowicz @norbert_tech]

flow-php/parquet got another significant performance boost 🚀
The next step is to create an extension for apache arrow cpp and make parquet in #php even faster!

[Flow PHP @flowphp]

We also moved all our examples to playground!
Now each of them can be executed directly in the browser :)

Layout of documentation also got slightly better

[Norbert Orzechowicz @norbert_tech]

Flow #PHP 0.33.0 was just released 🎉

This update was mostly about stabilization of flow-php/telemetry package and bug fixes.

Please find a full list of changes at: https://t.co/vXkyrOghMI

[Flow PHP @flowphp]

Because PHP can into data 💪

[Norbert Orzechowicz @norbert_tech]

I wrote a new blog post about how to approach preparing data for analysis in distributed transactional systems.

https://t.co/mknuhntfFw

Available in: 🇵🇱🇺🇸🇩🇪🇫🇷🇪🇸

[Flow PHP @flowphp]

Join and learn how to process data like a pro! 💪

[Never Code Alone @nevercodealone]

Big data, small data, every data #php

[Norbert Orzechowicz @norbert_tech]

1/9 🧵

Parquet is an amazing file format, almost like an immutable database in a single file.
One of the cool features is that each column can have different encoding and compression.

Let's take a look at Delta Binary Packed encoding.

[Flow PHP @flowphp]

Help us decide! 🤗

[Norbert Orzechowicz @norbert_tech]

I'm working on adding Match/Switch feature to Flow #PHP for even better DX.
I'm a bit on the fence with DSL since `match` and `case` are reserved keywords.

Looking for more creative ideas ❤️

https://t.co/A8auIcn4MJ

[Norbert Orzechowicz @norbert_tech]

I'm still working on redesigned types system for Flow #PHP.
You can check my progress here: https://t.co/v39yFtLI0z

I'm mostly focused on simplifying types and turning them into fully standalone package that helps with types assertions and coercions

[Norbert Orzechowicz @norbert_tech]

Version 0.15.0 is here! 🎉

Heads up: There's a BC break—schema-related classes have shifted to a new namespace. Dive into our upgrade docs for the scoop.

Spotlight on this release: Exciting updates for Dbal and Google Sheets Adapters.

Get the full rundown: https://t.co/o7awQQYP8D

[Flow PHP @flowphp]

Processing large database based datasets is going to be much faster with this key set extractor 💪

[Norbert Orzechowicz @norbert_tech]

Diving into Flow #PHP with a fresh Doctrine DBAL Extractor! Say goodbye to sluggish limit/offset and hello to speedy key-set pagination. 🚀

Mark your calendars for Monday’s release!

Check it out: https://t.co/bTqbSQWcsM

[Norbert Orzechowicz @norbert_tech]

Flow #PHP 0.14.0 is out now! 🚀 Dive into enhanced safety with all math operations now powered by https://t.co/x6cGMRnAlt, ensuring secure float handling.

[Norbert Orzechowicz @norbert_tech]

Flow #PHP version 0.13.0 has just dropped under our revamped release cycle!

Dive into all the details on our GitHub release page: https://t.co/siqyGq0MpR

Here's what's new:

[Norbert Orzechowicz @norbert_tech]

Exciting changes ahead for the Flow #PHP Project!

Starting today, get ready for fresh releases every two weeks 🚀

Of course, we'll swiftly tackle any critical bugs or security issues.

Dive into the details here: https://t.co/fy7xJsMHVK

[Norbert Orzechowicz @norbert_tech]

When diving into datasets, defining a schema is your go-to move for reliability and consistency.
Flow #PHP CLI app can effortlessly detect schemas from any compatible data sources.

Today, let me introduce you to column statistics:

[Norbert Orzechowicz @norbert_tech]

Hey, don’t do that! High coupling with the framework makes maintenance and upgrades a nightmare, and it also limits your system’s scalability.

I know it’s a quick way to build something, and it might work for a while, especially if you’re building a CRUD app.

But here’s the thing: a good framework should stay out of your way. Frameworks are meant to solve specific problems, not be the center of your system. Laravel and Symfony are great for:

- UI (CLI/Http)
- Routings
- Backend HTML rendering
- Handling and validating input/output

And probably a few other things.

Try to build your system’s core as if it knew nothing about the framework. That way, you’ll have a more flexible and maintainable system.

That’s what sets software engineers apart from "framework developers".

Frameworks come and go, like Zend. Don't let your system die with the framework (or framework version)

[Flow PHP @flowphp]

How to import large CSV datasets to a database in #php

[Norbert Orzechowicz @norbert_tech]

New blog post, data processing in #PHP!

https://t.co/MPK54E3VPz

[Norbert Orzechowicz @norbert_tech]

Nice one! I'm glad to see posts about data processing in #php

For those who want to take data import to the next level, scaling up to dozens of millions, https://t.co/nlMT69mATb is a solution.

It supports all popular data formats, including CSV, JSON, DB, Elasticsearch, Parquet, and XML. It can also be easily integrated with Salon PHP to bring data from external APIs.

This allows for on-the-fly data transformations with powerful schema evolution with minimal resource consumption.

[Norbert Orzechowicz @norbert_tech]

@christophrumpel https://t.co/ASxJ5KcudY is your solution for importing data from any format in any size!

I just wrote an article precisely about importing data from a csv https://t.co/MPK54E4tF7