@mikiobraun: "So it looks like you're decomposing the task, but you're act..."

Back to 2022

Mikio Braun

@mikiobraun

Part of a thread

So it looks like you're decomposing the task, but you're actually confuscating the flow of data. I personally find it better if the data flow is always visible on the top level, you process different parts of data at the top level and compose them there.

Sep 07, 2022 · 13:50

Full thread (7 tweets) →

(Hot Take🌶) The call graph for your data pipelines should have depth no more than 2.

Sep 07, 2022 · 13:07

OK, what I meant with that: I frequently see code that does any pipeline that does like: first_we_d...

Sep 07, 2022 · 13:44

So it looks like you're decomposing the task, but you're actually confuscating the flow of data. I p...

Sep 07, 2022 · 13:50

Put in a different way: every level should work on some level of abstraction that makes it possible ...

Sep 07, 2022 · 13:50

If you realize you need to break out complex processing into subfunctions, do so in a way that is se...

Sep 07, 2022 · 13:50

View all 7 tweets in thread