(Hot Take🌶) The call graph for your data pipelines should have depth no more than 2.

Sep 07, 2022 · 13:07

OK, what I meant with that: I frequently see code that does any pipeline that does like: first_we_d...

Sep 07, 2022 · 13:44

So it looks like you're decomposing the task, but you're actually confuscating the flow of data. I p...

Sep 07, 2022 · 13:50

Put in a different way: every level should work on some level of abstraction that makes it possible ...

Sep 07, 2022 · 13:50

If you realize you need to break out complex processing into subfunctions, do so in a way that is se...

Sep 07, 2022 · 13:50

View all 7 tweets in thread