Back to archive

Thread

3 tweets

1
I don‘t know man. So in my mind notebooks are like console and shell scripts. Good for interactive work and a bit of automation, but not easily testable or reusable.
2
@mucio Next step up would be to extract the „good stuff“ into a library/jar to make the notebooks „simple“ again. Once you have that, you‘ll run into the challenge of painlessly reloading etc.
3
@mucio I think other than that you‘d want to get to something like airflow eventually where you can programmatically define dependencies, have proper tracking and monitoring etc.