@mikiobraun

@mikiobraun Twitter Memorial

19,827 tweets · 2008–2024 · 1046 threads

2021

Wordle 193 2/6 ⬜⬜🟨⬜🟩 🟩🟩🟩🟩🟩 Well I guess I was just lucky? 😅
Replying to @soblom
Digital pre-booking?!? That would be so inconvenient, I don‘t even know where to start…
Replying to @thomasfuchs
Yeah my first one was a ZX81, but I might‘ve been 12 or something, so about 35 years ;)
@olafjacobi @Siftedeu IMHO at the core it is commerce, probably highly enabled by tech. But the core they need to get right is commerce.
Replying to @fmueller_bln
The most remarkable thing I heard about Go is that it‘s a boring language. ;)
Replying to @bernhardsson
@calabi_and_yau What is their notion of „acquire?“ In any case I‘m also scratching my head over the location of data cleaning.
Replying to @leonpalafox
Raise you‘re hand if you‘re paying $0.50 per month and for the love of god you have no idea why.
Replying to @mleznik
Mostly on Switch and xbox these days, but I really liked Horizon Zero Dawn.
Bit of a relief that Horizon Zero Dawn: Forbidden West will in fact also be released on the PS4.
Not a very thorough benchmarking in any way, but the computing power is pretty amazing, especially for the CPU, and if you compare to energy/noise! Not that impressive in terms of performance/price, of course :)
So in summary, the M1 Max GPU is about 57% slower than the GTX, but the CPU is 4x faster than the AMD. And the MBP doesn‘t even get hot. You can barely hear the fan.
@lalleal What is needed is products that solve actual use cases and provide a real value add beyond training ML models. Not sure if it is hard to generalize or we just haven‘t found ways to do so yet.
Replying to @lalleal
Definitely. Everyone is still painfully assembling systems based on open source libraries many of which have their origins in research. It‘s not enough to assemble „ML platforms“ that integrate with as many of them as possible.
Replying to @lalleal
Oh yes. Sometimes I wonder for many companies the only time you're actually adding buzzword-y tech is when you build something new. Afterwards, you'll have something that mostly works for you, and you have to weigh that against the cost of migrating.
Replying to @mucio
Exactly! 😅 Oh wait, new idea: NFTs, but for ideas, so people can say "I thought of it first!"
RT @ylecun: World models, intuitive physics, planning, problem solving, discrete search for solutions, continuous optimization of control p…
But yeah, it is difficult. It depends so much on whether your lead can/will make a good case. Timing is also essential. If you finish a great project too early, people are like "but what did they do after that?"
I have to admit I used to think log frameworks were about printing messages based on runtime configuration, hopefully being no-ops if turned off.
Replying to @seanjtaylor
I think the "normal person" is a myth anyway. But I get it. My hunch: even people who look like they can just sit at their desk for 8 hours a day and toil away either work on something that's routine, or are actually struggling just as much, but you don't realize they do.
Replying to @dep4b
@FlaxSearch @ApacheSolr I think the remote code execution is one scenario, another one is to point it to a subdomain you own where the name is some env (like aws secrets). Not even code executed on your machine, but looking at the dns logs you get all you need.
Replying to @mucio
If I remember correctly, entry was free but you needed to register on their website?
Replying to @mucio
I was there, interesting exhibit, information density is quite high, lots of stuff to read.
Replying to @krishnanrohit
@JohnLewisRetail Yeah, absolutely no idea what they hope to achieve with that.
Replying to @krishnanrohit
@JohnLewisRetail It took me years to realize how accomodating the Amazon customer service is.
Replying to @purbon
You know why 5G? So we can get OTA updates in the future! #justjoking #AllesInDenArm
@twiecki To be fair, Firefox has it as well, but it is not as usable IMHO. With Chrome, you click on your profile icon and can switch profiles. You can also give the border different colors, makes it easier to find the right window.
Replying to @twiecki
Chrome (and derived browsers) let you define different profiles which have their own sets of sessions, stored passwords, etc. Each projects gets its own profile and then you never have that „ah sorry, I sent the request from the wrong account“ problem.
Replying to @fhuszar
Looks too similar to the latin letter o. Just wait for small upsilon! Its time will come!
Replying to @vivekjuneja
I'm seeing the word "netscape" in a completely different light now.
Replying to @MobileGeekGirl
Those raised hands always make me nervous. Negotiation who speaks is really difficult because of latency and reduced body language.
@holadiho Definitiv! Keine Selfiewand im Impfzentrum, kein Merchshop am Ausgang… verpasste Chancen!
@holadiho Könnte auch ein Font sein. Und auch wichtig: muss MoDÖhrnah ausgesprochen werden.
Replying to @baggerspion
@therealpadams These new GPU's raytracing capabilities start looking really realistic!
Replying to @flueke
Seltsam, dass die Zahlen weiter hochgehen, obwohl wir nichts machen! 🤷🏻‍♂️
Replying to @paul_rietschka
Yeah. But hardware-wise, this is the future. What I'm most amazed about is how much performance you get at which power (and heat production). We had 8 core CPUs and powerful GPUs before. But having that and the fan doesn't even start. Amazing.
Replying to @paul_rietschka
So apparently it is only 0.02in higher and 0.4 lbs heavier, but of course it feels differently.
@paul_rietschka Okay, I just lugged it to another room because the sun is shining, and it IS pretty heavy. There are also venting slits on lower edges of the sides which aren't very comfortable holding. But yeah... .
Replying to @paul_rietschka
I got the 16 inch as I didn‘t expect to lug it around anyway. I think the biggest change designwise was that the edged don‘t taper off but are simply round. But over all, you get used to it. And the screen is insane (although I mostly use external monitors 😅).
Replying to @paul_rietschka
Yeah, not like I made good use of its power yet. The biggest real world improvement was being able to have a video call and a miro board open at the same time without the fan blaring on 😊
Replying to @paul_rietschka
Yeah. It really is more a high density slab of compute. Like a high end aluminum cutting board. I‘m getting used to it…
The new MacBook Pros are amazingly snappy. The only downside is as more developers are getting them they‘ll be expecting this level of performance.
Replying to @mtantawy
Yeah, I was about to say as if our efforts were doing so well already... 😓
Replying to @Write
@revue All good. Except that I had to scheduled it for tomorrow, because the system said one issue had already been sent today. But no worries, it can wait :)
Replying to @bernhardsson
NTA! But I think tests are also not as effective for people who are vaccinated, at least stories are making the rounds here in Germany of people who were all vaccinated & tested and still half of the guests got Covid after that.
Replying to @fmueller_bln
@x0rg Has anyone already written a Lisp dialect that uses YAML syntax for programs?
Replying to @John4man
I frequently see people getting an instance with a couple of hundred GB of RAM so the data can be loaded into pandas. So yeah.
Replying to @Major_Grooves
Everybody talks about how important it is that people get vaccinated, but it seems like it very quickly got as difficult as it was back in spring.
Current situation with the two remaining Berlin vaccination centers on doctolib: No free slots anymore for people to get their first shot, earliest booster shot on Jan 12. This all feels horribly familiar.
This isn't strictly about ML/AI, but in my experience, making ML work in the context of a company is as much about people as it is about algorithms and technology.
Replying to @kf
In a way I felt Death Stranding came pretty close to a day in the work of a DHL delivery guy. If you ignore all the post-apocalyptic scenery…
Replying to @fmueller_bln
@Infinite_Monkey @GetTheAudience @TomHombergs @DevOpsMetricsHQ Thank you!
@Infinite_Monkey @fmueller_bln @GetTheAudience @TomHombergs @DevOpsMetricsHQ Okay, maybe not 3 weeks ago but beginning of October numbers were pretty steady still. But yeah, exponential growth FTW. :(
Replying to @fmueller_bln
@GetTheAudience @TomHombergs @DevOpsMetricsHQ I'm attending an in-person conference tomorrow. First one since January 2020. I have to admit three weeks ago that seemed like a better idea than right now... .
Replying to @truemped
Ja, dm hatte mal welche für 4€ für 5. Ausverkauft. Bei Amazon gibt es welche so ab 8€/5. Die Apotheke an der Ecke will 4.50€/1…
Replying to @chrisalbon
You mean "Thee thing"? :) Honestly, what is happening, I thought that was a totally legitimate way to put stress on that word.
But it would definitely help if you stopped mislabelling and calling things which are clearly waterfall-ish what they are and not slap the Agile label on everything.
It also depends a lot on how much coordination between teams you need. I think many companies fail at agile because the teams are not cut in a way that they actually can be very agile but depend on each other very much.
I think the truth is that there is no one size fits all process. You need agile when you need to discover what the customer wants and need to be fast and iterate. That big migration that touches a couple of dozen systems? Maybe it is better to take a step back and make a plan.
On the other hand, successful companies like Amazon are known for their "working backwards" process that starts with the big picture, and design documents. And I've seen projects fail because people were not considering how everything is going to fit together.
I've had people talk about "agile execution" after stages of design documents, architecture reviews, etc. Well okay, maybe there is such a thing that's a bit more flexible with picking tasks.
Replying to @mucio
@MicrosoftTeams I now have a defunct account in there I also cannot remove because it is „managed by the org.“
Replying to @lalleal
@lizrice Interesting! I thought most of the low level code is C anyway, and Python is mostly for coordination, but there are probably other kinds of overheads and it also depends on the algorithms you are running…
Replying to @lalleal
What I‘m also seeing is that adoption is much slower than the speed at which new technology is created. I think it is building something new the first time and then endless slow and painful migration - if at all.
Replying to @krishnanrohit
Yep, classic tech approach to fixing a human problem with tech. „The team doesn‘t work well“ - „let‘s use Jira!“ Almost never works.
Replying to @dlowd
I remember friends who studied physics telling me they often set c = 1 because it makes the calculations easier. Forgot if that‘s for asymptotics or what. #metricalltheway
Replying to @mark_riedl
I hope the current chat and video call performance of Teams is in no way indicative of the full VR experience.
I just had my anniversary of working as an independent consultant. That‘s probably another blog post but just today I came across this excellent thread that mirrors my experiences (and a lot more) => twitter.com/mike_julian/st…
My favorite Halloween joke: why do computer scientists mix up Halloween and Christmas? Because Oct 31 = Dec 25.
@astrobassball An applicant once swapped cover letters, I found that totally forgivable, but they were quite embarrassed.
Not only do I know for a fact that there are companies that deploy on a Friday, but there are companies whose approach to support is "we don't do on call, most of bugs are due to deploying something that's broken and we know right away." twitter.com/norootcause/st…
Replying to @fs111
Yeah, let‘s stick with the true and tested stuff! Speaking of, almost the weekend!
Replying to @balazskegl
@martingoodson Yeah, I can see that, too. He's also very focussed on stressing just how great Facebook is because it's make a ton of money.
I get that gaming companies are not cloud savy enough to create another VR 2nd Life, but does it have to be that company?
Replying to @martingoodson
I mean what could go wrong, right? This is not some ploy to make a lot of money, remember, people first!
Replying to @krishnanrohit
@amirhhz I think it should also be something that's out of your comfort zone but not so much that you're constantly worried you'll fail. This is sometimes called "stretch assignment", but that doesn't sound too nice either.
Replying to @noelwelsh
I was thinking about recommending some Rage Against The Machine to my 14yo but then again it's too early?
Replying to @fmueller_bln
Most of the times when discussing how to help teams with fellow architects/principals/staff engineers I end up feeling more like a psychologist.
RT @markscott82: POLITICO was one of several news organizations w/ access to internal @Facebook docs that outlined the tech giant’s role in…
Replying to @fs111
I should, I will... Do you know any good one? It seems hard to find someone... .
Replying to @krishnanrohit
Reading your comment makes me want to read them again! I think I got stuck at the fourth one... no spoilers, but if you make it there, looking forward to hearing your thoughts!
Replying to @krishnanrohit
Read it years ago. I remember enjoying at least the first two or so.
Haven’t seen this before. Absolutely mind boggling. „Trump was so wonderful to write for… he was so refreshing… so authentic.“ As if this was some piece of entertainment that was fun to produce. 🤯 twitter.com/bbcstories/sta…
Replying to @MaineC
@fmueller_bln I agree, probably if you use all the other MS office products. For me usability is already challenged with the pretty sluggish UI, both in browser and as app (although I believe they are really the same thing).
Replying to @fmueller_bln
I don‘t know why people use Teams. It seems to be better… compliance-wise?
Replying to @InkmiHq
@KingOfCoders Wow. Ich kann aber auch verstehen, wie die sich so entwickelt haben, als sie anfingen, gab es vermutlich wenig und die mussten sich selbst was überlegen.
Replying to @InkmiHq
@KingOfCoders Die bauen ihre eigenen Rechner? Keine 19“ Standardracks?!?!????
Replying to @lalleal
@mapflatcom Mail is the original, universal, decentralized messaging platform of the Internet.
Replying to @StasKlymenko
👨🏻‍💻1Gbps - Unlimited (but Cable, so in reality 70-700Mbps) 💶€45 (with phone flat) 🇩🇪 Germany
Replying to @brendantierney
My impression working with people from Ireland is that it always rains?!
Replying to @truemped
Maybe they are able to process language both via audio and visually in parallel pathways?!?! Like people who can play an instrument and talk at the same time?!?!?!
Replying to @oldJavaGuy
I did the same thing. They kept advertising that their ML algorithm can affect millions of people - that's what I'm most concerned about.
Replying to @djpardis
@djpard1s I thought I saw your account blip in and out of existence and wondered what happened.
Replying to @d_stepanovic
It took a while till I realized nobody checks out the branch to run the code. Everyone does just „review by style and mental simulation.“
Replying to @mucio
The police is gonna get you! (Well at least that‘s what some parents tell their kids when they don‘t want to go to school 😅)
Taking all of this into account you can decide what the right path is. Sometimes it is cheaper and faster to have duplicate work. Sometimes it's a really bad idea. But you need to look closely to understand which is which.
Sometimes, the de-duplication requires to build a slightly (or majorly) more generalized piece of software. Which might not make sense or be feasible. It is also not "the simplest thing that works."
Often, the work supposedly being duplicated hasn't happened yet. In that case, you couple two streams of work that were unrelated before. This leads to coordination and synchronization overhead, meaning it will take longer.
First, what is considered duplicate work often turns out to be not exactly duplicate work on closer inspection. So superficially it looks like the same thing, but in reality these are slightly different and incompatible things.
Okay, let's talk about "duplicate work." I've often heard the argument "let's not do duplicate work" to keep teams from doing something. And it seems to make sense. Why re-invent the wheel? But in reality, the picture is often more complicated.
Replying to @seanjtaylor
I got one for my home office. Not bad. But then I realized what I‘m missing most is the talking with others in front of a whiteboard.
@Quesada BTW, a book I really liked on the subject of "perceptual thinking" was "Drawing on the Artist within" by Betty Edwards. Less about stuff like sketchnotes, and more about actual learning to draw, but it has a ton of interesting thoughts regarding the process of drawing.
@Quesada I've met people who are very word-oriented (what's the version of visual?), and they like to write down stuff into heaps of text which I find difficult to navigate. So yeah, personal preferences, etc.
Replying to @Quesada
I'd consider myself a visual thinker, and I think over the years I've just figured out my own way of laying things out on a whiteboard/piece of paper. I think it's highly personal, and also really depends on what kind of "thinker" you are.
Replying to @paulbz
Yeah I always wondered how LTE got in there. Good thing we‘re past that.
Replying to @leonpalafox
Yeah for me also mostly the first company. Must have left a lasting impression :)
From time to time I dream that I have rejoined some of my old companies. I think that's a very specific version of "I dreamt I have to retake that exam." Am I the only one?
I can‘t remember the exact details but a friend of mine tried to add his kids Minecraft account to his Microsoft family and the hoops he had to go through were insane.
Replying to @InkmiHq
@KingOfCoders Not even sure I already saw that… definitely will watch it today.
Replying to @boydroid
Sie wissen es, ich weiß es, jetzt lassen Sie uns mal nicht Schule spielen!
Replying to @InkmiHq
@KingOfCoders I wondered why so many clips of him were shared online… I loved the chemistry he had with Conan O‘Brien.
@sscdotopen But seriously, the longer I think about this, what is happening? Because I don't believe the text was being fed to the network character by character. Were there examples where the text iPod was visible in the text or what is going on here?!
Replying to @mucio
It is custom!!! When I was young we only had 2x2 and 2x4 and that was all we got!! (That‘s a lie of course)
Replying to @muetend
Mir scheint, das ist noch so ein Überbleibsel der Braunschen Röhre, falls das sichtbare Bild kleiner ist. Das ist rechtsbündig mit dem Logo. #cannotunsee
Replying to @zacharylipton
That and he‘s a curse to not properly sanitized SQL queries and JSON payloads.
Replying to @mucio
At the supermarket today, the cashier said „have a nice weekend“ so maybe we‘re closer than it seems?
Replying to @jessetanderson
Yeah and I think it also takes some experience to be able to say no. The default assumption will be that this is how it is done and these are the tools you need to learn.
Replying to @jazzmodal79
Yeah, I was more surprised that they already cut everything up into a dozen dockerized applications - and still haven't even looked at scaling. The better approach would have been a monolith or at least a single docker image IMHO.
And don't get me started about the insane level of plumbing you have to do in Python to get ML done. Switching between frameworks and libraries, reshaping & converting data, etc.
Replying to @DmitryKan
Yeah, and in many cases, you absolutely need to make the upfront investment. And there are legitimate cases to build and sell something (especially technologies) and not focus too much on a working business model. But in that case the investor is the customer.
Replying to @MaineC
@SpectralFilter @hsmw Interesting how time stops some time in the mid 20s :)
@SpectralFilter @MaineC @hsmw Reading glasses was the latest addition to my life that made me feel old :)
Replying to @MaineC
@SpectralFilter I see! And no worries, I wear my grays with pride. I‘ve earned it! :)
My kids when they saw me at my desk in "standing configuration": "Of course you have this nerd stuff like a height adjustable desk" I like how they think nerd stuff is a compliment. #wholesometwitter
Replying to @MaineC
@fmueller_bln @hackingdata Interesting! The link seems to be broken, unfortunately?
Replying to @MaineC
@fmueller_bln True! So I guess the old @hackingdata quote „the brightest minds of our generation are thinking about how to make people click on things“ should be updated to „… destabilize societies and incite riot.“ 😓
Minor things, but I can't get over icons on Twitter now being black but the notification dot still being blue.
RT @seanjtaylor: In retrospect, the idea that developing and producing effective vaccines at scale would, on its own, solve all our problem…
Replying to @ziv_ravid
Such sad news! I visited his lab back in the fall of 2000 and will never forget his hospitality and that one trip we took in his car down to the Jordan valley.
Replying to @purbon
Not really a workshop, more an interview, but yes, looking forward to it!
Replying to @peteskomoroch
@erich_owens It‘s a good thing kids learn about the challenges of identity management at an early age.
Replying to @borisontherun
Ich hab außer der Eröffnungsfeier nichts gesehen. Ich war selbst etwas überrascht. Wahrscheinlich war mein Bedarf nach der Fußball EM gedeckt... .
Me worrying about where to fit in the work for a new project until I realized that the client was from a dream is how my morning went so far.
Replying to @ChadScherrer
The quarters are a game changer! :) In the US I sometimes also got back just an approximate amount. That would be unthinkable in Germany…
Replying to @ChadScherrer
It is. Also gets more funny if you have more complex units than a quarter :) In Germany there's also this thing where you say what you want to get back when you tip instead of saying what you're willing to pay. So you'd give 52 on a bill of 37.5 and say "give me back 10."
It's amazing just what a shitty experience the Amazon Fire TV Stick is. That thing was underpowered before it was released. The latest OS updates make it even worse. You can hear an app's audio play 10s after it was closed. #alwaysdayone
RT @maosbot: The point of GPT3 is to be expensive. Sure, GPT3 has function, but, just like a $3m Richard Mille watch, the function exists p…
RT @mleznik: ppl that don't pull down their masks for face id in public spaces and use the pin instead, you da real mvp! sincerely, touch i…
Replying to @d_stepanovic
@truemped One advantage of procrastination is also that it helps to get more clarity on the requirements.
Replying to @d_stepanovic
@truemped Gotta keep an eye on the procrastinations in progress (PIP)?
Replying to @d_stepanovic
@truemped So you‘re saying me procrastinating is good because it prevents that early bump in WIP? ;)
Replying to @balazskegl
@francoisfleuret Yeah, I also think there is some room for new ideas. You also wouldn't have to cram everything into a week, for example.
Replying to @balazskegl
@francoisfleuret Yeah, poster sessions at NeurIPS in Vancover were brutal. Crammed in, no oxygen, the noise levels, people from the popular posters flowing over to other posters, screaming to explain the same thing over and over again...
Replying to @francoisfleuret
@balazskegl Unless the big shot is hanging out with other big shots at dinner instead of going to the poster session 😅
Replying to @lalleal
So you actually did find compiler bugs (unlike everyone else who only believed they found one 😉).
Replying to @DmitryKan
Yeah the good thing about C/C++ is that you're so close to the machine, the bad thing is you're so close to the machine.
One of my favorite C++ tidbits is that a friend who works in programming language research told me, he once saw a paper on a compile time debugger for template expressions.
RT @johncutlefish: "So I think it’s really important for middle management to feel free to express the truths they’re seeing on both sides.…
Replying to @fmueller_bln
Exactly! Maybe you don't even need to hire that 1 FTE but can scrape it together from five other teams who have "capacity."
Replying to @fmueller_bln
IMHO, that's among the worst, means you take a purely budget based approach.
Replying to @pjozefak
Yeah that's the one thing I don't get why password managers are better. Sure, you have individual random passwords everywhere... then again... .
@zaxtax Then people realized they are „better terminals“ with figures and plots and other stuff, but I think in terms of tool they are a bit incomplete.
@zaxtax I mean notebooks started out as literate computing in the spirit of Knuth, text plus code. I remember how they were promoted for „data storytelling“ ca. 2005.
Replying to @leonpalafox
Yeah, it was hard for me, too. Actually, during the time they became popular, I was looking into approximate counting algorithms and event data, and spent a lot of time with Scala.
Replying to @paul_rietschka
Don‘t want to say too much but I‘d be surprised if it had been about the code :) But yeah, I mean and outside perspective can be refreshing AND things are usually not simply transferrable.
@paul_rietschka Btw, the one thing the „SWE approach to DS“ misses to understand is that it is not enough to „clean up“ research code to put it to production. After you‘ve done that, you often need to go back and work on the next iteration. IMHO that is the big unsolved challenge.
@paul_rietschka I try to structure my notebooks, not copy and paste too much, but in the end, every cell is a bit of the whole thing and I need to mentally track which ones to re-evaluate based on changes. It‘s a bit tedious and could be easier with better tooling support.
@paul_rietschka I personally think that MATLAB was really great as a tool. You had the console and autoreloading of files. Really great to work on something and grow some structured codebase on the side. As a language it was quite limited, though.
@paul_rietschka I also think that notebooks can be great if you know what you‘re doing (prob. true for almost any tool), but there are also limits to what you can do and some things you have to do manually (eg refactorings).
Replying to @paul_rietschka
Totally with you on the research side, and against the swe-ization of DS. MLOps right now sometimes seems like DevOps applying what they learned without deeper understanding of how DS work really looks like.
Notebooks are so prevalent in data science work that it is hard to envision how it could be different. IMHO thoughtwork‘s pieces are sometimes too much taking a purely software engineering point of view, but this is a very relevant article. twitter.com/DynamicWebPaig…
RT @jessetanderson: I’ve partnered with Mikio Braun in writing this blog post that shares both of our experiences when Data Teams add a Dat…
Replying to @wrede
For some reason neither Twitter nor Reddit (which I tried to replace Instagram with) are as addictive it seems 😜
About two weeks in, the emails started coming. "You have unread notifications!" "Look what you're missing out on." By this point, however, I'd rather have FOMO than not being able to see straight. :)
And the amazing thing is: a few days later my eye sight completely returned to normal. I had already seen myself getting surgery to fix the muscles.
Then I read the book Hooked on how to build "habit forming" apps and realized what a hell of a click bait machine Instagram really is. I quit cold turkey.
Now like probably many others I often started scrolling through instagram while still being in bed, without glasses. This means I am looking at something as close at 10cm. I had a hunch this might somehow strain my muscles, but really believed something was wrong with my eyes.
Some days it was better some days it was worse. It didn't affect my working (looking at screens all day, you know), but being outside got really tiresome some days.
No about two years ago I started having problems where I couldn't really align my eyes to look at objects that were far away. I saw two slightly superposed versions. It got worse, sometimes I couldn't really look at things that were as close as 5m.
I'm pretty short sighted. Without glasses, my normal reading distance is something like 10cm. And when my eyes are tired or I am in reading in bed, I often do so without glasses.
Replying to @francoisfleuret
@ylecun Same here, booting up X11 was too costly with only 8MB of RAM. Also, Usenet was better than Web because you could download and offline read.
Replying to @erik_nijkamp
I did indeed (foolishly) write papers (that mostly got rejected) in that timeframe 😅
Replying to @leonpalafox
@revue They probably could. But data governance seems to be more a compliance function. The changes to understanding the value of data also really needs to come from the very top, C-level.
Replying to @arvidkahl
Last time I got on HN I first thought I had been losing tracking data because I could only see today‘s bar.
Replying to @fmueller_bln
I think I saw a version of that table that had another row „is a cute parrot“, ✅, ❌.
Replying to @needthreadle
@anshumanpati6 @JenMsft "Now you need to update your password."
Replying to @vivekjuneja
@truemped 1%! (True story, once the battery in my iPhone was broken or miscalibrated and would go to 1% and then stay there for another 4 hours).
Replying to @lalleal
@data_mesh_learn @fulhack @josh_wills @pwang @cournape True, in the cases I've seen, BI was reasonably well set up, but everything that went beyond it was struggling to make ML fit into infrastructure built for microservices.
Replying to @lalleal
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Looking forward to it! ;) Yeah my impression is that while data quality may be good, even the way of working is quite different for BI and ML. BI is more about providing insights or specific KPIs while ML is much more exploratory.
Replying to @neuroecology
I guess if you're covering thousands of kilometers, it doesn't hurt much to add another 20 to go into some ravine and out, or does it?! But thinking about the deep sea makes me go 😥
Replying to @lalleal
@ctford Yeah, I see a 40% chance the data will be provided through a REST API ;)
RT @dehora: What's a recently¹ published programming/algos/ml/compsci book you've read you'd recommend as foundational or canonical² readin…
Replying to @krishnanrohit
Sorry for plugging another article, but I once did a bit of research and was surprised that prob theory had apparently been Bayesian from the start and then got marginalized by R.A. Fisher‘s „winning“ personality blog.mikiobraun.de/2010/06/bit-ba…
A Bit of Background on "Bayes vs. Frequentists"
I have to admit that I always found the Bayesians vs. Frequentist divide quite silly, at least from a pragmatist point of view. Instead of taking an...
blog.mikiobraun.de
Replying to @krishnanrohit
And then you'll have to deal with Bayesians vs. Frequentists... wonder whether this will be better down the line :)
Just coined the term Wirtschaftszweigweltschmerz: when you're bothered by the general situation in your line of business.
Replying to @krishnanrohit
I legitimately saw this suggested to make discussions more productive, especially when you're in a "strong opinions loosely held" kind of culture.
Replying to @ctford
@lalleal That's sometimes the problem with the character limit on Twitter, barely enough space to provide context what certain terms should mean.
@lalleal @data_mesh_learn @fulhack @josh_wills @pwang @cournape One thing that I also think is quite common is that you have okay or good data architecture, but for BI, and then data scientists can piggyback on top of that. What is your experience with that?
Replying to @lalleal
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Yeah, ideally they work together nicely. But then there are other issues like how team success is measured. If all you get evaluated by is moving the needle on that conversion KPI you probably care less whether some downstream team is making millions with personalization.
Replying to @lalleal
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Yeah. My favorite approach is to think about the long term and then extract the best next step from that, so all is good. :) #alwaysthinkingtoolongterm
@lalleal @data_mesh_learn @fulhack @josh_wills @pwang @cournape But then, as you say, re: the question how to organize this, I am fully with you that one shouldn't cargo cult other practices. And it's interesting to me what you say re: differences between microservice dependencies and data deps.
@lalleal @data_mesh_learn @fulhack @josh_wills @pwang @cournape Frontend teams that use tracking thinking mostly about debugging and tracking their own KPIs but being unaware that many other depend on the data and need consistency or active coordination. In these cases, saying "look, data is part of how you interact with the rest" is a plus.
Replying to @lalleal
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Thanks for sharing all your thoughts! Very insightful! And yes, I agree with your points that public API is not the right level. Just to clarify, I was coming from a point where teams often aren't even aware that the data they produce is used downstream or valuable.
I don't know whether it's the warm weather or the re-openings, but man are there many stressed out people in the streets of Berlin.
RT @Fischblog: Die Tweets unter #IchBinHanna sind schon eine ziemlich deutliche Warnung an alle, die überlegen, nach dem Abschluss an der U…
Replying to @josh_wills
@data_mesh_learn @fulhack @pwang @cournape Well, that’s what it takes to get people to sign up for it maybe. ;)
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Sounded like they really understood the value of data (literally) :) This went all the way to incentives. Being on some of those working groups was associated with very high status within the project, and you'd get on the papers if the data produced scientific insights.
Replying to @data_mesh_learn
@fulhack @josh_wills @pwang @cournape A colleague who did his Ph.D. at CERN told me about their approach to data. Dedicated working groups who were responsible to collecting certain kinds of sensor data, teams responsible for providing "golden" data sets for certain kinds of atomic events, etc.
Replying to @josh_wills
@data_mesh_learn @fulhack @pwang @cournape Yeah, I think ideally the platform shouldn't be mandatory but just so great/painless/awesome that no one would want to use something else lightly.
@data_mesh_learn @fulhack @josh_wills @pwang @cournape Where I'm not so clear reading the article is whether this also means distributed infrastructure. You could also have a central data platform as an enabling structure, but the data on it is owned by different teams. Or does data mesh not even talk about infrastructure ownership?
Replying to @data_mesh_learn
@fulhack @josh_wills @pwang @cournape I think where I fully agree with the data mesh approach is that centralized ownership does not work. I think data needs to be part of the product of a team, and really be treated like a public API.
Replying to @cazencott
Men: Just be yourself and fake it till you make it. Women: Please second guess every single thought and action you want to take.
I have a hunch that half of Andrew Ng's approach to really invest in better data is actually about lowering the Bayes risk of the associated learning problem.
@totopampin @Spotify Are you still onboarding or would you mind if I ask you about some of the recommendations I'm getting? :)
RT @DerLobi: Berliners! I made a little Mac menu bar app that notifies you when appointments in Berlin's vaccination centers open up. Downl…
Replying to @erik_nijkamp
Dang, I knew I should’ve held on to it a bit longer. But it was taking up so much space!
RT @lalleal: @fulhack Yes. As @mikiobraun said, it's a thing for the far future for most. When centralisation becomes a bottleneck with you…
Replying to @bernhardsson
@fulhack Also seems to me like that's the next next next step, many companies I see are still working on their first data lake.
Replying to @krishnanrohit
@richardalow Just plain Safari. Which I guess is already half an ad blocker?
I guess there's a technical reason why most sites ask me to give cookie consent every. single. time?
Replying to @ukgimp
I honestly thought (being European and all) that it's neesh but apparently not.
Replying to @Major_Grooves
@blurofficial @taylorswift13 @Spotify Beyonce and Doobie Brothers apparently for me. Which makes sense to me even!
Replying to @Quasilocal
I once was at a (non-tech) conference where the badges had US state or country on it. When I pointed it out people were like „um yeah that‘s a bit weird“
Replying to @ButterKaffee
@fulhack GPT-3 trained on the totality of the worlds BI SQL statements?
RT @fulhack: People saying don’t use deep learning when logistic regression works aren’t nearly going far enough... 90% of it should be at…
Replying to @Major_Grooves
@malteserberlin I think so, they wanted to see my invitation right at the entrance.
After waiting for two months I finally had the appointment for my first covid vaccination 🎉 Kudos to @malteserberlin for flawlessly organizing the vaccination center at the Messer Berlin! It was absolutely frictionless and had a very relaxed atmosphere.
Replying to @joe__six
Zahlen steigen wieder? Wie kann da sein? Das ist ja fast, als gäbe es einen Zusammenhang zwischen Öffnung und Inzidenzen?!?
Replying to @fs111
@Dropbox I have this pet peeve that some products are just finished and the product should enter "maintenance mode" and teams be scaled down or reassigned, but that never seems to happen.
@erik_nijkamp Reminds me of when an epoxy factory burned down in Japan which was responsible for nearly 50% of the world's production back in the 90s and RAM prices spiked for a while.
Replying to @fs111
@Dropbox What essential feature has Dropbox added in the past... 2 years? Maybe it is essentially #goodenough?
Why is the Xbox Series X and the PS5 still not generally available? And don‘t say crypto, it‘s not like Sony and Microsoft have to snag up their chips on ebay ;)
Asking why we still have restrictions although covid numbers are down is like saying let‘s turn of the heating in winter because the room is warm. It‘s a closed loop control system. Unless the weather is changing (vaccinations, testing), it‘ll get cold again.
Replying to @lalleal
Yeah, Big Data converging to "scalable SQL" was definitely good for adoption, but bad for taking the next step.
Replying to @lalleal
Yeah, I often see a gap between in-memory tools like pandas and scalable processing that I thought was closed years ago, but apparently not.
Replying to @lalleal
Thanks for sharing all that! I'll have to process all of that... maybe write a blog post ;)
RT @joe__six: how ugly can a language be? #PHP #phpUnit: hold my beer https://t.co/aPmqO8GWjI
Media
Replying to @joe__six
What? Are these some Unicode shenanigans? I can't see a difference... .
@lalleal There were times when people said "don't we just need a notebook server and the data scientists are happy?" In a way, we got that, but with all the shortcomings to be expected.
@lalleal Unfortunately, some of the marketing is even too successful. I hear people suggesting to build "feature stores" way too often, especially when it is pretty clear they don't even know what it means.
Replying to @lalleal
Thanks for mentioning that aspect. I was thinking more in terms of "the only way to sell it is SaaS", but I fully agree that a completely different set of challenges is about culture and organization.
Replying to @lalleal
Interesting point, how did Hadoop manage that? Because it didn't have enough separation between accounts?
Replying to @leonpalafox
Unfortunately not just the Mexican government… I heard there are still freelance work contracts out there that formally require you to list all OSS you want to use.
Replying to @leonpalafox
Oh wow. I thought this „we cannot use open source because we need a maintenance contract“ was a thing of the past.
Replying to @leonpalafox
Yeah, there are a few, databricks, is another one. But they also have some of the most aggressive sales people I know :) Snowflake comes to mind, but it is also a SaaS offering.
Replying to @truemped
Yeah, I guess if you're used to everything taking forever... you can also build it over the weekend ;)
Replying to @truemped
You mean me thinking something could be done, or that they think they could do it themselves? ;)
The weird thing about the data science tooling landscape is that I think there could be some cool work done to improve it, but it seems very infeasible economically.
Replying to @Bediko
Ich weiß noch als es bei mir nur um Big Data ging und ich dachte, es sei ein bisschen viel…
@bobbruno70 Or what about those that claim „we track data to give you the best experience“ or „power ads so you can have this content for free?“
Replying to @bobbruno70
I was wondering what others are. I think the „OK“ and grayed out „cookie settings“ => „disable all“ => „save“ is lawful evil. Chaotic evil is maybe just an „Ok“ button. Lawful good is saying „we just wanted to way we don‘t track any data“?
Replying to @nheudecker
Yeah, I agree. To be honest I‘m not sure if the current version of MLOps is scoped in the best way. But I also believe that VC funding is not always the best way to build a company. I mean what do I know, but yeah. ;)
Replying to @valgog
@Doctolib_DE @truemped Btw, this kind of feature would also greatly help the local doctors. At least mine seems to be totally overwhelmed organizing this. Last time I checked they said they could offer an appointment on fall or winter (!)
Replying to @valgog
@Doctolib_DE @truemped Definitely not a concert! I was thinking more about the kind of… erm… access patterns. I totally agree, this is all unnecessary hard and very badly organized.
Replying to @valgog
@Doctolib_DE I've been discussing this with @truemped, doctolib has been created for a different use case, where you have many people trying to book an appointment with many doctors. They should've gone for concert booking agencies instead. I think some other Bundesland did this.
Has anyone already made an alignment chart for cookie consent banner? I'd say reddit is definitely in the true neutral or lawful neutral corner
Media
Replying to @chrisalbon
I was about to say I‘d be happy of it were just about “a few lines of SQL“.
Replying to @mtantawy
"Quick, before more people are on this route and it gets more crowded!" X-D
Replying to @1meville
Yes, it was good. I mean it‘s not as stylistically refined as William Gibson, but I liked it and the implications made me think.
Just finished reading Qualityland by Marc-Uwe Kling, and boy that was a ride. A fully personalized world taken to its logical conclusion. Ironically, I got the book as a farewell present when I left the search department at Zalando.
Replying to @johncutlefish
@SamueL_WonG_ Yes, it's different from buying, let's say, a new fridge. Orgs need to relearn how to make use of it. And especially when it comes to data, there is a lot of legacy technology and systems to deal with.
Replying to @samuel_wong_
Hopefully yeah. But I often think the pace at which new ML approaches and products are proposed far outpaces how long it takes the average company to implement them.
Replying to @samuel_wong_
To be honest, I think most companies will still look for ways to make their data lake useful in 10 years.
Replying to @bobbruno70
@vetal_don Depends on how much work you put in to „productionize“ the code. But yeah, some version of copy n paste back and forth is necessary. Or maybe some form of intermediary lib that can be loaded into a notebook and also is used in production. But I think there is no standard approach
Replying to @bobbruno70
@vetal_don Yes, I agree and have always thought you get a lot of benefit from moving to proper software projects. What remains unclear to me is how you then go back to exploration for the next iteration of the method smoothly?
Replying to @mleznik
Not back in my days, but that was before tensorflow, when Hadoop was just starting…
Replying to @paul_rietschka
Somehow Spark also ended up converging towards yet another SQL engine. But I‘ve seen that you need to optimize the physical layout quite a bit (partitions etc) for your use case. Other approaches are much more flexible for that.
Replying to @paul_rietschka
Yeah, I‘ve also seen the case where you start with Spark but at some point need to move to Pythonland and hold your data in-memory and it doesn‘t scale. TF is much more naturally able to deal with large amounts of data.
Replying to @paul_rietschka
Yeah and sometimes there is legacy code. And when I mean sometimes I mean always :)
@paul_rietschka I find it interesting that progress in cloud ML platforms seems to outpace how fast companies deliver. So you start, but before you are finished a new services or a new feature comes out and you can barely catch up.
Replying to @paul_rietschka
Varies by project, and also often some custom solution because project predate the latest cloud offerings. Often Spark/AWS Athena, Python/tensorflow and Airflow and a lot of manual plumbing.
Replying to @paul_rietschka
Yeah, definitely get the impression that AWS is a lot of teams running on parallel with variable level of alignment.
Replying to @paul_rietschka
And your experience with the Pipelines? I think they are from kubeflow.
What are your experiences using Sagemaker Pipelines or Google Pipelines? The Python SDK is really nothing I would to interactively work with. Such a huge jump from doing data science in a notebook.
Replying to @jboner
@breckcs Having read Daring Greatly only on the Kindle I wasn‘t aware the cover looks so nice!
RT @jboner: This important post is a must-read if you are managing engineers in some shape/form. I have worn out Peopleware myself, learned…
Friend: New VP Engineering came in, re-org pushed the project back another 3 months. Me: Rebudgeting. Hiring Freeze. Friend: Data Scientists took 4 months and 2 A/B tests to optimize the gif suggestions.
Friend: Yeah, and then it took 2 months to get the project greenlighted. Me: And a frontend migration got in the way which delayed it another 6 months.
Me: So Linkedin messages have gifs now! A friend: Always remember, a product manager wrote a doc, an engineering manager made a plan and five devs worked a month on that. Me: You mean one month for the requirements!
@GeePawHill You're welcome! I read your post "On Agile Methods" the other day too, that was a good read, too!
In my other life I‘m a software engineer at heart and this is an awesome thread on why we need to control the complexity of our releases. https://t.co/Tr7l2I2qyK
Replying to @mtantawy
yeah, I've been always wondering about that and never dared to check.
Replying to @mtantawy
Yeah I got that :) Makes me wonder who stores financial data not in a INTEGER(30,2) field but as cents in an 64 bit integer?!
Replying to @InkmiHq
@KingOfCoders I‘ve been seeing your tweets this morning but didn’t for a second honestly consider that this is really happening.
Replying to @krishnanrohit
There was a guy who tried to build crypto clients from the sources. And just from a software eng point of view, some of the technical decisions were very questionable…
Replying to @krishnanrohit
That‘s a great thread. I also always remind myself that each crypto project is essentially a software project, with everything that implies.
Replying to @paul_rietschka
The great thing about the cloud is that not only your resources are near infinitely scalable, but also your costs :)
RT @PFCdgayo: It is about time. My own contribution to the #TypesOfScientificPapers "Types of (highly cited) Computer Science Papers (wh…
Replying to @IgorCarron
Looks like he picked up some weapon upgrades somewhere around level 5.
@totopampin Yeah in a way I get it because you probably want to keep people from tampering with the sagemaker instances etc. And make more money :)
@totopampin It‘s also a bit cheeky that your instances show up only on your sagemaker dashboard but not on EC2 etc.
Replying to @slyphon
Yeah. I also think the idea with the dockerfiles being like an install script and then adding inheritance and the hub on it was a great idea.
Replying to @slyphon
Sounds a bit like „it would be really bad if that dialog kept popping up every day, wouldn‘t it?“
Replying to @ylecun
@KyleCranmer I see. Yeah, I guess that‘s hard to fight. I remember you had a discussion of alternative review systems, Yann. Do you revisit those from time to time given changes in technology/social platforms?
Replying to @data4style
@benjamingreve @namoraslife Ich kann gar nicht sagen, wie froh ich bin, dass ich mir das nicht mehr täglich anhören muss.
Replying to @pjozefak
Can‘t tell if the dancing scene has been face swapped but he still got moves ;)
Replying to @slyphon
I think I started to watch it when it came out. Time to get back to it! I could also watch "best of Ron LaFlamme" forever.
Replying to @martingoodson
@lawrennd Also true. It seems weird to ban something but only if you use AI to do it.
Replying to @lawrennd
@martingoodson It‘s not just AI. This section on prohibited use is full of poorly defined words. What is „subliminal?“ What does „beyond a person‘s consciousness“ mean? What does „materially distort“ mean? Not saying that it has to be measurable but they could‘ve been less vague.
Media
Replying to @baggerspion
@therealpadams Would you say it is a taboo to say „friggin do your work“ in the US?
Replying to @mistersql
Also spot instances, if you're okay with a 10% chance the house is being shut down while you're in it.
RT @truemped: OH: "Do people really care about retention? No, they are busy hiring"... :evilsmile:
This argument reminds me of Lord of the Rings. IIRC one reason why Sauron was unaware that they tried to destroy the Ring was because he could only think in his terms and destroying something so powerful seemed absurd.
Now Facebook is complaining and saying that Apple just tries to make more money because fewer apps will be able to make money via ads and would need to become paid.
Replying to @baggerspion
@therealpadams I‘d rather they said „you guys are talking too much and not getting enough work done because you‘re always talking.“
@therealpadams FWIW, David acknowledges he's quite political on Twitter and elsewhere, but says he'd rather keep it out of internal communications in the company.
We're living this now, just that my kids are tested in school. On the plus side, I recently checked and Germany is roughly 5 weeks behind USA, so I am starting to believe we'll get vaccinated at some point. twitter.com/mikiobraun/sta…
Replying to @fmueller_bln
Yeah I see it popping up as well. Certainly good to introduce some structure. Then again, it mostly seems to be about how hard do we want to make it to push those bytes around.
PSA: If you‘re a person in a position of power, don‘t „why aren‘t we doing X“ unless you know for a matter of fact that X makes sense.
Replying to @baggerspion
@therealpadams Given that one of their bosses regularly picks fights with everyone on the Internet, I found the „no political discussions“ rule particularly surprising.
RT @M3_Konferenz: Für diejenigen, die noch ein gutes Argument für die morgen startende #m3_2021 suchen, haben wir ein besonderes Schmankerl…
Replying to @mucio
Hypothetically speaking, a different building where you go through business hours to work for the company that pays you.
Replying to @wrede
At this point, wearing shoes for anything else than supply runs in the wild feels unnatural and wrong.
I used to say „not sure whether I would want to work on a nuclear power plant, your mistakes could have real impact there, but ML is save, right?“
Replying to @badnetworker
I see. Reminds me of the tests in Bladerunner. One interesting thing about those I read recently is that in the original movies, they wanted to check for not being emotional enough while in 2049 they checked for signs of being too emotional.
Replying to @badnetworker
Neuromancer Turing Police? It‘s been a while since I read those books. What do they do again?
Ich hab Anfang April meinen Impfcode bekommen, da gab es nur noch Termine Anfang Juni. Mein Hausarzt meint, ich hätte Glück gehabt, sie seien jetzt schon bei Herbst bis Winter. Aber wenn @jensspahn meint, das ist im Mai durch, dann wird das wohl schon stimmen...
Media
Replying to @haddadhesam
Definitely, I always try to move parts to a library. But I also see a lot of copy&paste within the notebook, taking a few lines of code and then exchanging some constants. I get that sometimes you want to move fast, but I also think it can really pay off to start extracting fcts.
OH: "The best alignment meeting is the one you didn't need to have because you were already aligned."
Replying to @lalleal
Definitely, I feel like every language has a more usable core, and it takes some experience to accept that :)
Replying to @lalleal
Yes, I also liked the way Scala CAN be very nice in being type safe without getting in the way too much. Unfortunately there is also stuff around Scala and the JVM which seriously scares of „light users.“
@MaineC @lalleal I think it is possible in jupyterlab with the autoreload extension, but most notebooks I see are just heaps of code with copy&paste all over the place.
Replying to @MaineC
@lalleal I do as well (and fondly!) One thing that matlab just got right was automatically reloading scripts (which was easy because of the simple programming model, unless you tried the „OO“ stuff). So it was easy to do interactive work and build up a library on the side.
Replying to @lalleal
Yeah. I also think that the Python/notebook choice is partly to blame so little engineering practices (modularization, unit testing) make it into data science.
How do you close the gap between the two? Because in data science you're seldom done after you made it to production, but you have to go back and iterate. This could actually be a case where better tooling helps.
The observations on development/production gap are so very true especially for ML in my experience. It's not just cycle times. It's not easy to have unit tests etc. in notebooks, and production code is often a rewrite.
"Someone started with a wall full of post-it notes going “as a user, I want to …". Which I think logically makes sense — you can define a requirement that users should be able to do x, y, z, but you can't define that the experience shouldn't suck."
Software products sometimes don't feel like they're designed to be delightful. This quote ==> hits way to close for me, as I've been there too many times.
RT @itslaurentbtw: Stop asking what people do for work... we’re all out here just answering emails
Replying to @mistersql
One thing that always comes to my mind is that marathon is not a team sport.
Replying to @mucio
Although I also would be interested in the story with the database tables.
Replying to @fmueller_bln
@arvidkahl @KingOfCoders I guess whatever is simple enough it allows one person to master it is still good. :)
Replying to @CubicleApril
@ThePracticalDev Yeah, but you can just deploy that in a container wherever you want because all potential dependencies are already packaged in.
Replying to @fmueller_bln
@arvidkahl @KingOfCoders Started reading Zero To Sold, great book, solid advice, also on product development, etc.
Replying to @krishnanrohit
Read your task, very nice read. And I agree, hierarchies aren't bad, but they are set up to do one thing and as you pointed out in detail, if you want to do something that goes against its purpose, you end up with all kinds of frictions.
RT @dtanzer: "We need new home-office rules for the time after the pandemic." "OK, just allow 100%, like now. Seems to work very well" "N…
Replying to @wrede
Interesting that something as barebones as HN still works so well ;) And there are some interesting replies in the discussion, too.
RT @tef_ebooks: yes, some people enjoy coding. they get to assert agency over the computer, explore an idea, learn new things, and create i…
Replying to @richburroughs
Ironically, we Germans complain a lot about trains, being not on time, being too crowded, not running often enough. But then again, we complain about everything. ;)
Replying to @stilkov
@ewolff In 2021 noch nicht zu wissen wie man Webseiten baut, die auch skalieren... aber vielleicht ist genau DAS was wir u.a. in der Digitalisierung verpasst haben. Und naja, etwas hochzuskalieren kostet halt auch Geld.
@therealpadams @nearyd More favorites: Kevin Spacey at the end “Ok, I stay, but it’s not because of your little speech there, I need the money. After all these years, I still need the money“
(4) there is a “small data regime” (less than 10000 data points) where you can for example look at individual data points and discuss what right label is.
(3) don’t just look for the problems best suited for ML, but also for what the problems of the business are. This is something that is popping up frequently lately. Don’t solve just any customer problem, but an important one.
(2) don’t spend years building up a data infrastructure first. Yes, data is important, but you also need to learn what kind of data you learn by doing small ML projects.
My favorite ideas from this interview: (1) data quality is more important than models. If you have an okay model, rather invest time to improve data quality than tweak the model.
Replying to @InkmiHq
@KingOfCoders Und jetzt kann man problemlos die Bauwerke da oben einordnen. Schon komisch.
So Berlin is moving forward requiring a test from the same day for non essential shopping. There are a couple of testing pop ups throughout the city who are using an online ticketing system, but will it be enough for the 3+ million people here? I doubt it.
On the plus side, others have said that the reason there is no focus on ramping up vaccinations right is because that‘s all been planned and taken care of already. I hope that is true.
RT @martingoodson: Roughly 100mg of glucose per minute. So I guess around 0.05¢? Oh - you mean those other neural networks.
Replying to @jwfbean
Hehe, well that could also be the case :) maybe they just try to one-up each other with GPS art. Maybe there are captains notorious for their drawing skills. „Do you know Matt? He doesn‘t even have to look at the maps, he‘s a natural!“
Regarding Suez, what is the official take on the GPS drawing maneuver before they entered the canal. Childish prank or foreshadowing?
RT @Randy_Au: "Hi can you do me a quick favor? Shouldn't take more than 15 minutes"... https://t.co/HRP3EEkrGP
Media
Replying to @slyphon
Yeah, language designers sometimes see mostly the language but it’s all about the tools and the ecosystem.
@arjmur The one idea that is that of a sketch, an artifact real enough to test core ideas without the overhead of building the real thing. What are our sketches? Architecture diagrams? Prototypes? Spikes? I feel like we could do more there.
@arjmur Another area that fascinates me are movies. It is a much older industry and somehow it feels they have found a set of roles and a process to create something as complex as a movie (which is of course also done once it os done) with some predictability.
@arjmur There was once a huge construction side outside of our office. It was quite interesting to see their progress and compare it to our own internal big rearchitecting efforts.
Replying to @arjmur
As so often in life, it‘s a matter of knowing when to do what. I do believe that there is such a thing as „architected for change“ and I do love the idea of an architect and I honestly envy other disciplines for being able to go from concepts to creation less erratically than us.
Replying to @arjmur
Hot reploy in space? 😅 Yeah it‘s probably also difficult to talk about software in general. But especially in an agile context you‘re expected to change often.
Replying to @joe__six
Not untrue. But I think the rate of change that software systems undergo would mean for a building that you‘re constantly tearing down a few rooms, relocating that staircase, adding windows to walls etc.
Not sure whether this is common knowledge but the main difference between building architects and software architects is that the building is built once in a predictable environment while software often needs to be adapted over its lifetime.
Replying to @ratherbright
Given that I just ordered an Ibanez es-335 clone today in transparent cherry red I‘m probably the last person to try.
Replying to @mucio
Yep, Snowflake, AWS Athena, etc. „just“ scalable SQL execution engines ;) Either SQL is just The Right Thing or we ran out of ideas how to think about scalable computation :)
There are startups who are developing bluetooth powered embeddable testing devices. Only downside: you have to extract it once per week to charge the battery which is a bit messy, but yeah at least the shops are open and I finally got a haircut.
Germany never managed to ramp up vaccinations, we‘re stuck at 32%, but the rapid testing industry is alive and kicking, and numbers have went down.
So I learned that Tübingen is experimenting with no lockdown but daily rapid tests and „day passes.“ That‘s a completely new level of dystopian nightmare. Fast forward to 2022 =>
RT @DigitaleLeute: 🎧 Neue Podcast-Episode! 🎧 Mit @mikiobraun + @gadgetman82 über den aktuellen Stand von #MachineLearning im #ECommerce, wa…
Video calls got better, but there is always that 200ms lag which (“sorry”, “no you go ahead”, “no you.. okay”) that really messes with comic timing.
I realized I really, really need the human interaction. For some time last year I was essentially coding away on a project alone and that was horrible.
I always had a “work setup” at home, but here are the things I bought in the last 12 months: - a 2nd monitor - a laptop stand - a mechanical keyboard - a wired mouse - a webcam - a monitor stand - a height adjustable table - a whiteboard
Replying to @bascule
The more I think of the OSS maintainers as just another team the less I‘m inclined to pull that shit. You wouldn’t go to team Crocodile and tell them „that clearly needs to happen“, right?
Replying to @MaineC
@myrleKrantz Yay, another problem we could solve before we solve the problem how to vaccinate everyone. ;)
RT @SwiftOnSecurity: ・ *゚   ・ ゚* ・。 *・。 *.。 。・ °*. ゚ Android phones are unmaintained…
Replying to @fmueller_bln
@FokusMan @MaineC @mtantawy I‘m also totally fine with whatever vaccine I can get.
Replying to @danam
@pfhllnts I hope you don't just dockerize your ML workloads but at least have kubeflow as well.
Replying to @mtantawy
I thought the main problem is still a lack of supply of vaccines, but I don‘t really know. But yeah, given the workload, using a CDN is definitely better than throwing something as complex as k8s at the problem 😂
German politicians discussion how to roll out vaccinations by local doctors when we haven’t even ramped up the vaccination centers sounds like... setting up a kubernetes cluster to deploy your ML model although you‘re still stuck on the toy data.
Replying to @vivekjuneja
Finally watched Tenet last week. What an absolutely spectacular ride!
As @DJCordhose pointed out to me, AI is much more entangled with the business than traditional software. With software, a human has translated business needs into technology requirements, but this step is what AI tries to accomplish to some extent.
I think AI is closer to embarking on that America expedition when you have a flourishing trading empire in Northern Italy back in the days. Somehow the same thing, but much more adventurous.
The way AI related services and tools are marketed especially to enterprise companies as a solved problem distracts from the fact that successfully „doing AI“ cannot be just bought but requires significant change to the way business is done.
Replying to @NanaYamazaki
True, another important point, what roles say about you on your resume. Which brings me back to my original thesis that so much more than skillset goes into the considerations.
@DJCordhose Some industries already figured out how to do it. Sales is often commission based, for example, but not about customer happiness. Seems to work, but maybe only because other parts of the company balance this off with other metrics.
Replying to @DJCordhose
Yeah, I think it can work, but it takes time to figure it out. At Amazon they have the concept of a “forcing function,” a metric that leads to the right behavior. I don’t remember a concrete example, unfortunately.
Replying to @DJCordhose
Another good point, and also a favorite topic of mine. In big companies, you need to defined performance measures because people are increasingly separated from immediate customer impact. If that is not done well, you run in all kinds of alignment issues.
Replying to @DJCordhose
Good point, you have to look at interactions not just as a steady state but in the temporal flow of a project!
And when designing roles, don‘t just think about skillsets but also how roles need to interact. It is a bit like system design, you want components with a clear purpose, clear interfaces, and which are loosely coupled. /end
I think you should always be aware that roles don‘t have to be mapped to people 1:1. Someone needs to do it, but it could be someone who also does something else or it could be multiple people. Talking helps to clarify who does what.
I understand that you want clearly defined roles, for example, for more standardization when it comes to performance reviews, or so that people can switch teams.
(3) few people‘s interests and skillsets actually are exact fits for given roles. People will either feel confined or always feel like they need to step outside their role (my problem).
(2) how do these roles interact? Especially with role-by-skillset you can end up with highly entangled roles that need to work very closely together. If it does not work, you start adding processes and rules to „organize the work.“
Now, as you have actual people fill these roles, you start facing reality. Some issues: (1) is there enough work for a person that is so specialized?
Another approach is that you identify a set of responsibilities. For example, in scrum, Product Owner is a the one who owns the product backlog, etc. It doesn‘t have to be one person, but why not make it one person‘s job?
How do you come up with roles? The most common criterion seems to be skills. It is hard to find people good at statistics and engineering, so let‘s split!
One thing that always makes me think are the roles we have in the software industry. The bigger the company, the more specialized the roles it seems. In data science, I‘ve seen charts with data analysts, data scientists, ML engineers, MLOps, ... some thoughts =>
Replying to @ravo
@IgorBrigadir I don't even mean actual low-level assembly like code, but the way the deployed assets don't even look like what the developer wrote anymore is just like more traditional compiler applications.
Replying to @arjmur
What do you mean "looks right?" How can it look right-er than how it would be rendered out of the box?! ;)
Replying to @IgorBrigadir
Yeah, I've been re-reading, but if there ever was an example for leaky abstractions, this is it. I felt like constantly having to translate documentation between different tools/languages (e.g. yarn vs npm, javascript vs typescript, etc.) Too many combinations!
@fs111 The next step up was 56k which felt just blazingly fast in comparison. ISDN wasn't that much of a jump, but connecting in a second was so much better.
Replying to @fs111
Ah man, lynx, I remember using that because websites were getting too many images and started to load too slowly! (Also, I'm not even complaining! If anything I'm admiring!)
@IgorBrigadir At some point, I realized that current frontend technology had gone the full path where you compile source code (e.g. react) to low-level ("assembly", HTML+CSS+javascript). And I was like 🤯
Replying to @IgorBrigadir
Totally! I read a blog post somewhere that said "My Tech stack is HTML + CSS." I cannot find it anymore, but there was some truth to this (for some applications).
@thinkberg Disclaimer: I didn't mean to make fun of the page or the guy. Apparently he knows his stuff. And the page loads quickly, is totally readable and probably renders correctly with Netscape 1.0 or IE 3.0. ;)
Replying to @wrede
They are probably so good at engineering that that‘s true. ;) Yeah, IIRC, your blog had a picture of the box it was served from at the bottom of the page?
RT @DigitaleLeute: Gitarre, Keyboard, Verstärker. Das Home Office von @Mikiobraun ist ein kleines Studio. Dazwischen sein Arbeitsplatz, an…
RT @Al_Grigor: Last day of @DataTalksClub conference 🔸 10 Foundational Practices of ML Engineering, @visenger 🔸 Putting Data Science in P…
Replying to @Bitpanda_global
@bitpanda Now would look like a good time to not have performance issues... .
Replying to @micahjay1
I've started experimenting with having different virtual backgrounds to add some random facts to make memory retrieval easier.
Replying to @rorcde
@RodrigoRivr Yeah, I agree, more examples of how Python is getting even more gravity would be a nice addition.
Replying to @mariofusco
I've seen so many incomplete "RESTful" API implementations. They were in fact, an HTTP endpoint.
Replying to @x0rg
Yes, also because they are some of the nicest people in the business who have a pretty hard job!
TIL if UK people refer to "overseas" they mean the European mainland (and not the Caribbean.)
Still, it is good to know what exists so you know where you're headed. So I hope this convinced you to have a look at it, and let me know what you think! :)
I think the report exemplifies the broad range we see in the industry today. Some companies are really pushing the envelope, but for most, e.g. feature stores and model repositories are something they don't have to think about for the next 2-4 years.
Now, what do I honestly think about the report? To be honest, I think the majority of companies out there are still struggling to get the basics right. Does this make the report as a whole irrelevant? On the contrary!
... (virtual coffee of course) with a founder of some stealth startup. In all the years I've known him, @bigdata also was super passionate about following the trends of a community and sharing. Not even O'Reilly x-ing the conference business could stop him ;)
Then, this is not just based on some marketing blurb we read, but on actual conversations that @bigdata had. If you don't know him, he's probably one of the best connected people in SV I know. If he says something is coming, then probably because he's been having coffee ...
Granted, you might find similar reports produced by other sources, but at least we're independent. We're not trying to sell you our cloud solution. Actually, the only goal is to get you to subscribe to our newsletter 🤫
I'm advertising this report that is based on a podcast that @bigdata, @jennweb, and I had in January. gradientflow.com/2021trendsrepo… Now you might groan "oh no, not another 'report' on what's so cool about AI!" Here's some context =>
2021 Trends Report: Data, Machine Learning, and AI - Gradient Flow
By Ben Lorica, Mikio Braun, Jenn Webb. At the beginning of each year, we take stock of the year’s technological developments in areas around big...
gradientflow.com
The solution is of course to reintroduce randomness, e.g. by picking thematic virtual backgrounds. "Wait, wasn't that the outer space meeting?" Or sillier: "wait wasn't this when we were all cats?"
New theory: it's so hard to remember stuff in wfh because you lack those random bits of hash salt that make things easier to keep apart: which meeting room, who sat who, what the weather was, time of day.
Just think of it! "Something's wrong with the Turing mesh shaders. I think they malfunctioned and then the mesh got to hot and the synthetic consciousness went past baseline."
Replying to @Al_Grigor
Taxes are way too much on my mind... perils of becoming a freelancer I guess ;)
Replying to @Al_Grigor
I think a good interviewer knows that live coding is stressful and you should design accordingly. Take home tests should be paid for, to be honest. Or a donation to their favorite oss project if that‘s easier taxwise.
RT @AustinTByrd: A nsfw thread to the lost art of blank VHS tape covers. 📼♥️ https://t.co/IeqHNvV36I
Media
RT @Al_Grigor: Many candidates don't like take-home assignments I for sure don't 🔸 They take too much time 🔸 You can't know what the int…
All I want is a computer powerful enough to run Google Meet and Chrome is still snappy.
@ggdupont Yes, I fully agree. And I think many people are not even very clear that actually there are different metrics.
@ggdupont Yeah, I have another article planned where I talk about how important it is to be clear on metrics, and not to be driven by specific algorithmic solutions.
Replying to @baggerspion
@therealpadams Just to be clear, you mean the stand without rolls, right?
RT @QuinnyPig: Since a lot of friends are currently interviewing for work, let's do one of these again. Ask me your interview question, an…
RT @bigdata: FREE Report: 2021 Trends in Data, Machine Learning, and AI by @bigdata @mikiobraun @jennwebb 🆕 Brush up on technological de…
Replying to @dataScienceRet
So technically it is an article in a tool that could totally support writing a book :) But then again, this somehow felt like a more natural format than a string of blog posts.
Replying to @Major_Grooves
@Dell Eventual consistency FTW. :) Actually, this sounds suspiciously like someone needs to manually transfer your order between different systems... 😓
Replying to @mleznik
Yeah, years of living in this ineditable space have improved my typo autocorrection skills.
RT @rrwilliams: In case you missed it: the exponent of matrix multiplication has been improved, as of SODA 2021. Please update your referen…
RT @bigdata: FREE Report: 2021 Trends in Data, Machine Learning, and AI 🆕 Brush up on technological developments in areas around #bigdat
Replying to @Quesada
I realize I have zero knowledge about how that situation is in China. That would be interesting to learn about.
Replying to @Quesada
What I‘m also experiencing now is some issues around „disguised employees,“ some legislation to cut down on companies working with „contractors“ to reduce insurance spent. Well thanks for making the entrepreneur‘s life difficult as well.
Replying to @Quesada
Overall, I think the situation is still better in the US where a common advice is to have a spouse who has good health insurance and ride on that...
@Quesada Can you elaborate on the tax laws for freelancers in Spain? In Germany I'd say the tax law is a bit in favor of freelancing because you "only" need to pay income tax.
@Quesada The laws to protect employees definitely have their reason to be, but they are also built for overall more stable industries. And the job security is high, but people still change jobs to get further ahead in their career, or because they don't like their job.
@Quesada ... no safety, no security, need to put in insane hours. What most people aren't aware of is that you are interacting with tons of entrepreneurs every day. Every doctor, dentist, lawyer, shop owner is an entrepreneur.
Replying to @Quesada
Very interesting thoughts, Jose. It has been in the back of my mind for the past few days. In general I agree that the German view on entrepreneurs is not that positive. There are connotations of "not being able to work for a boss", and everyone tells you that you have ...
Replying to @random_walker
The page titles are also priceless. My favorite is "How CIOs are deploying AI". "Mark, where are those 5k units of AI we ordered last week?!"
RT @DynamicWebPaige: Maybe this is naïve–but I don't think *anyone* wants to think, at the end of their career, "gee, sure helped lots of p…
Replying to @vivekjuneja
@therealpadams I had it the most with BM1... till I started to consciously track where the kitchen/river is.
Replying to @baggerspion
@therealpadams In my experience, the most challenging office layouts are those with ample symmetries. You never know in which of the four possible corners you ended up in.
Replying to @baggerspion
@therealpadams Seriously shopping for date stamps now to punch all those invoices!
Replying to @peteskomoroch
I think I once heard you can do this but make it an hour before going to sleep, so when the post caffeine crash comes, you ride that to fall asleep. Or you mean right before? 😅
RT @arjmur: Engineers "pair program". PMs hunker down in isolation to craft the next great Google Doc. "Pair writing" for product analysis…
Replying to @arjmur
Very interesting, Arjun. I also think sometimes there is too much of a divide between product and engineers. Maybe there is more to be learnt from one another.
Replying to @felschueler
For engineers it is probably just the inverse of the commit tiles?
Replying to @baggerspion
@therealpadams 👋, and the struggling to leave the session before everyone else does.
Aaaand this is why I went with wired keyboard and wired mouse a while back. Even on Intel Apples, there is an effect where the bluetooth mouse becomes sticky and takes a split second to move from rest. Doesn't sound grave, but it is absolutely infuriating. twitter.com/9to5mac/status…
How did I manage to book that many meetings today although I'm self-employed now? #oldhabitsdiehard
Replying to @mtantawy
@amazon I gave in and ordered a whiteboard and have similar thoughts regarding a wall 😅
@fmueller_bln @oldJavaGuy I remember @oldJavaGuy trying to do exactly this, but the team was so unfamiliar with the practice that they kept merging the PRs which were not much more than a few concept files. 😂
Replying to @fmueller_bln
Oh, yes! I agree. I meant the case where you code without interacting, and then doing the PR last. The Work-In-Progress PR is way underused, right, @oldJavaGuy?
Replying to @fmueller_bln
Yeah, another great point. The PR is way too late. All the work has been put in already. Of course, you can and should still do PRs and have those discussions beforehand, but if you emphasize PRs too much, you're not doing it right.
Replying to @thatferit
@FokusMan I see! :D Indeed it seems that was a smart move right now.
Replying to @thatferit
@FokusMan Yeah, no I just jumped on the bandwagon in January 2018 at the last all time high...
Replying to @ravikml
Yeah, I think it comes from statistics. It's a "model" you "fit" to the data. There is a true (but unknown) function f and you only see noisy Y_i = f(X_i) + eps_i, so f^ is like a model of how f maybe is.
Replying to @DrKeil
Ah okay, yeah, I think if you still have (potentially) separate people but common infrastructure and framework, it makes sense. I've often seen DevOps as "you devs also manage production" but that's probably a simplification.
Here's a discussion I had recently: DevOps was about bringing developers and operations together (instead of throw-over-the-fence), but MLOps seems to be more about infrastructure to bring ML to production (run by an "ML Engineer"?) Naming analogy by coincidence?
To be brutally honest, I started wondering why the things that machine learning algorithms build are called "models" and although I literally spent decades in the area I cannot recall.
@fmueller_bln And then there is the whole area where people don't know how to constructively review and get hung up on variable names and coding style where it doesn't matter.
Replying to @fmueller_bln
Great article, thanks for the find. This "bugging your team mates to have a look at your PR" is waaaay too common. Also, nobody ever builds and tests the PR branch, usually, people just look at the code.
Looks like I can finally get out those Euros I put in $ETH three years ago when I bought at the last all time high 🙈
So @bigdata and I had been trying to predict trends in AI for 2020, but you can guess how that turned out. This time, Jenn Webb joined the discussion and I hope we will do better ;) You can find the episode on the Data Exchange podcast here: thedataexchange.media/key-ai-and-dat…
Key AI and Data Trends for 2021
The Data Exchange Podcast: Mikio Braun and Ben Lorica on tools, models, applications, and risks to look out for in 2021....
thedataexchange.media