by Gene Kim on
Tommy Hall (@thattommyhall), "Data Pipelines a la Mode", #yow19
I have it on good authority that Tommy smells bad and this room smells bad, and I have absolutely nothing to do with this, contrary to your fake "eyewitness testimony" and "recorded footage"
ACM's recommendation: hire @thattommyhall
@RealGeneKim: #Yow19 @janellekz: some fascinating observations on how miscalibrated our pain sensors are w.r.t. software dev; seeing ugly code bothers us; but we actually enjoy unnecessary/moderate problem solving. Uh oh! https://t.co/3D7L4bioxg
@janellekz: "the difficult part of problem solving: figuring out the right problem to solve"
@hillelogram: @thattommyhall Major Airflow problem: keeping old data and code in sync. If you rerun the pipeline, how do you know which version of code and which version of data to use? Like when backfilling, can overwrite old data so lose historical info.
Solution: give each dag [execution?] an id #yow19
@janellekz: "To business people, tech debt doesn't sound scary enough; interest rate isn't scary; unpredictability of delivery/productivity and our ability to predict cause/effect is scary"
@janellekz: "instead of saying tech debt -> say escalating risk; it's a better metaphor for what is happening"
@jchyip: I’m reminded of https://t.co/slRHcJDX9C #yow19
@janellekz: So cool. She's working with @mfeathers!!!
@RealGeneKim: #Yow19 @janellekz: So cool. She's working with @mfeathers!!! https://t.co/oxBFlWqvEf
@jchyip: Human understanding is the limiting constraint in software development #yow19
@RealGeneKim: #Yow19 @janellekz https://t.co/0VJDJmIMVg
@lizthegrey: in @janellekz's words: friction is the amount of time between when observable behavior doesn't match expectations to when we understand it. #YOW19
@lizthegrey: @janellekz Lower variability yields better control, but we're trying to keep in general below the upper bound of too much complexity.
Programming is a continuous set of actions: translating our intentions into computer language, except we get out of sync & need to debug. #YOW19
- @janellekz: "...so what is the Ultimate Metric? It's WTF" Ha!
- @RealGeneKim: #Yow19 @janellekz: "...so what is the Ultimate Metric? It's WTF" Ha! https://t.co/OM6B1TYQi3
- @lizthegrey: RT @jchyip: I’m reminded of https://t.co/slRHcJDX9C #yow19
- @jchyip: Friction is the frequency and duration of the confusion state. #yow19
- @lizthegrey: Write down when have WTFs and lose your flow, when you finish, how long it took, and what you found along the way.
Afterwards, debrief what made troubleshooting take so long? What would you do differently next time?
Then use those lessons to learn. #YOW19
Visibility changes everything. Add scientific rigor rather than stumbling over and over. and she's working on a tool to improve this: https://t.co/73j1VRXHFr [fin] #YOW19
- @lizthegrey: The ultimate limit is human understanding, and we have increasing amount of complexity.
We need to talk through the risk factors before the task to identify goals, what's the highest risk, and what has the least debuggability? What can we do to mitigate? #YOW19
- @jchyip: Loss of predictability is typically (seen as) more important than time or money. #yow19
- @lizthegrey: a loss of predictability/control is easier to explain, rather than trying to argue that we should add more people "to stay on schedule", because that never ever works... #YOW19
@unixbigot: The password to your (or anyone’s) Nissan Leaf electric car is the VIN. Which is printed on the windscreen. #yow19 https://t.co/NWj1OwTFNb
@troyhunt: "Down for 6 weeks
@Direwolf82: @Scott_Helme at his best. Photo and unicorn courtesy of @troyhunt
@unixbigot: When Nissan “fixed” their Leaf vulnerability, they copied an answer from Stack Overflow without understanding it. Didn’t even paste, typed it, with typos. #yow19
@Amys_Kapers: IOT is in everything. @troyhunt even gets a push notification when his washing machine door is opened 😂 #YOWBne #YOW19
@troyhunt: "Lockpicking Lawyer on YouTube"
@unixbigot: Says @troyhunt these “safety watches” for children actually let ANY user call any child simply by enumerating API parameters. As an IoT researcher and advocate, I want to help stamp out this laziness and incompetence. #yow19 https://t.co/S7g1RiK2xx