04/25/2013 ChefConf Day 1

by Gene Kim on

#chefconf

Awesome to be here! My talk here at #chefconf on "Why Everyone Needs DevOps Now & DevOps Patterns" will be today (Day 2) at 1:45pm. See you there!

Up: Mitch Hill, CEO, Opscode

  • Hill: "Most of us started off as back-office, invisible; now we're tip of spear, driving/executing strategy, finding customers"
  • @chipadeedoodah: #ChefConf Mitch nails it: Ops have gone from back office to tip of the spear. Those who are killing it are pushing infra innovation.
  • Hill: "Infrastructure enables outcomes; everything is code"
  • Hill: "Community has more than doubled every year, for 3+ years now"
  • Hill: "Why is community growing? Chef is an amazing model for re-use"
  • Hill: "2nd most used language on Opscode website is Japanese -- those guys definitely know ruby"

Up: Chris Brown, CTO

  • Brown: Wow, OMG. Showing pic of Phoenix Project on stage; Honored. Quoting prediction that in 10y, all COOs will be from IT
  • Brown: On healthcare: "bad incentives generate terrible & perverse results.. emphasizes treatment over prevention"
  • Brown: "..it favors complexity, discourages transparency... This is what is happening in IT"
  • @B1ackavar: RT @lnxchk: "You don't get to roll back a burning building" -- @skeptomai #ChefConf
  • RT @B1ackavar/@lnxchk: "You don't get to roll back a burning building" -- @skeptomai #ChefConf
  • @PariseauTT: Opscode CTO Chris Brown quotes book saying that any COO who doesn't come from IT in next 10 yrs will be "an empty suit."
  • Brown: "Every discipline goes through craft, trade and then science" "happened w/shoes, watches and manufacturing"
  • Brown: "Velocity helped create the craft; common craft in community; now we're helping build the science"
  • @kurtmilne, hey! you here, buddy?
  • Brown: "In 1950s, computer science was initially believed to be impossible to be valid field of study"
  • @PariseauTT: Brown also makes this analogy: Dev are ducks; Ops beavers; #DevOps a platypus. Encourages platypus tshirts.
  • Brown: "programmer -> software engineer -> computer scientist; hacker -> sysadmin -> ???" "(system engineer? DevOps engr?)"
  • Brown: "McConnell wrote 'After The Gold Rush': 'software engr must be elevated to support the next generation of miracles"
  • Brown: "Tech changes must faster than typical textbook and certifications?" "how often do u chg infrastructure stack?"
  • Brown: Showing books: "Guerrilla Capacity Planning (math); Principles of Network & Sys Adm (science); Art of Capacity Planning
  • Brown: More books: "Checklist Manifesto (improving surgery outcomes)" (great book)
  • Brown: "If you want to build a great community, behave responsibly; often, we tech people don't treat each other well"
  • Both. It's a team sport. :) "@lnxchk: Would a PhD in DevOps be granted by tech dept or a business dept? #ChefConf
  • Brown: "New programs: new chef user office hours, All Nathan, all the time!" (wow. that's cool)
  • Brown: "Rewrote chef server in erlang, now on PostgreSQL; managed chef is largest chef installation in the world"
  • Brown: "Facebook is big. Carl Sagan big." (hahaha)
  • @geekubed: Stay positive and polite RT #ChefConf@ChefConf "140 characters is just enough to say something mean about someone" - CB on @twitter ^SV
  • @anthonygoddard: RT @jamesdotcuff: OH: "the guys who basically invented large scale" ;-) LiveStream @ http://t.co/zyiwsNYtyC go go #ChefConf /cc @cyclecomputing #devops
  • @lnxchk: RT @rberger: How many servers at Facebook? "Carl Sagan Big" #ChefConf @skeptomai
  • @jtroyer: RT @PariseauTT: "Twitter is a horrible medium for real communication." -Brown on collaboration
  • @tomduffield: "Crush the wireless" - http://t.co/PWwoIYtwIs
  • @aslaen: everyone go here immediately! amazing place to start learning chef #chefconf https://t.co/O3RjgbEzN4
  • @kevsmith: Incredibly proud to see FB and Cycle Computing projects in opening keynote. Lots of hard work by my excellent colleagues. #ChefConf
  • .@skeptomai: "We open sourced omnibus as a way to create simple out of box experience for chef installs"
  • .@skeptomai: Demo time! :) "It's like the movie Office Space"
  • @petecheslock: The new Opscode dashboard is awesome looking. Useful reporting!! #ChefConf
  • @geekubed: RT @sfalcon: . @skeptomai aka “Julia” is killing it at #ChefConf -- watch out here comes the live demo!
  • @lnxchk: new webui reporting feature for #opschef. it's all wibbly-wobbly tasty-graphy. #ChefConf
  • @sascha_d: This #chefconf dashboard demo is giving me some serious squee.

Scaling systems configuration at Facebook: The paradigms, design, and software behind managing massive numbers of systems with open source and small teams: Phil Dibowitz, Facebook

  • @chrisfarnham: At FB they commit to head and push to production twice per day.
  • RT @lnxchk: RT @rberger: How many servers at Facebook? "Carl Sagan Big" #ChefConf @skeptomai
  • RT @chrisfarnham: At FB they commit to head and push to production twice per day.
  • @irabinovitch: RT @B1ackavar: "At Facebook, it is common for developers to own their own infrastructure" - Phil Dibowitz
  • RT @irabinovitch: RT @B1ackavar: "At Facebook, it is common for developers to own their own infrastructure" - Phil Dibowitz
  • @chipadeedoodah: #ChefConf Facebook: 4 people to manage tens of thousands of heterogenous systems, allowing devs to own/adjust relevant settings.
  • RT @chipadeedoodah: #ChefConf Facebook: 4 people to manage tens of thousands of heterogenous systems, allowing devs to own/adjust relevant settings.
  • @chipadeedoodah: #ChefConf FB: Config management needs to adapt to your workflow, instead of proscribing a workflow.
  • @lnxchk: 15,000 nodes in a cluster at Facebook. illuminates the issues you only see at scale.
  • Dibowitz: "We want to create infrastructure so everyone can make changes without fear; developers, DBAs, everyone" (Awesome)
  • Dibowitz: "We wanted to move 'idempotency up the stack'; a risk is that these things get stale: cron records, sysctl, use, etc
  • @jdeamattson: #ChefConf Testing must be easy. If it isn't easy, then people don't do it!
  • Dibowitz: "Fabricator is our [something] tool"
  • Dibowitz: Showing actual code from Fabricator: "delete this code after March 1st"; "This sucks. No one will do this"
  • Dibowitz: "Before chef, we had cfengine2; we had thousands of sysctl records; we have hundreds of stale files"
  • @jdeamattson: #ChefConf Pre-Chef Facebook had 150+ copies of sysctl.conf in CFEngine...
  • @jbrand: 157 copies of sysctl.conf in cfengine2 :| #chefconf
  • Dibowitz: Wow. "Now only two lines required for dbas to config up amount of shared memory; they know how to assign vars"
  • Dibowitz: "Value: delegated configs to DBAs, reducing work; reduces knowledge needed for ops"
  • @jdeamattson: #ChefConf Making delegation simple at Facebook: they just need to assign values to a Hash...
  • Dibowitz: "Our chef infrastructure: we run open source chef and private chef"
  • Dibowitz: "Why? we want open source chef to leverage work of community; & early access to private chef features"
  • @newgoliath: "You can run Facebook sized clusters on Open Source Chef."
  • @kevsmith: FB: “You can run Facebook sized clusters on OSS Chef Server” #ChefConf
  • Dibowitz: "Our code process: code; review by peers; review by lint/food critic -> svn repos -> push to clusters"
  • Dibowitz: "The world exists between chef runs; so persistent data come from FB systems of record (SOR)
  • Dibowitz: "Facebook clusters: about 10K nodes; grocery runs every minute; avg rollout time to servers: about 15m
  • @ChefConf: RT @adamhjk: That's 80% idle, for 17k nodes on first pass. Good times. #chefconf, #facebook

  • @BryanStenson: RT +1!!! @dsackerman: "Geeks: Not only do we look forward to SkyNet. We want to build it."

  • @bradpat1: RT @aslaen: “Automation is more an evolution of trust than an evolution of technology” @glennodonnell

  • @jamesdotcuff: Crikey! @cyclecomputing listed up with the big boys and girls! @splunk @facebook @ancestrydotcom @prezi #ChefConf http://t.co/dNlyMh2oKT

  • @KaitlynHeinsohn: RT @wolf31o2: Innovate or die... traditional IT is a huge resource hog... embrace change and embrace the future #devops

  • @standardheart: RT @lnxchk: Give those geeks some change. Geeks love change. #ChefConf

  • @kmartinix: Pictures of facebook datacenters. New UIs. Soundtracks by @adamhjk

  • @wolf31o2: RT @aslaen: “Automation is more an evolution of trust than an evolution of technology” @glennodonnell

  • @wolf31o2: Just watched my own tweet on the screen at #chefconf #fb

Glenn O'Donnell Talk

  • RT @jdeamattson: #ChefConf Making delegation simple at Facebook: they just need to assign values to a Hash...
  • RT @BryanStenson: RT +1!!! @dsackerman: "Geeks: Not only do we look forward to SkyNet. We want to build it."
  • Haha! Awesome. :) RT @wolf31o2: Just watched my own tweet on the screen at #chefconf #fb
  • @wolf31o2: Innovate or die... traditional IT is a huge resource hog... embrace change and embrace the future #devops
  • @wolf31o2: Standing next to two guys from @pagerduty "Every three weeks, I hate you guys" "Good, we're doing our job"
  • RT @wolf31o2: Standing next to two guys from @pagerduty "Every three weeks, I hate you guys" "Good, we're doing our job"
  • @jdeamattson: RT @julian_dunn: "IT's full of a lot of caustic people. We've got to get rid of them." - @glennodonnell #ChefConf
  • @jdeamattson: RT @aslaen: “The automators (YOU) are inventing the future” #chefconf @glennodonnell
  • @markcornick: RT @chipadeedoodah: #ChefConf @glennodonnell “There are two industries that have users: IT and Drug Dealers.”
  • RT @markcornick: RT @chipadeedoodah: #ChefConf @glennodonnell “There are two industries that have users: IT and Drug Dealers.”

Misc

  • Running into so many friends here at #chefconf this morning! And seeing even more on Twitter!
  • @copperegg: Unable to make it to #ChefConf? Check out the live stream happening now! http://t.co/CsPlBUhCV8
  • RT @copperegg: Unable to make it to #ChefConf? Check out the live stream happening now! http://t.co/CsPlBUhCV8

Other notes

  • @pradeepprabhu1: everyone talking #ContinousDelivery @ #chefconf - but will this be the norm of software delivery? by when?
  • @mary_grace: culture not only eats strategy for breakfast. it eats collaboration for lunch and execution for dinner. #culturewins #ChefConf

Leadership forum

  • Up: Adam Jacobs:
    • intentional declaration of intent and guidelines
  • The mission
    • how do we accelerate the adoption of all these amazing practices that we're seeing at the 1%-er companies (e.g., Google, Twitter, Amazon), in the 99%s (e.g., P&G, Bank of America, General Motors)
    • Horses hate hearing about unicorns;
    • Enterprises are complex; probably scores of issues that don't exist even in mammoth unicorns
    • How do we lower the activation energy, increase the probability of success of DevOps initiatives
  • Topics
    • Organizational adoption: on both Dev and Ops side
      • ops just wants to use command ine
      • dev just wants to fork cookbook