9/28 PuppetConf Day 2

by Gene Kim on

#puppetconf

Dan Hushon, @danhushon, DE EMC

  • Haha. RT @unixgeekem: "Chances are that person next to u
  • h
  • as had same
  • prob, solved them d
  • ifferently,
  • & thinks ur way is idiotic."
  • @lynxbat: Up on stage at #PuppetConf @DanHushon http://t.co/pSZcVikW
  • @lynxbat: Up on stage at #PuppetConf @DanHushon http://t.co/pSZcVikW
  • A legend. Former Sun DE & grt guy to boot! RT @lynxbat: Up on stage at #PuppetConf @DanHushon http://t.co/pSZcVikW
  • .@DanHushon: "Exabyte computing will req 1MM hosts; that's a lot of power to even run: prob 10% of a power station"
  • Whoa. Did the callout box make cloud of smoke when it landed on the pie chart? Must be heavy... There it was again!
  • @complex: day 2 of #puppetconf is now streaming! http://t.co/7cgC3TzF #puppetize
  • RT @complex: day 2 of #puppetconf is now streaming! http://t.co/7cgC3TzF #puppetize
  • .@DanHushon: "As much as we all, uh.., love J2EE, it's starting to look like the mainframe environment; impedes agility"
  • Ha. RT @jeffweiss: RT @stahnma: RT @stahnma: I've called Java the new COBOL for years!!
  • RT @jeffweiss/@stahnma: I've called Java the new COBOL for years!!
  • Haha. It's tough to be @lynxbat. :) .@DanHushon: "Nick (@lynxbat): type faster, dammit."
  • .@DanHushon: "@PuppetConf: RT @puppetlabs: Just announced at #puppetconf: #Windows provisioning for Razor! #puppetize
  • This demo makes me smile. RT @PuppetConf: RT @puppetlabs: Just announced at #puppetconf: #Windows provisioning for Razor! #puppetize
  • Umm, dumb question: Windows can't actually install that fast, right? That was a movie? /cc @lynxbat
  • BTW, IMHO, that was freaking delightful demo. I'm still smiling. Command line, even. Impossible. :) @lynxbat@nfagerlund: OH at #puppetconf: "I'll never have to click 'next' again!"
  • Bell: "CERN future plans & budget: 15K hypervisors, 100K-300K VMs, which is, frankly, kind of scary"
  • @dberkholz: RT @PuppetConf: Starting at @CERN: read the Puppet books—no more 2 month mentorships before being productive.
  • Bell: "When you contrib to Puppet/PuppetForge, you're helping to find the 96% of universe that we're missing" (Applause)

CERN: Tim Bell, Accelerating Science With Puppet

  • Up next: CERN: Tim Bell, Accelerating Science With Puppet
  • RT @nfagerlund: OH at #puppetconf: "I'll never have to click 'next' again!"
  • @rylon: Next on the stage, Tim Bell from CERN!

higgs { ‘boson’: ensure => detected }

puppetconf

RT @rylon: Next on the stage, Tim Bell from CERN!

higgs { ‘boson’: ensure => detected }

puppetconf

  • @stahnma: It's underground because we couldn't afford to buy the land to put it above ground #puppetconf http://t.co/djwSXMVt
  • RT @stahnma: "It's underground because we couldn't afford to buy the land to put it above ground" #puppetconf http://t.co/djwSXMVt
  • @unixgeekem: Tim Bell speaking at #PuppetConf - "if you've read Dan Brown, it's not like that" (the Large Hadron Collider & other accelerators)
  • RT @unixgeekem: Tim Bell:"if you've read Dan Brown, it's not like that" (the Large Hadron Collider & other accelerators)
  • Bell: "LHC generates 1 petabyte per second"
  • Bell: "When things go wrong, it took 1 yr to cool LHC down and warm it back up again." (Long setup times lead to long MTTR :)
  • Bell: "
  • @nullfinch: CERN on their sensors: "They're like 100 megapixel cameras. No a big deal, they just take 40 million pictures a second."
  • @nrcantor: 1 camera at CERN generates 1 petabyte of data per second. 40M pictures. Holy science, Batman!
  • RT @nrcantor: 1 camera at CERN generates 1 petabyte of data per second. 40M pictures/sec. Holy science, Batman!
  • Bell: "Our job at CERN is just to record data from LHC and copy it to other Tier 1 site; 1 million jobs/day"
  • Bell: "11,728 servers, 15K servers; 64K cores; 64K disks (2K break/yr, 4x higher failure rates than mfg predict, like GOOG"
  • Bell: "Data rates: 25 PB/year; 25 GB/sec peak"
  • Bell: "
  • @dedemonstrat: CERN produces 25PB/year that they want to retain for 20 years - wow.
  • Bell: "45K tapes holding 73PB of data; tapes are most economical, reasonable power budget; disk too expensive"
  • Bell: Might have # wrong: "16K tape loads per week?!? Imagine the noise it makes: think thousands of old VHS VCRs"
  • Bell: "New data center: 3.5M
  • Bell: "Big strategy change at CERN: no longer will build own compute infrastructure"
  • Nice. Bell: "Reliance on open source solved big training prob: new hires would sit next to gurus; now, just buy a book"
  • Bell: "@stahnma: #CERN uses koji and mock!! #Packaginglove
  • @jetdillo: #CERN data center(s) built entire new toolchain from OSS in 12 months, prev. tools effort took 10 yrs. #puppetconf #CERN
  • RT @jetdillo: #CERN data center(s) built entire new toolchain from OSS in 12 months, prev. tools effort took 10 yrs. #puppetconf #CERN
  • Ha! Bell: "Service model: 1) Pets: gets nice names, nursed back to health when ill. 2) Cattle: get numbers, shot when ill"
  • @binford2k: CERN's view of disposable infrastructure @ #puppetconf http://t.co/XB7grXlw
  • RT @binford2k: CERN's view of disposable infrastructure @ #puppetconf http://t.co/XB7grXlw

Next up: Puppet at SpaceX, Joachim Thuau
* Next up: Puppet at SpaceX, Joachim Thuau
http://puppetconf.com/speakers/?speaker=Joachim%20Thuau
* Thuau: "SpaceX: 1st private company to send vehicle to low earth orbit, recover vehicle, and go to ISS"
* Thuau: "
* @courtneynash: Day 2 of #puppetconf, woke up feeling like hell (and no, not because of @RealGeneKim's party last night). Thank goodness for the live feed!
* Thuau: "we use PXE, puppet, then foreman to preprovision"
* Thuau: "We have HPC to answer q's like 'will new bolt alter rocket flight dynamics'"
* Thuau: Showing Falcon 9 launch: 2/3 of company cheers in mission control; wow. "Very emotion moment when solar panels deployd
* I think this is link of video of ISS docking that Thuau showed: http://www.youtube.com/watch?v=QwDCWTqNceQ&feature=youtubegdataplayer
* @nrcantor: @CERN & @SpaceX using #puppet while
I help advertisers make more money. #suddenperspective
Hahaha. RT @nrcantor: @CERN & @SpaceX using #puppet while
I help advertisers make more money. #suddenperspective

  • Awesome. @nigelkersten just introduced me to dude at Google who ran email, back when it was on one server in 2003.

John Willis, @botchagalupe, "Putting The Science Back In Computer Science: From Deming & Goldratt To DevOps"

  • John Willis, @botchagalupe, "Putting The Science Back In Computer Science: From Deming & Goldratt To DevOps"
  • .@botchagalupe: "To me, The Third Way is all about kaizen and kata: culture of constant experimentation, learning & practice"
  • BTW, I get total kick that @botchagalupe Twitter avatar is Dr. Edward Deming
  • .@botchagalupe: Is telling history of modern config mgmt: @puppetmasterd, @markburgess_osl and [cannot be named]"
  • .@botchagalupe: Talking about his inspiration for this talk: @benr's "DevOps Transformation" LISA keynote:
  • @RealGeneKim: .@botchagalupe: Talking about his inspiration for #puppetconf talk: @benr's "DevOps Transformation" LISA keynote: http://t.co/afiXzLrM
  • .@botchagalupe: Frederick Winslow Taylor: Principles of Scientific Management: credited for creating incredible prosperity and flip Taylorism
  • .@botchagalupe: "Deming was commissioned to train plant managers in WWII,
  • .@botchagalupe: "In 1950s, 80% of wealth concentrated in this one room in Japan: Deming
  • .@botchagalupe: "Donald Peterson, CEO, Ford: brought in 1980s: "in 5 yeras, if you follow my principles, you'll get results: passed GM as most profitable car company"
  • .@botchagalupe: Here's the NBC video interview of Deming and Ford CEO Petersen:
  • http://www.youtube.com/watch?v=mKFGj8sK5R8&feature=relmfu
  • @RealGeneKim: .@botchagalupe: #puppetconf: Here's the NBC video interview of Deming and Ford CEO Petersen: http://t.co/VgFD0kYW
  • .@botchagalupe: Talking about Dr. Eliyahu Goldratt "Beyond The Goal" audio CD: is awesome. I've listened to it 30x. http://www.amazon.com/Beyond-Goal-Eliyahu-Goldratt-Constraints/dp/1596590238
  • .@botchagalupe:
  • @jeffweiss: .@botchagalupe: #puppetconf http://t.co/FQVUDduv
  • .@botchagalupe: "Shewhart, Deming and Goldratt: the pioneers of modern systems mgmt in 20th century were all physicists"
  • .@botchagalupe: "Common cause variation (inside control limits) vs. special cause variation (outside control limits):
  • .@botchagalupe: Explaining why great ops people (Twitter ops & @allspaw) have Matlab on their laptops: understanding variation
  • .@botchagalupe: ___ using statistic process control on stack traces to answer Q: "is this worth bothering a developer?"

Nick Weaver: @lynxbat

  • .@lynxbat: "Razor: provisioning like it's 1999: developed with Tom McSweeney (sp?)"
  • .@lynxbat: "The problems: too many provisioning tools (all meh), couldn't do large loads, no provisioning + devops,
  • .@lynxbat: "The #razor problem: cloud capacity is infinite; what's finite is and difficult is the provisioning on bare metal"
  • .@lynxbat: "Goals: consume like it's not real (like EC2), declare what it should be (like puppet), slice/dice/julienne at will
  • .@lynxbat: "With EC2, you bind to small/med/large whenver you want; With Dell, you bind at order time" (Fascinating)
  • .@lynxbat: "Goal: #razor shouldn't be important: handoff to puppet where real config mgmt will be done"
  • .@lynxbat: "Tom and I showed up at doors of Puppet Labs@PuppetConf: RT @ramereth: RT @ramereth: I love the hand drawn graph by @agentdero #PuppetConf http://t.co/I03WRyNK
  • ;
  • .@lynxbat: "EMC open sourced #razor; @DanHushon is the hero, wrestling 7 lawyers to make it happen -- 1 is still missing" (ha)
  • .@lynxbat: Jeez. #razor is so clever. PXE bootstraps custom Linux microkernel to enable new hardware disc or install vmtools
  • .@lynxbat is the only person I've seen who can make cmd line dramatic exciting. He's better than Steve Jobs
  • @PuppetConf: RT @damonedwards: #puppetconf Live episode of DevOps Cafe with @botchagalupe @kartar and more! In Fisher room during lunch. Come take part!
  • RT @damonedwards: #puppetconf Live episode of DevOps Cafe w/@botchagalupe @kartar and more! In Fisher room during lunch. Come take part!
  • @pladipunk: @lynxbat the font is too small on your CLI during the #puppetconf demo < awesome demo though!
  • @pladipunk: I'm in room. It's not you. @lynxbat is actually using Dingbats font. :)
  • .@lynxbat: "for info on #razor: goto github site: https://github.com/puppetlabs/razor"

  • .@jezhumble posted video interview of legendary John Allspaw (@allspaw): must watch: http://continuousdelivery.com/2012/09/john-allspaw-discusses-devops/

@RealGeneKim: .@jezhumble posted video interview of legendary John Allspaw (@allspaw) on DevOps & Continuous Delivery: http://t.co/C5W5rvJg

Jordan Sissel, @jordansissel, talking Logstash

  • .@jordansissel:
    https://pbs.twimg.com/media/A36JN5vCMAEeiOX.jpg
  • @KrisBuytaert: http://t.co/3vfctaCE @puppetmasterd hiding in his natural habitat under the stairs #puppetcampgent
  • @nullfinch: @jordansissel has revealled that Nagios is pretty much your clingy ex (girl|boy)friend, texting you stupid messages at 4 AM.
  • RT @nullfinch: @jordansissel: "Nagios is pretty much your clingy ex (girl|boy)friend, texting you stupid messages at 4 AM.
  • @rylon: “Rm -rf all the logs!” - @jordansissel on responding to 4am Nagios disk alerts due to bad log management. #puppetconf #logstash
  • .@rylon: “If a newbie has a bad time, that’s a bug” - a great attitude to have towards your community @jordansissel #logstash
  • @PuppetConf: "If a newbie is trying #logstash and failing, that's a bug." - @jordansissel
  • @unixgeekem: "Ops should be interesting, not exciting. Problems are interesting, fires are exciting" - Chris Kelly of New Relic at #PuppetConf
  • RT @unixgeekem: "Ops should be interesting, not exciting. Probs are interesting, fires are exciting" - Chris Kelly, New Relic

Andrew Hay

  • .@andrewsmhay: talking about how cloud/devops/puppet can improve infosec better. Love it.
  • @PuppetConf: "Artisanal, handcrafted servers are NOT OK" @wfarr Automation makes IT better!
  • RT @PuppetConf: "Artisanal, handcrafted servers are NOT OK" @wfarr Automation makes IT better!
  • .@andrewsmhay: "controls live in the host, as opposed to perimeter controls;
  • .@andrewsmhay: Goal: reduce attack surface area
  • .@andrewsmhay: "When I looked up # of Windows vulns in Natl Vuln DB, I waited for 30m, and it locked me out..."
  • .@andrewsmhay: "New risk: spin up test machine in AWS, and never patching it, resulting in old insecure image;
  • .@andrewsmhay: "I'm an enthusiast;

http://puppetconf.com/speakers/?speaker=Barry%20Jaspan

Barry Jaspan, Continuous Integration for Infrastructure

  • @brhelwig: Quote of the con... Amazon is our chaos monkey.
  • RT @brhelwig: QOTD: [We don't need chaos monkey.] Amazon is our chaos monkey. [Things crash all the time by themselves]
  • @KrisBuytaert: Listening to Barry 'Amazon is our chaos monkey ' Jaspan. @bjaspan
  • RT @KrisBuytaert: Listening to Barry 'Amazon is our chaos monkey ' Jaspan. @bjaspan
  • .@bjaspan: Hey, Nick, they use @wikidsystems. His talk is awesome.
  • .@bjaspan: Hey, Nick, they use @wikidsystems. His talk is awesome.
  • .@bjaspan: "Reboot testing to ensure that services come up
  • .@bjaspan: "
  • @krisbuytaert: what kind of phone do you have?
  • @jeffweiss: RT @botchagalupe: RT @botchagalupe: #puppetconf My Deming to Devops presentation is posted on http://t.co/hAV0zkKa
  • RT @jeffweiss: RT @botchagalupe: #puppetconf My Deming to Devops presentation is posted on http://t.co/hAV0zkKa
  • .@bjaspan: "We run these infrastructure tests daily on the master branch; we have 3000 servers, puppet does our deploys"
  • .@bjaspan: "All of these infrastructure cases have caused issues: restarts, reboots, etc."
  • .@bjaspan: "server builds take too long, so we do builds overnight, so we can launch tests much faster: min instead of 20m"
  • .@bjaspan: "Problem: leaked AWS instances never destroyed after test ($$); Soln: EC2 tags, or@PuppetConf: RT @DejanGolja: RT @DejanGolja: cool Mozilla released puppetctl https://t.co/167T4BD6
  • separate account (delete all)"

Red, green, re-provision. Test driving Operations
R. Tyler Croy

  • Engineer

Segment: Rethinking Ops

Room: Fisher

Date: September 27th

Time: 4:35 pm

Abstract: The developers you work with have a new service they're building, and it is your job to add the appropriate Puppet modules to provision it. Where do you start? A base image, Vagrant and some tinkering? Editing files in ""/etc/puppet"" on a staging Puppet host? What is the most maintainable work-flow which won't saddle you with technical debt in the future? In this talk, I will take you from the ""outside"" inward, writing tests along the way with Cucumber and RSpec. This approach encourages you to think more about where the lines are drawn between the various services and resources you're configuring. While the work-flow is a departure from the ""traditional sysadmin"" role, the resulting modules can be more easily re-used and re-factored.

Speaker Bio: R. Tyler Croy has been spent the past 5 years trying to build and ship web applications faster and better, first with Python and now with Ruby at Lookout Mobile Security, Inc. On a daily basis, he is building new back-end services to help Lookout scale up, or helping engineers build, test and rapidly deploy their code through test-driven development and gratuitous use of automation with Jenkins. 9 times out of 10, he's not angry, just disappointed.Red, green, re-provision. Test driving Operations
R. Tyler Croy

  • Engineer

Segment: Rethinking Ops

Room: Fisher

Date: September 27th

Time: 4:35 pm

Abstract: The developers you work with have a new service they're building, and it is your job to add the appropriate Puppet modules to provision it. Where do you start? A base image, Vagrant and some tinkering? Editing files in ""/etc/puppet"" on a staging Puppet host? What is the most maintainable work-flow which won't saddle you with technical debt in the future? In this talk, I will take you from the ""outside"" inward, writing tests along the way with Cucumber and RSpec. This approach encourages you to think more about where the lines are drawn between the various services and resources you're configuring. While the work-flow is a departure from the ""traditional sysadmin"" role, the resulting modules can be more easily re-used and re-factored.

Speaker Bio: R. Tyler Croy has been spent the past 5 years trying to build and ship web applications faster and better, first with Python and now with Ruby at Lookout Mobile Security, Inc. On a daily basis, he is building new back-end services to help Lookout scale up, or helping engineers build, test and rapidly deploy their code through test-driven development and gratuitous use of automation with Jenkins. 9 times out of 10, he's not angry, just disappointed.

  • @nrcantor: Acronym quotient reached. TDD TFDD BDD ATDD... Also, test drive your code. Even puppet code. RT @nrcantor: Acronym quotient reached. TDD TFDD BDD ATDD... Also, test drive your code. Even puppet code.
  • @binford2k: The only thing worse than training people and having them leave is not training them and having them stay. #puppetconf http://t.co/A4I5hcST
  • https://pbs.twimg.com/media/A36uiRVCIAAuRHs.jpg
  • @fmonserrat: RT @KaitlynHeinsohn: RT @KaitlynHeinsohn: For all those who attended the #puppetconf, if you are interested in a #DevOps position with The Walt Disney Compan ...