2012/6/27 Velocity Day 2

by Gene Kim on

#velocityconf

* @nickgrossman: #velocityconf from @albertwenger's talk: join the network to de

Akamai

  • Akamai creating Internet Observatory: like astronomical observatory, but aimed at Internet: views 20-30% of Internet traffic
  • @SubmittedDenied: In 60 seconds, @akamai generats 1.3 billion log lines
  • RT @SubmittedDenied: In 60 seconds, @akamai generats 1.3 billion log lines
  • BTW, I loved @sludin's story about going to observatory as a kid w/dad, wanting to take telescope home. Awesome.
  • @radar: The #velocityconf keynote stage welcomes @sludin, sharing Internet insights gleaned at @Akamai. Watch via livestream: http://t.co/YYx7g05q
  • @Anselmo: Akamai web trafic observatorium http://t.co/8Q2IrYGV
  • RT @Anselmo: Akamai Internet Observatory http://t.co/8Q2IrYGV
  • Awesome. ppl use Chrome at home. @dlutzy: IE 8 usage dips on the weekend while Chrome increases! http://t.co/3WKqifaN
  • @avleen: RT @allspaw: Here's where I got my "YesOps (front) YesDev (back)" t-shirt: http://t.co/B0IVHKsW
  • RT @avleen: RT @allspaw: Here's where I got my "YesOps (front) YesDev (back)" t-shirt: http://t.co/B0IVHKsW

  • CEO of GoDaddy: "days of not talking about technology are over: tell the world: 3200 employees; 1000 engrs"

  • GoDaddy: 10 million customers: 8 million are small businesses;

  • Whoa. Love this. Go into Chrome, type in about:tracing.

  • @jphpsf: Low level performance profiling and optimization demo from Nat Duca at #velocityconf. Use chrome://tracing/ in Chrome. Cool stuff!

  • Wow. People RT @jphpsf: Low level perf profiling and optimization demo from Nat Duca at #velocityconf. Use chrome://tracing/ in Chrome. Cool stuff!

  • @mrmanc: Front end developers: chrome://tracing/ is awesome - work out why your pages are 'janky' #velocityconf http://t.co/NVIDtMWy

  • RT @mrmanc: Front end developers: chrome://tracing/ is awesome - work out why your pages are 'janky' #velocityconf http://t.co/NVIDtMWy

  • .@jesserobbins, awesome dude responsible for creating this conference, talking about culture hacking

  • .@jesserobbins: "

  • @avleen: #velocityconf demo on using chrome://tracing was awesome. @etsy performance engineers minds blown. I sense a serious hackathon ahead.

  • RT @avleen: #velocityconf demo on using chrome://tracing was awesome. @etsy perf engineers minds blown. I sense a serious hackathon ahead.

  • .@jesserobbins: "Continuously Deploy code: before you even write it!" (haha)

  • .@jesserobbins: "The right culture is a requiremt for survival & success at web scale" "but life back the office still sux"

  • .@jesserobbins: "Dear Jesse. I work for big company. I tried to [talk | implmeent] awesome stuff, but said won't work here"

  • .@jesserobbins: "I have chosen my battles very poorly; always said no to coolest things, like trying to kill EC2" Haha

  • .@jesserobbins: "OTOH, I have faced every org battle on planet: Don't fight stupid, make more awesome"

  • .@jesserobbins: "1. Start small, build trust & safety; 2. Create champions: chg must come from more than u"

  • .@jesserobbins: "3. Use metrics to build confidence (eg cost of outage, cost of 1ms of latency)

  • .@jesserobbins: "4. Celebrate successes; 5. Exploit compelling events"

  • .@jesserobbins: "Lucky for us, compelling events where everything is broken happens all the time" (haha)

  • .@jesserobbins: "Game Day: exercise to inject large-scale faults to increase RESILIENCE, part of Resilience Engr"

  • .@jesserobbins: "Game Day: start with a small fire; starts to build competency"

  • .@jesserobbins: "Use metrics to build confidence; show what a good neighborhood looks like, showing value"

  • .@jesserobbins: "Start small: isn't threat & easy to ignore; call it an experiment (minimize profile) to deflect objection@jonathanklein: "Optimism is a force multiplier" - @jesserobbins at

  • RT @jonathanklein: "Optimism is a force multiplier" - @jesserobbins at

  • .@jesserobbins: "Get executive sponsor, starting with your boss"

  • .@jesserobbins: "Give everyone else the credit: one of the best way to activate people"

  • .@jesserobbins: "Give 'special status': like Google SRE corp, make people stand out as part of your program

  • .@jesserobbins: "Have these 'special status' brag about the new awesome: create scarcity

  • .@jesserobbins: "Find KPI that support chg. (good starting metric: time from code commit to deploy: it's all wasted $$)

  • .@jesserobbins: "Track metric and use it ruthlessly: show value, and then use it to punish laggards

  • .@jesserobbins: "Tell your story of data, like Hans Rosling: ideal reaction: 'that's amazing. how did u do that?

  • Wow. Loving this. @jesserobbins is giving a world-class talk here at

  • Haha. @jesserobbins: "Do you really want to be remembered as the guy who said 'no' a lot? That was me. Don't."

  • .@jesserobbins: "Leave room for people to come to your side. Ideal: ppl can flip to your side w/o them noticing

  • .@jesserobbins: "Compelling events: Just wait. It will come. Prepare and get ready to exploit"

  • .@jesserobbins: "Can be created by things like compliance, scaling, cloud migration: this is best use of compliance mandate

  • .@jesserobbins: "No 'I told you so'. Instead 'what do we do now?'

  • .@jesserobbins: "

  • @tekBuddha: RT @xthestreams: "code that's written and not deployed is wasted money" @jesserobbins

  • RT @tekBuddha: RT @xthestreams: "code that's written and not deployed is wasted money" @jesserobbins

  • .@jesserobbins: "@downdb: "Almost nobody wants things to be as shitty as they can be inside large organizations. There are a few." - @jesserobbins

  • RT @downdb: "Almost nobody wants things to be as shitty as they can be inside large orgs. There are a few." - @jesserobbins

  • .@jesserobbins: "

  • @linda_bernardi: RT @ginablaber: GoDaddy's @augustegoldman: "The ideas our engineers took from #Velocityconf, had a significant and positive impact on our business"

  • .@jesserobbins: "Use titles like Czar, Master of Disaster; type them into HR form, and it gives you extra authority

  • .@jesserobbins: "

  • @xthestreams: "when people say no it's often because they don't know how to say yes" @jesserobbins

  • RT @xthestreams: "when people say no it's often because they don't know how to say yes" @jesserobbins

  • @mark_barger: RT @dlutzy: Culture hacks. @jesserobbins Nailed it. His positivity is infectious and inspiring.

@Anselmo: RT @danwrong: Time To First Tweet slides that myself and @sayrer delivered at #VelocityConf: https://t.co/d1afMOBu

Patrick Lightbody:

  • .@plightbo: Patrick Lightbody up. "Wisdom Of The Crowd". I love his talk last year
  • .@plightbo: "+100 RT @mark_barger: RT @dlutzy: Culture hacks. @jesserobbins Nailed it. His positivity is infectious and inspiring.
  • .@plightbo: "DevOps pillars: performance, availability, functionality"
  • .@plightbo: "Selenium + Jenkins + Cloud = Awesome"
  • .@plightbo:
  • "RT @Anselmo/@danwrong: Time To First Tweet slides that myself and @sayrer delivered at #VelocityConf: https://t.co/d1afMOBu

  • @geekle: #velocityconf: Where you have a problem with your Twitter client and you have a Twitter engineer sitting right next to you.

  • Haha RT @geekle: #velocityconf: Where you have a prob w/your Twitter client and you have a Twitter engineer sitting right next to you

  • Haha. @plightbo: "Robots != Regular Dudes.

    https://p.twimg.com/Awaq4OpCEAIEltS.jpg

Hello, fellow #velocityconf!! Book excerpt from "When IT Fails: A Business Novel" now avail! (DevOps Cookbook next!)
http://itrevolution.com/velocity/

@xthestreams: RT @sascha_d: Start by changing the way people work and you can change the way they think. @lnxchk

Pinterest

  • Hearing talk about scaling Pinterest. Wow. Growth stats are breathtaking
  • Pinterest: " Amazon is great, we can get 10 more memcache instances in 10 minutes. That happened last week"
  • Pinterest: "Why use MySQL: everyone knows how to use it; no loss of data yet"
  • Pinterest: "Why memcache? everyone likes and uses it; no failure modes except when it starts swapping"
  • Pinterest: "Why Redis? variety of conv data structure, persistence and replication; few failure modes
  • Pinterest: "Clustering vs sharding; our mental model: clustering is automatic/magic; sharding is manual"
  • Pinterest: "Our principle of Keep It Simple led us to choose Sharding"
  • Pinterest:
  • @thewebvy: In March of 2010, #Pinterest had just 1 MySQL database and 1 engineer, today's numbers are closer to 80/25. #scalability
  • RT @thewebvy: In March of 2010, #Pinterest had 1 MySQL database &1 engineer, today's numbers are closer to 80/25. #scalability
  • Pinterest: "Clustering: difficult and scary upgrade mechanisms: I got scared in middle of an upgrade
  • Pinterest: "We got screwed by cluster manager: data rebalance broke: stopped 20% into operation: lost data"
  • @sigje: with a front row seat @kimor79 live blogging the shiny of @jschauma
  • Pinterest: "...20% of our data disappeared in a blink of an eye. The db guy & I just stared at each other for 10m"
  • Pinterest: "
  • @velocityconf: Scaling Pinterest session w/Yashwanth Nelapati & Marty Weiner is on now. Watch it live via #velocityconf livestream: http://t.co/iupb6hcO
  • Pinterest: "Big challenge: migrating data from shards: took 4 months. Orig est was 22 days"
  • Pinterest: "Sharding makes schema design hard; remove all joins & complex queries
  • Pinterest: "During heavy load situation, we had code like (if id > XX, goto shard 1, etc...); kept us limping for month
  • Pinterest: "
    @xthestreams: "complex systems fail in complex ways", Bellovin @jschauma

  • Pinterest: "We planned: 512 mysql databases across 8 physical servers

  • Pinterest: "When DB load incr: we split into 2 shards: bring read slave out,

  • Pinterest: "

  • @mdjanderson: #pinterest sharding for future scale by starting with shards of shards with federated mapping IDs to locate them

  • RT @mdjanderson: #pinterest sharding for future scale by starting w/shards of shards w/federated mapping IDs to locate them

  • Pinterest: "every table named nounverbnoun; e.g., userlikesitem (?)

  • Pinterest: "table names: users, usershasboards, boards, boardhaspins, pins"

  • Pinterest: "500M pins; 1.6B follower rows; took 3 months to move all our data; loves Pyres, based on github resque queue

  • Pinterest: "@kshep: Seems Pinterest borrowed FriendFeed's schemaless MySQL approach http://t.co/pugX35C0

  • RT @kshep: Seems Pinterest borrowed FriendFeed's schemaless MySQL approach http://t.co/pugX35C0
    Pinterest: "Like every other company here, we're hiring!" (This is true. Everyone is hiring here.)

@hrobertking: Software maintenance is ~75% of TCO and operations is the other 75%.
Haha. RT @hrobertking: Software maintenance is ~75% of TCO and operations is the other 75%.
@rbowlby83: RT @jonathanklein: The 3AM principle - whatever you do must be understandable to someone who just woke up at 3AM
RT @rbowlby83/@jonathanklein: The 3AM principle - whatever you do must be understandable to someone who just woke up at 3AM
@scottpricegeek: RT @velocityconf: Video from #velocityconf keynotes and interviews are starting to be posted http://t.co/E3j28E0H
RT @scottprice
geek/@velocityconf: Video from #velocityconf keynotes and interviews are starting to be posted http://t.co/E3j28E0H

House MD