065: The High-level WTF on “Scheduling”

We spend this week talking about workload scheduling, starting with Mesos. It’s a fun ride from CONTROL-M to Lambda, along with Cloud Foundry and serverless. So get ready to beat a horse into glue. Plus, how to handle gifts for father’s day and the usual recommendations at the end.

Check out the full show notes for links to the recommendations, conferences, and tech news items we didn’t get to cover.

Listen above, subscribe to the feed (or iTunes), or download the MP3 directly.

With Brandon Whichard, Matt Ray, and Coté.

SPONSOR

Show notes

Father’s Day

MesosCon

  • Platform Infrastructure at Twitter: The Past, Present and – Future – Chris Pinkham, VP of Engineering, Twitter
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
  • Twitter’s kinda big deal, maybe you’ve heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
  • http://twitter.github.io
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn’t sustainable, need an open source community.
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
  • 30,000 node Mesos cluster (probably largest). “We don’t like being the biggest of anything, we find the edge cases.” 130,000,000 containers launched daily.
  • Some of their acquisitions were in public cloud, they don’t move them in-house. They’re actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS.
    Users: Time Warner, Twitter (30,000 host deployment), Apple Siri.

What exactly is scheduling?

  • BMC CONTROL-M
  • Coté gets Matt to “checks out” his crudes understanding. (Spoiler: Checks out.)

Serverless, what’s the deal?

Mid-roll

BONUS LINKS!

Not covered in show:

Somebody’s using Kubernetes

  • Hear the tale!
  • Concur & Barkly Protects
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)

AWS & Australia News

Coté’s revamped Pivotal Conversations Podcast

Typosquatting Package Managers

  • Seriously messed up.
  • “In the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.”

A Docker on every HPE Server

  • Running on HPE
  • Reference Architectures!
  • HPE 3PAR and SiteScope plugins!
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
  • Also, some ALM stuff. Sadly, I don’t have access to the IDC reports on this, however, they’re expecting big things: “IDC’s analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014–2019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%”
  • erry-one doin’ it! What’s up with Chef’s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.

Recommendations

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s