Episodes

Scaling Beyond the CDN – Jake Holland, Principal Architect @ Akamai

How to scale beyond the CDN with 8k video, millions of simultaneous download and streams, local caches and multicast. This episode is the last in the series of 3 in which we discuss scaling the internet.

The main links discussed in this episode are:

https://github.com/GrumpyOldTroll/multicast-ingest-platform

https://github.com/GrumpyOldTroll/wicg-multicast-receiver-api/blob/master/explainer.md

Other main things we referenced:

https://blog.apnic.net/2020/07/28/why-inter-domain-multicast-now-makes-sense/

https://tools.ietf.org/html/rfc6726 (FLUTE)

https://tools.ietf.org/html/rfc8777 (DRIAD)

https://datatracker.ietf.org/doc/draft-ietf-mboned-dorms/

https://datatracker.ietf.org/doc/draft-ietf-mboned-cbacc/

https://datatracker.ietf.org/doc/draft-ietf-mboned-ambi/

https://github.com/GrumpyOldTroll/chromium/tree/multicast_new

3,477 Replies to “Scaling Beyond the CDN – Jake Holland, Principal Architect @ Akamai”

  1. Matthew Walster
    Reply

    In what seems to be a regular feature for me, a few counter-arguments to the points made in this show:

    1. It took nearly 20 years for roughly 1/3 of all bits in an access network to get IPv6, I think it’s incredibly unlikely for multicast to be supported there. Where multicast has seen usage is in networks operated by those bundling services: delivering the ISPs own content to the set top box they provide. Expanding that (for video) to other devices is laudable, but fraught with issues as previous discussed (wrt WiFi etc).

    2. Just because 20Mbit/s is recommended for 4K streams doesn’t mean that’s the average bitrate, that is the peak. Realistically, the average bitrate is lower than this, but even if we use the 20Mbit/s figure you can be assured that the vast majority of streaming clients are not subscribed to the highest bitrate streams, and that HD (or even SD) streams will consume the vast majority of streams.

    For 100M concurrent viewers of the superbowl, that’s almost certainly counting viewers as people, not devices, and it’s probably much less than half of this figure… In a non-COVID year anyway!

    Regardless, when the superbowl is not on you need the capacity to stream what viewers want to watch on demand, so if on this one day per year you find most people are watching the same content, you still need the network capacity for all the other days of the year.

    3. Streaming OS and game updates via multicast is a terrible idea outside of the enterprise situation. You have to rely on all their devices being turned on (which is possible if you schedule the download for an overnight session for the device to wake itself up, but then the traffic demands on the last-mile access network are considerably smaller anyway) and can only send data at the lowest common denominator.

    Taking the 150GB update as a figure, if you send that multicast stream at 10Mbit/s, you need roughly 30 hours of constant stream to download everything. If someone uses their internet connection during that time, you are almost certainly going to lose packets and therefore have to “fill in the gaps” later via a separate unicast catch-up channel. Whereas if you allow users to download via unicast from a local cache node, and it is spread out over a day or so, if the user has 100Mbit/s internet connection they can download that same amount of data in a little over 3 hours.

    Multicast is a great tool, for sure, but almost all of these use cases that are shared are solutions looking for a problem. I don’t for a moment doubt that there are good cases for multicast, but on a sliding scale of effort versus benefit, unicast almost always wins out considering you need a well-built unicast network to start off with.

  2. Jake Holland
    Reply

    Responses:
    1. Most access networks already have hardware support that requires only a config change to enable. This is one of the key reasons the idea is viable. (But with that said, “most” means that you can’t just take it for granted if you haven’t checked your gear or run TV with it.)

    2. The days with big video events actually have a difference in amount of traffic, not just which specific things people are watching. It’s this change in amount of traffic that causes the network disruptions. Yes, for day-to-day non-peak usage you’ll still need to be growing capacity over time, but getting slammed by the difference-in-kind demand for those big days can stop being a recurring issue.

    3. The premise of this response is based on incorrect assumptions about how the transport protocols operate for file transfer.
    This is not a theoretical claim, we have a demo downloader running that starts on-demand, has receiver-driven bandwidth flexibility, is robust to loss, and doesn’t require a longer download than unicast delivery.
    While it’s possible to get better network efficiency if you synchronize the scheduling (which might be useful for OS delivery and maybe sometimes for game delivery), even without scheduling there’s so much concurrency on a big release day that multicast can be leveraged very effectively for this traffic if you send it right.

    I’ll also disagree that anything about this is a solution looking for a problem. This is an operations problem for peak days that’s happening frequently today. And it’s incredibly expensive to address it by digging up streets and laying new wires to cover these peak demand loads well, so it’s just going unaddressed. The mismatch between capacity and demand is causing disruptions for millions of end users several times per year, and they’re universally driven by pushing the same bits to more people than usual on the same day.

    Those who are willing to actually look at the numbers and experiment quickly discover that the problem is both real and highly tractable via multicast. Yes, there’s still work to do before it’s in production, but I would urge anyone who encounters hand-wavy counterarguments not to dismiss it out of hand without taking a good hard look first, especially if you’re considering upgrading hardware.

    • Atrossy
      Reply

      She talked about how stressed my body was, and asked if we were trying to have a baby and I said yes buy cialis online usa Clinical scale production of these vectors, however, is problematic, as the generation of stable producer cell lines is made significantly more difficult by their self inactivating SIN long terminal repeats LTRs

  5. Shoow
    Reply

    Check your page referrals regularly, and you may find referrals that you weren’t aware of. For instance, if you assume that most people like your page by landing on it, you may be surprised to see how many people like your page from your content showing on their news feed instead, or perhaps from an external source of traffic that you knew nothing about. The Facebook Competitors Report gives your brand the ability to track key metrics for any Facebook page, and benchmark their performance against your own. Whether you want to see how you stack up against the competition or just want to keep your finger on the pulse of other brands in your industry, our Facebook Competitors Report will give you the intel you need to make more informed decisions. Before diving deep into the details of your clients’ Facebook Ads campaigns, it’s best practice to provide a summary of everything that went well during the month and what needs improving. You can use the monthly write-up section of the Facebook Ads report template to provide an overview of your wins and losses, as well as your marketing plan going forward.
    http://www.elimwater.com/en/bbs/board.php?bo_table=free&wr_id=32538
    By Veronica Leasure, WXII 12 News talked with Papp's family about the incident. On July 26, 2017, WXII announced that it would move its 10:00 p.m. newscast to its new sister station WCWG beginning July 31 and expanded it to a full hour on weeknights while remain as a half-hour on weekends. In recent years, WXII has been carried on cable in areas outside of the Greensboro television market including cable systems within the Charlotte market in North Carolina and the Roanoke market in Virginia. On DirecTV, WXII has been carried in multiple areas within the Roanoke market in Virginia. As part of the SAFER Act, WXII temporarily kept its analog signal on the air to inform viewers of the digital television transition through a loop of public service announcements from the National Association of Broadcasters.

  86. Davidgreah
    Reply

    Altogether! Declaration information portals in the UK can be awesome, but there are numerous resources ready to boost you espy the unmatched in unison as you. As I mentioned already, conducting an online search with a view https://shellyshairandbeauty.co.uk/pag/reasons-behind-vinita-nair-s-departure-from-cbs.html “UK scuttlebutt websites” or “British intelligence portals” is a great starting point. Not only purposefulness this grant you a encyclopaedic tip of communication websites, but it will also afford you with a improved savvy comprehension or of the in the air story scene in the UK.
    In the good old days you have a liber veritatis of potential rumour portals, it’s prominent to value each undivided to influence which upper-class suits your preferences. As an exempli gratia, BBC Dispatch is known benefit of its objective reporting of news stories, while The Custodian is known quest of its in-depth criticism of bureaucratic and sexual issues. The Independent is known pro its investigative journalism, while The Times is known by reason of its affair and investment capital coverage. During concession these differences, you can choose the talk portal that caters to your interests and provides you with the news you have a yen for to read.
    Additionally, it’s usefulness considering neighbourhood pub news portals representing specific regions within the UK. These portals lay down coverage of events and dirt stories that are akin to the область, which can be especially utilitarian if you’re looking to hang on to up with events in your local community. For event, municipal good copy portals in London include the Evening Standard and the Londonist, while Manchester Evening Talk and Liverpool Repercussion are in demand in the North West.
    Comprehensive, there are numberless tidings portals at one’s fingertips in the UK, and it’s significant to do your digging to see the one that suits your needs. At near evaluating the different news programme portals based on their coverage, style, and editorial angle, you can choose the a person that provides you with the most apposite and interesting news stories. Meet luck with your search, and I anticipation this tidings helps you reveal the practised expos‚ portal inasmuch as you!