Seahawks hit local Wi-Fi record during playoff game with 2.6 Terabytes of traffic; Verizon maintains cone of silence over its investment in network

Screen Shot 2015-01-16 at 11.05.18 AMThe Wi-Fi network that debuted in CenturyLink Field this season had its highest Wi-Fi traffic day last weekend, when 2.6 terabytes of data was carried during the Seattle Seahawks’ Jan. 10 playoff victory over the Carolina Panthers.

According to the Seahawks’ tech staff, 18,899 of the 68,524 fans in attendance used the Wi-Fi network at some point, with a peak concurrent user mark of 15,662. The peak bandwidth utilization of 1.4 Gbps was reached just after Cam Chancellor sealed the win with his electric 90-yard interception touchdown return, the Seahawks tech staff said.

The Wi-Fi numbers represent traffic on both of the separate Wi-Fi networks in the stadium, one of which is reserved exclusively for Verizon Wireless customers. Verizon, which has declined to comment publicly on the specifics of its partnership with the Seahawks, is believed to have bankrolled a major portion of the Wi-Fi deployment at CenturyLink. Before the Wi-Fi partnership between the Seahawks, Wi-Fi gear provider Extreme Networks and Verizon was officially announced on Oct. 29, Verizon claimed it had “added an in-stadium Wi-Fi system” at CenturyLink prior to the start of the 2014 football season, as part of a national football stadium Wi-Fi map Verizon published on Sept. 4. The Wi-Fi deployment was somewhat of a surprise, since team officials had long said they were looking at 2015 as the year they might pull the trigger on a Wi-Fi expenditure. Apparently, having available funding from Verizon helped push the project forward faster than expected; but again, we have no official confirmation or explanation of the exact fiscal participation level of all the partners involved.

For Seattle fans, having Verizon as a Wi-Fi partner has additional perks — in addition to a separate Wi-Fi network for Verizon customers, all fans at the stadium also have access to the NFL Network’s popular RedZone channel, via the new Seahawks stadium app created by YinzCam. Because of various conflicting rights contracts, RedZone isn’t available in most stadiums for fans to watch. The Seahawks also have a number of live-action and replay views available via the app; however, the stadium’s tech team did not have any metrics on fan use of the app or the number of video replays watched.

Wi-Fi access point antennas visible on poles at CenturyLink Field, Seattle. Credit: Extreme Networks

Wi-Fi access point antennas visible on poles at CenturyLink Field, Seattle. Credit: Extreme Networks

Verizon’s reluctance to comment publicly on its Wi-Fi deployments is no surprise; repeated attempts and queries by MSR for interviews with Verizon executives about Wi-Fi deployments are routinely ignored by Verizon representatives, and public quotes like the one from Bobby Morrison, president for the Pacific Northwest and Alaska at Verizon Wireless, in the official press release, don’t offer any details about Verizon’s level of fiscal commitment to the CenturyLink deployment. Verizon has also declined to comment on its Wi-Fi network deployments at Ford Field in Detroit, and at the Staples Center in Los Angeles.

Verizon executives were also conspicuously absent from a stadium-technology event centered on the Wi-Fi network earlier this week, leading some reports to omit Verizon’s considerable participation in the network’s deployment, something NFL CIO Michelle McKenna-Doyle told MSR about earlier this year.

Though no statistics were available from Verizon about the DAS deployment it also put in at CenturyLink Field this year, AT&T did share some DAS stats from CenturyLink for the Seahawks’ Dec. 14 victory over the San Francisco 49ers. During that game, AT&T customer traffic on the AT&T DAS at CenturyLink was 395 GB, according to AT&T. It will be interesting to see how much wireless traffic this weekend’s NFC championship game between the Seahawks and the Packers will generate — we’ll track down as much of it as we can to see if it compares to the 6 TB mark set at the recent College Football Playoff championship game at AT&T Stadium in Arlington, Texas.

AT&T: Miami Dolphins, Oklahoma State are tops for season-long DAS traffic for pro, college stadiums

Screen Shot 2014-09-12 at 2.21.51 PMThe Miami Dolphins’ Sun Life Stadium and the Oklahoma State Cowboys’ Boone Pickens Stadium were the top professional and collegiate venues, respectively, when it came to cellular data traffic used by fans on AT&T networks during this past football season, according to AT&T.

As a caveat we need to say that the numbers used here do not reflect all wireless data users — they only represent totals from AT&T customers at stadiums where AT&T has a DAS, or distributed antenna system, installed. Still, since AT&T is the runaway leader when it comes to DAS installations — and so far, the ONLY wireless provider willing to share stadium statistics — for now its numbers are the only ones we have, so we’ll use them to award the honorary crystal iPhone trophy, or whatever top-traffic winners get.

Among NFL stadiums, Miami’s Sun Life took the top average honors by a wide margin, with an average of 1 terabyte of DAS data per game. Next highest was Dallas and AT&T Stadium, with an average of 830 GB per game; the next three were San Diego’s Qualcomm Stadium (735 GB per game), the San Francisco 49ers’ Levi’s Stadium (601 GB per game) and the New Orleans Superdome (596 GB per game). What’s interesting about the top 5 is that all except San Diego also have fan-facing Wi-Fi, so even with Wi-Fi around there are still high cellular data totals.

On the collegiate side, OSU’s Boone Pickens Stadium racked up an average of 769 GB per home game, pretty impressive when you consider the capacity is only around 60,000 fans. In second place was the University of Miami and Sun Life Stadium, whose network must just stay warm all the time; the U fans used an average 745 GB per game, according to AT&T. The next three highest averages were all close, led by Texas A&M’s Kyle Field (668 GB per game), then Baylor’s McLane Stadium (661 GB) and the University of Alabama’s Bryant-Denny Field (660 GB). For more numbers see the AT&T blog post on the collegiate data season.

College championship game at AT&T Stadium breaks 6 Terabyte wireless data mark, with almost 5 TB of Wi-Fi traffic

AT&T Stadium before the college football playoff championship game. (Click on any photo for larger image) Credit all photos: Paul Kapustka, MSR

AT&T Stadium before the college football playoff championship game. (Click on any photo for larger image) Credit all photos: Paul Kapustka, MSR

Not only did Monday night’s College Football Playoff championship game crown a new new national title team — it also broke the unofficial record for most wireless traffic at a single sporting event, with more than 6 terabytes of data used by the 85,689 fans in attendance at AT&T Stadium in Arlington, Texas.

John Winborn, chief information officer for the Dallas Cowboys, said the AT&T-hosted Wi-Fi network at AT&T Stadium carried 4.93 TB of traffic during Monday’s game between Ohio State and Oregon, a far higher total than we’ve ever heard of before for a single-game, single-venue event. AT&T cellular customers, Winborn said, used an additional 1.41 TB of wireless data on the stadium DAS network, resulting in a measured total of 6.34 TB of traffic. The real total is likely another terabyte or two higher, since these figures don’t include any traffic from other carriers (Verizon, Sprint, T-Mobile) carried on the AT&T-neutral host DAS. (Other carrier reps, please feel free to send us your data totals as well!)

The national championship numbers blew away the data traffic totals from last year’s Super Bowl, and also eclipsed the previous high-water Wi-Fi mark we knew of, the 3.3 TB number set by the San Francisco 49ers during the opening game of the season at their new Levi’s Stadium facility. Since we’ve not heard of any other event even coming close, we’ll crown AT&T Stadium and the college playoff championship as the new top dog in the wireless-data consumption arena, at least for now.

University of Phoenix Stadium, already with Super Bowl prep under way

University of Phoenix Stadium, already with Super Bowl prep under way

Coincidentally, MSR on Tuesday was touring the University of Phoenix Stadium and the surrounding Westgate entertainment district, which is in the process of getting the final touches on a new complex-wide DAS installed by Crown Castle. The new DAS includes antennas on buildings and railings around the restaurants and shops of the mall-like Westgate complex, as well as inside and outside the UoP Stadium. (We’ll have a full report soon on the new DAS installs, including antennas behind fake air-vent fans on the outside of the football stadium to help handle pre-game crowds).

The University of Phoenix Stadium also had its entire Wi-Fi network ripped and replaced this season, in order to better serve the wireless appetites coming for the big game on Feb. 1. At AT&T Stadium on Monday we learned that the network there had almost 300 new Wi-Fi access points and a number of new DAS antennas installed since Thanksgiving, in anticipation of a big traffic event Monday night. Our exclusive on-the-scene tests of the Wi-Fi and DAS network found no glitches or holes in coverage, which is probably part of the reason why so many people used so much data.

UPDATE: Here is the official press release from AT&T, which basically says the same thing our post does.

Stadium Tech Report: AT&T Stadium network a winner at CFP Championship game

Inside AT&T Stadium at the College Football Championship game. Credit all photos: Paul Kapustka, MSR

Inside AT&T Stadium at the College Football Championship game. Credit all photos: Paul Kapustka, MSR

It’s late here in North Texas and you know by now that Ohio State beat Oregon to win the first non-mythical college football championship. Behind the scenes at AT&T Stadium Monday night, the wireless network in AT&T Stadium was also a winner, standing up to the challenge of the 85,000-plus crowd on both the DAS and Wi-Fi front.

We’ll have a more thorough stadium report when we get time to digest all the info we gathered at the game (and get the network stats back from the AT&T Stadium tech crew) but one thing we learned before the game was that since November, the Wi-Fi network at AT&T Stadium grew by more than 280 access points, on top of a total somewhere in the 1,200 range. According to AT&T network folks the stadium here in Arlington, Texas, has been seeing game-day totals of 3.3 Terabytes of data carried on the Wi-Fi network — leading some here to believe that Monday’s championship game could well surpass 4 TB of data used at a single game, an unofficial record as far we know for a single-day, single facility network.

As guests of AT&T we also got a quick demonstration of LTE broadcast technology, which basically slices the available cellular spectrum into a channel that can provide live streams of video. We’ll have more on this new technology in another separate report, but it is something to watch for facilities that want video options but don’t want to go whole hog on Wi-Fi.

AT&T LTE Broadcast demo, showing a live streaming broadcast of the game

AT&T LTE Broadcast demo, showing a live streaming broadcast of the game

Even though we were housed in a field-level suite your intrepid MSR crew wandered all over the massive facility, and basically found great connectivity wherever we were. Two places stick out in my mind: At the very top of the nosebleed section in the south end zone the Wi-Fi dipped to just 1 Mbps, probably because the roof is so high there is no place for an access point. However, at that same spot the AT&T 4G LTE signal was around 7 Mbps, providing great connectivity in a tough to configure spot.

The other notable spot was in a “star level” suite (about the 6th level of the building), where we got a Wi-Fi signal of 28 Mbps download and 59 (no typo!) Mbps on the upload. Yes, suite people have it better but all around wherever we went we got consistent Wi-Fi signals in the high teens or low 20s, and LTE cellular signals (including Verizon 4G LTE) just under 10 Mbps. Like the Ohio State offense, the network at AT&T Stadium works really well and may have set a new record Monday night. More soon, and more images soon as well. For now, Elvis has left the building.

Outside in the frozen tundra of North Texas, aka Arlington

Outside in the frozen tundra of North Texas, aka Arlington

This place was humming all night long

This place was humming all night long

AT&T 4G LTE speedtest, from the top of the stadium

AT&T 4G LTE speedtest, from the top of the stadium

The view from the nosebleed section

The view from the nosebleed section

Some "suite" Wi-Fi speeds

Some “suite” Wi-Fi speeds

MSR at the College Football Playoff Championships: Send us your speedtests!

ESPN's College Football Playoff Championships stage in downtown Fort Worth, Sunday night. Credit: Paul Kapustka, MSR

ESPN’s College Football Playoff Championships stage in downtown Fort Worth, Sunday night. Credit: Paul Kapustka, MSR

As Twitter followers found out yesterday, MSR is in “north Texas,” aka the Dallas-Fort Worth “Metroplex,” attending tonight’s inaugural College Football Playoff Championship game at AT&T Stadium.

We’re here to see a test of AT&T’s LTE broadcast technology, which will ostensibly make it easier for venues to deliver live video streams via a cellular connection. But we also are going to take advantage of the event to walk around “Jerry’s World” and take speed tests and see how the network at AT&T Stadium performs for a big game. If you are in attendence and know how to do a Wi-Fi or cellular speed test, send us the results (tweet at @paulkaps is the best way, or send me email to kaps at mobilesportsreport.com). Check Twitter for updates during the game.

Stadium Tech Report: Network finishes season strong at Niners’ Levi’s Stadium

Arriving at Levi's Stadium for last 2014 season game

Arriving at Levi’s Stadium for last 2014 season game

While the football season didn’t turn out like 49ers fans wanted, the wireless network at the team’s new Levi’s Stadium closed out the year with strong performances to complete a largely glitch-free stretch of events at what is one of the world’s most technologically advanced stadiums.

With more than 2 Terabytes of data used by fans at each of the last two home games for the San Francisco 49ers, the Wi-Fi and DAS networks at Levi’s Stadium closed out a season of superb connectivity that eventually allowed the team to not just offer in-seat food and beverage delivery, but also ordering and delivery of merchandise like hats and T-shirts, an option that was available for the Dec. 20 game against the San Diego Chargers and the Dec. 28 closer vs. the Arizona Cardinals.

According to the Levi’s Stadium network crew, the Wi-Fi network carried 2.34 TB of data for the Chargers game and another 2.11 TB for the Cardinals game, with 20,096 fans using the network on Dec. 20 and 20,164 on Wi-Fi on Dec. 28. Peak concurrent user numbers were 13,700 for the Chargers game, and 14,400 for the season closer.

All season long, our speed tests in various parts of the stadium showed strong signals for both the Wi-Fi as well as the distrbuted antenna system (DAS) enhanced cellular network. At the final game it was no different; we found Wi-Fi download speeds of 16 Mbps on the rooftop deck, 25 Mbps in a suite and a scorching 39 Mbps in the Levi’s 501 Club seats (no doubt in part because there was a Wi-Fi antenna under the seat next to us).

Both Verizon and AT&T 4G LTE services also worked well, consistently scoring download speeds in the 4-6 Mbps range in most places and much higher in others. In short, we didn’t find any flaws in the network coverage in five games of walking all around the stadium, testing everywhere we went.

CalTrain to VTA a smooth ride

Caltrain crown en route to Arizona game

Caltrain crown en route to Arizona game

At the final game, Mobile Sports Report (me) tested out the full public-transit method of getting to the game, starting from San Mateo on CalTrain at 10:51 a.m. The parking lot at the station was almost completely empty, and free since it was Sunday; it’s possible that crowds were lighter since the Niners had been eliminated from postseason play, but nevertheless the ride to Mountain View went without hitch, a good sign for next year when many fans in town for Super Bowl 50 will no doubt be using CalTrain to get from San Francisco to Levi’s.

At the Mountain View CalTrain/VTA station operations were at their best I’ve seen, with more neon-vested VTA helpers offering clear instructions on why you might want to take an express bus instead of the light rail. Insider tip: If the express bus is available, take it, because in our testing it arrived at Levi’s in about half the time as the train trip (~20 minutes as opposed to almost 40 minutes for the light rail option).

Express bus option at Mountain View

Express bus option at Mountain View

The only thing that still remains to be ironed out is the fare confusion in switching from CalTrain to VTA, which are two different operators. On CalTrain there was advertising for a $6 “combo ticket” that would let you ride VTA and could be purchased at the same time you bought your CalTrain pass. But an online single-day ticket purchased via the VTA app was only $4.50, so it’s not clear why you would buy the CalTrain pass. Especially for the Super Bowl, it’d help fans if there was one price and one place to buy a single “Get to Levi’s” public-transit ticket.

Food order arrives as promised

Another thing I tried at the season closer was the in-seat food ordering feature on the Levi’s Stadium app. Sitting in the Levi’s Club section seats on the third level, I consulted the app to order a cold beer and a warm pretzel, which the app said could be delivered in 10 minutes.

Food runner bringing me my cold beer and warm pretzel

Food runner bringing me my cold beer and warm pretzel

After entering credit-card information into the app and hitting the order button the app updated itself with timely notices about the order being prepared, and that it was on its way. I found that information to be very assuring, a sign that things were indeed happening; there was even a big number associated with my order that appeared, apparently to make it easier for the food runner to confirm the order.

The order arrived exactly in 10 minutes’ time, as predicted by the app — it also arrived in a lot of extra packaging, a separate plastic bag for the steel bottle of beer and a paper sack holding a cellophane wrapper-encircled pretzel. Since there is no way to add a gratuity in the app, I gave the runner a cash tip, which seemed appropriate even though there is a $5 charge added to the order cost for the delivery service. I have to admit it felt a little weird to have someone bring me my food and drink but in the time it took to order and deliver I sat in my seat and watched the Niners’ game-winning TD drive so it’s clearly a fan-friendly option.

Video replays work well, for small amount of viewers

Another part of the Levi’s Stadium technology that was at peak performance by year’s end was the app’s instant replay feature. Though it started slowly and had some hiccups early on, by the final game instant replays were appearing in the app even before the next play had concluded (see our feature on how the VenueNext team gets the replays to the app so quickly).

While it’s an impressive addition to the in-game experience, the replays are a feature that only a small amount of fans are watching. According to the team network stats there were only 1,253 unique users watching replays on Dec. 20, and 1,019 during the Dec. 28 game. Total replays viewed for the Chargers game were 6,285, while 4.310 replays were watched during the season closer.

Why aren’t the replays catching on? Our main guess is that the Levi’s Stadium big screens are so clear and so quick to show replays (they also show live action as it’s happening), fans don’t find it necessary to use their phones to watch replays. It’s also possible that many fans in the stadium who are using the network aren’t using the Levi’s Stadium app. Indeed, according to the team network stats, the team app hasn’t yet cracked the top-four apps being used at any of the games this season; for the Dec. 20 game the top apps being used on the network were Amazon cloud drive, Facebook, Google APIs (probably Gmail) and Apple; for Dec. 28 the list was Amazon, Google, Facebook, then Apple.

We’ll try to get some season-long stats to share for both the network and the app features, but our quick conclusion after five live-game visits to Levi’s Stadium this year is that the wireless network and the app both pretty much lived up to their pre-season billing and hype, delivering a wireless game-day experience that is the standard other large public facilities will be measured against, going forward. More photos from our last visit below.

The Microsoft Surface/sideline Wi-Fi unit

The Microsoft Surface/sideline Wi-Fi unit

close-up of cable connection

close-up of cable connection

Niners' Flickr promotion on scoreboard -- very popular

Niners’ Flickr promotion on scoreboard — very popular

Sideline Surface tablets for Niners players and coaches

Sideline Surface tablets for Niners players and coaches

Colin Kaepernick exchanges his radio helmet for his flat-brimmed hat after throwing a TD pass

Colin Kaepernick exchanges his radio helmet for his flat-brimmed hat after throwing a TD pass

View from the Levi's skydeck out over Santa Clara

View from the Levi’s skydeck out over Santa Clara

If you throw a rooftop party, the cheerleaders might visit

If you throw a rooftop party, the cheerleaders might visit

View from the Levi's 501 Club section seats

View from the Levi’s 501 Club section seats

Wi-Fin antenna right under the seat next to me (probably why my speedtest was 40+ Mbps)

Wi-Fin antenna right under the seat next to me (probably why my speedtest was 40+ Mbps)

In-stadium signing help to get fans to light rail

In-stadium signing help to get fans to light rail

End of game view from skydeck

End of game view from skydeck

A final toast to the season at the BNY Club

A final toast to the season at the BNY Club

VTA train line. Only took 15 minutes from here to get on bus.

VTA train line. Only took 15 minutes from here to get on bus.

Caltrain platform at Mountain View. Extra trains helped make ride home easy

Caltrain platform at Mountain View. Extra trains helped make ride home easy