Verizon goes under concrete to bolster NRG Stadium DAS for Super Bowl LI

Nodes on wheels, or NOWs, provide extra coverage for Verizon Wireless in Houston for Super Bowl LI. Credit: Verizon Wireless

Nodes on wheels, or NOWs, provide extra coverage for Verizon Wireless in Houston for Super Bowl LI. Credit: Verizon Wireless

In a slight twist from its strategy for last year’s Super Bowl, Verizon Wireless has installed DAS antennas underneath the concrete flooring of lower-tier seats at Houston’s NRG Stadium, to provide extra bandwidth for the expected high wireless data usage at Super Bowl LI.

Last year at Levi’s Stadium in Santa Clara, Calif., Verizon beefed up its distributed antenna system (DAS) with under-seat antennas it designed specifically for use in stadiums. The idea of mounting antennas under seats, a growing trend in the stadium Wi-Fi world, is gaining traction as another method of bringing signals closer to fans, especially in places (like lower bowl seats) where there are no overhangs or other places to mount gear.

And while Verizon has been preparing for Sunday’s big game at NRG Stadium for years, that didn’t stop the company from “continually tweaking” its network preparations, according to Leo Perreault, executive director of network operations for Verizon’s South Central market, a region that stretches from west of Florida to Arizona, including Houston. In a phone interview this week, Perreault said that Verizon installed the under-concrete antennas during the middle of the 2016 football season, giving the company “some good experience” with the deployment ahead of Sunday’s game.

Under concrete = easier install and maintenance

A view inside the head end room that runs Verizon's NRG Stadium DAS. Credit: Verizon Wireless

A view inside the head end room that runs Verizon’s NRG Stadium DAS. Credit: Verizon Wireless

It might not be well known outside of wireless networking circles, but signals will travel through concrete; many early stadium Wi-Fi designs (and some current ones, including a new network installed at the Pepsi Center in Denver) use antennas mounted under concrete floors, pointing up. Though fixed under-seat antennas can provide better coverage, Perreault said the ease of deployment made putting the additional DAS antennas underneath the floor a better option in Houston.

“This way [under the concrete] is non-intrusive,” Perrault said, noting that the devices are also not affected by stadium power-washing units. The decision may have been influenced by the fact that NRG Stadium’s new Wi-Fi network had a big issue with moisture in under-seat AP placements, forcing a mid-season rip and replace for all the under-seat Wi-Fi APs.

Even though antennas under concrete are not as powerful, Perrault said Verizon is “very pleased with the performance. It’s a good compromise.”

Biggest stadium DAS?

Between the game being the Super Bowl and it being in Texas, there’s no shortage of hyperbole surrounding the game and all its attendant facets, including the network technology. But when Perreault claims that the DAS Verizon has installed for NRG Stadium “might be the largest we have anywhere,” that might be true since it also serves adjacent properties including the NRG Convention Center, the NRG Arena and an outdoor DAS in the surrounding spaces. In addition to Houston Texans games, NRG Park (which includes the stadium) is also host to the Houston Livestock Show and Rodeo, which humbly bills itself as the “world’s largest livestock show and richest regular-season rodeo.”

An alien spaceship, or a temporary cell tower from Verizon? You choose.

An alien spaceship, or a temporary cell tower from Verizon? You choose.

Inside NRG Stadium, Perreault said the new Verizon DAS (built before the 2015 season) has more than 900 antennas. As neutral host, Verizon will also provide access to AT&T and T-Mobile on its network; Sprint, which built a previous DAS at NRG, will continue to run on that system.

Outside the stadium and around Houston, Verizon has done the usual big-event preparations, with lots of permanent and temporary macro network improvements, and portable units like COWs (cells on wheels) and smaller NOWs (nodes on wheels). You can review all the Verizon preparations in a company blog post.

As previously reported in MSR, Verizon also helped foot part of the bill for the new NRG Stadium Wi-Fi network, a deal that will give Verizon a reserved claim to 40 percent of the Wi-Fi network’s capacity, according to Perreault.

Whether or not Super Bowl LI breaks the wireless data consumption records set at last year’s game remains to be seen, but Perreault said there doesn’t seem to be any slowing down yet of the perpetual growth in wireless data use at stadiums, especially at big events like the Super Bowl.

“Fans just seem to find ways to consume whatever additional bandwidth you provide,” he said.

NFL builds its own Super Bowl app, with no concessions delivery and fewer replays

Screen shot of map function on NFL Super Bowl LI app.

Screen shot of map function on NFL Super Bowl LI app.

The NFL has built its own Super Bowl mobile app, breaking with a recent history of using stadium-app specialists like VenueNext and YinzCam to develop specific apps for Super Sunday.

Also unlike recent years, the NFL’s Super Bowl app will not feature instant replays or have any kind of food or drink delivery services. Instead, there appears to be a big focus on promoting Super Bowl events (especially those for this weekend) and for helping out of town tourists find their way to Super Bowl events and to the game itself.

Curiously, an interview about the app with the NFL’s CIO claimed that this year’s app will also be the first to include the ability for fans at the game to watch Super Bowl commercials. The story also claims without any attribution that “In the past, commercials weren’t on the app in order to avoid using too much bandwidth in the stadium.” However, at the most recent Super Bowls, including the past two, stadium bandwidth has been more than sufficient enough to stream plenty of video. And in fact, both of the last two Super Bowl apps have included the ability for fans at the game to see Super Bowl commercials.

Last year’s app, developed by VenueNext for the Levi’s Stadium hosting of Super Bowl 50, definitely showed Super Bowl commercials, part of what the San Francisco 49ers network team said was a record-breaking day of app-based video watching. The Super Bowl 49 app, built by YinzCam, also included Super Bowl commercials according to this NFL video and according to our previous reporting.

Fewer replays, no food or beverage delivery service

Screen shot of transportation info links from Super Bowl LI app.

Screen shot of transportation info links from Super Bowl LI app.

And even though NFL CIO Michelle McKenna-Doyle is quoted in the previous story about the new app as saying “You won’t feel like you’re using two separate apps as fans have in the past,” the Super Bowl LI app contains a link to download the separate NFL Mobile app, which is apparently where Super Bowl highlights and replays will live. There was no confirmation from the NFL or Verizon about whether or not fans in the stands would be able to watch the live broadcast of the game via NFL Mobile. Fans not at the game will be able to use NFL Mobile to watch the game on cellular devices; fans can also stream the game from the FoxSports website, for PCs or tablet devices.

This year’s app will also not include any way for fans to use the app to order food or beverage delivery to their seats; last year’s app did have the ability to order in-seat delivery of beverages or to place an order for food and beverage express pickup, a service used for 3,284 orders. NRG Stadium, however, does not offer full-stadium in-seat ordering like Levi’s Stadium does; the stadium does have serving staff with wireless devices providing in-seat ordering services for club sections, which will likely be in use at the Super Bowl as well.

NRG Stadium hit 4.11 TB on Wi-Fi for Texans-Raiders playoff game

NRG Stadium. Credit: Houston Texans Instagram

NRG Stadium. Credit: Houston Texans Instagram

In what became the last live tune-up before the Super Bowl, NRG Stadium in Houston saw fans use 4.11 terabytes of data on the venue’s new Wi-Fi network during Houston’s 27-14 playoff victory over Oakland on Jan. 7, according to the Texans.

Jeff Schmitz, vice president of information technology for the Texans, said that NRG Stadium also saw approximately 35,000 unique users on the network at the playoff game, a 48 percent take rate against the total attendance of 71,790. The peak concurrent user number for the game was almost 24,000 users, with all numbers setting season highs for the network that debuted at the NFL season start, according to Schmitz.

“The playoff game was definitely the biggest” network-traffic day for the Texans, said Schmitz in a phone interview. During the talk Schmitz clarified that the network went through a serious up-and-down stretch during the middle of the season, due to under-seat Wi-Fi AP enclosures that didn’t completely seal out moisture.

Under seat APs visible down seating row. Credit: 5 Bars

Under seat APs visible down seating row. Credit: 5 Bars

While MSR had previously reported on the issue, Schmitz clarified that the full replacement of the APs took place in late October, meaning that the network staff had to basically re-tune and adjust the network in the later months of the season.

But the 4.11 TB mark and the large number of connected users for the playoff game was a sign that the network was in fine shape for Sunday’s Super Bowl LI, where if history offers any guidance there might be another new record set for single-day Wi-Fi usage.

The number to beat is the 10.1 TB mark from Super Bowl 50 at Levi’s Stadium last February, part of a 26 TB wireless day (with 15.9 TB recorded on cellular and DAS networks).

Wi-Fi coaches staying for Super Bowl

Schmitz also said that the Extreme Networks “Wi-Fi coaches” would be on hand for Super Sunday, helping fans figure out how to connect to the Extreme-based network and its 1,250 APs.

“We thought we’d only keep the coaches (who roam the stadium helping fans with network issues) for half a season, but with the switch [in APs] we ended up having them there for every game,” Schmitz said.

Wi-Fi gear visible above concourse kiosk. Credit: 5 Bars

Wi-Fi gear visible above concourse kiosk. Credit: 5 Bars

Having the Wi-Fi coaches at the Super Bowl also makes sense since many fans at that game will likely be visiting NRG Stadium for the first time, as opposed to Texans season ticket holders.

Though NRG Stadium won’t have to contend with temporary structures like those built on the concourses at Levi’s Stadium last year, Schmitz said there is some extra network work ahead to make sure the auxiliary press box area has “beefed up” Wi-Fi as well as wired connections for media use.

Another thing missing from last year’s Super Bowl is the ability for fans in any seat to order beverage delivery via the game-day app. Though details of services for the Super Bowl app have yet to be fully announced, Schmitz said the only in-seat delivery would be for premium club-level seats, which in addition to app-based ordering will have live humans who can take orders from fans for in-seat delivery, something Texans fans have available during regular-season games.

“That service [fans ordering from servers] gets used the most,” Schmitz said.

Sprint sees 797 GB at college playoff title game; will have separate DAS for Super Bowl

Ready for the playoffs and Super Bowl! Credit: 5 Bars

Ready for the playoffs and Super Bowl! Credit: 5 Bars

More results from fan wireless usage at the recent College Football Playoff championship game is trickling in, with Sprint claiming it saw 797 gigabytes of data traffic from its sites in and around Raymond James Stadium in Tampa.

Added to the 3.8 TB reported by AT&T on its networks, we now have a running total of approximately 4.6 TB of DAS usage for the Jan. 9 game between Clemson and Alabama, which Clemson won 35-31 on a last-second TD. We are still waiting for reports from Verizon Wireless and T-Mobile, so stay tuned.

We also have yet to receive any reports of Wi-Fi traffic from Raymond James Stadium officials, so it’s still undetermined how “big” of a wireless event the college championship game was this year. In the past two years, the CFP championship was among the top Wi-Fi single-day usage totals, but so far the Raymond James Stadium folks haven’t responded to any calls or emails requesting information. Anyone who was at the game who wants to comment on the Wi-Fi performance, feel free to jump in to the comments below.

Sprint on its own DAS at NRG Stadium

We also learned from Sprint and from NRG Stadium officials that Sprint will be on its own DAS and small cell network for the Super Bowl, and not on the new Verizon DAS that was installed last year. In a Sprint blog post the company said it saw 637 GB of data on its NRG Stadium network for a December Houston Texans game, ahead of what it saw on its networks during last year’s Super Bowl at Levi’s Stadium in Santa Clara, Calif.

According to David Moore, manager of information services for NRG Park, Sprint installed the original DAS in the venue, ahead of Super Bowl XXXVIII in 2004. AT&T and Verizon “migrated” to the new Verizon DAS last season, and T-Mobile will also be on the Verizon DAS, according to Moore.

New Report: First look at Sacramento’s Golden 1 Center

q4 thumbMOBILE SPORTS REPORT is pleased to announce the Winter 2016-2017 issue of our STADIUM TECH REPORT series, with a first look at the pervasive stadium technology built into the Sacramento Kings’ new home, the Golden 1 Center.

Also in our latest in-depth publication created specifically for the stadium technology professional and the stadium technology marketplace is a profile of a new Wi-Fi deployment at the Indiana Pacers’ Bankers Life Fieldhouse, and a profile of new Wi-Fi and DAS networks deployed at Arizona State’s Sun Devil Stadium. We also provide an update on how the new Wi-Fi network at Houston’s NRG Stadium is getting ready for the upcoming Super Bowl LI.

Renting a Wi-Fi network?

In addition to our historical in-depth profiles of successful stadium technology deployments, our fourth issue for 2016 has additional news and analysis, including a look at whether or not stadiums will soon be able to lease their Wi-Fi networks. Download your FREE copy today!

We’d like to take a quick moment to thank our sponsors, which for this issue include Mobilitie, Crown Castle, SOLiD, CommScope, JMA Wireless, Corning, Samsung Business, Xirrus, Huber+Suhner, ExteNet Systems, and Extreme Networks. Their generous sponsorship makes it possible for us to offer this content free of charge to our readers. We’d also like to thank you for your interest and support.

As always, we are here to hear what you have to say: Send me an email to kaps@mobilesportsreport.com and let us know what you think of our STADIUM TECH REPORT series.

Vikings hit peak of 4.32 TB for Wi-Fi use at U.S. Bank Stadium, with average 43 percent take rate

Game day at U.S. Bank Stadium. Credit all photos: Vikings.com (click on any photo for a larger image)

Game day at U.S. Bank Stadium. Credit all photos: Vikings.com (click on any photo for a larger image)

While the football season may not have gone exactly to Vikings’ fans wishes, the Wi-Fi network at U.S. Bank Stadium performed well during its inaugural NFL season, with a peak single-game data total of 4.32 terabytes used, part of a season average of 2.89 TB used during Vikings games.

According to statistics provided to MSR by Tod Caflisch, vice president and chief technical officer for the Vikings, the biggest data-use day was Sept. 18, 2016, during the regular-season home opener for the Vikings against the rival Green Bay Packers, a 17-14 Vikings victory. That contest also saw season highs for unique Wi-Fi users, with 31,668 fans connecting to the Wi-Fi at some point of the game day, and for most concurrent users, with 17,556 users connected at the same time. The 31,668 number represented a 49 percent take rate, with the game’s reported attendance of 64,786.

Even though Caflisch said the Vikings didn’t heavily promote the AmpThink-designed Wi-Fi network — which uses Cisco Wi-Fi gear in mostly handrail-mounted AP locations to serve the main bowl seating areas — the average take rate during the season was at the high end of numbers we’ve seen, with a 43 percent average over the two preseason and eight regular-season Vikings games.

Screen Shot 2017-01-12 at 11.41.21 AMAnd even though the total data-used number only crested 3 TB one other time in the season — a 3.16 TB mark during a 30-24 Vikings win over the Arizona Cardinals on Nov. 20, 2016 — the average mark of 2.89 TB per game showed solid, consistent use.

Caflisch said that the Vikings and U.S. Bank Stadium were also able to correct the train-snafu issue that arose at some of the early events at the new venue, which has a light-rail station right outside the stadium doors. While some of the first events had big lines of riders and not enough trains, Caflisch said that during the season extra trains were held in reserve at the transit station that is close to Target Field (a few stops down the line from U.S. Bank) and then filtered in as Vikings games neared their end.

“We were able to clear the [train] platform in 40 minutes after the last game,” Caflisch said. “The fans really loved the trains.” (More U.S. Bank Stadium images below)

Screen Shot 2017-01-12 at 11.39.38 AM

Vikings fans gather outside the stadium for pregame activites.

Screen Shot 2017-01-12 at 11.40.04 AM

Great nighttime view with city skyline visible through windows.

vik5

A look at the handrail Wi-Fi antenna mounts (this photo credit: Paul Kapustka, MSR)