NRG Stadium Wi-Fi ready for Super Bowl LI

NRG Stadium. Credit: Houston Texans Instagram

NRG Stadium. Credit: Houston Texans Instagram

Nonexistent a year ago, the new Wi-Fi network at Houston’s NRG Stadium has at least one more live game that administrators can use as a final tune-up before the venue and its wireless infrastructure host Super Bowl LI on Feb. 5.

Live since the start of the current NFL season, the Wi-Fi network deployed by integrator 5 Bars using Extreme Networks Wi-Fi gear has seen growth in fan usage for each subsequent game, according to David Moore, manager of information services for NRG Park.

“The first few games [of the season] it wasn’t heavily promoted, but as we went on usage shot up,” said Moore in a recent phone interview. Though he wouldn’t release specific figures on data use, Moore said that game-day totals near the end of the season saw in the range of 25,000 unique users per game, with data totals in the “4-5 terabyte” range. The stadium’s main tenants, the Houston Texans, will have at least one more home game this weekend when they host the Oakland Raiders in the first round of the NFL playoffs.

Under seat APs visible down seating row. Credit: 5 Bars

Under seat APs visible down seating row. Credit: 5 Bars

While it’s possible that the Texans could be hosting the AFC Championship game if all the higher-seed teams lose en route, this weekend’s game is most likely the last chance the NRG Stadium tech team will have as a dress rehearsal for the Super Bowl. Since the Super Bowl is historically the biggest single-day data-usage event — and has gotten bigger every year — all technical eyes will be on the NRG Stadium network, which only started becoming a reality after the stadium hosted last year’s men’s NCAA basketball Final Four. With a base seating capacity of 72,220, NRG’s Super Bowl crowd should roughly be the same as last year’s at Levi’s Stadium in Santa Clara, Calif.

Fast deployment schedule met

“It was a challenge [to deploy so quickly] and we are still working out the tuning,” said Michelle McKenna-Doyle, the NFL’s chief information officer, in an email interview. “We were fortunate to have the regular season to work on it, but hope to have it Super Bowl ready within next couple weeks. 5 Bars, Extreme Networks, The Texans, Harris County and the host committee all worked hard to make it a reality for our fans.”

At one point in recent history, it seemed like NRG might never get a fan-facing Wi-Fi network since the county-owned facility couldn’t find the budget necessary to bring wireless connectivity to the venue. But with the Super Bowl approaching, a consensus finally pushed through, with 5 Bars winning a deployment bid that still needed a change in equipment from Ruckus (the original supplier in the 5 Bars bid) to Extreme. While no official breakdown of funding shares has been supplied, the reported $6 million-plus cost of the Wi-Fi deployment was likely shared in some fashion by the Texans, the NFL, Verizon Wireless and Extreme.

Ready for the playoffs and Super Bowl! Credit: 5 Bars

Ready for the playoffs and Super Bowl! Credit: 5 Bars

According to Moore, Verizon chipped in to secure guaranteed offload for its cellular customers, as well as its own SSID that will automatically sign on Verizon customers in the facility, a tactic used by Verizon in several other NFL stadiums. Non-Verizon customer fans can use a free xfinitywifi SSID, as Comcast is the backbone supplier for the Wi-Fi network services.

According to Moore there are 1,250 Extreme Wi-Fi APs in the venue now, with 550 of those deployed under seats in the main bowl. While Moore said the under-seat location allows for much denser deployment and better network tuning, the method also caused the most headaches during deployment, beyond the usual cost and struggle of drilling through concrete floors.

First of all, the installers had to bring all the necessary power and cabling infrastructure in, since there was nothing underneath the concrete seat floors, Moore said. In fact, because there are offices underneath some of the seating areas, contractors had to negotiate a “drip pan” that kept moisture from seating power-washing away from the office roofing.

Another “big hiccup” emerged when the original equipment used for the under-seat locations didn’t lock out all the moisture, leading to a full replacement of all the 550 under-seat APs. Moore said the under-seat locations now use Extreme’s highest-grade outdoor-rated AP, the 3965i.

New DAS installed last year

Since Super Bowls also typically set records for cellular DAS usage, it’s no surprise that Verizon also recently updated the DAS at NRG Stadium, reportedly putting $12 million into a new system installed before the 2015 season. According to Moore, the DAS and the Wi-Fi also cover parking areas outside the venue, including a plaza where the Texans typically see 6,000 or more fans gathering before games.

“There’s great coverage” in the parking lots with the new DAS, Moore said. Announcements have not yet been made public, but you can expect that both AT&T and Verizon are busy beefing up the cellular systems in and around the stadium, as typical before any big public event.

With the dust finally settled, Texans fans and the soon-to-arrive Super Bowl fans will have good connectivity for the big day, due in no small part to the efforts of 5 Bars, which Moore complimented repeatedly for the company’s persistence and effort.

According to Moore 5 Bars had brought semi-trailers full of equipment to town ahead of the Final Four, and even used the floor of the old Houston Astrodome to roll out network inventory.

“They were working under the gun, with a limited amount of time to get it done,” said Moore of 5 Bars.

AT&T beefs up DAS at Tampa’s Raymond James Stadium ahead of College Football Playoff championship

Tampa's Raymond James Stadium. DAS antennas visible on light standards. Photos credit: AT&T

Tampa’s Raymond James Stadium. DAS antennas visible on light standards. Photos credit: AT&T

With the college football playoff championship game coming to Tampa’s Raymond James Stadium on Jan. 9, 2017, it’s no surprise that wireless carriers like AT&T have been beefing up coverage in and around the venue ahead of what is historically one of the biggest wireless-use events in sports.

According to our unofficial list, the last two college football playoff games rank fifth and sixth overall in the list of “most Wi-Fi used for a single-day event,” trailing only the last two Super Bowls, WrestleMania 32 and a Texas A&M home game against Alabama. (Note to stadium IT types: If you have a recent event that should be on our list, let us know!) DAS stats from the CFP championship games were also among the top usage totals for single-day events, with such numbers still growing year to year.

DAS antenna visible on red stanchion

DAS antenna visible on red stanchion

For this year’s game at the home of the NFL’s Buccaneers, AT&T said it had increased coverage via the stadium’s DAS by 400 percent, now up to a total of 452 antennas inside the venue. In and around town, AT&T said it had invested more than $9 million in new improvements, including 20 new or enhanced cell sites, ahead of the playoff championship weekend. In addition, AT&T will be deploying 2 cell on wheels or COWs during the event.

MSR TOP 3 TOTAL USAGE

1. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB; DAS: 15.9 TB; Total: 26 TB
2. Super Bowl XLIX, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB; DAS: 6.56 TB**; Total: 12.79 TB**
3. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB; DAS: 1.9 TB*; Total: 8.6 TB*

* = AT&T DAS stats only
** = AT&T, Verizon Wireless and Sprint DAS stats only

MSR TOP 5 FOR WI-FI

1. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB
2. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB
3. Super Bowl XLIX, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB
4. Alabama vs. Texas A&M, Kyle Field, College Station, Texas, Oct. 17, 2015: Wi-Fi: 5.7 TB
5. College Football Playoff championship game, AT&T Stadium, Arlington, Texas, Jan. 12, 2015: Wi-Fi: 4.93 TB

Stadium Tech Report: Carolina Panthers take ownership of DAS, Wi-Fi at Bank of America Stadium

James Hammond, director  of IT for the Panthers, poses next to an under-seat Wi-Fi AP. Credit all photos: Carolina Panthers

James Hammond, director of IT for the Panthers, poses next to an under-seat Wi-Fi AP. Credit all photos: Carolina Panthers

“The fan is the most valuable member of our team,” Jerry Richardson, owner of the Carolina Panthers, is fond of saying.

And it’s become the virtual mission statement for the Charlotte, N.C.-based National Football League franchise. So even though its home field, the Bank of America Stadium, was built relatively recently (1996), technology has come a long way in two decades. And as the Panthers began a four-phase renovation in 2014, they did it with fans’ MVP status in mind, according to James Hammond, director of IT for the Panthers. “It was time for some changes,” he said.

While Carolina was among the first NFL stadiums to install fan-facing Wi-Fi and enhanced cellular networks, the previous DAS and Wi-Fi systems weren’t keeping up with demand and that was starting to adversely impact the Panthers fan experience, Hammond said.

“We chose to perform a rip-and-replace on both DAS and Wi-Fi and take ownership in-house,” Hammond explained. Because the Panthers own and operate BofA Stadium, making those moves was a lot easier than if they were tenants.

Time for an upgrade

Editor’s note: This profile is part of our latest STADIUM TECHNOLOGY REPORT, which includes more stadium profiles as well as looks at Wi-Fi at the Mall of America, and analytics software being used by the Cleveland Browns. DOWNLOAD YOUR FREE COPY of the report today!

The first “fan-centric improvements,” as Hammond called them, came in 2014 in the form of escalators, video big boards and a distributed audio system. As part of the second phase of upgrades, the Panthers then used the 2015 offseason to renovate the club-level suites and tore out the old DAS system while they were at it. And after a careful evaluation of different DAS solutions, they shortlisted two vendors: CommScope and Corning.

CommScope ultimately got the nod; the Panthers then had to decide between the vendor’s ION-B and ION-U DAS systems. “We went with the ION-U, which was quite new and cutting edge at that point, since it had NEMA-rated remotes,” Hammond said. Other systems lacked that kind of weatherproofing and would require additional enclosures – and expense.

CommScope's ION-U powers the new DAS at Bank of America Stadium.

CommScope’s ION-U powers the new DAS at Bank of America Stadium.

“We started over with all new fiber and coax. We did the decommissioning and construction in 90 days, which was pretty quick for a ground-up project,” he said. Beam Wireless Inc. did the design, integration and optimization and is handling the ongoing maintenance of the DAS system; Optical Telecom installed the DAS gear. BofA Stadium now has 256 DAS remotes and more than 600 DAS indoor and outdoor antennas.

AT&T, Verizon and Sprint are the participating DAS carriers; T-Mobile is weighing whether to join the mix during the 2017 off-season.

The Panthers have divided BofA Stadium into 48 DAS zones: 16 zones for the upper bowl, 16 in the lower bowl, and another 16 for concourses, suites, clubs, and offices. Not all zones are used exclusively; carriers choose simulcast patterns that place multiple zones into sectors, and can change them as capacity requirements dictate, Hammond told Mobile Sports Report.

“With some minor design changes to the interior areas, we can accommodate nearly 70 zones,” he explained. “At present the most sectors in use by a carrier is 32. This means the carrier simulcasts across a mix of our 48 zones in order to match them up to 32 carrier sectors.”

Once the new DAS was built and the first couple of events were analyzed, carriers began asking for more frequencies and additional DAS sectors to continue meeting ever-growing demand. In response to the new carrier requests, the first round of DAS upgrades were implemented in the spring of 2016, Hammond said. During the 2015 season, DAS bandwidth was running around 2 GB during games. Hammond said, “With these latest DAS upgrades, we expect the bandwidth numbers to be even higher.”

A DAS remote in a NEMA-rated enclosure.

A DAS remote in a NEMA-rated enclosure.

The impact of the new DAS system was felt immediately upon its debut in July 2015. “It was a much better experience for fans who noticed the improved cellular experience,” Hammond said. Another unexpected benefit: The upgraded DAS helped mitigate bottlenecks with the old Wi-Fi system, which Hammond characterized as “under-designed.”

Going under seat for Wi-Fi upgrade

Unfortunately, there wasn’t time to address any Wi-Fi upgrades before the 2015 football season began, but the Panthers issued an RFP for new Wi-Fi in August 2015 in preparation for Phase 3 renovations that would also include security upgrades and renovations to the upper concourse.

Interested vendors needed to ensure high bandwidth rates as well as high take-rates that allowed three different ISPs (Time Warner Cable/Charter, Level 3 Communications and Windstream) to deliver in excess of 10 GB, though Hammond said they’re starting at a 7-GB threshold.

The Wi-Fi award went to Aruba, now HP Enterprise, in December 2015, and construction began in January 2016 after the last postseason game, when the Panthers beat the Arizona Cardinals to win the NFC championship and a trip to Super Bowl 50.

Similar to Levi’s Stadium and the Dodgers Stadium, the Panthers chose underseat AP enclosures; BofA Stadium sports 770 AP enclosures in the upper and lower bowls out of a total of 1,225 APs, all to ensure maximum coverage and minimal dead spots. The Panthers selected AmpThink to do the Wi-Fi integration and construction; the turnkey contractor also designed and fabricated a custom enclosure for the APs.

Indoor access point inside the stadium.

Indoor access point inside the stadium.

One other innovation in the Panthers’ Wi-Fi installation is that the underseat enclosure is mounted to the riser — the vertical part of the step — but looks like it’s on the tread, the horizontal part, which is intended as a waterproofing measure. “The riser is easier to seal and isn’t affected by pressure washers, which you’re doing constantly with an outdoor stadium,” Hammond said. “And by running pipe through the riser, you don’t have gravity working against you,” which helps keep out water, he explained.

Panthers fans access the stadium Wi-Fi through a portal page after accepting the team’s terms and conditions. From there, they are whitelisted and can automatically join the Wi-Fi network for the rest of the season. Hammond said a fan’s email is requested but not required by the portal page, and there’s a small incentive offered to encourage fans’ email subscriptions.

The new Wi-Fi system got a workout with a soccer game at BofA Stadium at the end of July 2016, then with a Panthers’ Fan Fest the following week. “All the indicators were good, and fan feedback about the system was excellent,” Hammond said. But he cautioned that the two events were not “full bowl” events with smaller attendance numbers (~50,000) than a regular season football game (75,000+). “We will continue to optimize and tune settings as we learn more during events with higher attendance,” Hammond said.

Total budget so far for the technology upgrades totals about $16 million; the DAS build-out was just under $10 million; Wi-Fi was a little more than $6 million, which included additional wired infrastructure, according to the team.

Beacons coming next

And the Panthers aren’t done making technology improvements to their stadium. Phase 4 looks to add Bluetooth beacons and do some refinement of the Panthers app. “My goal during the upcoming season is to look at options for location-aware services,” Hammond said. Some APs have beacons built in; other may need to be added to get the granularity the Panthers want for location awareness.

Hammond also wants to give fans more things to do with the Panthers app and also optimize it for push notifications, even with something as basic and useful as restroom and concessions location information. “As we learn more about fans individually, we can direct them to things of particular interest to them,” he added.

“So far, we are very pleased with the performance of the Wi-Fi and DAS systems,” Hammond said, noting the Panthers will continue to tune frequencies, add zones and increase bandwidth where needed. It’s the sort of attention that smart sporting franchises pay to their most valued team members.

car1

VenueNext lands $15 million Series B funding, adds San Jose Sharks as 1st NHL client

Screenshot from new San Jose Sharks app developed by VenueNext. Credit: VenueNext

Screenshot from new San Jose Sharks app developed by VenueNext. Credit: VenueNext

Stadium and venue app developer VenueNext has secured a $15 million Series B round of financing, as well as its first National Hockey League client, the San Jose Sharks.

Both announcements were made by VenueNext Tuesday, just ahead of Wednesday’s season opener for the Sharks at SAP Center in San Jose. The new app is ready for fans to download in time for the Sharks’ game against the Los Angeles Kings. Later this season fans will also be able to connect via the arena’s new Wi-Fi network, which will use Wi-Fi gear from Cisco.

The new round of funding brings VenueNext’s total of announced venture capital to $24 million, following a $9 million round raised last summer. Causeway Media Partners, which led the initial round, is also leading the new round; according to VenueNext some of its first-round investors are also participating in the B round, but the company did not yet name any of them other than Causeway. Twitter, Live Nation and Aruba were among the Series A investors in VenueNext.

Adding hospitality and healthcare to market targets

In the increasingly competitive market for stadium and team application development, VenueNext has had a solid year in breaking away from just being the app provider to the San Francisco 49ers and Levi’s Stadium, its initial offering. So far this year, new VenueNext apps have appeared at Super Bowl 50, Yankee Stadium, Churchill Downs for the Kentucky Derby, and at the Minnesota Vikings’ new home, U.S. Bank Stadium. VenueNext also announced a new app being developed for the Saratoga and Belmont horse-racing tracks, which will be launched next year.

SAP Center, home of the San Jose Sharks. Credit: SanJoseSharks.com.

SAP Center, home of the San Jose Sharks. Credit: SanJoseSharks.com.

While VenueNext still hasn’t come close to publicly announcing the 30 clients CEO John Paul said the company would have by the end of 2015, the list of announced clients now includes the 49ers and Super Bowl 50, the Dallas Cowboys, the Orlando Magic, and now the San Jose Sharks. According to VenueNext, it does have clients signed already in the healthcare and hospitality markets, but cannot name them due to confidentiality agreements. VenueNext said it will announce more customers in the next few months.

Sharks fans get beverage, not food, delivery to seats — for now

One of the signature VenueNext services at Levi’s Stadium, the ability for all fans to use the app to order concessions delivered to their seats, will initially only support in-seat beverage ordering and delivery for Sharks fans, according to VenueNext. That service is similar to how the VenueNext app was used at Super Bowl 50. Other new services now available at SAP Center via the app include digital ticketing, with the ability to view, upgrade or transfer tickets; the ability to view and manage parking passes; mobile ticket access via the VenueNext ticket kiosks; and team content.

According to Sharks chief operating officer John Tortora, the team was first introduced to VenueNext during the NHL Stadium Series game at Levi’s Stadium in February of 2015.

“We were impressed with their execution at that event and have witnessed the business success they have generated at sports venues throughout the country,” said Tortora of VenueNext in an email communiction. “We look to bring that standard to SAP Center.” According to Tortora, wayfinding and virtual reality experiences are among features that will be added to the app in the future.

The Sharks app page also says that during the season the app will add a large list of Sharks-related content, including team and league stats, and it will also add in-game trivia contests. So far in most of its deployments, VenueNext has added and improved features in its apps over time.

On the Wi-Fi side, the venue is now getting its first full-scale Wi-Fi network for fans, a deployment that will include the use of Cisco StadiumVision for digital-display controls. According to the Sharks, the Wi-Fi network is expected to be operational by Dec. 1.

“To complement our new Sharks app and the use of it at SAP Center, we are in the process of deploying Cisco Connected Stadium Wi-Fi, a best-in-class Wi-Fi platform used in sports venues around the world,” Tortora said. “We want our patrons to be able to easily and reliably connect while at SAP Center to allow for the best fan experience when attending Sharks games and other events.”

VenueNext said it now has 90 employees, with offices in Santa Clara, Calif., San Francisco, New York and London. The new funds, the company said, will be used to “continue to innovate on our platform,” and also to help launch the new vertical markets as well as expansion to international clients.

Analysis: The year of the big stadium Wi-Fi upgrade

Carolina Panthers director of IT James Hammond shows off a new under-seat Wi-Fi AP at Bank of America Stadium. Credit: Carolina Panthers

Carolina Panthers director of IT James Hammond shows off a new under-seat Wi-Fi AP at Bank of America Stadium. Credit: Carolina Panthers

Even in the midst of several brand-new stadium debuts and the future-proofed wireless networks inside them, there is a separate, yet distinct trend emerging in the big-stadium, wireless connectivity world: Call it the year of the big upgrade.

Our profile in our latest STADIUM TECH REPORT of Bank of America Stadium in Charlotte, N.C., is a case in point: Thanks to the never-ending demand for more connectivity for fans, stadiums that deployed networks just a few years ago are now finding that those old systems already need upgrades or replacements, typically at a much higher cost than the original network. In addition to BofA Stadium, the New England Patriots’ home, Gillette Stadium, also got a Wi-Fi makeover this past summer, going from about 400 Wi-Fi APs to well over a thousand, with most of the new ones deployed under seats.

According to Fred Kirsch, who oversees the Gillette Stadium network, some of the under-seat placements there were especially tricky, since granite underneath the stands didn’t allow for the ability to drill through the concrete. A workaround involving an above-ground enclosure was envisioned and manufactured, underlining the custom complexity of network deployment found from stadium to stadium. No two are the same, and what works at one may or may not work at another.

But what is common across all these large venues is the ever-increasing need for bandwidth, a moving target that has yet to slow down or stabilize. Last year the story that turned everyone’s head was the need by carriers to upgrade their DAS infrastructure at Levi’s Stadium ahead of Super Bowl 50 – this coming just a year after the stadium had opened for business. While the demands of a Super Bowl (especially Super Bowl 50, which set records for DAS and Wi-Fi usage) are perhaps much different than everyday events, it’s still a safe bet that for many stadiums with Wi-Fi networks – especially the early movers – 2016 has become a year of reckoning, or biting the bullet and writing more checks for more coverage, perhaps seemingly too soon after the initial rollout.

Getting ready for Super Bowl LI

In Houston, NRG Stadium finally has Wi-Fi, and not a moment too soon, with Super Bowl LI on the near horizon. Since the venue didn’t have Wi-Fi prior to this season it’s not really an upgrade but it’s hard to understate the challenge of putting in a Super Bowl-ready network in just one summer, a construction calendar shortened by the fact that integrator 5 Bars and equipment vendor Extreme Networks had to wait until after the NCAA Men’s Final Four was over to begin installing cabling and APs. At of the start of the NFL season the Wi-Fi network is already live at NRG Stadium, and is sure to go through weekly tweaks as the league marches on toward its championship game.

Gillette Stadium before the Sept. 11 game vs. the Miami Dolphins. Credit: Steve Milne, AP, via Patriots.com

Gillette Stadium before the Sept. 11 game vs. the Miami Dolphins. Credit: Steve Milne, AP, via Patriots.com

And while attention-grabbing new stadiums like US Bank Stadium in Minneapolis and Mercedes-Benz Stadium in Atlanta are planning big network capacity from the get-go, some new stadiums like T-Mobile Arena in Las Vegas have upgrade thinking planned in from the start, with the idea that the network will never really be a finished product, at least until they stop making new phones or developing new apps. Of course, that future isn’t happening anytime soon, with the Apple iPhone 7 announcement with the new double-lens camera coming in just before the start of another football season.

New phones and new apps mean more bandwidth demands, leading even those who already have stadium networks to keep wondering if what they’ve installed is enough. We suspect this may be an ongoing story line for the foreseeable future, so – stay tuned here to Mobile Sports Report for the latest success stories and lessons learned from those who have already jumped in or jumped back in to the deployment fray.

Editor’s note: This column is from our latest STADIUM TECH REPORT, which is available for free download from our site. Read about Wi-Fi deployments at Bank of America Stadium, Mercedes-Benz Stadium and more!

New Report: Carolina Panthers build new Wi-Fi and DAS; Mercedes-Benz Stadium update, and more!

Q3thumbMobile Sports Report is pleased to announce the Q3 issue of our STADIUM TECH REPORT series, the ONLY in-depth publication created specifically for the stadium technology professional and the stadium technology marketplace.

In addition to our historical in-depth profiles of successful stadium technology deployments, our Q3 issue for 2016 has additional news and analysis, including a look at Wi-Fi analytics at the Mall of America, and a story about how the Cleveland Browns found $1 million in ROI using new analytics software from YinzCam. Download your FREE copy today!

Inside the report our editorial coverage also includes:

— Bank of America Stadium profile: An in-depth look at the Carolina Panthers’ decision to bring new Wi-Fi and DAS networks in-house;
— Mercedes-Benz Stadium profile: An early look at the technology being built into the new home of the Atlanta Falcons, with an emphasis on fiber;
— T-Mobile Arena photo essay: A first look at the newest venue on the famed Las Vegas Strip;
— Avaya Stadium profile: How the stadium’s Wi-Fi network became the star of the MLS All-Star game.

We’d like to take a quick moment to thank our sponsors, which for this issue include Mobilitie, Crown Castle, SOLiD, CommScope, JMA Wireless, Corning, Samsung Business, Xirrus, Huber+Suhner, ExteNet Systems, DAS Group Professionals and Boingo Wireless. Their generous sponsorship makes it possible for us to offer this content free of charge to our readers. We’d also like to thank you for your interest and support.