Wi-Fi stats left on the bench in RootMetrics’ baseball stadium network performance scores

The folks at RootMetrics have another network research project out, one that claims to determine the best wireless connectivity in all the U.S. Major League Baseball stadiums. However, the report doesn’t include Wi-Fi network performance in any of its scoring processes, and it doesn’t publicly reveal the limits of its network tests, which are based on just one day’s results from a handful of devices in each venue and do not include any results from Apple iOS devices.

According to the RootMetrics survey, Fenway Park in Boston ended up atop their results, with strong scores for all the four major U.S. wireless carriers, a list that includes AT&T, Verizon Wireless, Sprint and T-Mobile. But the caveat about those “scores” is that they are composite results devised by RootMetrics itself and not a direct reflection of numerical network performance.

At Fenway, for instance, RootMetrics’ own results show that T-Mobile’s median upload and download speeds are 3.0 Mbps and 3.5 Mbps, respectively, while Verizon’s are 20.7 Mbps and 13.0 Mbps. Yet RootMetrics gives T-Mobile a third place at Fenway with a 89.5 “Rootscore,” compared to Verizon’s winning mark of 97.9, meaning that in RootMetrics’ scoring system a network six times as fast is only 10 percent better.

While it’s not included in the scoring or ranking, the Wi-Fi network at Fenway as measured by RootMetrics delivered speeds of 23.1 Mbps down and 22.0 up, besting all the cellular networks in the stadium. In its blog post RootMetrics does not explain why it doesn’t include Wi-Fi networks in its network measurements or scoring, even though its testing does show Wi-Fi performance at individual stadiums. Over the past year, Major League Baseball led a $300 million effort to install Wi-Fi networks in all MLB parks.

Unlike its metro-area tests, where RootMetrics uses “millions of data points,” the baseball stadium tests were calculated using just one device from each carrier — and all are Android-based, since RootMetrics’ internal testing system doesn’t run on iOS devices. And while RootMetrics said that for its results each park was visited “at least once,” in going through all 29 stadium reports there was only a single visit date mentioned for each one. RootMetrics also did not visit Rogers Centre in Toronto, home of the American League’s Blue Jays.

Levi’s Stadium sees another 2+TB of Wi-Fi during Ravens vs. Niners

Levi's Stadium during Sunday's game against the Baltimore Ravens. Photos: Levi's Stadium

Levi’s Stadium during Sunday’s game against the Baltimore Ravens. Photos: Levi’s Stadium

Another Sunday, another 2+ terabytes of data used on the Levi’s Stadium Wi-Fi network, as fans at the Ravens vs. the Niners game this past week used 2.18 TB of Wi-Fi data, according to figures from the San Francisco 49ers.

As the team and its stadium are gearing up to host Super Bowl 50 later this season, it appears that the Levi’s Stadium Wi-Fi network is continuing to perform in fine fashion, handling 16,840 unique Wi-Fi users during Sunday’s 25-20 victory by the Niners over the visiting Ravens. Statistics provided by Roger Hacker, senior manager of corporate communications for the Niners, also show a maximum concurrent Wi-Fi user number of 10,848 and a peak Wi-Fi bandwidth of 1.543 Gbps.

We still don’t have any numbers, however, on how well the Levi’s Stadium app is performing this season, specifically when it comes to fan use of innovative services like ordering food and drink to be delivered to the seat or even to someone else’s seat, features that are unique to Levi’s Stadium and its namesake app. VenueNext, the developer of the app for Levi’s Stadium, has not released any performance numbers for the specific services, including parking ticket purchases, food ordering and instant replay, so far this season.

If any Niners fans are out there and can comment about using the send-a-beer-to-someone-else service, we’re all beers. Or ears. The Levi’s Stadium network will get another workout Thursday when the Niners host the Seattle Seahawks, a game sure to bring lots of network use.

Screen shot 2015-10-21 at 4.59.34 PM

Niners fans celebrate during Sunday's win over the Ravens

Niners fans celebrate during Sunday’s win over the Ravens

Keeping the Wi-Fi hidden: AT&T Stadium perfects the art of Wi-Fi AP concealment

Wi-Fi antennas visible under the 'shroud' covering the outside of the overhang at AT&T Stadium. Photo: Dallas Cowboys (Click on any photo for a larger image)

Wi-Fi antennas visible under the ‘shroud’ covering the outside of the overhang at AT&T Stadium. Photo: Dallas Cowboys (Click on any photo for a larger image)

Since they like to do everything big in Texas, it’s no surprise that the IT team at AT&T Stadium has taken the art of Wi-Fi access point concealment to new heights.

To just above the first and second seating levels of the stadium, that is.

Even though the venue has more Wi-Fi APs than any sports stadium we’ve ever heard of, trying to find any of the 1,900 permanently installed APs is a tough task, thanks to measures like the fiberglass shrouds that circle the stadium just above the first and second seating levels. Underneath those custom-built coverings are numerous Wi-Fi APs, DAS antennas and even cameras, all contributing to the high level of connectivity inside AT&T Stadium while remaining invisible to the visiting fan’s eyes.

“The philosophy throughout the stadium is for a clean, stark look,” said John Winborn, chief information officer for the Dallas Cowboys Football Club, which is the primary tenant of the venue. “That’s a high standard, and that is a real challenge for us when it comes to Wi-Fi and DAS.”

In just about every stadium network deployment we write about, concealment and aesthetics are always one of the top concerns, especially when it comes to Wi-Fi access points and DAS antennas. For some reason, the physical appearance of an obvious piece of technology evokes strong reactions, even as other necessary structural items are ignored.

(Editor’s note: This story is an excerpt from our most recent Stadium Tech Report, the PRO FOOTBALL ISSUE, which is available for FREE DOWNLOAD right now from our site. In the report our editorial coverage includes a profile of the new Wi-Fi network at Green Bay’s Lambeau Field and team-by-team profiles of Wi-Fi and DAS deployments at all 31 NFL stadiums. Get your copy today!)

Under-seat Wi-Fi AP at AT&T Stadium. Photo: Dallas Cowboys

Under-seat Wi-Fi AP at AT&T Stadium. Photo: Dallas Cowboys

A clean, sleek look at the house that Jerry built

As one anonymous commentator at this summer’s SEAT conference noted, “stadium supervisors don’t ever care about seeing a 4-inch pipe, but leave one antenna out and they go crazy.” And whoever that stadium person is, he or she probably has a kindred soul in Dallas Cowboys owner Jerry Jones.

An unseen antenna is Jerry Jones’ favorite kind. Winborn said that AT&T Stadium embraces design in all things visible, noting that the “clean look” idea extends to advertising inside the seating bowl, where the only permanent signs are located in the end zone areas.

“We’re very conscious of the aesthetics here,” Winborn said. “Everyone here sees the benefit of what a great looking building can be. And it all starts with [Jerry] Jones.” Jones’ ideas, Winborn said, “are a major influence on everything we do.”

What that means when it comes to Wi-Fi is that while the stadium always aims to be the best-connected venue around – for this football season, AT&T Stadium will have 1,900+ permanent Wi-Fi APs and another 100 or so available for temporary placements – it also aims to hide the physical gear as much as possible. In suites and hallways there is the natural solution of putting antennas behind ceiling panels, but in the seating bowl, Winborn said, “we don’t have a lot of areas to hide them. We’ve had to become pretty clever about ways to hide APs.”

Two years ago, when the stadium’s AP count was going up from 750 to 1,250, the idea came about to design a custom fiberglass “shroud” that would circle the arena on the front of the overhangs above the first and second seating levels.

A row shot of the under-seat APs. Photo: Dallas Cowboys

A row shot of the under-seat APs. Photo: Dallas Cowboys

“We’re very conscious of the aesthetics here,” Winborn said. “Everyone here sees the benefit of what a great looking building can be.

Winborn said one of the IT staff members had contacts in the manufacturing world, which helped the Cowboys build a slighly convex design that wouldn’t be readily apparent to the untrained eye, yet be big enough to house Wi-Fi and DAS gear all the way around the bowl.

Winborn said the shroud and its underlying gear were installed during one of the recent off-seasons, taking about a couple months – and the final result was so good that Winborn says he needs to use a laser pointer to show interested parties exactly where the equipment shroud sits. Since it’s fiberglass the shroud is somewhat easy to move to allow administration and maintenance of the equipment, but the seamless flow of the structure around the bowl may just be the most elegant AP hiding strategy in the short history of stadium Wi-Fi.

But even with the shrouds there was still a need for more new placements, especially in the middle of the open seating areas. So last year the AT&T Stadium team started deploying under-seat AP enclosures, working with design teams at the AT&T Foundry program to build a custom unit that is much smaller and unobtrusive than other under-seat AP enclosures currently in use.

“We worked with the AT&T Foundry and went through [testing] about a half-dozen models,” Winborn said, before finally arriving at a design that worked well and stayed small. “It’s about the size of a small cigar box,” said Winborn of the under-seat APs, 300 of which were installed in the 100-level seating last year. Another 250 are being installed for this year up in the 300-level seating, he said.

Winborn credited the early use of under-seat APs by the IT team at AT&T Park in San Francisco as a welcome guide.

Here's the big bowl that needs to be filled with Wi-Fi. Photo: Paul Kapustka / MSR

Here’s the big bowl that needs to be filled with Wi-Fi. Photo: Paul Kapustka / MSR

“I talked to the Giants and Bill [Schlough, the Giants’ CIO] and had my concerns” about under-seat APs, Winborn said. “But after they did it and had only one complaint in 2 years, that raised my comfort level.”

Like the Giants’ under-seat APs, the ones in AT&T Stadium are designed to be as maintenance-free as possible, so that they can be steam washed and not harmed by spills or any other physical interactions. Winborn said the Cowboys have even started putting sealant and paint over the top of the under-seat APs, “so they look just like a bump.”

With 1,900 to 2,000 APs available, it might seem like the AT&T Stadium IT crew has enough APs for now, so they can relax a bit when it comes to finding new ways to hide Wi-Fi gear. But Winborn knows the next surge is probably right around the corner (including early results from this season showing 4+ terabytes of Wi-Fi use).

“Everything we are giving the fans [in Wi-Fi bandwidth] they are gobbling it up, pretty quickly,” Winborn said.

Rangers fans lead postseason baseball DAS usage on AT&T networks

Screen Shot 2015-10-14 at 11.43.57 AMFans at the Texas Rangers’ Globe Life Park in Arlington have so far topped the charts for cellular traffic totals on AT&T networks during baseball’s postseason, with an average of 992 gigabytes of data used in two games played.

Across all the series, DAS totals for postseason play showed big leaps in data use compared to regular-season totals, in one case almost six times as much. And while you can’t really compare apples to oranges it looks like DAS traffic for games this year might eclipse last year’s record wireless traffic totals at places like AT&T Park.

According to statistics provided by AT&T, game 3 of the divisional series between the Rangers and the Toronto Blue Jays saw 1,109 GB of data move across the AT&T DAS network at Globe Life Park, the highest single-game DAS total across all baseball venues this fall. Remember, stats mentioned here are ONLY AT&T customer traffic on AT&T networks in the stadiums mentioned. According to AT&T, the 992 GB average of the two games so far in Arlington are 51 percent higher than the average DAS use from the season’s opening series back in the spring.

Over in the National League, AT&T customers at Citi Field in New York used 617 GB of data during game 3, which AT&T said was an increase of 600 percent compared to average use during the Mets’ season-opening series. At games 1 and 2 in Dodgers Stadium, AT&T saw an average of 532 GB of data used per game, a 34 percent jump from the season-opening average in Chavez Ravine.

Game 3 in the Chicago Cubs vs. St. Louis Cardinals at Wrigley Field saw 500 GB of data used, a 120 percent jump compared to the season-opening series (which may be skewed since Wrigley was still undergoing construction at that point). For games 1 and 2 in Busch Stadium in St. Louis the AT&T networks saw an average of 586 GB per game, with 617 GB used during game 2.

For the Royals-Astros series, AT&T did not have any stats for games in Kansas City (perhaps because the Kauffman Stadium DAS is still being deployed) but for game 3 and 4 in Minute Maid Park in Houston AT&T saw an average of 237 GB per game.

Report excerpt part 2: App updates part of Levi’s Stadium prep for Super Bowl 50

New outward-facing TV screen at Dignity Health gate. Photos: Paul Kapustka / MSR

New outward-facing TV screen at Dignity Health gate. Photos: Paul Kapustka / MSR

Other than the Wi-Fi network, the other “tech” thing that really set Levi’s Stadium apart in its debut season last fall was the stadium app and its revolutionary services, like instant replay and in-seat food and beverage ordering to every seat in the stadium.

While those two services garnered most of the headlines, the Niners are also high on other less-heralded services the app also enabled, such as digital ticketing and directional info, both en route to the facility as well as wayfinding once inside the building.

If there was one thing that never really took off, it was use of the app’s instant replay services, which were stunning in their ability to have plays available for viewing on mobile devices just seconds after they had concluded on the field. With never more than a few thousand replays watched per game, the service team officials thought would be a real “wow” turned out to be one largely ignored.

(Editor’s note: This story is the second part of an excerpt from our most recent Stadium Tech Report, the PRO FOOTBALL ISSUE, which is available for FREE DOWNLOAD right now from our site. In the report our editorial coverage includes a profile of the new Wi-Fi network at Green Bay’s Lambeau Field, a profile of Wi-Fi concealment techniques at AT&T Stadium, and team-by-team profiles of Wi-Fi and DAS deployments at all 31 NFL stadiums. Get your copy today!)

The stadium app everyone’s still talking about

From personal visits to Levi’s Stadium, we can attest that another stadium technology – the two huge, crystal-clear video boards above each end zone – may have been the app-replay killers, because of their ability to be seen from anywhere in the stadium, along with the decision to offer up replays there in the same fast fashion fans are used to from television broadcasts. (Perhaps team officials remembered the deficiencies of Candlestick Park too well, where fans used to leave their seats to watch TVs mounted in the concession stands for replay video.)

Levi's Stadium app screenshot. Photo: VenueNext

Levi’s Stadium app screenshot. Photo: VenueNext

And while the food ordering services – which included both the in-seat delivery options as well as an “express pickup” service, where food could be ordered and paid for online, then picked up at a nearby stand without waiting in the regular line – didn’t garner more than a couple thousand orders per game, app developer VenueNext and the Niners said the app ordering did account for nearly a million dollars in concession revenue, a number that should only grow as fans become more familiar with the feature and the Levi’s Stadium team gets better at delivering.

Niners COO Al Guido said that delivery times for the in-seat service started out around 20 minutes, which he said “wouldn’t cut it” in the real world of a fan.

“If I can walk to a stand and get the order myself faster than delivery, what’s the point?” Guido asked.

But by the last six games of the season, Guido said the app team had figured out how to “bundle” deliveries to specific section areas, cutting the average delivery time down to 7 minutes. Even with the $5 extra delivery charge, Guido thinks the in-seat option delivers value along with your beer and hot dog. Especially if the app team and food runners are in sync.

“I do think we nailed it at the end of the year,” Guido said.

Better ticketing support, and more stadium customers?

VenueNext, the app development company that was started by the Niners for the express purpose of building the Levi’s Stadium app, will soon be spreading its wings with plans to announce at least 30 new customers (including the Orlando Magic) for its app development, measurement and deployment services. It might not be widely known that VenueNext also developed the innovative “Kezar” devices that scan tickets (or phones showing ticket codes) outside the stadium gates.

According to VenueNext CEO John Paul, the Kezar devices will in the future support near-field wireless technologies that could allow fans to just walk in the stadium without “showing” anything, as the radio waves perform the authentication process on their own by communicating with devices in pockets or purses.

The magical "rainbow" at June 27 Grateful Dead concert at Levi's Stadium. Photo: Levi's Stadium

The magical “rainbow” at June 27 Grateful Dead concert at Levi’s Stadium. Photo: Levi’s Stadium

The team and VenueNext are also improving the ticket-access technology for this season, adding the ability to buy parking passes online and be directed to that spot via the app. The Levi’s Stadium app, which previously had the ability to direct fans around the stadium, will later this year add the ability for fans to find each other via technology supported by the 2,000+ Bluetooth beacons installed throughout the venue.

Along with maintaining and supporting the app at games, VenueNext’s staff as well as Niners executives played host to numerous other team and stadium reps during the season (in five visits to Levi’s Stadium last year we saw such folks in attendance at every game). The parade was so strong it got Guido to joke about becoming “a master tour guide” for the facility.

While unconfirmed rumors surfaced this summer saying that VenueNext’s app services were going to appear soon at other NFL facilities, the company and the Niners have said they are also targeting other sports and even other types of venues, like shopping malls and concert facilities.

“A lot of people wanted to learn more about it,” said Guido of the app infrastructure, which also includes detailed marketing reporting and analytics of network and app usage, things important to any team or large venue that is seeking to improve the marketing knowledge it has of the people who come inside their buildings.

“Data was the first buzzword, and now everyone is trying to figure out how to improve the fan experience,” Guido said. Like on the Wi-Fi front, Levi’s Stadium’s app and app infrastructure are already ahead of the curve.

Outside operations and looking past Super Bowl 50

Compared to the polished jewel that is Levi’s Stadium, the geography directly surrounding the building is still somewhat of an unpolished gem. Because of the complicated parking situation – the stadium sits in the middle of a heavily built-up commercial zone with many tech-company buildings nearby, limiting available space for parking – getting to and from Levi’s Stadium was perhaps the biggest headache for fans last year, and will probably still be a challenge up to and beyond the Super Bowl in February.

VTA train line at late 2014 season Niners game. Only took 15 minutes from here to get on bus. Photo: Paul Kapustka / MSR

VTA train line at late 2014 season Niners game. Only took 15 minutes from here to get on bus. Photo: Paul Kapustka / MSR

According to Guido, the Niners spent more than $5 million in capital expenditures this offseason just on parking and transportation items around the stadium, including additional exit spots in the parking lots, which last year often became hellish traffic jams after games. He also said the team is working closely with the city of Santa Clara to draft new traffic plans for game days, and continues to work with the Valley Transportation Authority, which runs the light rail trains that stop right outside the Levi’s Stadium gates, to improve fan flow to and from the trains.

The Niners and DAS provider DGP also improved cellular coverage in the parking lots this offseason, addressing what Guido said was a top fan concern. And though the team currently offers some fan entertainment areas outside the stadium for pregame times, he said the league’s planned Super Bowl setups in the areas adjacent to the stadium – which in the past at Super Bowls have included areas for bands, food and other entertainment – will be watched closely to see how such amenities might become regular offerings.

“We’re going to take a real hard look at what the Super Bowl will do there,” in the areas outside the stadium for the official tailgate operations, Guido said. “They will get a lot of sponsors to activate in that area, and we can learn from them.” Guido also said the team is looking at possibly expanding its relationship with the next-door Great America theme park, perhaps using facilities like the park’s amphitheater for football-related events.

On the easy-to-see scale of improvements are two new video boards that face outside the stadium from the Intel and Dignity Health concourses. Guido said the boards will be used for social media engagement (the Levi’s Stadium app is encouraging fans to post pictures that may show up on the big screen), as well as possibly for showing live video like the NFL Network’s RedZone channel during pregame tailgating time.

Without a doubt, there will be more enhancements and features added to the Levi’s Stadium package before the big game rolls into town. But for now, Guido and the 49ers are confident they have a winning venue that will only keep getting better.
“Overall, we’re really happy how it all shook out,” Guido said. “We’re looking forward to kicking off year two.”

Cowboys fans at AT&T Stadium use 4.295 TB of Wi-Fi during Sunday’s game

Dallas fans cheering on the Cowboys Sunday. Photo: DallasCowboys.com

Dallas fans cheering on the Cowboys Sunday. Photo: DallasCowboys.com

It’s no fun to try to take on Tom Brady and the New England Patriots when your star quarterback and receiver are sidelined with injuries. But watching an undermanned team didn’t keep Dallas Cowboys fans from using a whole lot of Wi-Fi at AT&T Stadium Sunday, as statistics from AT&T show that 37,173 unique users consumed 4.295 terabytes of Wi-Fi data during the contest.

UPDATE, 10/20: We just heard from the AT&T network folks who told us that an additional 1.517 TB of data was used on the AT&T DAS network at the same game. So that’s nearly 6 TB of wireless data (and probably more with the other carrier DAS traffic added in) for a regular-season game… !

This is the second time this season that the defending Super Bowl champs helped run up a big wireless score when visiting an enemy arena. While we don’t have DAS stats yet for Sunday’s game (a 30-6 New England victory) it’s a good guess that 4+ TB is the “new normal” for big-ish regular season games at pro or college venues with high-fidelity Wi-Fi networks. Maybe it’s just a “the Patriots are in town” thing but we are betting we’ll see a lot more 4+ TB games around the country this football season.

Also according to AT&T, there was a peak concurrent user number of 25,551 connections Sunday, when combined with the 37,173 unique users is a pretty healthy user percentage out of the 93,054 in attendance. If you want to read a good story about how the IT team at AT&T Stadium got creative about hiding some of the almost 2,000 Wi-Fi APs they use inside the venue, download our latest report which has a feature all about those techniques.

That's sunlight, and not visible Wi-Fi beams, at AT&T Stadium. Photo: DallasCowboys.com

That’s sunlight, and not visible Wi-Fi beams, at AT&T Stadium. Photo: DallasCowboys.com