Stadium Tech Report: Wireless connectivity brings fans and business benefits to the Palace at Auburn Hills

The Palace at Auburn Hills. Credit all photos, Palace at Auburn Hills (click on any photo for a larger image).

The Palace at Auburn Hills. Credit all photos, Palace at Auburn Hills (click on any photo for a larger image).

Not too long ago, a marketing executive who was new to the Detroit Pistons’ ownership team tried to post a tweet during a game at the Palace of Auburn Hills. But to get the message to send, he had to … step outside the building.

Fast forward a few years, and the situation is completely reversed. Not only is there a storm of wireless connectivity inside the Palace, that same Wi-Fi and cellular traffic is keeping fans inside, bringing new fans in and giving the Pistons management team better insight into what all those fans want.

Using technology as an “accelerant,” the Pistons have changed the game for the fans and for themselves, seeding a process that seems destined to help the team build business success as their fan base evolves into one that expects and delights from an always-connected experience.

In a story-telling twist, we’ll tell you one of the early ends to this tale now: Even though the Pistons have suffered on the court of late, finishing the 2013-14 season with a 29-53 record, the team this year had a season ticket renewal rate above 80 percent, according to the Pistons management. Either there’s massive optimism in Motor City, or the Pistons ownership team is doing something very right in making the game-day experience something fans want to keep experiencing.

If you want to believe more in the latter reason, then listen to what Dennis Mannion, president and CEO of Palace Sports and Entertainment and the Detroit Pistons, has to say: There are a lot of smart programs now in place and some that are just starting to take off, but none of it happens, he said, without a solid communications core.

“It always comes back to the great accelerator, technology,” Mannion said.

Building the network inside the building

Editor’s note: This profile is part of our new Stadium Tech Report HOOPS AND HOCKEY ISSUE, available for free download. In addition to this story it contains additional profiles and team-by-team tech capsules for all 30 NBA teams. Download your copy today!

Mannion, who joined the Pistons in 2011 following a long career in sports management that included time as the Los Angeles Dodgers’ president and COO, and stints with the Baltimore Ravens, Denver Nuggets and Philadelphia Phillies, said the new commitment to technology started at the Pistons’ ownership level, where they knew things needed to change.

“When I came in to the job we knew there needed to be some technology improvements [at the Palace],” Mannion said. “We needed to make games more of a happening for our fans.” As part of an overall stadium renovation project that cost somewhere between $13 and $15 million, the Pistons started bringing the Palace into the world of wireless connectivity.

Screen shot of Pistons app

Screen shot of Pistons app

For help, Mannion and the Palace team enlised a Detroit sports-stadium technology consulting firm called Nuvuz Sports, run by CEO Scott Wruble, a former tech exec with the NBA and MLB, and chief marketing officer Jim Wolski. According to Wolski, when the technology revamp of the Palace started in 2012, there was a bit of a connectivity hill to climb.

“The entire building had nine cable modems, total,” Wolski said.

The first step was to start with a DAS, or distributed antenna system, to make sure cellular carriers could connect with their customers. The Palace team wound up picking Verizon Wireless to act as lead on a neutral-host DAS deployment, which is currently in the process of adding AT&T and Sprint to its system.

Opened in 1988, the Palace had some physical challenges when it came to wireless technology, including the omnipresent question of retrofits — where do you put the DAS head end? In the Palace’s case, the solution was a new building built outside, in a Palace parking lot.

Verizon helped on the next step in the deployment process by bringing in their longtime technology partner Ericsson to deliver the gear for the building’s Wi-Fi network. Though somewhat of a newcomer in the stadium Wi-Fi space, Ericsson’s long history in telecommunications equipment showed through with the Wi-Fi deployment, according to Mike Donnay, vice president for brand networks at Palace Sports & Entertainment.

“The performance from the Ericsson [Wi-Fi] equipment is super high,” said Donnay, who was the exec who had to leave the building to send the tweet before the renovation happened. Now, with 238 Wi-Fi access points in the venue (which seats 22,076 for basketball) Donnay doesn’t have any problems tweeting.

Nuvuz’s Wolski said that in addition to providing fan Internet access, the internal Wi-Fi network also powers the game-day ticketing operation as well as concession point of sale. It also is the base for a large suite of fan engagement platforms, which are hyper-targeted to the many different types of Pistons or other event fans who walk in the doors.

Clusters within the clusters

Kevin Grigg, vice president of public relations for the Pistons, said Mannion’s “big picture” ROI is to use technology to engage fans in a one-on-one relationship.

“The biggest challenge [in the past] has been if you are a fan and you buy a ticket, we didn’t know who you are,” Grigg said. “Now, we’re in a position to identify people during the engagement.”

Nuvuz’s Wolski concurs.

“It chages the game when you know who they [the fans] are,” Wolski said.

Mannion said the Pistons’ IT team is already well into the implementation of an elaborate fan-engagement system that breaks the fan base into multiple segments that can each be targeted with programs tailored to their wants and needs.

palace2a“We have different fan bases, from those who buy courtside seats, to those in corprate suites to families,” Mannion said. “We have affinity groups, like ‘future Pistons,’ women’s groups, and people interested mainly in attending concerts. We have clusters within clusters. And we use a combination of media, memories and merchandise for each cluster.”

On the team side, Mannion said that “even perceived ‘inside access’ is a real turn-on. Fans like to join, belong and brag.” Some ways fans can get “closer” to the team is to use the stadium app’s seat-upgrade feature (powered by partner PogoSeat) to purchase seats closer to the action, or by special access like post-game shootarounds on the court floor.

There is also a big focus on Pistons-related content, both from the team as well as from fans themselves. And increasingly, fans are turning to social media to share this content. The Pistons have responded with tricks like putting selfies tagged with the #pistonspride hashtag right onto the new huge center court video board.

The tech team also just added beacon technology to the Palace, and are already offering beacon-powered features like seat upgrades to fans who have seats in the upper levels, and discounts on merchandise to fans who are walking right outside the team shops. There are also scoreboard trivia contests and real-time fan polling, all of which keep fans engaged with the team and game even as they stare at their mobile devices.

“We wouldn’t be able to do all this without a connected arena,” Donnay said.

Connected now and for the future

Right now, Donnay said that approximately one-third of a regular Pistons game audience uses the Wi-Fi network, a take rate among the higher of reported crowd participation numbers. The Palace team also uses the Wi-Fi network to connect to 30 “smart carts,” which are mobile food carts that can be moved around (even outside the building) to take advantage of being where hungry fans are.

“It’s interesting to watch the heat maps of how the building is filling, and being able to tell concessions where to beef up,” Mannion said. In the past, he noted, many such game-day operations were decided by “gut feelings,” which could be right or could be wrong. Now, he said, there are facts and figures to back up the guesswork.

“Now you can still act on gut feelings, but you also have ways to prove what’s going on,” Mannion said. “You can do a digital promotion for food and beverage, and immediately measure the impact. That’s really fascinating.”

Even as they build on early successes, the team behind the Palace’s new tech operations knows that these are early days, and much work lies ahead. One current “big drag,” Mannion notes, is the plethora of social-media sharing platforms, a mix that includes Twitter, Facebook, Instagram, Vine, Snapchat and others, almost too many to track coherently.

There’s also a big challenge to keep pace with all the potential partners and digital features that could be added, like instant replays or food ordering for the stadium app; Mannion noted: “The question is, how do you create the right kind of [feature] incubation system, without spending too much money?”

At the very least, the Pistons team has grabbed a leading position in the connected-arena future, one where having advanced connectivity and engagement programs is table stakes to attract new potential season ticket buyers.

“We’ve seen colleges experience heartaches” when their fans leave because the stadiums don’t have connectivity, said Donney. “That’s the fan base that’s coming to the NBA. They’re going to expect that technology, so we’re going to have to be very good at it.”

So far, the Pistons and the Palace seem to be ahead of the curve of the new era of connected stadiums and the fans who fill them. Mannion, for one, knows he’s now in a much different business than the one he’s spent most of his career in.

“It’s a lot different now,” he said, “than just opening up the window and selling tickets.”

Stadium Tech Report: NBA, NHL teams deploying more Wi-Fi without league-wide help

Hoops and hockeySo who needs a league-wide stadium networking strategy, anyway? Neither the NBA nor the NHL has such a beast, but it doesn’t seem to be stopping the deployment of fan-facing Wi-Fi services that now reach almost every NBA arena and almost two-thirds of NHL venues.

That’s one of the main themes explored by our latest STADIUM TECH REPORT, the HOOPS AND HOCKEY ISSUE, now available for free download from our site. If you’re new to our site, our quarterly long-form reports are designed to give stadium and large public venue owners and operators a way to dig deep into the topic of stadium technology, via exclusive research and some profiles of successful stadium technology deployments.

We’d like to take a quick moment to thank our sponsors, which for this issue include Mobilitie, Crown Castle, SOLiD, CommScope, TE Connectivity, Extreme Networks, Aruba Networks, and JMA Wireless. Their generous sponsorship makes it possible for us to offer this content free of charge to our readers.

In this issue we take a look at NBA and NHL arenas, with profiles on how some of the leading teams and stadium owner/operators are using technology to improve the fan experience, even without a stated, public direction on stadium technology from their respective leagues. What did we discover? First, that the lack of such strategies may not be such a bad thing, with 24 out of 29 NBA venues and 19 out of 30 NHL venues all offering some comprehensive form of free fan-facing Wi-Fi.

And while the lack of a single strategic direction also means there’s a bit of chaos when it comes to picking technology or building a team app strategy, we also think that scramble could also be a bonus right now, providing more choice and competitive pricing as the industry starts to grow as a whole. Inside our 40-page-plus issue you’ll find four in-depth profiles of Wi-Fi and DAS networking deployments, and the kinds of things those deployments make possible, like greater granularity when it comes to knowing who the fans are. There’s also analysis on the situation from yours truly and some key thinking on DAS deployment strategies from industry thought leader Seth Buechley. Again, all this is yours for the free reading, just download your copy today!

HP buys Wi-Fi gear maker Aruba Networks for $3 billion

An Aruba AP inside the Moda Center

An Aruba AP inside the Moda Center

The rumors from last week were confirmed Monday, as computing giant Hewlett-Packard (aka “HP”) announced it was acquiring Wi-Fi gear vendor Aruba Networks for $3 billion. After cash and debt are accounted for, the actual value of the transaction is $2.7 billion, but what’s $300 million between friends?

Though the headline of the HP release pegs the reason behind the deal as the desire to “create an industry leader in enterprise mobility,” the acquisition will likely cause a lot of business activity in our corner of the world, namely wireless network deployments for large public venues, like stadiums. Over the past year, Aruba has been making a name for itself with high-profile Wi-Fi deployments in venues like the San Francisco 49ers’ new Levi’s Stadium, Texas A&M University’s Kyle Field, and the Dallas Mavericks’ American Airlines Center, among others. Perhaps the most interesting question from a business perspective is whether being part of HP will help or hurt Aruba when it comes to making stadium deals, and whether or not using HP core networking gear will become a required (or preferred) part of prospective stadium Wi-Fi deals.

On a business-wide view, the second $3 billion acquisition this year in the DAS/Wi-Fi space (following CommScope’s $3 billion purchase of DAS and networking supplier TE Connectivity) is perhaps a signal that consolidation is upon us in the greater Wi-Fi and local networking marketplace. Though we didn’t know exactly how and when such deals would shake out, on one hand it’s not that much of a surprise to us since we have always believed that the stadium networking market is really just a precursor to what will eventually happen in other large public venues as well as in large public places like cities and towns: Wi-Fi, which already carries more wireless data than cellular, will continue to expand and appear in more places, generating new business ideas like Wi-Fi phones and Wi-Fi first wireless plans.

The appearance of IBM as a strong entrant in the stadium wireless space can also be looked at as another signal that bigger players are entering the market, which usually means that smaller players — like the Arubas of the world — get snapped up, like a star player being traded mid-year to a team seeking a championship. Cisco, which is no stranger to acquisitions, has been quiet of late, and we are noticing that telecom gear giant Ericsson is making more moves toward Wi-Fi, especially in the arena of small cells and the idea of bringing LTE to Wi-Fi frequencies. Sounds like the Wi-Fi market is moving up from the $10 tables into the green- and black-chip territory.

Who’s next in the Wi-Fi world as an acquisition target? The easy picks are players like Ruckus Wireless and Aerohive Networks, given their ability to conduct their own IPOs. But we’re also guessing there may be some digesting of other smaller concerns in the Wi-Fi DAS food chain as the bigger players seek to add skills, customers and technology via purchases. Stay tuned for what should be an exciting year in the enterprise and stadium Wi-Fi business arena.

San Jose Earthquakes’ Avaya Stadium will have Wi-Fi for ‘soft’ preseason opener

Practice on the pitch at Avaya Stadium in San Jose. Credit all photos: Avaya (click on any photo for a larger image)

Practice on the pitch at Avaya Stadium in San Jose. Credit all photos: Avaya (click on any photo for a larger image)

Keeping in tune with its Silicon Valley location, the San Jose Earthquakes‘ new Avaya Stadium will have a bit of a “beta” launch this weekend when the Quakes host the Los Angeles Galaxy for a 2 p.m. preseason match on Feb. 28, with only 10,000 fans being allowed into the brand-new 18,000-seat venue.

While all the bells and whistles for Avaya Stadium may not be in place yet, one thing will be at full strength for the preseason tilt — the stadium’s free fan-facing Wi-Fi network. With 180 Wi-Fi access points from Wi-Fi gear supplier Ruckus Wireless and a 10 Gbps backbone pipe, the network should be ready for the first batch of selfies and other communications from the Bay area’s newest sports stadium, located right next to the San Jose airport a little bit south and west of the San Francisco 49ers’ Levi’s Stadium.

If the Avaya Stadium app gets finalized in time, fans who attend Saturday’s game will be able to use the “Phase 1” features which include ticketing, parking and concession information. According to Peter Thompson, managing director of global sponsorship for Avaya, a follow-on phase of the app will add in-game statistics, among other features being considered. Thompson said the unfinished feeling to the app is a bit by design, since Avaya and Earthquakes officials want to first get some fan feedback on things they’d like to have in an interactive platform.

In-stadium message board touts the Wi-Fi

In-stadium message board touts the Wi-Fi

“We’re trying to make this collaborative,” Thompson said in a phone interview Friday afternoon, following the official ribbon-cutting ceremonies at the stadium. “We’ll be looking for fans to tell us what they want [in the app] and see which ideas float to the top.”

And even though the crowd this weekend will be limited to 10,000 fans, Thompson is quite sure the network will see almost 10,000 devices access it, from fans as well as those from media at the game. Fans may want to switch to the Wi-Fi network early, since according to Thompson there isn’t yet a distributed antenna system (DAS) deployment inside Avaya Stadium, which might make cellular communications a bit constrained.

And even if the Avaya Stadium app launches in time for the game, Thompson isn’t sure it will be the most-used application. When Avaya ran networking operations for the recent Winter Olympics in Sochi, Russia, Thompson said iTunes and DropBox were at the top of the list.

“It [app usage] wasn’t what we expected, it wasn’t Facebook or Twitter [at the top],” Thompson said. “It will be interesting to see what happens.”

We will have stats from the Avaya Stadium network following the preseason match as well as the sold-out home opener on March 22. More photos from the stadium below.

Panoramic view of the field

Panoramic view of the field

Good look at the steep pitch of stands

Good look at the steep pitch of stands

Big scoreboard atop open-air bar area. Sure to be popular, with many beer taps available!

Big scoreboard atop open-air bar area. Sure to be popular, with many beer taps available!

Let's hope this grass holds up better than some other stadium turf we have seen

Let’s hope this grass holds up better than some other stadium turf we have seen

Soon to be full of soccer fans!

Soon to be full of soccer fans!

Hockey crowd melted down Levi’s Stadium network and app, overwhelmed light rail

Levi's Stadium scoreboard during Stadium Series hockey game. Credit all images: Paul Kapustka, MSR (click on any photo for larger image).

Levi’s Stadium scoreboard during Stadium Series hockey game. Credit all images: Paul Kapustka, MSR (click on any photo for larger image).

From a financial and publicity standpoint Saturday’s Coors Light Stadium Series hockey game at Levi’s Stadium was a success, with 70,205 fans packing the football facility to watch the San Jose Sharks lose to the Los Angeles Kings, 2-1. But while the sellout crowd contributed to the general electricity that filled the venue, the mass of people also caused problems with the stadium’s vaunted wireless network, knocking out some parts of the Wi-Fi and cellular networks and overwhelming the unique feature of the stadium app designed to allow fans to have food and drinks delivered to their seats.

Hockey fans also swamped the VTA light rail system, causing some fans to wait as long as two hours before they could catch a bus or train to get home from the stadium. Though light rail officials said they will work on correcting the problems, the commuting jam does not bode well for a facility that is scheduled to host Super Bowl 50 in less than a year’s time, especially since many Super Bowl fans are expected to be traveling from San Francisco to the Santa Clara, Calif., neighborhood where Levi’s Stadium sits.

According to Roger Hacker, senior manager for corporate communications for the San Francisco 49ers, the Levi’s Stadium network team identified “isolated interruptions” of the Wi-Fi network, due to “frequency coordination issues” that the network team had not seen at previous events. Hacker also said that one unnamed wireless carrier had “issues” with its base station firmware, but said that the problems were resolved by game’s end. (For the record, I am a Verizon Wireless customer and I had “issues” getting cellular connectivity Saturday, so draw your own conclusions.)

Since the Niners’ full explanation is somewhat light on facts and numbers, we will first offer a “fan’s view” of the events Saturday night, under the caveat that Mobile Sports Report was not attending the game as press, but instead as just a regular hockey fan (one who purchased two full-price tickets) who was looking forward to using the stadium’s technology to enhance the game experience. Unfortunately for this fan, the Levi’s Stadium network, app and transit services all fell down on the job.

Light show a dud

Though the MSR team had no problems getting to the stadium — our light rail train out of Mountain View at about 5:30 p.m. was relatively empty — I noticed some irregularities in network connections during the pregame ceremonies, when I tried to join in the fan-participation light show, a technology feature recently added to the Levi’s Stadium app especially for the Stadium Series game. Like many people in our area, I couldn’t get the app to work, leaving me staring at a spinning graphic while others in the stadium saw their phones contribute flashing lights during pre-game music.

After the light show segment ended, I noticed that the Levi’s app was performing erratically, quitting on its own and kicking my device off the Wi-Fi network. After rebooting the device (a new Apple iPhone 6 Plus) I still couldn’t connect to the Wi-Fi, an experience I’ve never had at Levi’s. Turning off the Wi-Fi didn’t help, as cellular service also seemed poor. Since I wasn’t really there to work — I just wanted to enjoy the game with my older brother, who was in town for the event — I posted a quick tweet and went back to just watching the Sharks play poorly for the first 20 minutes.

One of the benefits of being a close follower of Levi’s Stadium technology is that when you tweet, people listen. By the middle of the first intermission, I was visited personally by Anoop Nagwani, the new head of the Levi’s Stadium network team, along with a technician from Aruba Networks, the Wi-Fi gear supplier at the stadium. Even with laptops and scanners, my visitors couldn’t immediately discern the network problem; they were, however, visited by a number of other nearby fans, who figured out who they were and relayed their own networking problems to them.

To be clear: I didn’t spend the game as I usually do at Levi’s, wandering around to see how the network is performing at as many spots as I can. But even if the outage was only in our area, that’s a significant problem for Levi’s Stadium, which has touted its technology every chance it gets. I also noticed problems with cellular connectivity all night, which leads me to believe that the network issues were more widespread than just at my seating area.

The official statement from Hacker describing the problems doesn’t pin any specific blame, but a guess from us is that perhaps something in the mix of systems used by the entertainment performers (there was a small stage to one side of the rink where musicians performed) and media new to the facility caused the Wi-Fi problem. Here is the official statement on the Wi-Fi issues:

The Levi’s Stadium network team identified isolated interruptions of the WiFi system in specific sections on Saturday night due to frequency coordination issues previously unseen at the venue and unique to this event. Saturday’s event featured extra radio systems not typical to previous stadium events, some of which were found to be unauthorized by event frequency coordinators. To avoid similar situations in the future, Levi’s Stadium management will be initiating additional frequency control protocols for all events.

Hacker said the network team did not track exactly how widespread the outages were, so could not provide a number of fans affected. But enough apparently did connect, since according to Hacker, the Levi’s network saw near-record traffic Saturday night, with a total of 3.0 terabytes of data carried, second only to the season-opening Niners game back in September, which saw 3.3 TB of data used on the Wi-Fi. Hacker said there were 24,792 unique devices connected to Wi-Fi during Saturday’s event, with a peak concurrent user number of 17,400 users, also second highest behind the season-opener total of 19,0000. The Stadium Series game did set a new mark for throughput with 3.5 Gbps on the network just before the start of the game, a surge that seems to be behind some of the other problems.

Food ordering overwhelmed

During the intermission, my brother and I went out on the 300-level concourse to get something to eat and drink — and encountered one of the untold stories of Levi’s Stadium: the incredibly long and slow lines for concessions. While I haven’t researched this problem in depth, after 10 minutes of inertia in our line I told my brother I would use the app’s food and drink ordering function to get us some vittles and beverages. Finally able to connect via Wi-Fi while on the concourse I placed an order for two beers and two hot dogs, and didn’t worry that the delivery time was 20 minutes. That would put it at the very latest near the end of the second period, which was fine by me since it meant I didn’t have to wait in lines. Or so I thought.

Back in my seat, I was troubled by the fact that even halfway through the period, the app had not switched yet from ordered to “en route.” I also got some error messages I had never seen at Levi’s Stadium before:

When the period ended and there was still no movement from the app (which I only checked sporadically since Wi-Fi never fully connected in my seat), I went back on the concourse where I found a small, angry crowd around the food-runner window at the closest concession stand. Pretty much, everyone there had the same problem I had: We’d ordered food and the app had said that the order had been taken, but nothing had happened since then.

Fans trying to figure out why their food orders weren't delivered

Fans trying to figure out why their food orders weren’t delivered

The situation wasn’t good since nobody at the food-runner window had any technology that would allow them to communicate with the app or network team; they couldn’t even cancel orders or make sure credit card refunds would be processed, which only served to increase the frustration for the fans who were just trying to use the services as advertised.

In the end, the staff at the delivery window did the best they could — which at one point resulted in someone producing slips of paper which the waiting fans used to write down their orders; one staffer then tried to fulfill those orders as best he could, going to the concession stand and bringing them out one by one. After waiting nearly the full intermission (missing Melissa Etheridge) I was given two cold hot dogs and two draft beers. Since there were no food holders left at the stand, I had to put the hot dogs into my jacket pockets and hold both beers. At least I didn’t starve or go thirsty, but it was a far cry from the delivered-to-the-seat functionality I had raved about to my brother that simply didn’t materialize.

During this process I sent an email to Louise Callagy, vice president of marketing at stadium app developer VenueNext. Her in-game response was:

“Levi’s Stadium app usage exceeded any previous event and set new records, causing delivery and order fulfillment delays. As always, we will do a post mortem after the event, and make the necessary adjustments to operational and staffing support, including systems performance analysis. We apologize to any fans who were inconvenienced.”

According to Hacker, the Levi’s Stadium food-runner staffing was at the same level as a regular-season Niners’ game; however, Hacker said the hockey fans broke the previous ordering records before the first period was over. Here is the official statement on the food ordering snafu:

With more than 31,000 new downloads of the Levi’s Stadium App – 20 percent more than had ever been seen at any previous stadium event – the [food ordering] system experienced 50 percent higher order volume in the just first hour of the game than had been seen during any previous event. The dramatic increase led to the extended wait times and cancelled orders experienced by some fans.

In a separate email, Hacker did not provide an exact number for how many fans were represented by the term “some,” but he did confirm that “no customers were charged for unfulfilled orders.”

Still, the system shouldn’t have had any unfulfilled orders, at least not according to the Niners’ consistent hype of the network and the app. Remember, Niners officials had long been confident that their network would be able to stand up to any load. Such was not the case Saturday night.

The long wait home

VTA line following Levi's Stadium hockey game

VTA line following Levi’s Stadium hockey game

After an exciting third period and a game that went down to the final horn, we left the stadium and were immediately greeted by a mass of people packing in to the VTA departure area. With too many people and not enough trains and buses, we spent almost an hour moving like slow cattle until we eventually got on a train to Mountain View. We considered ourselves lucky, since it looked like the folks heading south on VTA were in for an even longer wait.

When we got to the Mountain View station, we waited almost another hour to leave since Caltrain (nicely) kept its last train at the station until two more VTA trains brought the stragglers in from Levi’s. Though VTA has since claimed there were more than twice the “normal” number of riders than it saw at Niners games this season, there was no explanation why VTA didn’t or couldn’t provide more capacity after it saw more fans use the service to get to the game. What was most unpleasant was the overall unorganized method of boarding the trains, just a massive group line with one VTA person on a bullhorn telling everyone to make sure they bought a ticket.

In the end, the time it took to get from the start of the VTA line to my house in San Mateo was three hours — almost as long as the game itself. With some other “special” events like Wrestlemania and concerts coming up at Levi’s and the Super Bowl 50 next year, it’s clear there is lots of work that needs to be done to make it a good experience for all who purchase a ticket, especially those looking to use public transport and the app features to enhance their game-day experience.

Sharks and Kings on the ice at Levi's Stadium

Sharks and Kings on the ice at Levi’s Stadium

Super Bowl XLIX sets new stadium Wi-Fi record with 6.2 Terabytes of data consumed

University of Phoenix Stadium. Credit: Arizona Cardinals.

University of Phoenix Stadium. Credit: Arizona Cardinals.

The Super Bowl is once again the stadium Wi-Fi champ, as fans at Sunday’s Super Bowl XLIX in Glendale, Ariz., used 6.23 terabytes of data during the contest, according to the team running the network at the University of Phoenix Stadium.

The 6.23 TB mark blew past the most recent entrant in the “most Wi-Fi used at a single-day single-stadium event” sweepstakes, the 4.93 TB used at the Jan. 12 College Football Playoff championship game at AT&T Stadium. Prior to that, pro football games this past season at Levi’s Stadium in Santa Clara, Calif., and at AT&T Stadium had pushed into the 3-plus TB mark to be among the highest totals ever reported.

The live crowd watching the New England Patriots’ 28-24 victory over the Seattle Seahawks also used about as much cellular data as well, with Verizon Wireless, AT&T and Sprint claiming a combined total of 6.56 TB used in and around the stadium on game day. All three carriers were on the in-stadium and outside-the-stadium DAS deployments being run by neutral host Crown Castle. If those figures are correct (more on this later) it would put the total wireless data usage for the event at 12.79 TB, far and away the biggest single day of wireless data use we’ve ever heard of.

Apple OS updates still the application king

Handrails with Wi-Fi antenna enclosures from AmpThink. Credit: Arizona Cardinals.

Handrails with Wi-Fi antenna enclosures from AmpThink. Credit: Arizona Cardinals.

Mark Feller, vice president of information technology for the Arizona Cardinals, and Travis Bugh, senior wireless consultant for CDW, provided Mobile Sports Report with the final Wi-Fi usage numbers, which are pretty stunning for anyone in the stadium networking profession. According to Feller the new CDW-deployed Wi-Fi network with Cisco gear at the UoP Stadium saw 2.499 TB of data downloaded, and 3.714 TB uploaded, for a total of 6.213 TB of Wi-Fi usage. Bugh of CDW said there were 25,936 unique devices connecting to the network on game day, with a peak concurrent usage of 17,322, recorded not surprisingly at halftime.

Peak download usage of 1.3 Gbps was recorded before the game’s start, while peak upload usage of 2.5 Gbps was hit at halftime. The top applications by bandwidth use, Feller said, were Apple (mobile update), Facebook, Dropbox and Snapchat.

DAS numbers also set new record, but clarification needed

The only reason we aren’t yet trumpeting the 6.564 TB of reported DAS use as a verified record is due to the differences in clarity from each of the reporting providers. We also haven’t yet heard any usage totals from T-Mobile, so it’s likely that the final final wireless data use number is somewhere north of 13 TB, if all can be believed.

Parking lot light poles, Westgate entertainment district. Can you spot the DAS?

Parking lot light poles, Westgate entertainment district. Can you spot the DAS?

As reported before, AT&T said it saw 1.7 TB of cellular wireless activity from its customers on game day, with 696 GB of that happening inside the stadium, and the balance coming from the outside areas before and after the game. We’d also like to welcome Sprint to the big-game reporting crew (thanks Sprint!), with its total of 754 GB of all 4G LTE traffic used in and around the stadium on game day. According to Sprint representatives, its Super Bowl coverage efforts included 5 COWs (cell towers on wheels) as well as expanded DAS and macro placements in various Phoenix-area locations. The Sprint coverage included the 2.5 GHz spectrum that uses TDD LTE technology.

As also previously reported, Verizon Wireless claimed 4.1 TB of customer traffic in and around the stadium on game day, which Verizon claims is all cellular traffic and does not reflect any Verizon Wireless customer use of the stadium Wi-Fi network. Verizon also reported some other interesting activity tidbits, which included 46,772 Verizon Wireless devices used at the game, of which just 59.7 percent were smartphones. Verizon also said it saw 10 million emails sent on its networks that day, and 1.9 million websites visited, while also seeing 122.308 videos sent or received over wireless connections.

We’re still waiting to see if we can get usage numbers from the Super Bowl stadium app (we’re especially interested to see if the instant replay feature caught on) but the warning for stadium owners and operators everywhere seems to be clear: If you’re hosting the big game (or any BIG game), make sure your network is ready for 6 TB and beyond!