Mobilitie, AT&T beef up DAS coverage at Churchill Downs ahead of Kentucky Derby

White DAS antennas visible on the overhangs at Churchill Downs. Photo: Mobilitie (click on any photo for a larger image).

White DAS antennas visible on the overhangs at Churchill Downs. Photo: Mobilitie (click on any photo for a larger image).

Since it’s legal in horse racing, how about a bet? Who thinks the final AT&T DAS traffic total from the Kentucky Derby weekend will pass 10 terabytes this year? After hitting 5.1 TB during last year’s two days of racing, what are the odds on wireless data used there doubling down again? Anyone want to bet against growth?

For sure, operators of the wireless infrastructure at the track aren’t going to left behind for lack of trying — according to neutral-host DAS provider Mobilitie and DAS design partner AT&T, there will be approximately a 50 percent increase in AT&T’s cellular capacity at Churchill Downs this year, with double coverage in the 1900 MHz band compared to last year, according to AT&T.

Mobilitie president Christos Karmis said in a phone interview this week that “every year, the amount of data used has doubled,” at least since Mobilitie put in the first part of the DAS at the track for the 2013 event. Since then, Karmis said the DAS antenna count has grown from 253 to 290, and the network now has 55 sectors, in and around the track and seating areas as well as in the parking lots. In addition to AT&T, the DAS also carries traffic for Verizon Wireless and T-Mobile, neither of which have reported traffic totals from the event.

Biggest DAS in sports?

Where all the Kentucky Derby race-day social media posts go to find the Internet (aka the head end at the Churchill Downs DAS). Photo: Mobilitie

Where all the Kentucky Derby race-day social media posts go to find the Internet (aka the head end at the Churchill Downs DAS). Photo: Mobilitie

With race day drawing 170,513 fans last year, the Kentucky Derby may well be one of the most challenging events to provide wireless coverage to, with multiple spikes in traffic due to two full days of racing (there are 13 races scheduled for Friday May 6, the Kentucky Oaks Day, and 14 scheduled for Saturday May 7, the Kentucky Derby Day).

According to Karmis, the fans are mainly shooting video and taking pictures during the races, and then posting those images to social media networks during the breaks in between. And then there’s the betting, which can be done on premises via the twinspires app, which drives additional traffic. And then there’s the hats and fashion, which are worth lots of pictures themselves, especially if you see any celebrities during the red-carpet parade.

Though there is still a small amount of Wi-Fi in the main track buildings — at least there was a couple years ago when we did a profile on the new networks — the DAS is the workhorse at the venue, which spreads out far and wide and includes an infield area full of fans as well.

“It’s crazy to try to keep up” with the data demands, Karmis said.

With any luck on our side, we’ll be able to get Verizon and T-Mobile to send over their DAS stats after the event to see if the weekend of races can match the DAS total of 15.9 TB from Super Bowl 50. If the AT&T data alone has gone from 2 TB two years ago to 5.1 TB last year, what’s the total going to be for this year? Put your predictions in the comments below!

T-Mobile Arena opens in Las Vegas, with 565 Wi-FI APs

T-Mobile Arena, Las Vegas, on the official April 6 opening. All photos: Cox Business (click on any photo for a larger image)

T-Mobile Arena, Las Vegas, on the official April 6 opening. All photos: Cox Business (click on any photo for a larger image)

If they build it, will professional hockey or basketball teams come? The first part of that question has already been answered, with the official opening of T-Mobile Arena in Las Vegas on April 6, just in time for a kickoff concert from the Killers. With 565 Cisco Wi-Fi access points, the arena is well-enabled for wireless access; the big question is, will an NHL or NBA team soon call the place home?

With no deal announced for either league it’s an open-ended question. For now, the 20,000-seat venue, located just west of the strip near the New York New York hotel/casino (right next to the freeway) will have to be satisfied hosting all kinds of events from concerts to one-off sports events like the Harlem Globetrotters (April 19) and a WWE event in June. Fans at any event will be able to use free Wi-Fi provided by Cox Business, which is the “exclusive Technology Integration/Telecommunications Services Provider,” according to a press release from the official opening ceremonies.

While we haven’t visited the arena yet — we are looking forward to a hosted tour during this summer’s SEAT Conference in July — the $375 million multi-purpose venue, owned by a joint venture between AEG and MGM Resorts International, looks pretty cool with its overhanging lounges and outdoor plaza with real, live trees, a rarity on the strip. Inside, the tech underpinnings sound state of the art, beginning with a 10-Gigabit fiber optic network that serves as the arena’s backbone.

Special shrouds for the Wi-Fi APs

Custom shroud for Wi-Fi APs at T-Mobile Arena

Custom shroud for Wi-Fi APs at T-Mobile Arena

According to figures provided to us by Cox Business folks, the 565 Wi-FI APs include a mix of indoor and outdoor models from Cisco, some designed for office-type settings and some designed to withstand outdoor temperatures and weather. According to Cox its on-site engineers also designed a “vanity cover” type of shroud, which is more aesthetically pleasing to the eye while also helping keep the AP safe from “disruptions,” like possibly being bumped or some other physical intrusion.

The arena will also use Cisco’s StadiumVision system to provide synchronized content feeds to the 767 4K-capable digital displays throughout the venue. Thanks to the Cox sponsorship, that content could include “all 60 channels of high-definition news, sports and entertainment content from the Cox cable channel lineup as well as live in-house feeds from the arena,” according to Cox.

We have also heard reports, but have not confirmed with the company, that Mobilitie will be providing the in-venue DAS. Mobilitie’s involvement is not a big surprise, given that the company partnered with MGM in the past to bring Wi-Fi to the resort company’s casinos. Back when the T-Mobile naming sponsorship was announced, there were reports of special discounts and VIP access for T-Mobile customers, but so far none of that information was easily discovered on the arena’s website. Stay tuned for more updates as we get them on the DAS/cellular side of things; anyone who visits the arena soon should take a speedtest and post the results here in the comments.

Jeff Breaux, vice president of western operations, Cox Business, (left) and Derrick R. Hill, vice president, Cox Business/Hospitality Network, gesture toward the exterior digital signage at T-Mobile Arena.

Jeff Breaux, vice president of western operations, Cox Business, (left) and Derrick R. Hill, vice president, Cox Business/Hospitality Network, gesture toward the exterior digital signage at T-Mobile Arena.

UPDATE: WrestleMania 32 sets new Wi-Fi mark at AT&T Stadium; total Wi-Fi + DAS hits 8.6 TB

The Undertaker arrives at AT&T Stadium for WrestleMania 32. Photo: WWE.com

The Undertaker arrives at AT&T Stadium for WrestleMania 32. Photo: WWE.com


UPDATE: Fixes an MSR calculation error on DAS figures.

The 101,763 fans who filled AT&T Stadium Sunday for WrestleMania 32 set new stadium records for Wi-Fi, according to figures provided by AT&T Stadium and AT&T, with 6.77 terabytes of Wi-Fi traffic and an additional 1.9 TB on the AT&T network on the stadium’s DAS for a total wireless figure of 8.6 TB.

The Wi-Fi numbers put Sunday’s signature WWE event (also the biggest WrestleMania by attendance) into second place in our unofficial record-keeping of the largest single-day Wi-Fi traffic stadium events. Only Super Bowl 50 at Levi’s Stadium earlier this year was bigger, with 10.1 TB of Wi-Fi traffic. So far, WrestleMania 32 is also now third in combined Wi-Fi and DAS figures, trailing Super Bowl 50 and Super Bowl XLIX (see charts below).

THE NEW TOP 3 TOTAL USAGE

1. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB; DAS: 15.9 TB; Total: 26 TB
2. Super Bowl XLIX, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB; DAS: 6.56 TB**; Total: 12.79 TB**
3. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB; DAS: 1.9 TB*; Total: 8.6 TB*

* = AT&T DAS stats only
** = AT&T, Verizon Wireless and Sprint DAS stats only

THE NEW TOP 5 FOR WI-FI

1. Super Bowl 50, Levi’s Stadium, Santa Clara, Calif., Feb. 7, 2016: Wi-Fi: 10.1 TB
2. WrestleMania 32, AT&T Stadium, Arlington, Texas, April 3, 2016: Wi-Fi: 6.77 TB
3. Super Bowl XLIX, University of Phoenix Stadium, Glendale, Ariz., Feb. 1, 2015: Wi-Fi: 6.23 TB
4. Alabama vs. Texas A&M, Kyle Field, College Station, Texas, Oct. 17, 2015: Wi-Fi: 5.7 TB
5. College Football Playoff championship game, AT&T Stadium, Arlington, Texas, Jan. 12, 2015: Wi-Fi: 4.93 TB

Wi-Fi not to blame for stadium entry issues

John Winborn, chief information officer for the Dallas Cowboys Football Club, said in an email that the reported claims of the Wi-Fi being offline Sunday — and that being the reason why entry lines were long and slow — were not true. While Winborn did admit that one single Wi-Fi AP (out of the more than 2,000 in the stadium’s network) was offline and there were “a couple issues” with ticket scanners, he said “there were no Wi-Fi issues that would have had a significant impact on ingress.” Other reports have claimed the doors were opened later due to extended show rehearsals, while commenters on MSR’s posts have claimed that a lack of wristbands for stadium-floor seating also led to seating issues even for fans already inside the main building entrances. So far, we have not seen any official explanation for the delays other than the official apology from the stadium and the WWE:

“To ensure the safety of WWE fans, increased security measures were put in place tonight. We apologize that it may have taken some fans longer than usual to get into AT&T Stadium.”

During Sunday’s event Winborn said the Wi-Fi network saw 20,462 concurrent and 34,951 total user connections, some via a network of 150 temporary Wi-Fi APs installed among the seats on the stadium floor.

Betting the Under (Part 2): Putting Wi-Fi antennas under seats is the hot new trend in stadium wireless networks

Under-seat Wi-Fi AP at Levi's Stadium. Photo: Paul Kapustka, MSR (click on any photo for a larger image)

Under-seat Wi-Fi AP at Levi’s Stadium. Photo: Paul Kapustka, MSR (click on any photo for a larger image)

Part 2 of this story picks up with the decision to put Wi-Fi APs under seats at Levi’s Stadium. If you missed it, here is the link to Part 1.

According to Chuck Lukaszewski, now vice president of wireless strategy and standards at Hewlett Packard Enterprise (formerly very high density architect in the CTO Office of Aruba Networks), Aruba had been testing under-seat AP designs since around 2010, “in one form or another.” There were some initial tests of under-seat AP deployments at Turner Field in Atlanta and at American Airlines Arena in Dallas, but nothing on the scale of AT&T Park’s 2013 deployment, or on the scale Aruba planned to have at Levi’s Stadium when it opened in 2014.

Some of the first under-seat Wi-Fi deployments in other arenas were actually deployed completely under the stands, Lukaszewski said, with signals shooting up through the concrete. Though he said “you could get reasonably good throughput through concrete,” especially for 2.4 GHz frequencies, installing antennas above the concrete was “considerably better,” Lukaszewski said.

Curiously, one of the biggest problems in stadium Wi-Fi deployment — especially for those heavy on overhead antenna use — is negotiating interference between antennas; sometimes, clients can “see” antennas and APs that are across the stadium, and will try to connect to those instead of the AP closest to them, a problem that leads to inefficient bandwidth use. Interference also means you can’t place APs too closely together, making it somewhat of an art to find ways to increase coverage without increasing interference.

Dan Williams, former VP of technology for the San Francisco 49ers, talking networking at Levi's Stadium. Photo: Paul Kapustka, MSR

Dan Williams, former VP of technology for the San Francisco 49ers, talking networking at Levi’s Stadium. Photo: Paul Kapustka, MSR

What Aruba found in its testing, Lukaszewski said, was that under-seat Wi-Fi AP deployments could be far more dense than overhead-centric designs, mainly because the human bodies in the seats would provide beneficial “blocking” of signals, allowing network designers to place APs more closely together, and to be able to re-use the same Wi-Fi channels in more antennas.

“If you can use human bodies to contain signals, you can have much smaller cells,” Lukaszewski said. Under-seat deployments, he said, “allows us to re-use the same channel less than 100 yards away.”

With more channels available for each AP, the difference in the metric Lukaszewski calls “megabytes per fan” can be “profound” for an under-seat design versus an overhead design, he said.

“We do see trends [in stadium network data] of under-seat being able to deliver well over 100 MB per fan per event, while overhead designs [deliver] significantly under 100 MB per fan per event,” said Lukaszewski.

Dan Williams, the former vice president of technology for the San Francisco 49ers, said he and Lukaszewski were in agreement that under-seat was the best method to deploy at Levi’s Stadium.

Kyle Field at Texas A&M. White spots in stands are under-seat AP locations. Photo: Paul Kapustka, MSR

Kyle Field at Texas A&M. White spots in stands are under-seat AP locations. Photo: Paul Kapustka, MSR

“I just did not believe in overhead,” said Williams, who said he brainstormed with Aruba’s Lukaszewski on the under-seat idea, which they both brought to the Wi-Fi design at Levi’s. By using under-seat APs, Williams said, the Levi’s Stadium design looked to provide “cones [of bandwidth] around the audience, immersing [fans] in a signal.”

After beating the previous year’s Super Bowl Wi-Fi total at its NFL regular-season opener in 2014, Levi’s Stadium’s Wi-Fi network more than passed its biggest test ever this year, carrying a record 10.1 terabytes of Wi-Fi data during Super Bowl 50. Those numbers are proof of Lukaszewski’s claim: “By far, under seat is better.”

New deployments trending to under-seat

Editor’s note: This excerpt is from our latest STADIUM TECH REPORT, our long-form PDF publication that combines in-depth stadium tech reports with news and analysis of the hottest topics in the world of stadium and large public venue tech deployments. Enjoy this PART 1 of our lead feature, or DOWNLOAD THE REPORT and read the whole story right now!

Even though under-seat deployments can be considerably more expensive, especially in a retrofit situation where deployment requires coring through concrete, many stadiums are now seeming to agree with another Lukaszewski claim, that “the return absolutely justifies the investment.”

At AT&T Stadium in Arlington, Texas, the Cowboys quicked followed their sister park’s lead and installed under-seat APs in force ahead of that venue’s hosting of the inaugural College Football Playoff championship game in January of 2015. John Winborn, chief information officer for the Dallas Cowboys Football Club, said the team worked with AT&T’s “Foundry” innovation centers to produce a smaller, sleeker under-seat AP enclosure that fit well with the stadium’s commitment to aesthetics.

Back on the baseball side, the Giants now have 1,628 Wi-Fi APs in their park, with the vast majority of them under-seat, in all three decks of seating. And the Giants’ main rival to the south, the Los Angeles Dodgers, also used under-seat APs in a recent Wi-Fi upgrade.

Close-up of conduit running to under-seat AP at Kyle Field. Photo: Paul Kapustka, MSR

Close-up of conduit running to under-seat AP at Kyle Field. Photo: Paul Kapustka, MSR

And if Levi’s Stadium led the way for under-seat Wi-Fi, the new mainly under-seat network at the refurbished Kyle Field at Texas A&M might be the QED on the debate, with ultra-fast network speeds and big data-consumption numbers (including 5.7 TB of Wi-Fi at a game versus Alabama) adding measureable momentum to the under-seat trend. Bill Anderson, CEO of Wi-Fi deployment strategy firm AmpThink, said he was an early disbeliever in under-seat Wi-Fi — until he saw the numbers.

“At first we mocked it, made fun of it,” said Anderson, whose firm has been called in to produce Wi-Fi network designs for several recent Super Bowls, as well as for the Kyle Field design. But when Aruba showed AmpThink the data from under-seat tests and deployments, “that was the ‘a-ha’ moment for us,” Anderson said.

Working with Aruba at Kyle Field, AmpThink was able to collect its own data, which convinced Anderson that under-seat was the way to go if you wanted dense, high-performing networks.

“The really important thing is to get APs closer to the people,” said Anderson. “That’s the future.”

Anderson said some doubters may remain, especially those who try to mix a small amount of under-seat APs with existing overhead deployments, a recipe for lowered success due to the potential interference issues. At Texas A&M, Anderson said AmpThink was able to build a design with far less interference and much greater density than an overhead solution, producing numbers that people have to pay attention to.

“We only know what we’ve observed, but we’re evangelistic supporters” of under-seat designs, Anderson said. “If someone says to you under-seat is hocus-pocus, they’re not looking at the data.”

Not for everyone, but more are trying under-seat

Though proponents of under-seat Wi-Fi all agree on its ability to deliver denser, faster networks, they all also agree that under-seat can be considerably more costly than overhead Wi-Fi, especially in a retrofit situation.

In addition to having to core through concrete seating areas to get conduit to the under-seat APs, the devices themselves need to be sealed, to guard them from weather, drink spills, and the power-washing equipment employed by most stadiums to clean seating areas.

Aruba’s Lukaszewski also noted that under-seat deployments generally use more linear feet of cabling to connect the APs than overhead, which also drives up the cost. Then since under-seat designs tend to use more APs, that also means a higher budget to cover a higher number of devices.

A row shot of the under-seat APs at AT&T Stadium. Photo: Dallas Cowboys

A row shot of the under-seat APs at AT&T Stadium. Photo: Dallas Cowboys

For some stadiums, the construction materials used prohibit the under-seat option from even being tried. At the Green Bay Packers’ legendary Lambeau Field, a late-1950s construction design that used lots of concrete and rebar — as well as part of the stadium’s bottom sitting directly in the ground — meant that under-seat Wi-Fi wasn’t an option, according to Wayne Wichlacz, director of information technology for the Packers.

Other stadiums, like the University of Nebraska’s Memorial Stadium, don’t have enough space between the stadium’s bleacher seats and the floor for under-seat APs to be safely installed. And many schools or teams simply don’t have big IT budgets like the $20-million-plus available to Texas A&M that allowed the Kyle Field design to seek the best result possible.

But many of the new stadiums under construction, as well as existing venues that are planning for new best-of-breed networks, have already committed to under-seat Wi-Fi designs, including the Sacramento Kings’ Golden 1 Center, where Ruckus Wireless will implement its first under-seat stadium Wi-Fi network.

Steve Martin, senior vice president and general manager at Ruckus, said the Golden 1 Center design, planned to be the most dense anywhere, will “primarily be underseat,” a choice he said “helps in a lot of ways.”

Foremost is the performance, something Martin said Ruckus has been testing at the Kings’ current home, the Sleep Train Arena. “It [under seat] does give you the isolation for frequency re-use,” he said.

The under-seat design also makes sense in Golden 1 Center since the stadium’s overall design is very open, with lots of glass walls and unobstructed views.

And under-seat deployment is even making inroads into the distributed antenna system (DAS) world, with Verizon Wireless implementing more than 50 under-seat DAS antennas at Levi’s Stadium prior to Super Bowl 50. Mainly installed to cover the bottom-of-the-bowl rows, the under-seat APs helped Verizon manage a record day for DAS traffic, with 7 TB reported on its in-stadium cellular network during the game.

“To get a quality signal, we had to go under seat,” said Brian Mecum, vice president, network, for Verizon Wireless, who said that in that area of the stadium, under seat was the only way to get a quality signal close to the subscriber’s phone. Verizon, he said, helped design the under-seat DAS antenna, and is looking to deploy it in other stadiums soon.

“It’s the first of more,” he said.

END PART 2… HERE IS THE LINK TO PART 1… TO READ THE WHOLE STORY NOW, DOWNLOAD OUR REPORT!

Commentary: Will stadium networks ever catch up with demand?

Dallas fan in mobile action at AT&T Stadium. Photo: Phil Harvey, MSR

Dallas fan in mobile action at AT&T Stadium. Photo: Phil Harvey, MSR

If there’s one thing the stadium-networking industry learned — or should have learned — from the stunning stats from Super Bowl 50, it’s that nobody really knows where or when the demand for in-venue bandwidth will stop growing.

Thanks to the smart folks who built the Levi’s Stadium Wi-Fi network — and the smart deployers and carrier partners who doubled down on the DAS this summer — the venue was able to handle an incredible 26 terabytes of wireless data on Super Sunday, with 15.9 TB amongst the four major cellular carriers on the DAS, and 10.1 TB on the stadium’s Wi-Fi network. Both were easily new records for single-day events, far eclipsing the totals seen at Super Bowl XLIX the year before.

The question, of course, for everyone else is: What comes next? And what does that mean for networks built in the past few years?

Keep building for growth

Editor’s note: This column is an excerpt from our latest STADIUM TECHNOLOGY REPORT, which is available for FREE DOWNLOAD from our site. In addition to this analysis and stadium tech deployment profiles we also take an in-depth look at the new trend of deploying Wi-Fi and DAS antennas under seats, and provide a wireless recap from Super Bowl 50. GET YOUR COPY today!

Texas A&M student recording the halftime show. Photo: Paul Kapustka, MSR

Texas A&M student recording the halftime show. Photo: Paul Kapustka, MSR

In some follow-up discussions with folks from Aruba, the Levi’s Stadium networking team, Verizon Wireless and others in the industry, I wondered out loud if what we are seeing is just yearly growth in demand, or whether expanded networks are merely satisfying pent-up demand that was always there.

To be sure, the “big” events like the Super Bowl, the World Series and the Final Four are always going to generate outsize traffic numbers, especially as more and more fans join the selfie craze and post photos and videos from the stadium, showing the rest of the world how great their life is. According to Verizon, the amount of traffic uploaded on their DAS network at Super Bowl 50 was double the upload traffic the carrier saw at Super Bowl XLIX, validating Verizon’s belief that traffic was going to grow significantly.

For mobile traffic in general, and for in-stadium wireless activity specifically, the continued growth over the past few years can likely be traced to a number of factors, including the ever-increasing power of mobile devices; the new number of bandwidth-hungry apps that incorporate images and video; and a steady increase in familiarity with devices and apps, as older folks — those more likely to purchase event tickets — catch up to their kids in wanting to use, and being able to use, the content-sharing features of social media and other communication apps. And, simply, more people trying and successfully connecting to in-stadium networks, reversing historical thinking that told them from experience in past years that connecting at a stadium was futile. In almost all venues these days, no longer is that the case.

So with no end yet in sight to the general doubling of traffic on a year to year basis, the big question out there for stadium technology teams has to be — is what we have now enough to handle growing needs, and if not, what are we going to do about it? The fact that cellular carriers (correctly) assumed they needed to add capacity to the Levi’s Stadium DAS a year after it was deployed should give pause to anyone building a network right now; though your venue may not be hosting the Super Bowl anytime soon, it might not hurt to re-think the traffic projections that have been made and step them up a bit, just in case.

These signs are up all over AT&T Park. Photo: Paul Kapustka, MSR

These signs are up all over AT&T Park. Photo: Paul Kapustka, MSR

On both the Wi-Fi side and the DAS side, we may also be looking soon at a need for new kinds of technology to help build the networks of the near future. In this issue we take an in-depth look at the trend toward putting antennas for both Wi-Fi and DAS under seats, mainly to build networks that are more dense and can handle more traffic.

Verizon, which pioneered DAS under-seat antennas at Levi’s Stadium this year, said it is already seeing stadiums where just adding another sector of traditional DAS produces diminishing returns; if traffic on both types of networks keeps growing at the current rate, when will existing designs become obsolete? And what will replace them?

Stadium network owners shouldn’t ignore policy

As stadium-networking types ponder the future, it would serve the industry well to start thinking together as well, especially in the areas of telecom policy and standards-setting. As the builders of telecom networks worldwide ponder the future of 5G technologies there are some discussions where stadium networking representatives are nowhere to be found, especially in the potentially troubling direction of LTE-U, the idea of carriers using unlicensed bands for LTE traffic.

It’s still early days in the LTE-U discussions, but a recent decision by the FCC to allow carriers to conduct tests of the technology should be a call to action for the stadium networking industry. While nobody knows quite for sure yet what will happen to an in-venue Wi-Fi network if and when LTE-U traffic appears, it seems to make sense for the industry to get together and at least present some kind of unified voice before decisions get made.

At the recent Silicon Flatirons telecom policy conference in Boulder, Colo., there were exactly zero representatives from the venue Wi-Fi ecosystem present, including no visible representation from the Wi-Fi and DAS gear manufacturers who sell into the stadium networking space. With telecom providers hungry for spectrum of any kind, it’s a fool’s bet to assume that the unlicensed bands used in stadiums worldwide today will remain as free and available as they are now. It’s just another factor that’s needed to be considered, as venue tech professionals plan for a future of ever-increasing needs.

Stadium Tech Report: Connectivity soars at Denver Broncos’ Sports Authority Field at Mile High

Panoramic view of Sports Authority Field at Mile High from the top seats. All photos: Paul Kapustka, MSR (click on any photo for a larger image)

Panoramic view of Sports Authority Field at Mile High from the top seats. All photos: Paul Kapustka, MSR (click on any photo for a larger image)

On most of our stadium visits, we have to wait until we get inside the venue to start testing the network. At Sports Authority Field at Mile High, however, we barely got out of the car before the Wi-Fi auto-connected — at superb speeds. Nothing like a network that announces itself before you get in the door.

The parking-lot connection — at a download speed of 45.48 Mbps and an upload speed of 53.35 — was the first clue that football fan connectivity is taken seriously in Denver, especially so if you have Verizon service. While the stadium’s Wi-Fi network is currently only available to Verizon customers — more on this later — full DAS participation by the three other major U.S. wireless carriers means that pretty much any visitor to the venue is going to have good, if not great, connectivity for their mobile device, no matter which service they use.

Inside the stadium, a trained eye can spot many different types of DAS and Wi-Fi antenna placements, under overhangs, on towers, on ceilings and on walls; and thanks to a first-person stadium tech tour conducted by Russ Trainor, vice president of information systems for the Denver Broncos, we got to learn about a wide range of not-so-noticable antenna deployments, including in railing enclosures and on field-level walls, all part of an ongoing plan to try to stay ahead of the still-growing demand for mobile data from sports fans who come to the games.

The parking lots just outside Sports Authority Field have good Wi-Fi coverage as this light pole shows.

The parking lots just outside Sports Authority Field have good Wi-Fi coverage as this light pole shows.

The day we visited, during the last regular-season game on Jan. 3, was important for the Broncos as a team since their 27-20 victory over the San Diego Chargers gave Denver home-field advantage through the playoffs, an edge that helped the team reach its eighth Super Bowl. But even as he celebrated his team’s win, Trainor was happy for another reason: the bye week gave him and his team more time to light up some new Wi-Fi and DAS antenna placements, to better handle the expected and eventual playoff data crush.

“You can never have enough APs,” Trainor said.

Good Wi-Fi, but still only for Verizon customers

Opened on Aug. 11, 2001, with a concert by the Eagles, the then-named Invesco Field at Mile High replaced the old Mile High Stadium in basically the same spot, sitting at 5,280 feet above sea level. Seen by many on TV when it hosted the 2008 Democratic National Convention and the acceptance speech of then-Sen. Barack Obama, the “new” Mile High has seen more than 12 million fans come through its doors since it opened for a variety of sports and entertainment events.

But true high-speed wireless for fans didn’t take root until 2012, when a revamp led by Verizon Wireless and the Broncos’ IT staff added a Cisco-based Wi-Fi network to the stadium with 500 access points, designed to serve 25,000 concurrent users and also designed to be “open,” allowing any other carrier to provide access to its customers by negotiating a deal with Verizon. While Trainor said the option still remains open and talks with some of the other carriers are underway, none have yet signed on — making the Wi-Fi network a fast playground for Verizon customers, who apparently are in the vast majority in the Denver region.

Sorry, AT&T customer, no soup for you

Sorry, AT&T customer, no soup for you

We don’t have any exact proof of that thinking, but statistics from the recent AFC Championship game at Sports Authority Field — a 20-18 Denver victory over the New England Patriots — seem to show Verizon customers in a bit of a majority. According to Verizon, its customers at the game used a total of 2.87 terabytes of data, with 1.7 TB on the Wi-Fi network and another 1.17 TB on the Verizon LTE DAS network. AT&T, by comparison, said its customers used 819 GB on the AT&T DAS network that day. So either there are more Verizon customers at the stadium on game days, or Verizon customers use more data because they have more network options; take your pick.

With our Verizon iPhone 6 Plus in hand, we found great connectivity on Wi-Fi pretty much everywhere we roamed. After finding our way from the parking lot to the press box, we got a signal of 46.46 Mbps down and 46.90 up, this from the regular fan network in the stands and not from the press-only Wi-Fi network.

While roaming through the plush United Club we got a speed test of 33.36/35.19, a figure that Trainor said could change on any given game day — “when it gets cold outside, this place fills up,” he noted — and then later when we walked up to the top, 5th-level concourse, we still got a Wi-Fi signal of 34.96/30.40 on the walkways behind the seats. During second-quarter action we even sneaked up to the nosebleed seats in section 501, one of the ski-slope steep sections near the stadium’s top edge — and still got a Wi-Fi signal of 10.28 Mbps/5.00 Mbps.

According to Trainor, the upper seats are among the toughest challenges for Wi-Fi reception, especially those in the “bulge” areas in the middle of the stadium where on both sides the sections curve upwards, adding more seats. Though the light structures that wind all the way around the stadium do provide good spots for antenna mounts, the bulge areas are harder to reach, and in the near future Trainor and his team will keep experimenting with other methods of deployment, like railing enclosures and row-end mounts they have used successfully for both Wi-Fi and DAS in other areas of the stadium.

Lots of antennas visible in this overhang area

Lots of antennas visible in this overhang area

One interesting architectural quirk of the stadium — its use of metal decking instead of concrete — actually helps the wireless deployment team, Trainor said. Installed to mimic the metal upper deck at the old Mile High Stadium — where Broncos fans would do the “Denver Stomp” to produce thunderous noise — the metal construction acts as a barrier to keep Wi-Fi signals from the bowl from interfering with those from antennas inside suites and concourses, Trainor said.

While most of the stadium has favorable locations for overhead antennas — there are three main levels of seating, providing two expansive overhangs covering about 80 percent of the seating area — some typical problem places like seats near field level and in the no-overhang South stands have required some creative thinking, an excercise that never really ends.

“We started with 500 Wi-Fi APs, and we’re now at 640, and by the time we get it [the current plan] all built out we’ll have about 850 to 900 total,” Trainor said.

DAS deployments a mix of connectivity

On the DAS side, Trainor said that the four major carriers — Verizon Wireless, AT&T, Sprint and T-Mobile — are all present inside the stadium, with different antenna placements in different numbers. In some instances, all the carriers use “neutral” antennas, mainly in areas where there isn’t enough room for exclusive deployments. But in other areas, the carriers have installed their own antennas, an arrangement that allows them to replace and upgrade them as necessary at their own discretion, Trainor said.

Field-level Wi-Fi AP (small white box next to right leg of Peyton Manning fan)

Field-level Wi-Fi AP (small white box next to right leg of Peyton Manning fan)

We didn’t have a Sprint or T-Mobile device on hand, but our AT&T Android phone had good connectivity everywhere we measured, including a 4G LTE signal of 27.94 Mbps down and 6.86 up in the press box, and signals of 47.83/6.37 on the same 5th-level concourse area where we tested the Verizon Wi-Fi.

All the carrier back-end gear is housed in a brick building built outside the southeast side of the stadium, Trainor said, since there wasn’t room inside the stadium structure itself. DAS and Wi-Fi antennas also exist in great number in the vast parking lots that directly surround the stadium, as well as in the “fan zone” gathering area outside the South stands.

Like with the Wi-Fi, Trainor and his team are always planning for more DAS capacity, even if contracts aren’t signed yet. On the new railing enclosures they are installing, the Denver IT team builds in enough space for both DAS and Wi-Fi, even if only one network is using the deployment to start with. Again, you can never have enough antennas — or enough places to put them.

YinzCam app and Cisco SportsVision

Rounding out the mobile-device offerings is not one but two YinzCam team apps, one for use at outside the stadium and the other one for live game-day offerings, with a geocache feature that allows the team to provide content it has stadium rights to, like the NFL’s RedZone channel. Both apps have live links to the Broncos radio coverage from KOA Radio, and the in-stadium instant replay feature worked superbly during our visit, showing plays in seconds and often before they appeared on the stadium’s big screens.

In the concourses we recognized the split-screen capabilities of Cisco’s StadiumVision technology, which can direct programming to all the TV screens inside a stadium. Another nice touch in the United Club was a circular charging station, with tabletop space so fans could have a place to put food and drink while waiting for their devices to juice back up. “We are always looking for ways and configurations to allow fans to recharge their devices,” Trainor said.

With all its different parts, the wireless deployment at Sports Authority Field at Mile High adds up to a favorable fan experience, one that clearly has the ability to keep getting better on an incremental basis. But like their Super Bowl team, Denver fans should be happy with what they have right now.

MORE PHOTOS BELOW

mihi7

Railing antenna enclosure. Some of these have both Wi-Fi and DAS.

mihi11

App promo on the scoreboard

mihi13

Panoramic view of the stadium and the city

mihi4

South stands have a horse and Wi-Fi antennas on the top of the scoreboard

mihi20

Cisco SportsVision in action on 6-panel display

mihi22

DAS antennas on end-of-row railing area

mihi24

Game on, phones out!

mihi25

Antennas covering the concourse area on second level

mihi26

More SportsVision and Wi-Fi deployment in the United Club

mihi14

Only accept on the scene reporting!