Cowboys hit 2+ TB, Texas A&M sees 1.8+ TB in first AT&T DAS stats for 2016 football season

dx1With the first few football games of the season now under our belts, stats from stadium wireless networks are filtering in with a refrain we’ve heard before: Fan use of wireless data is still growing, with no top reached yet.

Thanks to our friends at AT&T we have the first set of cellular network stats in hand, which show a report of 2.273 terabytes of data used on the AT&T network at AT&T Stadium for the Cowboys’ home opener, a 20-19 loss to the New York Giants on Sept. 11. That same weekend the AT&T network at Kyle Field in College Station, Texas, home of the Texas A&M Aggies, saw 1.855 TB of data during Texas A&M’s home opener against UCLA, a 31-24 overtime win over the Bruins.

Remember these stats are for AT&T traffic only, and only for the AT&T network on the DAS installations in and around the stadiums. Any other wireless carriers out there who want to send us statistics, please do so… as well as team Wi-Fi network totals. Look for more reports soon! AT&T graphics below on the first week results. We figure you can figure out which stadiums they’re talking about by the town locations.

Screen Shot 2016-09-19 at 11.21.50 AM

Screen Shot 2016-09-19 at 11.21.58 AM

Ookla shares Speedtest data from CenturyLink Field, other stadiums

Ookla ad banner being flown over CenturyLink Field in Seattle. Credit: Ookla

Ookla ad banner being flown over CenturyLink Field in Seattle. Credit: Ookla

Anyone who follows Mobile Sports Report knows that I use the Speedtest app from Ookla to measure stadium network performance whenever I visit a sporting venue. While my one-man tests do show some measure of network power, I always dreamed of harnessing the results from many fans at the same game to see a better picture of the network performance.

Well, Speedtest’s creators think along the same lines, and conducted an experiment during an Aug. 25 Seattle Seahawks preseason game at CenturyLink Field in Seattle. You can read their very thorough post and neat results here, with some interesting twists — for instance, the cellular networks are way faster than the CenturyLink Wi-Fi, according to the Ookla results.

UPDATE: Ookla responded to our email and let us know that on Aug. 25, there were 252 Speedtests at CenturyLink Field, a great sampling to draw results from. Ookla also talked about tests from 12 different events at CenturyLink Field, and said in the email that across those events it saw 1,143 tests conducted.

Ookla also published some test result totals from other stadiums as well, including Levi’s Stadium, AT&T Stadium and Bank of America Stadium, but didn’t say when those tests were recorded, or how many tests were taken.

What we really like, however, is that Ookla’s tests show what our stadium tech report surveys have been showing — that overall, in-stadium network performance is steadily improving. Over time, more data like this can help dispel the still-lingering rumor that stadium networks don’t deliver good connectivity. Now if we could only get Ookla to partner with us to do league-wide or college-comparison speedtests… anyone ready for that idea?

Sacramento Kings’ Golden 1 Center will use really fast fiber technology from CommScope

Fiber cabling inside the Golden 1 Center data center. Credit: CommScope / Golden 1 Center

Fiber cabling inside the Golden 1 Center data center. Credit: CommScope / Golden 1 Center

Since the Sacramento Kings are already talking about bandwidth-hogging applications like virtual reality replays for fans who visit the new Golden 1 Center, it’s perhaps no surprise that the venue will also have some of the fastest, highest capacity fiber network technology at its core.

On Tuesday, the Kings and network infrastructure provider CommScope announced that Golden 1 Center will be the first place to employ something called wideband multimode fiber, or WBMMF in the world of tech acronyms. Without getting too deep into fiber optics details it might be enough for most to know that WBMMF, a new developing standard in the cabling infrastructure world, lets you send more stuff over fewer fibers, an advancement developed mainly for the data center world but one that will also benefit places that expect to move a lot of data around, like Golden 1 Center.

Back in the old days, it was news when stadium networks upgraded to 1-gigabit per second pipes coming in to provide bandwidth. These days, many stadiums are talking multiple 10-gig pipes and even looking at 100-gig pipes (like Golden 1 Center will use from Comcast), meaning that the internal networks also need to get faster and wider to handle the never-ending increases in data use.

Golden 1 Center nears completion. Credit: Golden 1 Center

Golden 1 Center nears completion. Credit: Golden 1 Center

Before its scheduled October opening we are sure we’ll hear more about the fan-facing Wi-Fi and DAS network deployments, but it’s worthwhile to acknowledge that the underlying core network at Golden 1 Center should be able to handle data expansion for the foreseeable future thanks to the choice of the latest in fiber technology.

John Schmidt, vice president for CommScope’s Data Center solutions team, said the WBMMF products are primarily targeted at the data center market; but he also noted that with its own 6,000-square-foot data center, Golden 1 Center qualifies as the kind of place that will need the kind of future-proofing WBMMF can provide.

When the plans for Golden 1 Center were first talked about publicly, Schmidt said CommScope reached out to the Kings with a pitch about using the latest fiber technology in the core.

“It was clear they wanted something state of the art, with a great fan [network] experience,” Schmidt said. “We told them we could help with the physical layer, to support the bandwidth they would need.”

sax3

Will cellular carrier aggregation matter in stadium networks?

Kauffman Stadium during 2015 World Series

Kauffman Stadium during 2015 World Series

Over the past few days, both Sprint and Verizon Wireless have made announcements about a technique called “carrier aggregation” (CA for short) for LTE cell networks that basically bonds together different frequency channels to bring more bandwidth to a mobile device. Though the premise sounds great, what we here at MSR HQ haven’t been able to ascertain yet is whether or not this technique will help solve the biggest problem in stadium network situations, namely providing enough capacity for users on the networks installed there.

Sprint has made the most noise this week, with claims of CA demonstrations at Soldier Field in Chicago and Kansas City’s Kauffman Stadium that (they said) showed Sprint devices bonding three different frequency channels to hit download speeds of 230 Mbps, a score way off the charts for any existing stadium networks. (The fastest Wi-Fi and cellular speeds we’ve seen in our short history of stadium tests, by comparison, are in the 60 Mpbs range.) Verizon made a similar announcement about CA being put in across its network, without specifying if the service would be available in stadiums. Other carriers, including AT&T and T-Mobile, are also exploring use of the CA technique. At the very least, some lucky users with newer devices may see leaps in performance thanks to CA deployments, a good thing on any level.

But our bigger question — which hasn’t been answered in the press releases and hasn’t (yet) been answered in email questions to Sprint or Verizon — is whether or not CA will help with overall network capacity, which to us seems to be a more pressing problem at most stadiums as opposed to simple download speeds. I mean, demos are great and it’s cool to see what the upper limits are for one device; but it’d be more impressive if Sprint could guarantee that 230 Mbps mark to every device in the park, should everyone there have a Sprint phone with the capability to perform the CA trick (not all devices in the market today can do so).

Finally using the Clearwire spectrum

What’s also not completely revealed in the press releases is what kind of gear is necessary on the back end of the network to make CA work, and whether or not it makes economic sense to have that gear placed inside stadiums to enable the technique for as many fans as possible. While we understand the basic premise probably better than most (since in a former life yours truly spent several years following and analyzing the Clearwire spectrum holdings at 2.5 GHz) it’s not clear if CA solves any congestion problems, especially for carriers other than Sprint, who only have a limited amount of licensed spectrum in each market they serve.

(Without getting too deep into spectrum geekiness, Sprint on paper probably has more room to grow in the CA space since its 2.5 GHz holdings dwarf other carriers’ licensed bands; but to make use of that spectrum, you need customers with devices that can use that spectrum, and enough cash for a wide network buildout, both of which Sprint may be challenged to find.)

As we understand CA, by bonding channels you can make one device faster since it has more aggregate bandwidth to work with. But it’s not clear that using CA in a stadium environment would make the overall situation any faster than say, three phones using single channels by themselves. Also, since you can’t create new bandwidth, if one phone starts tapping three different channels doesn’t that actually leave less room for other devices that may want to also use those channels? Perhaps with CA the connections would be faster and wouldn’t last as long, thereby freeing up spectrum for other devices; again, there’s not a lot of information yet on the capacity side of the equation, especially in crowded stadiums or at big events where bandwidth needs escalate. If there are any cellular wizards in the audience with more knowledge of the situation, feel free to chime in.

We did get an email response from our old friend John Saw, formerly of Clearwire and now chief technical officer at Sprint. Here’s his explanation of why CA is a good thing for stadiums:

Essentially, sites with bonded channels will drive higher capacities. This will be especially timely and helpful in crowded spaces like Soldier Field where there are surges in capacity demand during live sporting events. Sprint customers with CA enabled phones will enjoy 2X (in the case of 2CA) or 3X (in the case of 3CA) their download speeds, which means that they will get a better data experience with a bigger pipe. But wait – CA will lift all boats and it will also benefit those Sprint customers who have not upgraded to CA enabled phones yet. While they may not enjoy the higher peak speeds enabled by CA phones, their phones will have access to more network resources which means they will also have a better data experience, with no stalling or without that dreaded “windmill effect” in a crowded stadium.

I kind of understand what Saw is talking about here, but I am still having a problem with the math that says all boats will be lifted through the use of CA. Plus, experience and interviews have taught us that across the country, Sprint is behind Verizon and AT&T when it comes to DAS deployments inside stadiums; and, it’s not clear (and hasn’t been answered) whether or not CA can work over a neutral-host DAS deployment where carriers share antennas and other infrastructure.

From an industry-wide standpoint, CA seems like a great thing for all cell phone users since as it progresses devices should be able to utilize whatever bandwidth is around to make performance better. It’s also good to see more technology advancements made on the network side of things, since infrastructure needs all the help it can get to keep up with devices. But right now, we’re not sure if CA is the answer to any of the capacity problems stadium network operators face. Anyone with views that can expand the explanation, feel free to hit the comments section below or send me an email to kaps at mobilesportsreport.com.

Belmont, Saratoga race tracks to get VenueNext app in 2017

Screenshot of what the Saratoga app might look like. Credit: VenueNext

Screenshot of what the Saratoga app might look like. Credit: VenueNext

Operators of the famed Belmont Park and Saratoga Race Course horse-racing tracks have signed a deal with VenueNext to bring that company’s mobile app platform to both venues in 2017, with features including online betting integrated into the mobile app.

In an announcement Monday, the New York Racing Association (NYRA) said it will use VenueNext’s platform and mobile app to provide a set of features to race-day fans including the ability to store digital tickets, to purchase food, beverage and merchandise and have those items delivered to seats, to have wayfinding maps to help fans find their way around the facilities, and to view live and archived content.

The VenueNext apps will also integrate the functionality of the NYRA Bets system into the app, so that fans can place wagers directly from their mobile devices, according to the companies. The VenueNext app will be available first at Belmont Park in the spring of 2017, followed by a summer rollout at Saratoga, the companies said.

What will be interesting to watch is whether or not either track updates its connectivity ahead of the app deployment; according to the Belmont website, that track does have free fan-facing Wi-Fi, but only in the clubhouse areas with limited access in the grandstands. The Saratoga list of amenities for fans does not include any Wi-Fi information.

“VenueNext has a proven track record for delivering innovative fan experiences to sporting venues across the country and we’re proud to partner with them,” said NYRA President & CEO Chris Kay, in a prepared statement. “This partnership is yet another step in our efforts to continuously improve the guest experience through the use of technology. By leveraging VenueNext at Belmont and Saratoga Race Tracks, integrating our new NYRA Bets wagering platform and our new HD Video mobile app, NYRA will create a new standard for the horseracing industry and provide the New York fan base that is so passionate about Belmont and Saratoga the very best experiences possible.”

VenueNext, the stadium app development company created to build the stadium app platform for the San Francisco’s Levi’s Stadium, now has seven announced customers for its various stadium-app and stadium-app management systems, including the Orlando Magic, the New York Yankees, the Dallas Cowboys, the Minnesota Vikings, and Churchill Downs, home of the Kentucky Derby. VenueNext also provided the stadium app for the recent Super Bowl 50 at Levi’s Stadium.

Optical fiber, under-seat Wi-Fi will power wireless connectivity at Atlanta’s Mercedes-Benz Stadium

Aerial photo of Mercedes-Benz Stadium under construction. Credit all photos and artist renderings: Merecedes-Benz Stadium (Click on any photo for a larger image)

Aerial photo of Mercedes-Benz Stadium under construction. Credit all photos and artist renderings: Merecedes-Benz Stadium (Click on any photo for a larger image)

Once just a series of drawings on a blueprint, Atlanta’s new Mercedes-Benz Stadium is getting more real by the day, with walls being added to steel beams, and wires for the internal networks being pulled into place.

Though the June 2017 opening day still is many months away, thanks to thoughtful planning many elements of the stadium’s network have already been tested, thanks to a facility created by stadium network officials to test components under situations as close to “live” as they could possibly get. That lab environment helped the network team make its final decisions on vendors and deployment methods, like going under-seat for deployment of most of the 1,000 Wi-Fi APs that will be in the stadium’s bowl area, part of a planned total of 1,800 APs in the entire venue.

In a recent interview with Jared Miller, chief technology officer at AMB Sports and Entertainment (the entity named for Arthur Blank, the owner of the Atlanta Falcons), Mobile Sports Report got an exclusive update on the construction progress so far for the new $1.5 billion facility, along with new details about the internal network deployment, which will be using more optical fiber than any previous stadium network we know of.

Like the network built at Texas A&M’s Kyle Field, the network inside Mercedes-Benz Stadium will have a single optical core for Wi-Fi, cellular and video, using the Corning ONE platform and deployed by lead network integrator IBM along with Corning.

Wall panels being added to Mercedes-Benz Stadium in Atlanta

Wall panels being added to Mercedes-Benz Stadium in Atlanta

Miller also confirmed our earlier report that YinzCam software would be used to host the stadium’s IPTV deployment, but vendor choices for Wi-Fi gear and a stadium app have yet to be named.

As construction teams continue to hustle toward completion of the building, here are more details from our conversation with Miller about how the Falcons’ tech team went through the process of determining the products and methods that would allow them to construct a network able to “push the limits” on fan connectivity.

Under-seat for Wi-Fi, with handrail heat sinks

In our early August conversation with Miller, he was happy to report that the planned 4,000 miles of optical fiber were finally starting to be threaded into the new building. “We’re making great progress with a ton of yellow cable,” Miller said.

While the overall architecture at the network core in Mercedes-Benz Stadium will be similar to the one IBM and Corning deployed at Kyle Field, Miller said that in Atlanta his team is pushing fiber even farther to the edge, “with only the last couple feet at most being copper.”

Interior suite construction with fiber cable visible

Interior suite construction with fiber cable visible

Miller said optical fiber, which can carry more data traffic at faster speeds than copper cable, is a necessary infrastructure underpinning for facilities like Mercedes-Benz Stadium that expect to host the biggest events like the Super Bowl and college football championship games. Mercedes-Benz Stadium is already slated to host Super Bowl LIII, the 2018 College Football Playoff Championship, and the 2020 Final Four.

“I really believe [fiber] gives us the foundation to grow and react in the future, to handle technologies we don’t even know about yet,” Miller said.

On the Wi-Fi side of things, Miller said that Mercedes-Benz Stadium will also mimic Kyle Field’s extensive use of under-seat APs in the bowl seating areas. Miller said the stadium will have 1,000 APs serving the seating areas and another 800 for the rest of the venue, for a total Wi-Fi AP count of 1,800.

Since the Mercedes-Benz Stadium network will be using more optical equipment closer to the edge, Miller said that his team used 3D printing experiments to craft custom enclosures for the under-seat APs, both to ensure they didn’t act as debris “traps” and also to add elements like an internal heat sink to diffuse the warmth from the extra electrical components. The heat sink solution involved attaching the AP elements to metal chair railings to dissipate heat, Miller said.

Testing the network before the building is built

After announcing its partnership with IBM in early 2015 as lead technology integrator, the stadium network team spent 6 months reworking the network design, Miller said, a process that confirmed the choice of optical networking at the core. Then to help the network team select gear and components, the Mercedes-Benz Stadium organization built a “full-scale lab facility” that Miller said allowed his team to build multiple live networks to test gear for performance and interaction with other network elements.

Artist rendering of outside of building

Artist rendering of outside of building

“The lab enabled us to see firsthand how gear behaved, not just alone but together [with other products],” said Miller, who added that at one time the network team had three simultaneous running stadium networks inside the lab.

“We were able to bring in different endpoint devices, like POS systems, and know how it’s going to behave [in a network],” Miller said. Plus, the network gave eventual business users of the planned gear time to get hands-on experience and training well before the stadium opens its doors.

On the DAS side of the network buildout, Miller said the stadium has an on-site, raised-floor room for DAS gear with “ample room” for future growth.

“One of those things we learned was that DAS [needs] always double,” Miller said.

YinzCam software for IPTV

Though the stadium hasn’t yet announced a provider for a game-day stadium application, Miller did confirm that Mercedes-Benz Stadium will use YinzCam software to control its IPTV system, which will cover the 2,500 or so TV screens inside the building.

Artist rendering of Falcons game configuration with roof open and 'halo' video board visible

Artist rendering of Falcons game configuration with roof open and ‘halo’ video board visible

“YinzCam is just the most intuitive and capable content management system,” Miller said.

Video is going to be a big part of the stadium from all angles, beginning with the one-of-a-kind “halo board,” a circular screen that will sit inside the retractable roof lines. For standard TV placements, Miller said Mercedes-Benz Stadium will use mainly 50-inch screens and will work with YinzCam to ensure the screens can be seen.

In the stadium’s suites, TV screens will be controlled by a tablet application; Miller said that Mercedes-Benz Stadium is also “contemplating adding the ability to control TV screens with a mobile app,” like the system YinzCam deployed at Texas A&M.

Friendly food pricing and more to come

Though Miller’s concerns are mostly technological in nature, he said there are still a lot of improvements coming to the stadium “that are not always reliant on brute technology,” like the new lower-priced food menus the Falcons announced earlier this year that seem to harken another era with $2 Cokes and $2 hot dogs. Miller said the stadium team continues to get feedback from a fans’ council, which has tagged the arrival and departure experience as one of the main pain points that needs fixing.

Artist rendering of window wall with view to city

Artist rendering of window wall with view to city

Mercedes-Benz Stadium will try to alleviate ingress and egress issues by doing things like creating “ticketed spaces” perhaps on the big outdoor plazas where many fans can congregate even before entering the stadium doors. By creating such spaces, Miller said fans might be able to enter the stadium more rapidly without the logjams that sometimes occur.

“We’re going to study arrival patterns and see what it looks like,” Miller said. “We have one more season to test those kind of things.”

Another amenity that may emerge is the use of wireless charging stations at a number of locations, to combat a scenario that Miller said often happens at marquee events, mainly fans’ phones draining their batteries as they compete with other devices to connect to a wireless network.

“We are focusing on providing amazing connectivity and pushing the limits,” Miller said. “We are looking at all kinds of options to allow fans to stay connected and not be separated from their device.”