Dodgers up the ante with new Wi-Fi 6 network

Dodger Stadium upgraded its wireless with a new Wi-Fi 6 network installed this past offseason. Credit all photos: Los Angeles Dodgers (click on any picture for a larger image)

Professional sports may have put games and exhibitions on hold, but a handful of IT executives from Major League Baseball teams have been using pandemic downtime to upgrade Wi-Fi and DAS systems in their stadiums.

Case in point: The Los Angeles Dodgers just completed the league’s first Wi-Fi 6 overhaul along with adding new 5G cellular antennas to ensure Blue Believers stay seamlessly connected to social media, email, text and good old-fashioned voice calls during home games. When baseball returns to venues, Dodger Stadium and the new Globe Life Field in Arlington, Texas, will lead the way as the first stadiums with Wi-Fi 6 fan-facing networks.

“We’re up against the same challenges that every stadium has, which is how to deal with the density of individuals trying to connect simultaneously – a challenge that’s unique to our industry,” explained Ralph Esquibel, vice president of IT for the Dodgers. “Wi-Fi 6 was created for this kind of high-density environment.”

Wi-Fi 6, better known in IEEE circles as the 802.11ax standard, is a significant upgrade for Wi-Fi networks that started appearing last year. Among its benefits are that use of the new standard can increase the amount of available spectrum and number of channels available for users; it can also significantly accelerate users’ average data rates, while also decreasing the amount of battery power used by devices searching for a Wi-Fi connection.

As long as they have newer phones that support the new standard, Wi-Fi 6 networks provide everything a team could want for its connection-conscious fans.

Replacing the Wi-Fi 4 network

Editor’s note: This profile is from our latest STADIUM TECH REPORT, which is available to read instantly online or as a free PDF download! Inside the issue is our comprehensive study on how venues can cope with Covid-19, plus a profile of Globe Life Field! Start reading the issue now online or download a free copy!

Like its predecessor, the Wi-Fi 6 network will use under-seat APs in the bowl

It’s been barely five years since the Dodgers installed Wi-Fi 4 in the stadium, making use of under-seat APs and what were the league’s first APs cleverly concealed inside hand railings for even denser coverage. There were about 900 APs powering the network then, which easily accommodated 8,000 simultaneous users on its maiden voyage.

“It was state of the art back at that point in time,” Esquibel recalled. But usage and uptake quickly soared among fans and it wasn’t long before 30,000 simultaneous users were contending for bandwidth at each game.

“That was when I’d get a call from previous ownership, usually sometime in the second inning with, ‘I can’t get on email or make a phone call…’,” Esquibel laughed. Suddenly, it didn’t matter how close your seat was to home plate; anybody watching the game became inadvertent victims of Wi-Fi’s highly successful rollout at Dodger Stadium.

Other baseball stadiums experienced similar capacity and uptake issues. That’s in part what prompted MLB to dispatch its technology committee to look at technology upgrades to make sure baseball fans could do all the wireless networking they wanted to while watching a game. Though MLB did not respond to a request for more information, STR was able to get some information from other sources about the pending upgrade plans.

Wi-Fi 6 coming to more ballparks

According to our sources, MLB technologists settled on Wi-Fi 6 upgrades as their next strategic push. So while the Dodgers will be the first baseball team to upgrade to Wi-Fi 6, other teams were also reportedly in the first steps of adding Wi-Fi 6 before the coronavirus pandemic put a hold on many upgrade plans.

More APs were added in overhangs and roofed areas

It’s unclear if the MLB technology committee brought any financial help to the table along with their wireless expertise for these six upgrades. When MLB put together a consortium to bring wireless connectivity to parks starting back in 2014, it got financial buy-in from wireless carriers, equipment vendors and teams to help spread the costs around. Esquibel wouldn’t specify any dollar amounts for the Dodgers’ Wi-Fi 6 budget or whether the league contributed anything. He did note that the team negotiated an upgrade clause into its previous Wi-Fi networking contract.

Construction for the Dodgers’ new network began last fall, right after the Dodgers lost to the Washington Nationals in the NLDS playoffs. Back then, there were 880 APs that comprised the Wi-Fi 4 network; the upgrade to Wi-Fi 6 bumped that total closer to 1,100 APs, Esquibel said. The Dodgers installed 9100 series APs from Cisco in most of the same locations, reusing the cabling and conduits in the process. The Dodgers also replaced network switches (Cisco again, and its 9300 switching line) to handle greater throughput and the increased processing capacity, Esquibel added.

On the cellular side, Esquibel said carriers are adding 5G gear to the stadium, with AT&T having the most extensive deployment right now. Customers of AT&T and Verizon will also be able to be switched over to the Wi-Fi network when entering the park.

The upgrades to its wireless infrastructure also set the stage for some new capabilities coming down the pike. The combo of Wi-Fi 6 and 5G services will help the Dodgers deliver 4k and 8k video formats; it will also help as professional sports move toward “probability gaming,” i.e., online sports betting. Esquibel credits partners Cisco, AmpThink, Horizon Communications and MLB with building a powerful solution to enable these emerging services and capabilities.

Bench seating also got under-seat APs

There were other elements to the Dodgers’ 2020 tech stack refresh as well. Inside the stadium, they reworked the outfield to create a centerfield plaza with left- and right-field pavilions, with cut-outs and walkways above the pavilions plus more APs than last year to accommodate more seated and standing spectators. Esquibel said the team has also replaced its point-of-sale system, and has added Appetize, a cloud-based POS concessions app, as well as ParkHub to keep closer tabs on the Dodgers’ parking lots.

While the Wi-Fi 6 construction is complete, advance testing and fine-tuning are on indefinite hold. As of early June, Esquibel and his Dodger colleagues were sheltering in place and had been since mid-March.

“The pandemic has slowed down testing,” he said, nothing that the stadium needs capacity crowds to gauge how well the new networks are engineered and where antennas need adjusting. And it’s clear that contemplating the first post-pandemic home game brings out Esquibel’s fan boy, broadband wireless notwithstanding.

“I want to smell the grass and be with the crowd,” Esquibel said. “Like everyone else, I just want to see some baseball.”

New Report: What’s Next for venues in the face of Covid-19; plus profiles of Globe Life Field and Dodger Stadium

STADIUM TECH REPORT is pleased to announce the Summer 2020 issue of our STADIUM TECH REPORT series, the ONLY in-depth publication created specifically for the stadium technology professional and the stadium technology marketplace.

Our stories for this issue include our first comprehensive look at how venue owners and operators, and teams and schools, might find a way back to live action and fans in stadiums following the current pandemic shutdowns. This feature is just the start of an ongoing series of research papers, interviews and other offerings of timely information we will be grouping under the “Return to Venues” title, a series of content done in part through an editorial partnership with AmpThink. We also have two profiles in this issue, one on the extensive network deployments at the ready-to-open Globe Life Field in Arlington, Texas, and another on a new Wi-Fi 6 network deployment at Dodgers Stadium. Plus an explanation of our overall name change from Mobile Sports Report to Stadium Tech Report — read on!

You can also download a PDF version of the report.

We’d like to take a quick moment to thank our sponsors, which for this issue include Corning, Boingo, MatSing, Cox Business/Hospitality Network, Comcast Business, Samsung, and American Tower. Their generous sponsorship makes it possible for us to offer this content free of charge to our readers. We’d also like to welcome readers from the Inside Towers community, who may have found their way here via our ongoing partnership with the excellent publication Inside Towers. We’d also like to thank the SEAT community for your continued interest and support.

As always, we are here to hear what you have to say: Send me an email to kaps@mobilesportsreport.com and let us know what you think of our STADIUM TECH REPORT series.

AT&T sees 9 TB of wireless data use at World Series

The latest statistic showing that wireless data use at sports venues continues to grow comes from AT&T, which said that it saw 9 terabytes of wireless data use on its networks at this year’s World Series games, an 80 percent increase from last year’s total of 5 TB.

According to AT&T, the biggest single-game use of this year’s series between the Los Angeles Dodgers and the Houston Astros came during Game 2 at Dodger Stadium in Los Angeles, where fans on AT&T networks used 1.5 TB of data. An AT&T blog post about the series has some interesting statistics about when data use surged, mainly right after dramatic events took place on the field.

Last year, AT&T said it saw 5 TB of data used on its networks at Wrigley Field and Progressive Field during the seven-game series between the Cubs and the Indians. We don’t have any Wi-Fi data yet from either park this year but it will be interesting to see what happened on the network at Minute Maid Park in Houston during the phenomenal Game 5, a contest that kept many baseball fans up late at night.

Verizon Wireless said it didn’t keep track of DAS statistics for this year’s World Series games.

Cubs fans on AT&T networks use 1.4 TB of cellular on opening night, more than World Series games

Bleacher fans at Wrigley Field use their mobile devices to record the team’s World Series banner celebration. Credit: Screen shot of ESPN broadcast

As we found out last fall, having a World Series game at your venue can generate large amounts of wireless traffic, on both cellular and Wi-Fi networks. But as it turns out, celebrating a World Series victory can generate even more traffic, especially when the celebration includes an on-field ceremony made for fan photos from the seats.

According to AT&T, Cubs fans at Wrigley Field for Monday night’s home opener used 1.4 terabytes of wireless data on AT&T’s cellular and DAS (distributed antenna system) in and around the Friendly Confines. That was almost 400 GB more than the biggest AT&T usage report from last fall’s World Series, when Wrigley Field saw 1.006 TB of data used on AT&T networks for Game 3, the first game in Chicago.

Before the Cubs and Los Angeles Dodgers played on Monday night, there was a lengthy rain delay where a packed house of fans was waiting for the Cubs to unveil their World Series and National League pennant banners.

The flags, which were mounted on four poles at the back of the centerfield bleachers, became the center of attention when the entire Cubs roster still with the team from last season climbed up into the stands to each take a pull at hoisting the World Series champion banner aloft. As you can tell by the pictures we snapped off the ESPN broadcast, it was a made-for-mobile-device moment, with some lucky fans able to get up close and personal photos of the Cubs players.

After hoisting the banners the Cubs players emerged from the tunnels behind the outfield walls with the World Series trophy and paraded it onto the field, again no doubt attracting more of the photos that eventually were sent over the AT&T networks. It’s a lot of wireless traffic, but no doubt a problem any team in Major League Baseball would be willing to tackle each spring.

Rangers fans lead postseason baseball DAS usage on AT&T networks

Screen Shot 2015-10-14 at 11.43.57 AMFans at the Texas Rangers’ Globe Life Park in Arlington have so far topped the charts for cellular traffic totals on AT&T networks during baseball’s postseason, with an average of 992 gigabytes of data used in two games played.

Across all the series, DAS totals for postseason play showed big leaps in data use compared to regular-season totals, in one case almost six times as much. And while you can’t really compare apples to oranges it looks like DAS traffic for games this year might eclipse last year’s record wireless traffic totals at places like AT&T Park.

According to statistics provided by AT&T, game 3 of the divisional series between the Rangers and the Toronto Blue Jays saw 1,109 GB of data move across the AT&T DAS network at Globe Life Park, the highest single-game DAS total across all baseball venues this fall. Remember, stats mentioned here are ONLY AT&T customer traffic on AT&T networks in the stadiums mentioned. According to AT&T, the 992 GB average of the two games so far in Arlington are 51 percent higher than the average DAS use from the season’s opening series back in the spring.

Over in the National League, AT&T customers at Citi Field in New York used 617 GB of data during game 3, which AT&T said was an increase of 600 percent compared to average use during the Mets’ season-opening series. At games 1 and 2 in Dodgers Stadium, AT&T saw an average of 532 GB of data used per game, a 34 percent jump from the season-opening average in Chavez Ravine.

Game 3 in the Chicago Cubs vs. St. Louis Cardinals at Wrigley Field saw 500 GB of data used, a 120 percent jump compared to the season-opening series (which may be skewed since Wrigley was still undergoing construction at that point). For games 1 and 2 in Busch Stadium in St. Louis the AT&T networks saw an average of 586 GB per game, with 617 GB used during game 2.

For the Royals-Astros series, AT&T did not have any stats for games in Kansas City (perhaps because the Kauffman Stadium DAS is still being deployed) but for game 3 and 4 in Minute Maid Park in Houston AT&T saw an average of 237 GB per game.

Stadium Tech Report: Los Angeles Dodgers hit it out of the park with Cisco, Aruba Wi-Fi

Dodgers Stadium, the SoCal baseball shrine. All photos: Terry Sweeney, MSR (click on any photo for a larger image)

Dodgers Stadium, the SoCal baseball shrine. All photos: Terry Sweeney, MSR (click on any photo for a larger image)

Growing up in the Los Angeles suburb of Norwalk, Ralph Esquibel recalled playing outdoors while inside the Dodger game was on the radio. “I knew from the kinds of noises coming out of the house how the game was going,” he laughed. Esquibel, now vice president of IT for the Los Angeles Dodgers, may have wished for some similar indicators or guideposts as he began the wireless retrofitting of Major League Baseball’s third oldest stadium (after Boston’s Fenway Park and Chicago’s Wrigley Field) in early 2011.

Esquibel faced multiple challenges with Dodger Stadium. First, there was all that concrete to push signals through or around. There was the size of the Chavez Ravine venue and its far-flung parking lots, spanning more than 350 acres. The stadium also has few overhangs, a favorite place to attach Wi-Fi access points or distributed antenna system (DAS) gear. Then there’s Dodger Stadium’s capacity — 56,000 seats – the largest in the league and almost 30 percent larger than the average MLB stadium (42,790).

Esquibel’s biggest hurdle? ” Trying to achieve the network that we wanted but also maintain an appropriate budget for the solution,” he said. While Esquibel would not specify what the Dodgers spent, he did allow that it was “an 8-figure project.”

Coverage challenges in the best seats

Initially, the best seats in the house presented a coverage challenge; field and club level seats along the third- and first-base lines and the dugout lack any overhangs. So while phones in those sections could receive a short, directional beam sent from across the outfield, the upstream signal couldn’t get back to the AP across the field, said Esquibel.

Ralph Esquibel, VP of IT for the Dodgers, with the new Wi-Fi relief pitcher mobile.

Ralph Esquibel, VP of IT for the Dodgers, with the new Wi-Fi relief pitcher mobile.

“We wanted to guarantee a premium experience, regardless of the seat,” said Esquibel, who joined the Dodgers 6 years ago after working in IT at Toyota and Honda. So by using what he calls “a hybrid approach,” Wi-Fi APs and antennas are installed overhead where possible, but also under seats and in staircase handrails that divide the stadium’s steep aisles.

All told, nearly 1,000 APs from Cisco and Aruba Networks blanket Dodger stadium, its concession areas and parking lots. Horizon Communications helped the Dodgers with design and installation of the Wi-Fi and DAS.

The under-seat APs/Wi-Fi antennas on the club level are housed in NEMA enclosures about every 15 seats, set eight rows apart. Esquibel was concerned about losing real estate under those seats; he also didn’t want to create any potential trip hazard for fans. In addition, the Dodgers use Cat 6A cabling, whose thickness and rigidity couldn’t run up a stepped incline. Consequently, they drilled through concrete to snake the cabling through from the clubhouse underneath. “There’s no visible conduit leading into the enclosure,” Esquibel explained. The profile and footprint of the enclosure still leaves space for fans to place belongings.

Handrail Wi-Fi enclosure

Handrail Wi-Fi enclosure

It’s the same modus operandi for the enclosures housed in the stair rails, except there are two APs in larger enclosures at the top of each staircase on the reserve level and upper deck, then a single AP per enclosure as the stairways descend. Some 290 APs offer coverage on the reserve level, which by itself has a greater capacity than nearby Staples Center (18,118 seats), Esquibel told Mobile Sports Report. After 2 years of use, there have been no issues with the AP enclosures. “We power-wash the seats and stands after games and [the enclosures] are very resilient against the sun, water and wind,” Esquibel said.

He also acknowledged some early challenges with Wi-Fi. Part of the issue was working with Cisco’s CleanAir technology, which is supposed to minimize RF interference, if not eliminate it altogether. If an AP starts broadcasting over a frequency in use by another AP, for example, CleanAir helps it find another frequency. It took a few months to fully tune the network; some directional antennas needed a 10-degree adjustment, Esquibel said. Another challenge was having APs from more than one vendor. “If your network is 100 percent Cisco and all leveraging the same controllers, [CleanAir] will work perfectly,” Esquibel said. “If you have a mixed environment that pushes Wi-Fi in certain locations, it becomes a problem — there’s competition for frequencies.”

Coordinating the APs

A third-party leveraging a non-public frequency would switch channels, for example, causing the APs for public use to also switch channels. “What we had was a lot of bouncing back and forth,” Esquibel said, which affected performance. “So we assigned channels and frequencies for each AP, which still requires a lot of coordination.”

Under-seat Wi-Fi enclosure

Under-seat Wi-Fi enclosure

Since 2013, the stadium has been carved into 24 DAS sectors. AT&T, T-Mobile USA and Verizon Wireless are the carriers presently using the DAS; Ericsson makes the DAS antennas. Stubborn Sprint relies on a tower adjacent to the stadium.

Dodger fans average anywhere from 500-655 megabytes of data use per game, according to Esquibel. During a busy game, the wireless networking accommodates 16,000 concurrent users; a slower event clocks in at 4,000-8,000. To test upload speed, Esquibel will push a 50MB video to Facebook. When there’s lots of available bandwidth, he gets 60 Mbps performance; on the low end, it’s closer to 4 Mbps. Esquibel said users are mostly streaming and posting videos and photos to social media; Dodger Stadium is the second most Instagrammed site in southern California, after Disneyland, Esquibel added.

The Dodgers have their own version of Ballpark, the in-stadium MLB app, which offers video replay and highlights; in-seat ordering of food and drink in certain areas; and stadium mapping. Check-ins on Ballpark are handled through a network of 44 iBeacons, which takes advantage of Bluetooth Low Energy (BTLE) technology. Between Ballpark and social media activity, Dodger fans have run up as much as 700 MB data usage during games — and the network is ready if more demand is needed.

“We don’t do any rate limiting, so if we consume all our bandwidth we get a free upgrade, thanks to a clause in our agreement with our ISP, AT&T,” Esquibel explained.

To ensure a family-friendly and wholesome environment, the Dodgers use Palo Alto Networks 5020 firewalls for content filtering. “As we developed our SLAs, it was one of the first issues to pop up — no sexual content, no malware/phishing, and no illegal drug sites,” he said.

What’s on his wish list for the future? “I’d like geo-fencing within the Wi-Fi network so if I see someone enter a club, I can say hi or welcome them, notify them of specials, or flag points of interest around the stadium,” Esquibel said, like the World Series trophy case or giveaway locations for promotional items. Alongside all the other applications, wireless can be used as guideposts for fans and visitors to Dodger Stadium.