A Max Pressure Algorithm for Traffic Signals Considering Pedestrian Queues

Hao Liu [email protected] Vikash V. Gayah [email protected] Michael Levin [email protected] The Pennsylvania State University, University Park, PA, United States University of Minnesota, Minneapolis, MN, United States
Abstract

This paper proposes a novel max-pressure (MP) algorithm that incorporates pedestrian traffic into the MP control architecture. Pedestrians are modeled as being included in one of two groups: those walking on sidewalks and those queued at intersections waiting to cross. Traffic dynamics models for both groups are developed. Under the proposed control policy, the signal timings are determined based on the queue length of both vehicles and pedestrians waiting to cross the intersection. The proposed algorithm maintains the decentralized control structure, and the paper proves that it also exhibits the maximum stability property for both vehicles and pedestrians. Microscopic traffic simulation results demonstrate that the proposed model can improve the overall operational efficiency—i.e., reduce person travel delays—under various vehicle demand levels compared to the original queue-based MP (Q-MP) algorithm and a recently developed rule-based MP algorithm considering pedestrians. The Q-MP ignores the yielding behavior of right-turn vehicles to conflicting pedestrian movements, which leads to high delay for vehicles. On the other hand, the delay incurred by pedestrians is high from the rule-based model since it imposes large waiting time tolerance to guarantee the operational efficiency of vehicles. The proposed algorithm outperforms both models since the states of both vehicles and pedestrians are taken into consideration to determine signal timings.

keywords:
Max Pressure algorithm; Pedestrians; Decentralized traffic signal control; Maximum stability

1 Introduction

Real-time decentralized signal control for large-scale urban networks has attracted intensive research interest in the past decades. Various methods have been developed, including SCOOT (Hunt et al., 1981), OPAC (Gartner, 1983), UTOPIA (Mauro and Di Taranto, 1990), SCATS (Lowrie, 1990) and RHODES (Mirchandani and Head, 2001). More recently, max-pressure (MP) has become a very popular decentralized traffic signal control algorithm. This algorithm was originally developed to address the packet scheduling problem in wireless communication networks (Tassiulas and Ephremides, 1990), but was applied to traffic signal control in (Varaiya, 2013). Since then, many MP-based traffic signal control algorithms (Kouvelas et al., 2014; Gregoire et al., 2014; Xiao et al., 2014; Le et al., 2015; Wu et al., 2017; Li and Jabari, 2019; Rey and Levin, 2019; Levin et al., 2020; Mercader et al., 2020; Dixit et al., 2020; Liu and Gayah, 2022; Xu et al., 2022; Wang et al., 2022; Liu and Gayah, 2023) have been proposed as a result of its ease of implementation, prominent control performance, and fast computational speed. Additionally, certain MP algorithms share the following desirable properties: no need for external demand information and maximum stability. The latter property indicates that the MP algorithm can accommodate any demand that can be served by an admissible control strategy. A detailed review of MP-based signal control algorithms can be found in (Levin, 2023).

The MP algorithms determine signal timings for each intersection based on the pressure of all phases, which is calculated based on the values of a selected metric—such as queue length, travel time and travel delay—measured for all local movements at the intersection. In general, the MP control algorithm aims at kee** the overall pressure low to maintain the operational efficiency at the intersection, and the pressure of each phase reflects the pressure value that can be potentially “released” from the associated intersection by the phase. Therefore, the MP algorithms usually tend to allocate green time in favor of the phase with the highest pressure.

According to this basic working mechanism, it is easy to imagine that the control performance of an MP algorithm is highly dependent on the selected metric for the pressure computation. Therefore, the first aspect that the MP-related studies in the literature have mainly concentrated on is the selection of the metric. The queue length is used as the metric in (Varaiya, 2013). Note that, since point queue models were employed for traffic dynamics modeling in (Varaiya, 2013), the queue length is equivalent to the number of vehicles of a given link. Thus, for simplicity and consistency with what is used in the MP literature, the term “queue” is referred to as the number of vehicles in this paper. However, this metric does not consider the position, moving status of vehicles and maximum occupancies of links, which can affect the control performance significantly. Various MP-based algorithms have been proposed to address these drawbacks. For example, the maximum occupancies of links were taken into consideration in (Gregoire et al., 2014; Xiao et al., 2014). A position-weighted MP algorithm was proposed in (Li and Jabari, 2019), which incorporates each vehicle’s location on the link into the pressure calculation. Compared to queue length, travel time and travel delay are inherently influenced by the maximum occupancy of links, and travel time-based (Mercader et al., 2020) and delay-based (Dixit et al., 2020; Liu and Gayah, 2022, 2023) MP algorithms have also been developed and shown to outperform queue-based MP approaches.

In addition to the metric, another pressing area of interest with respect to MP algorithms is its practicability. Many MP-based algorithms (Varaiya, 2013; Gregoire et al., 2014; Liu and Gayah, 2022; Li and Jabari, 2019) update phases at a fixed frequency in an arbitrary order, which could be a barrier for implementation since doing so may confuse travelers who expect regular cyclic structure. MP algorithms with fixed signal sequences have been developed to address this issue (Levin et al., 2020; Mercader et al., 2020).

Another practical concern for the aforementioned MP algorithms is that they do not distinguish vehicle types in a mixed traffic flow environment, and this treatment could diminish the overall operational efficiency. An MP algorithm considering public transit signal priority in networks with exclusive bus lanes was proposed in (Xu et al., 2022). In addition to bus rapid transit, pedestrians are another important component of urban transportation networks. However, incorporating pedestrians into the MP control architecture has received very little attention in the research literature. Xu et al. (2023) proposed an MP algorithm that considers pedestrian access at intersections by using a rule-based approach. Specifically, when the waiting time of the first-arrived pedestrian exceeds a predefined threshold value, the traffic signal provides protected phase to the corresponding pedestrian movement. Otherwise, the signals are controlled by a regular queue-based MP algorithm. Although the maximum stability of the proposed model was proved for vehicles, the stable region is dependent on the predefined threshold for pedestrian’s waiting times. Also, the stability for pedestrians in the network is not clear. In addition, the proposed method did not consider the yielding behavior of right-turn vehicles to pedestrians during permissive phases, which is a common signal design in urban transportation networks.

In order to partially bridge these gaps, this paper proposes an MP algorithm that incorporates pedestrians into the pressure calculation while maintaining the MP control structure. The contributions of this paper include: 1. develop a traffic dynamics model for pedestrians; 2. propose a queue-based MP algorithm that considers both vehicle and pedestrian queues; 3. demonstrate the proposed model inherits the maximum stability property for both vehicles and pedestrians; 4. show the proposed model can outperform the queue-based MP proposed in (Varaiya, 2013) and the rule-based model proposed in (Xu et al., 2023) under various traffic conditions.

The remainder of this paper is organized as follows. Section 2 describes the traffic dynamics models for both vehicles and pedestrians. Then, the novel MP algorithm that incorporates pedestrian states is proposed, and the maximum stability is proved in Section 3. Section 4 shows the results of microscopic traffic simulations, which demonstrate that the proposed model can outperform two baseline models under various vehicle demand levels. Finally, concluding remarks are provided in Section 5.

2 Traffic dynamics

First, we define the required notations used for the modeling of traffic dynamics in this paper. We consider a network consisting of a set of intersections NN\pazocal{N}roman_N and a set of directional links LL\pazocal{L}roman_L. A link that connects a pair of adjacent intersections, i𝑖iitalic_i and j𝑗jitalic_j, is denoted by (i,j)𝑖𝑗(i,j)( italic_i , italic_j ). A movement from link (i,j)𝑖𝑗(i,j)( italic_i , italic_j ) to link (j,k)𝑗𝑘(j,k)( italic_j , italic_k ) is denoted by (i,j,k)𝑖𝑗𝑘(i,j,k)( italic_i , italic_j , italic_k ). Links are classified as either entry links LentersubscriptLenter\pazocal{L}_{\mathrm{enter}}roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT from where vehicles enter the network, exit links LexitsubscriptLexit\pazocal{L}_{\mathrm{exit}}roman_L start_POSTSUBSCRIPT roman_exit end_POSTSUBSCRIPT from where vehicles exit the network, and internal links LinsubscriptLin\pazocal{L}_{\mathrm{in}}roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT that simply connect intersections. Also, let UisuperscriptUi\pazocal{U}^{i}roman_U start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT (DisuperscriptDi\pazocal{D}^{i}roman_D start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT) indicate the set of upstream (downstream) intersections of intersection i𝑖iitalic_i if i𝑖iitalic_i is not an entry (exit) intersection.

We assume without loss of generality that all links have a sidewalk on the right side that allows pedestrian movements in both directions, as shown in Figure 1. At each intersection, pedestrians are allowed to wait at each corner, referred to as pedestrian nodes, to cross the intersection. We use iαsubscript𝑖𝛼i_{\alpha}italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT to denote a pedestrian node at intersection i𝑖iitalic_i, where α𝛼\alphaitalic_α indicates the relative location of the pedestrian node. Assume each intersection has four corners (i.e., that each intersection has four links). Then, for example, iSEsubscript𝑖𝑆𝐸i_{SE}italic_i start_POSTSUBSCRIPT italic_S italic_E end_POSTSUBSCRIPT represents the pedestrian node in the southeast of intersection i𝑖iitalic_i, as shown in Figure 1. Each sidewalk is represented by a pair of pedestrian nodes. We use OiαsuperscriptOsubscripti𝛼\pazocal{O}^{i_{\alpha}}roman_O start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT to indicate the set of adjacent pedestrian nodes of iαsubscript𝑖𝛼i_{\alpha}italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT at the same intersection, i𝑖iitalic_i, and UiαsuperscriptUsubscripti𝛼\pazocal{U}^{i_{\alpha}}roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT to denote the set of pedestrian nodes from adjacent intersections of i𝑖iitalic_i that connect iαsubscript𝑖𝛼i_{\alpha}italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT. For the example shown in Figure 1, OjSW={jNW,jSE}superscriptOsubscriptjSWsubscriptjNWsubscriptjSE\pazocal{O}^{j_{SW}}=\{j_{NW},j_{SE}\}roman_O start_POSTSUPERSCRIPT roman_j start_POSTSUBSCRIPT roman_S roman_W end_POSTSUBSCRIPT end_POSTSUPERSCRIPT = { roman_j start_POSTSUBSCRIPT roman_N roman_W end_POSTSUBSCRIPT , roman_j start_POSTSUBSCRIPT roman_S roman_E end_POSTSUBSCRIPT } and UjSW={iSE,kNW}superscriptUsubscriptjSWsubscriptiSEsubscriptkNW\pazocal{U}^{j_{SW}}=\{i_{SE},k_{NW}\}roman_U start_POSTSUPERSCRIPT roman_j start_POSTSUBSCRIPT roman_S roman_W end_POSTSUBSCRIPT end_POSTSUPERSCRIPT = { roman_i start_POSTSUBSCRIPT roman_S roman_E end_POSTSUBSCRIPT , roman_k start_POSTSUBSCRIPT roman_N roman_W end_POSTSUBSCRIPT }.

Let MvisuperscriptMvi\pazocal{M}^{vi}roman_M start_POSTSUPERSCRIPT roman_v roman_i end_POSTSUPERSCRIPT and MpisuperscriptMpi\pazocal{M}^{pi}roman_M start_POSTSUPERSCRIPT roman_p roman_i end_POSTSUPERSCRIPT indicate the set of vehicle movements and pedestrian movements between two pedestrian nodes at intersection i𝑖iitalic_i, respectively, and let SisuperscriptSi\pazocal{S}^{i}roman_S start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT be the set of admissible phases, at intersection i𝑖iitalic_i. An admissible phase at intersection i𝑖iitalic_i is represented by an array with a length of |Mvi|+|Mpi|superscriptMvisuperscriptMpi|\pazocal{M}^{vi}|+|\pazocal{M}^{pi}|| roman_M start_POSTSUPERSCRIPT roman_v roman_i end_POSTSUPERSCRIPT | + | roman_M start_POSTSUPERSCRIPT roman_p roman_i end_POSTSUPERSCRIPT |, in which each element is a binary variable indicating if the associated movement is served by the phase. Let Si(t)superscript𝑆𝑖𝑡S^{i}(t)italic_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ) be the phase that is activated at intersection i𝑖iitalic_i at time t𝑡titalic_t and Sh,i,jv,i(t)subscriptsuperscript𝑆v𝑖𝑖𝑗𝑡S^{\mathrm{v},i}_{h,i,j}(t)italic_S start_POSTSUPERSCRIPT roman_v , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) and Siα,iβp,i(t)subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡S^{\mathrm{p},i}_{i_{\alpha},i_{\beta}}(t)italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) be the elements associated with the vehicle movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) and the pedestrian crosswalk movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) in Si(t)superscript𝑆𝑖𝑡S^{i}(t)italic_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ), respectively. For simplicity, we also use the symbols Sh,i,jv(t)subscriptsuperscript𝑆v𝑖𝑗𝑡S^{\mathrm{v}}_{h,i,j}(t)italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) and Siα,iβp(t)subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) without the superscript for intersection index, which is unique for both vehicle and crosswalk movements, to represent whether the vehicle movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) and the pedestrian crosswalk movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) are served at time t𝑡titalic_t.

Refer to caption
Figure 1: Pedestrian network.

2.1 Vehicle traffic dynamics

Most MP algorithms in the literature—e.g., (Sun and Yin, 2018; Varaiya, 2013) use a store-and-forward point queue model for the vehicle traffic dynamics in which the maximum occupancy of each link is assumed to be infinite, and this model was observed to be effective in micro-simulations comparing MP to existing signal timings (Levin et al., 2020; Barman and Levin, 2022). Therefore, this paper use the same model for the vehicle dynamics modeling. Specifically, the evolution of the number of vehicles on link (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) can be expressed as:

xh,i,jv(t+1)=xh,i,jv(t)min(Ch,i,jv(t)Sh,i,jv,i(t),xh,i,jv(t))+gUhmin(Cg,h,iv(t)Sg,h,iv,i(t),xg,h,iv(t))Rh,i,jv(t+1)𝟙Lin(h,i)+dh,i,jv𝟙Lentry(h,i)subscriptsuperscript𝑥v𝑖𝑗𝑡1subscriptsuperscript𝑥v𝑖𝑗𝑡subscriptsuperscript𝐶v𝑖𝑗𝑡subscriptsuperscript𝑆v𝑖𝑖𝑗𝑡subscriptsuperscript𝑥v𝑖𝑗𝑡subscript𝑔superscriptUhsubscriptsuperscript𝐶v𝑔𝑖𝑡subscriptsuperscript𝑆v𝑖𝑔𝑖𝑡subscriptsuperscript𝑥v𝑔𝑖𝑡subscriptsuperscript𝑅v𝑖𝑗𝑡1subscript1subscriptLin𝑖subscriptsuperscript𝑑v𝑖𝑗subscript1subscriptLentry𝑖\begin{split}x^{\mathrm{v}}_{h,i,j}(t+1)=&x^{\mathrm{v}}_{h,i,j}(t)-\min(C^{% \mathrm{v}}_{h,i,j}(t)S^{\mathrm{v},i}_{h,i,j}(t),x^{\mathrm{v}}_{h,i,j}(t))\\ &+\sum_{g\in\pazocal{U}^{h}}\min(C^{\mathrm{v}}_{g,h,i}(t)S^{\mathrm{v},i}_{g,% h,i}(t),x^{\mathrm{v}}_{g,h,i}(t))R^{\mathrm{v}}_{h,i,j}(t+1)\mathbbm{1}_{% \pazocal{L}_{\mathrm{in}}}(h,i)\\ &+d^{\mathrm{v}}_{h,i,j}\mathbbm{1}_{\pazocal{L}_{\mathrm{entry}}}(h,i)\end{split}start_ROW start_CELL italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t + 1 ) = end_CELL start_CELL italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) - roman_min ( italic_C start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_g ∈ roman_U start_POSTSUPERSCRIPT roman_h end_POSTSUPERSCRIPT end_POSTSUBSCRIPT roman_min ( italic_C start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_g , italic_h , italic_i end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_g , italic_h , italic_i end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_g , italic_h , italic_i end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_h , italic_i ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_entry end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_h , italic_i ) end_CELL end_ROW (1)

where xh,i,jv(t)subscriptsuperscript𝑥v𝑖𝑗𝑡x^{\mathrm{v}}_{h,i,j}(t)italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) is the number of vehicles of movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ), i.e., the number of vehicles waiting on link (h,i)𝑖(h,i)( italic_h , italic_i ) to join link (i,j)𝑖𝑗(i,j)( italic_i , italic_j ), at time t𝑡titalic_t; Ch,i,jvsubscriptsuperscript𝐶v𝑖𝑗C^{\mathrm{v}}_{h,i,j}italic_C start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT is the stochastic and bounded saturation flow for movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) at time step t𝑡titalic_t with mean value ch,i,jvsubscriptsuperscript𝑐v𝑖𝑗c^{\mathrm{v}}_{h,i,j}italic_c start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT; Rg,h,ivsubscriptsuperscript𝑅v𝑔𝑖R^{\mathrm{v}}_{g,h,i}italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_g , italic_h , italic_i end_POSTSUBSCRIPT is the random turning ratio from link (g,h)𝑔(g,h)( italic_g , italic_h ) to link (h,i)𝑖(h,i)( italic_h , italic_i ) with mean value rg,h,ivsubscriptsuperscript𝑟v𝑔𝑖r^{\mathrm{v}}_{g,h,i}italic_r start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_g , italic_h , italic_i end_POSTSUBSCRIPT; 𝟙A(x)subscript1𝐴𝑥\mathbbm{1}_{A}(x)blackboard_1 start_POSTSUBSCRIPT italic_A end_POSTSUBSCRIPT ( italic_x ) is the indicator function. The second term in Equation (1) is the outflows of movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) during time interval (t,t+1)𝑡𝑡1(t,t+1)( italic_t , italic_t + 1 ); the third term is the inflows from upstream movements if link (h,i)𝑖(h,i)( italic_h , italic_i ) is an internal link; and, the fourth term is the external demand if link (h,i)𝑖(h,i)( italic_h , italic_i ) is an entry link. Note that the second and third terms in Equation (1) imply that the time step size is equal to the free-flow travel time of the link. The long links in the network can be divided into shorter sub-links to satisfy this condition (Varaiya, 2013).

2.2 Pedestrian dynamics

Pedestrians are divided into two groups based on their locations: pedestrians waiting at a pedestrian node to cross the intersection—i.e., pedestrian movement between two pedestrian nodes at the same intersection—and pedestrians movement on the sidewalk. For simplicity, the former group is called crosswalk movements while the latter is called sidewalk movements. The following assumptions for pedestrian dynamics are made:

  1. 1.

    Pedestrians enter or exit the network from sidewalks;

  2. 2.

    The maximum occupancy for pedestrian nodes is infinite, so pedestrians cannot be blocked on sidewalks;

  3. 3.

    Pedestrians on sidewalks always walk at the free-flow speed;

  4. 4.

    Pedestrians crossing an intersection from a pedestrian node will not go back to the same pedestrian node immediately.

Following these assumptions, the evolution of pedestrians of a crosswalk movement can be expressed as:

xiα,iβpc(t+1)=xiα,iβpc(t)min(Ciα,iβp(t)Siα,iβp,i(t),xiα,iβpc(t))+iγOiα{iβ}min(Ciγ,iαp(t)Siγ,iαp,i(t),xiγ,iαpc(t))Riγ,iα,iβp(t+1)+jηUiαψ(𝐕(jη,iα))Rjη,iα,iβpsubscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡1subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsubscript𝑖𝛾superscriptOsubscripti𝛼subscripti𝛽subscriptsuperscript𝐶psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽𝑡1subscriptsubscript𝑗𝜂superscriptUsubscripti𝛼𝜓𝐕subscript𝑗𝜂subscript𝑖𝛼subscriptsuperscript𝑅psubscript𝑗𝜂subscript𝑖𝛼subscript𝑖𝛽\begin{split}x^{\mathrm{\mathrm{pc}}}_{i_{\alpha},i_{\beta}}(t+1)=&x^{\mathrm{% pc}}_{i_{\alpha},i_{\beta}}(t)-\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^% {\mathrm{p},i}_{i_{\alpha},i_{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}% }(t))\\ &+\sum_{i_{\gamma}\in\pazocal{O}^{i_{\alpha}}\setminus{\{i_{\beta}\}}}\min(C^{% \mathrm{p}}_{i_{\gamma},i_{\alpha}}(t)S^{\mathrm{p},i}_{i_{\gamma},i_{\alpha}}% (t),x^{\mathrm{pc}}_{i_{\gamma},i_{\alpha}}(t))R^{\mathrm{p}}_{i_{\gamma},i_{% \alpha},i_{\beta}}(t+1)\\ &+\sum_{j_{\eta}\in\pazocal{U}^{i_{\alpha}}}\psi(\mathbf{V}(j_{\eta},i_{\alpha% }))R^{\mathrm{p}}_{j_{\eta},i_{\alpha},i_{\beta}}\end{split}start_ROW start_CELL italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) = end_CELL start_CELL italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_O start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ∖ { roman_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT } end_POSTSUBSCRIPT roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ∈ roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_ψ ( bold_V ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_CELL end_ROW (2)

where Ciα,iβp(t)subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) is the stochastic saturation flow of crosswalk movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) at time t𝑡titalic_t; Riγ,iα,iβp(t+1)subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽𝑡1R^{\mathrm{p}}_{i_{\gamma},i_{\alpha},i_{\beta}}(t+1)italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) is the turning ratio from (iγ,iα)subscript𝑖𝛾subscript𝑖𝛼(i_{\gamma},i_{\alpha})( italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) to (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ). The second term is the outflow of crosswalk movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ); the third term is the inflow from the adjacent pedestrian node; ψ𝜓\psiitalic_ψ is a function map** the distribution of pedestrians on a sidewalk to the number of pedestrians that are going to join movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ). Since the walking speed of pedestrians is much slower than the free flow travel speed of vehicles, pedestrians on a sidewalk can arrive the downstream node within one time step only if their distance to the downstream node is shorter than the walking travel distance in one time step. Specifically, ψ𝜓\psiitalic_ψ can be expressed as:

ψ(𝐕(jη,iα))=v[1,nv(jη,iα)]𝟙b(v)bf(v)𝜓𝐕subscript𝑗𝜂subscript𝑖𝛼subscript𝑣1superscript𝑛vsubscript𝑗𝜂subscript𝑖𝛼subscript1𝑏𝑣subscript𝑏𝑓𝑣\psi(\mathbf{V}(j_{\eta},i_{\alpha}))=\sum_{v\in[1,n^{\mathrm{v}}(j_{\eta},i_{% \alpha})]}\mathbbm{1}_{b(v)\leq b_{f}(v)}italic_ψ ( bold_V ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) = ∑ start_POSTSUBSCRIPT italic_v ∈ [ 1 , italic_n start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ] end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT italic_b ( italic_v ) ≤ italic_b start_POSTSUBSCRIPT italic_f end_POSTSUBSCRIPT ( italic_v ) end_POSTSUBSCRIPT (3)

where nv(jη,iα)superscript𝑛vsubscript𝑗𝜂subscript𝑖𝛼n^{\mathrm{v}}(j_{\eta},i_{\alpha})italic_n start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) is the number of pedestrians on (jη,iα)subscript𝑗𝜂subscript𝑖𝛼(j_{\eta},i_{\alpha})( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ); b(v)𝑏𝑣b(v)italic_b ( italic_v ) is the distance between the v𝑣vitalic_vth pedestrian to the downstream node; bf(v)subscript𝑏𝑓𝑣b_{f(v)}italic_b start_POSTSUBSCRIPT italic_f ( italic_v ) end_POSTSUBSCRIPT is the travel distance of pedestrian v𝑣vitalic_v in a time step.

The number of pedestrians of sidewalk movement (iα,jβ)subscript𝑖𝛼subscript𝑗𝛽(i_{\alpha},j_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) can be expressed as,

xiα,jβps(t+1)=xiα,jβps(t)ψ(𝐕(iα,jβ))(t)qiα,jβout(t)+qiα,jβin(t)+iγOiαmin(Ciγ,iαp(t)Siγ,iαp(t),xiγ,iαpc(t))Riγ,iα,jβp(t+1)+hγUiα{jβ}ψ(𝐕(hγ,iα))Rhγ,iα,jβpsubscriptsuperscript𝑥pssubscript𝑖𝛼subscript𝑗𝛽𝑡1subscriptsuperscript𝑥pssubscript𝑖𝛼subscript𝑗𝛽𝑡𝜓𝐕subscript𝑖𝛼subscript𝑗𝛽𝑡subscriptsuperscript𝑞outsubscript𝑖𝛼subscript𝑗𝛽𝑡subscriptsuperscript𝑞insubscript𝑖𝛼subscript𝑗𝛽𝑡subscriptsubscript𝑖𝛾superscriptOsubscripti𝛼subscriptsuperscript𝐶psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑆psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑗𝛽𝑡1subscriptsubscript𝛾superscriptUsubscripti𝛼subscriptj𝛽𝜓𝐕subscript𝛾subscript𝑖𝛼subscriptsuperscript𝑅psubscript𝛾subscript𝑖𝛼subscript𝑗𝛽\begin{split}x^{\mathrm{ps}}_{i_{\alpha},j_{\beta}}(t+1)=&x^{\mathrm{ps}}_{i_{% \alpha},j_{\beta}}(t)-\psi(\mathbf{V}(i_{\alpha},j_{\beta}))(t)-q^{\mathrm{out% }}_{i_{\alpha},j_{\beta}}(t)+q^{\mathrm{in}}_{i_{\alpha},j_{\beta}}(t)\\ &+\sum_{i_{\gamma}\in\pazocal{O}^{i_{\alpha}}}\min(C^{\mathrm{p}}_{i_{\gamma},% i_{\alpha}}(t)S^{\mathrm{p}}_{i_{\gamma},i_{\alpha}}(t),x^{\mathrm{pc}}_{i_{% \gamma},i_{\alpha}}(t))R^{\mathrm{p}}_{i_{\gamma},i_{\alpha},j_{\beta}}(t+1)\\ &+\sum_{h_{\gamma}\in\pazocal{U}^{i_{\alpha}}\setminus{\{j_{\beta}\}}}\psi(% \mathbf{V}(h_{\gamma},i_{\alpha}))R^{\mathrm{p}}_{h_{\gamma},i_{\alpha},j_{% \beta}}\end{split}start_ROW start_CELL italic_x start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) = end_CELL start_CELL italic_x start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_ψ ( bold_V ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ) ( italic_t ) - italic_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) + italic_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_O start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT end_POSTSUBSCRIPT roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ∖ { roman_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT } end_POSTSUBSCRIPT italic_ψ ( bold_V ( italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_CELL end_ROW (4)

where qiα,jβin(t)subscriptsuperscript𝑞insubscript𝑖𝛼subscript𝑗𝛽𝑡q^{\mathrm{in}}_{i_{\alpha},j_{\beta}}(t)italic_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) and qiα,jβout(t)subscriptsuperscript𝑞outsubscript𝑖𝛼subscript𝑗𝛽𝑡q^{\mathrm{out}}_{i_{\alpha},j_{\beta}}(t)italic_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) are the number of enter and exit pedestrians on sidewalk (iα,jβ)subscript𝑖𝛼subscript𝑗𝛽(i_{\alpha},j_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) at time t𝑡titalic_t, respectively; the fifth term is the inflow from adjacent pedestrian nodes at the same intersection; the sixth term is the inflow from the upstream sidewalk.

3 Max pressure algorithm incorporating pedestrians

3.1 Signal control algorithm

Following the traffic dynamics models, this section derives a step-based MP algorithm that incorporates pedestrian queues into pressure calculation. The proposed algorithm is referred to as PQ-MP in the remainder of this paper. The signal phase at all intersections is updated at a fixed frequency. Like most step-based MP algorithms in the literature, the proposed PQ-MP works in the following four steps.

  1. 1.

    At each signal update instant t𝑡titalic_t, measure the number of vehicles of all vehicle movements and the number of pedestrians at each pedestrian node;

  2. 2.

    Define the weight of a vehicle movement (pedestrian crosswalk movement) as the difference between the number of vehicles (pedestrians) of this movement and the average number of vehicles (pedestrians) over all downstream vehicle movement (pedestrian crosswalk movement) using the turning ratio as the proportion. Specifically, both types of weights can be expressed as Equation (5) and Equation (6), respectively. Note that since we assume pedestrians on sidewalks do not incur delay, this group of pedestrians is not considered in the weight definition. In addition, for pedestrian crosswalk movement, we do not consider the downstream sidewalk movement in the weight calculation. In addition, since we assume the pedestrians from node iαsubscript𝑖𝛼i_{\alpha}italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT to node iβsubscript𝑖𝛽i_{\beta}italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT will not go back to node iαsubscript𝑖𝛼i_{\alpha}italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT immediately, there is only one downstream crosswalk movement in Equation (6).

    wh,i,jv(t)=xh,i,jv(t)kDjxi,j,kv(t)Ri,j,k(t)subscriptsuperscript𝑤v𝑖𝑗𝑡subscriptsuperscript𝑥v𝑖𝑗𝑡subscript𝑘superscriptDjsubscriptsuperscript𝑥v𝑖𝑗𝑘𝑡subscript𝑅𝑖𝑗𝑘𝑡w^{\mathrm{v}}_{h,i,j}(t)=x^{\mathrm{v}}_{h,i,j}(t)-\sum_{k\in\pazocal{D}^{j}}% x^{\mathrm{v}}_{i,j,k}(t)R_{i,j,k}(t)italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) = italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) - ∑ start_POSTSUBSCRIPT italic_k ∈ roman_D start_POSTSUPERSCRIPT roman_j end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i , italic_j , italic_k end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUBSCRIPT italic_i , italic_j , italic_k end_POSTSUBSCRIPT ( italic_t ) (5)
    wiα,iβp(t)=xiα,iβpc(t)xiβ,iγpc(t)Riα,iβ,iγpsubscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛽subscript𝑖𝛾𝑡subscriptsuperscript𝑅psubscript𝑖𝛼subscript𝑖𝛽subscript𝑖𝛾w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)=x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}% }(t)-x^{\mathrm{pc}}_{i_{\beta},i_{\gamma}}(t)R^{\mathrm{p}}_{i_{\alpha},i_{% \beta},i_{\gamma}}italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) = italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT (6)
  3. 3.

    Compute the pressure for the phase array 𝐒i(t)superscript𝐒𝑖𝑡\mathbf{S}^{i}(t)bold_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ) at intersection i𝑖iitalic_i, as:

    p(𝐒i(t))=(h,i,j)Mviwh,i,jv(t)C~h,i,jv(t)Sh,i,jv,i(t)+λ(iα,iβ)Mpiwiα,iβp(t)Ciα,iβp(t)Siα,iβp,i(t)𝑝superscript𝐒𝑖𝑡subscript𝑖𝑗superscriptMvisubscriptsuperscript𝑤v𝑖𝑗𝑡subscriptsuperscript~𝐶v𝑖𝑗𝑡subscriptsuperscript𝑆v𝑖𝑖𝑗𝑡𝜆subscriptsubscript𝑖𝛼subscript𝑖𝛽superscriptMpisubscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡p(\mathbf{S}^{i}(t))=\sum_{(h,i,j)\in\pazocal{M}^{vi}}w^{\mathrm{v}}_{h,i,j}(t% )\tilde{C}^{\mathrm{v}}_{h,i,j}(t)S^{\mathrm{v},i}_{h,i,j}(t)+\lambda\sum_{(i_% {\alpha},i_{\beta})\in\pazocal{M}^{pi}}w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t% )C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p},i}_{i_{\alpha},i_{\beta% }}(t)italic_p ( bold_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ) ) = ∑ start_POSTSUBSCRIPT ( italic_h , italic_i , italic_j ) ∈ roman_M start_POSTSUPERSCRIPT roman_v roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) + italic_λ ∑ start_POSTSUBSCRIPT ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ∈ roman_M start_POSTSUPERSCRIPT roman_p roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) (7)

    It is assumed that the right-turn vehicles need to yield to conflicting pedestrian movements served by the same phase. Therefore, the saturation flow for an activated right-turn vehicle movement needs to be adjusted if the conflicting pedestrian crosswalk movements are being served as well. Specifically, the portion of a time step that is required to serve the associated pedestrian cross movement cannot be utilized by the right-turn vehicle movement, so the same proportion needs to be subtracted from the original saturation flow of the right-turn vehicle movements. C~h,i,jv(t)subscriptsuperscript~𝐶v𝑖𝑗𝑡\tilde{C}^{\mathrm{v}}_{h,i,j}(t)over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) in Equation (7) is the saturation flow of vehicles considering the impact from pedestrians, and it can be expressed as:

    C~h,i,jv(t)=Ch,i,jv(t)(1min(1,max(iα,iβ)Mh,i,jpxiα,iβpc(t)Siα,iβp,i(t)Ciα,iβp(t)))subscriptsuperscript~𝐶v𝑖𝑗𝑡subscriptsuperscript𝐶v𝑖𝑗𝑡11subscriptsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscriptMphijsubscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡\tilde{C}^{\mathrm{v}}_{h,i,j}(t)=C^{\mathrm{v}}_{h,i,j}(t)\left(1-\min\left(1% ,\max_{(i_{\alpha},i_{\beta})\in\pazocal{M}^{\mathrm{p}}_{h,i,j}}\frac{x^{% \mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p},i}_{i_{\alpha},i_{\beta}}(% t)}{C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)}\right)\right)over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) = italic_C start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) ( 1 - roman_min ( 1 , roman_max start_POSTSUBSCRIPT ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ∈ roman_M start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_h , roman_i , roman_j end_POSTSUBSCRIPT end_POSTSUBSCRIPT divide start_ARG italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG start_ARG italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG ) ) (8)

    where Ch,i,jv(t)subscriptsuperscript𝐶v𝑖𝑗𝑡C^{\mathrm{v}}_{h,i,j}(t)italic_C start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) is the saturation flow of vehicle movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ) without pedestrians, and Mh,i,jpsubscriptsuperscriptMphij\pazocal{M}^{\mathrm{p}}_{h,i,j}roman_M start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_h , roman_i , roman_j end_POSTSUBSCRIPT is the set of pedestrian movements that conflict with vehicle movement (h,i,j)𝑖𝑗(h,i,j)( italic_h , italic_i , italic_j ). The term of xiα,iβpc(t)Siα,iβp,i(t)Ciα,iβp(t)subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡\frac{x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p},i}_{i_{\alpha},i_% {\beta}}(t)}{C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)}divide start_ARG italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG start_ARG italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG is the proportion of a time step that is required to clear the pedestrian queue of movement (iα,iβ)subscript𝑖𝛼subscript𝑖𝛽(i_{\alpha},i_{\beta})( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ). Note, since pedestrians are allowed to travel in both directions on a crosswalk, each right-turn vehicle movement has two conflicting crosswalk movements. Therefore, min(1,max(iα,iβ)Mh,i,jpxiα,iβpc(t)Siα,iβp,i(t)Ciα,iβp(t))1subscriptsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscriptMphijsubscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆p𝑖subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡\min\left(1,\max_{(i_{\alpha},i_{\beta})\in\pazocal{M}^{\mathrm{p}}_{h,i,j}}% \frac{x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p},i}_{i_{\alpha},i_% {\beta}}(t)}{C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)}\right)roman_min ( 1 , roman_max start_POSTSUBSCRIPT ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ∈ roman_M start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT roman_h , roman_i , roman_j end_POSTSUBSCRIPT end_POSTSUBSCRIPT divide start_ARG italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p , italic_i end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG start_ARG italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_ARG ) is the portion that needs to be subtracted from the saturation flow of the corresponding right-turn movement.

    In general, the travel speed of vehicles is higher than the walking speed of pedestrians; however, the density of pedestrian stream is higher than the critical density of vehicle flows, and this excess in density usually outweighs the speed shortage. As a result, the saturation flow for pedestrians is significantly higher than that of vehicles. Therefore, without a coefficient for the pedestrian weight, Equation (7) will weigh pedestrian crosswalk movements considerably more over vehicle movements and assign excessive green time to pedestrians. Consequently, the delay incurred by vehicles, especially the left-turn vehicles, could be extremely high. To address this issue, we added an coefficient 0<λ<10𝜆10<\lambda<10 < italic_λ < 1 for the second term of Equation (7).

  4. 4.

    At each intersection, the phase with the maximum pressure is activated for the next time step,

    Si(t)=argmaxSi(t)Sip(Si(t))subscriptsuperscript𝑆𝑖𝑡subscriptargmaxsuperscript𝑆𝑖𝑡superscriptSi𝑝superscript𝑆𝑖𝑡S^{*}_{i}(t)=\operatorname*{arg\,max}_{S^{i}(t)\in\pazocal{S}^{i}}p(S^{i}(t))italic_S start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ( italic_t ) = start_OPERATOR roman_arg roman_max end_OPERATOR start_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ) ∈ roman_S start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_p ( italic_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_t ) ) (9)

3.2 Maximum stability property

One desirable property of MP-based algorithms is the maximum stability, which suggests that they can accommodate a demand if this demand can be accommodated by any feasible control strategy. This section proves this property holds for the PQ-MP.

3.2.1 Stable region

Let 𝐝vsuperscript𝐝v\mathbf{d}^{\mathrm{v}}bold_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT indicate the vector of (average) vehicular demand from entry links, 𝐪insuperscript𝐪in\mathbf{q}^{\mathrm{in}}bold_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT indicate the vector of (average) pedestrian generation rate from all sidewalks, and 𝐪outsuperscript𝐪out\mathbf{q}^{\mathrm{out}}bold_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT indicate the vector of (average) pedestrian exit rate from all sidewalks. In addition, let 𝐟vsuperscript𝐟v\mathbf{f}^{\mathrm{v}}bold_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT indicate the vector of (average) vehicular demand on all internal links, 𝐟pssuperscript𝐟ps\mathbf{f}^{\mathrm{ps}}bold_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT indicate the vector of (average) pedestrian demand on sidewalks, and 𝐟pcsuperscript𝐟pc\mathbf{f}^{\mathrm{pc}}bold_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT indicate the vector of (average) pedestrian demand for crosswalks. 𝐟vsuperscript𝐟v\mathbf{f}^{\mathrm{v}}bold_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT, 𝐟pssuperscript𝐟ps\mathbf{f}^{\mathrm{ps}}bold_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT and 𝐟pcsuperscript𝐟pc\mathbf{f}^{\mathrm{pc}}bold_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT can be uniquely determined by 𝐝vsuperscript𝐝v\mathbf{d}^{\mathrm{v}}bold_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT, 𝐪insuperscript𝐪in\mathbf{q}^{\mathrm{in}}bold_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT, 𝐪outsuperscript𝐪out\mathbf{q}^{\mathrm{out}}bold_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT and turning ratios for both vehicles and pedestrians (Hao et al., 2018). It is easy to obtain the expressions in Equations (10)–(12).

dl,m,nv,subscriptsuperscript𝑑v𝑙𝑚𝑛\displaystyle d^{\mathrm{v}}_{l,m,n},italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT , if (l,m)Lenter𝑙𝑚subscriptLenter(l,m)\in\pazocal{L_{\mathrm{enter}}}( italic_l , italic_m ) ∈ roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT (10a)
kUlfk,l,mvrl,m,nvsubscript𝑘superscriptUlsubscriptsuperscript𝑓v𝑘𝑙𝑚subscriptsuperscript𝑟v𝑙𝑚𝑛\displaystyle\sum_{k\in\pazocal{U}^{l}}f^{\mathrm{v}}_{k,l,m}r^{\mathrm{v}}_{l% ,m,n}∑ start_POSTSUBSCRIPT italic_k ∈ roman_U start_POSTSUPERSCRIPT roman_l end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT italic_r start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT otherwise (10b)
fiα,iβpc=iγOiα{iβ}fiγ,iαpcriγ,iα,iβp+jηUiαfjη,iαpsrjη,iα,iβp,(iα,iβ)subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsubscript𝑖𝛾superscriptOsubscripti𝛼subscripti𝛽subscriptsuperscript𝑓pcsubscript𝑖𝛾subscript𝑖𝛼subscriptsuperscript𝑟psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽subscriptsubscript𝑗𝜂superscriptUsubscripti𝛼subscriptsuperscript𝑓pssubscript𝑗𝜂subscript𝑖𝛼subscriptsuperscript𝑟psubscript𝑗𝜂subscript𝑖𝛼subscript𝑖𝛽for-allsubscript𝑖𝛼subscript𝑖𝛽f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}=\sum_{i_{\gamma}\in\pazocal{O}^{i_{% \alpha}}\setminus{\{i_{\beta}\}}}f^{\mathrm{pc}}_{i_{\gamma},i_{\alpha}}r^{% \mathrm{p}}_{i_{\gamma},i_{\alpha},i_{\beta}}+\sum_{j_{\eta}\in\pazocal{U}^{i_% {\alpha}}}f^{\mathrm{ps}}_{j_{\eta},i_{\alpha}}r^{\mathrm{p}}_{j_{\eta},i_{% \alpha},i_{\beta}},\quad\forall(i_{\alpha},i_{\beta})italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_O start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ∖ { roman_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT } end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_r start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT + ∑ start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ∈ roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_r start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT , ∀ ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) (11)
fiα,jβps=qiα,jβinqiα,jβout+iγOiαfiγ,iαpcriγ,iα,jβp+hγUiα{jβ}fhγ,iαpsrhγ,iα,jβp,(iα,jβ)subscriptsuperscript𝑓pssubscript𝑖𝛼subscript𝑗𝛽subscriptsuperscript𝑞insubscript𝑖𝛼subscript𝑗𝛽subscriptsuperscript𝑞outsubscript𝑖𝛼subscript𝑗𝛽subscriptsubscript𝑖𝛾superscriptOsubscripti𝛼subscriptsuperscript𝑓pcsubscript𝑖𝛾subscript𝑖𝛼subscriptsuperscript𝑟psubscript𝑖𝛾subscript𝑖𝛼subscript𝑗𝛽subscriptsubscript𝛾superscriptUsubscripti𝛼subscriptj𝛽subscriptsuperscript𝑓pssubscript𝛾subscript𝑖𝛼subscriptsuperscript𝑟psubscript𝛾subscript𝑖𝛼subscript𝑗𝛽for-allsubscript𝑖𝛼subscript𝑗𝛽f^{\mathrm{ps}}_{i_{\alpha},j_{\beta}}=q^{\mathrm{in}}_{i_{\alpha},j_{\beta}}-% q^{\mathrm{out}}_{i_{\alpha},j_{\beta}}+\sum_{i_{\gamma}\in\pazocal{O}^{i_{% \alpha}}}f^{\mathrm{pc}}_{i_{\gamma},i_{\alpha}}r^{\mathrm{p}}_{i_{\gamma},i_{% \alpha},j_{\beta}}+\sum_{h_{\gamma}\in\pazocal{U}^{i_{\alpha}}\setminus{\{j_{% \beta}\}}}f^{\mathrm{ps}}_{h_{\gamma},i_{\alpha}}r^{\mathrm{p}}_{h_{\gamma},i_% {\alpha},j_{\beta}},\quad\forall(i_{\alpha},j_{\beta})italic_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT = italic_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT + ∑ start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_O start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_r start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT + ∑ start_POSTSUBSCRIPT italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT ∈ roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT ∖ { roman_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT } end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_r start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT , ∀ ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) (12)

The convex hull of all admissible phases at intersection i𝑖iitalic_i can be expressed as:

co(Si)={𝐒i,eSiπe𝐒i,e|πe0,eπe=1}𝑐𝑜superscriptSiconditional-setsubscriptsuperscript𝐒iesuperscriptSisubscript𝜋esuperscript𝐒ieformulae-sequencesubscript𝜋e0subscriptesubscript𝜋e1co(\pazocal{S}^{i})=\{\sum_{\mathbf{S}^{i,e}\in\pazocal{S}^{i}}\pi_{e}\mathbf{% S}^{i,e}|\pi_{e}\geq 0,\sum_{e}\pi_{e}=1\}italic_c italic_o ( roman_S start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT ) = { ∑ start_POSTSUBSCRIPT bold_S start_POSTSUPERSCRIPT roman_i , roman_e end_POSTSUPERSCRIPT ∈ roman_S start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_π start_POSTSUBSCRIPT roman_e end_POSTSUBSCRIPT bold_S start_POSTSUPERSCRIPT roman_i , roman_e end_POSTSUPERSCRIPT | italic_π start_POSTSUBSCRIPT roman_e end_POSTSUBSCRIPT ≥ 0 , ∑ start_POSTSUBSCRIPT roman_e end_POSTSUBSCRIPT italic_π start_POSTSUBSCRIPT roman_e end_POSTSUBSCRIPT = 1 } (13)
Definition 1.

A demand (𝐝v,𝐩in)superscript𝐝vsuperscript𝐩in(\mathbf{d}^{\mathrm{v}},\mathbf{p}^{\mathrm{in}})( bold_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT , bold_p start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT ) is feasible if there exists a control vector 𝚺co(S)𝚺𝑐𝑜S\bm{\Sigma}\in co(\pazocal{S})bold_Σ ∈ italic_c italic_o ( roman_S ) such that

fiα,jβpsciα,jβps,(iα,jβ)subscriptsuperscript𝑓pssubscript𝑖𝛼subscript𝑗𝛽subscriptsuperscript𝑐pssubscript𝑖𝛼subscript𝑗𝛽for-allsubscript𝑖𝛼subscript𝑗𝛽f^{\mathrm{ps}}_{i_{\alpha},j_{\beta}}\leq c^{\mathrm{ps}}_{i_{\alpha},j_{% \beta}},\quad\forall(i_{\alpha},j_{\beta})italic_f start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ≤ italic_c start_POSTSUPERSCRIPT roman_ps end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT , ∀ ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_j start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) (14)
fl,m,nvc~l,m,nvΣl,m,nv,(l,m,n)subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript~𝑐v𝑙𝑚𝑛subscriptsuperscriptΣv𝑙𝑚𝑛for-all𝑙𝑚𝑛f^{\mathrm{v}}_{l,m,n}\leq\tilde{c}^{\mathrm{v}}_{l,m,n}\Sigma^{\mathrm{v}}_{l% ,m,n},\quad\forall(l,m,n)italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ≤ over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT roman_Σ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT , ∀ ( italic_l , italic_m , italic_n ) (15)
fiα,iβpcciα,iβpΣiα,iβp,(i,α,β)subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscriptΣpsubscript𝑖𝛼subscript𝑖𝛽for-all𝑖𝛼𝛽f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}\leq c^{\mathrm{p}}_{i_{\alpha},i_{\beta% }}\Sigma^{\mathrm{p}}_{i_{\alpha},i_{\beta}},\quad\forall(i,\alpha,\beta)italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ≤ italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT roman_Σ start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT , ∀ ( italic_i , italic_α , italic_β ) (16)

where c~l,m,nvsubscriptsuperscript~𝑐v𝑙𝑚𝑛\tilde{c}^{\mathrm{v}}_{l,m,n}over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT and ciα,iβpsubscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽c^{\mathrm{p}}_{i_{\alpha},i_{\beta}}italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT are the mean of the saturation flows for vehicle movement and pedestrian crosswalk movement, respectively.

It is easy to prove that a control sequence {𝐒(t),t=0,T,2T,3T,}formulae-sequence𝐒𝑡𝑡0𝑇2𝑇3𝑇\{\mathbf{S}(t),t=0,T,2T,3T,...\}{ bold_S ( italic_t ) , italic_t = 0 , italic_T , 2 italic_T , 3 italic_T , … } is admissible if and only if

lim infN1Nn=0N𝐒i(nT)co(Si),iNformulae-sequencesubscriptlimit-infimum𝑁1𝑁superscriptsubscript𝑛0𝑁superscript𝐒𝑖𝑛𝑇𝑐𝑜superscriptSifor-alliN\liminf\limits_{N\rightarrow\infty}\frac{1}{N}\sum_{n=0}^{N}\mathbf{S}^{i}(nT)% \in co(\pazocal{S}^{i}),\quad\forall i\in\pazocal{N}lim inf start_POSTSUBSCRIPT italic_N → ∞ end_POSTSUBSCRIPT divide start_ARG 1 end_ARG start_ARG italic_N end_ARG ∑ start_POSTSUBSCRIPT italic_n = 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT bold_S start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT ( italic_n italic_T ) ∈ italic_c italic_o ( roman_S start_POSTSUPERSCRIPT roman_i end_POSTSUPERSCRIPT ) , ∀ roman_i ∈ roman_N (17)

Therefore, Definition 1 indicates that a control sequence can accommodate a demand, or equivalently, a demand can be stabilized by the control sequence, if the average service rate is not lower than the average demand for all movements in the network. Equation (15) and Equation (16) indicate the vehicle and pedestrian demand for crosswalks are lower than the corresponding average service rates. Note that if Equation 16 holds, the third and fourth terms in Equation 14 are independent of the signal control strategy and uniquely determined by 𝐪insuperscript𝐪in\mathbf{q}^{\mathrm{in}}bold_q start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT, 𝐪outsuperscript𝐪out\mathbf{q}^{\mathrm{out}}bold_q start_POSTSUPERSCRIPT roman_out end_POSTSUPERSCRIPT and 𝐫psuperscript𝐫p\mathbf{r}^{\mathrm{p}}bold_r start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT. Then, Equation (14) indicates that the sum of pedestrian generating rate and the external demand from adjacent sidewalks and cross movements subtracted by the exit rate on sidewalks should be lower than the corresponding saturation flow to make the pedestrian demand feasible. This relationship is independent of signal timings under the assumptions made in the previous section. The stable region of demand, denoted by (Dv,Qin)superscriptDvsubscriptQin(\pazocal{D}^{\mathrm{v}},\pazocal{Q}_{\mathrm{in}})( roman_D start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT , roman_Q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT ), is defined as the set of demand that satisfies Equations (14)-(16). Let D0superscriptD0\pazocal{D}^{0}roman_D start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT and Qin0superscriptsubscriptQin0\pazocal{Q}_{\mathrm{in}}^{0}roman_Q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT denote the interior of DvsuperscriptDv\pazocal{D}^{\mathrm{v}}roman_D start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT and QinsubscriptQin\pazocal{Q}_{\mathrm{in}}roman_Q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT, respectively.

3.2.2 Maximum stability

Definition 2.

A signal control policy SS\pazocal{S}roman_S stabilizes the queue process in the mean if for some Mv<superscript𝑀vM^{\mathrm{v}}<\inftyitalic_M start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT < ∞ and Mp<superscript𝑀pM^{\mathrm{p}}<\inftyitalic_M start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT < ∞,

1Tt=1Tl,m,nE(xl,m,nv(t))Mv,T=1,2,3formulae-sequence1𝑇superscriptsubscript𝑡1𝑇subscript𝑙𝑚𝑛𝐸subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡superscript𝑀v𝑇123\frac{1}{T}\sum_{t=1}^{T}\sum_{l,m,n}E(x^{\mathrm{v}}_{l,m,n}(t))\leq M^{% \mathrm{v}},\quad T=1,2,3...divide start_ARG 1 end_ARG start_ARG italic_T end_ARG ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_E ( italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) ≤ italic_M start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT , italic_T = 1 , 2 , 3 … (18)
1Tt=1Ti,α,βE(xiα,iβpc(t))Mp,T=1,2,3formulae-sequence1𝑇superscriptsubscript𝑡1𝑇subscript𝑖𝛼𝛽𝐸subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡superscript𝑀p𝑇123\frac{1}{T}\sum_{t=1}^{T}\sum_{i,\alpha,\beta}E(x^{\mathrm{pc}}_{i_{\alpha},i_% {\beta}}(t))\leq M^{\mathrm{p}},\quad T=1,2,3...divide start_ARG 1 end_ARG start_ARG italic_T end_ARG ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_E ( italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) ≤ italic_M start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT , italic_T = 1 , 2 , 3 … (19)

As mentioned before, the average number of pedestrians on sidewalks is stabilized regardless of the signal control strategy if the demand is in the stable region. The combination of Equation (18) and Equation (19) is equivalent to

1Tt=1T[l,m,nE(xl,m,nv(t))+i,α,βE(xiα,iβpc(t))]M,T=1,2,3formulae-sequence1𝑇superscriptsubscript𝑡1𝑇delimited-[]subscript𝑙𝑚𝑛𝐸subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscript𝑖𝛼𝛽𝐸subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡𝑀𝑇123\frac{1}{T}\sum_{t=1}^{T}\left[\sum_{l,m,n}E(x^{\mathrm{v}}_{l,m,n}(t))+\sum_{% i,\alpha,\beta}E(x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t))\right]\leq M,\quad T% =1,2,3...divide start_ARG 1 end_ARG start_ARG italic_T end_ARG ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT [ ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_E ( italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) + ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_E ( italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) ] ≤ italic_M , italic_T = 1 , 2 , 3 … (20)

where M<𝑀M<\inftyitalic_M < ∞.

Theorem 1 (Maximum stability).

The proposed PQ-MP algorithm Equations (5)–(9) stabilizes the queue process if (𝐝v,𝐩in)(D0,Qin0)superscript𝐝vsuperscript𝐩insuperscriptD0superscriptsubscriptQin0(\mathbf{d}^{\mathrm{v}},\mathbf{p}^{\mathrm{in}})\in(\pazocal{D}^{0},\pazocal% {Q}_{\mathrm{in}}^{0})( bold_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT , bold_p start_POSTSUPERSCRIPT roman_in end_POSTSUPERSCRIPT ) ∈ ( roman_D start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT , roman_Q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT ) and if the distribution of the adjusted saturation flow, C~h,i,jv(t)subscriptsuperscript~𝐶v𝑖𝑗𝑡\tilde{C}^{\mathrm{v}}_{h,i,j}(t)over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT ( italic_t ) in Equation (7), is fixed for all right-turn vehicle movements.

Proof.

The first step is to prove that there exist ϵ1>0subscriptitalic-ϵ10\epsilon_{1}>0italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0 and ϵ2>0subscriptitalic-ϵ20\epsilon_{2}>0italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 such that the Lyapunov functions |𝐗v(t)|2superscriptsuperscript𝐗v𝑡2|\mathbf{X}^{\mathrm{v}}(t)|^{2}| bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT and |λ𝐗pc(t)|2superscript𝜆superscript𝐗pc𝑡2|\sqrt{\lambda}\mathbf{X}^{\mathrm{pc}}(t)|^{2}| square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT under the control of PQ-MP satisfy the following inequality:

E{|𝐗v(t+1)|2|𝐗v(t)|2+|λ𝐗pc(t+1)|2|λ𝐗pc(t)|2|𝐗v(t),𝐗pc(t)}kϵ1|𝐗v(t)|ϵ2|𝐗pc(t)|𝐸superscriptsuperscript𝐗v𝑡12superscriptsuperscript𝐗v𝑡2superscript𝜆superscript𝐗pc𝑡12conditionalsuperscript𝜆superscript𝐗pc𝑡2superscript𝐗v𝑡superscript𝐗pc𝑡𝑘subscriptitalic-ϵ1superscript𝐗v𝑡subscriptitalic-ϵ2superscript𝐗pc𝑡E\{|\mathbf{X}^{\mathrm{v}}(t+1)|^{2}-|\mathbf{X}^{\mathrm{v}}(t)|^{2}+|\sqrt{% \lambda}\mathbf{X}^{\mathrm{pc}}(t+1)|^{2}-|\sqrt{\lambda}\mathbf{X}^{\mathrm{% pc}}(t)|^{2}|\mathbf{X}^{\mathrm{v}}(t),\mathbf{X}^{\mathrm{pc}}(t)\}\leq k-% \epsilon_{1}|\mathbf{X}^{\mathrm{v}}(t)|-\epsilon_{2}|\mathbf{X}^{\mathrm{pc}}% (t)|italic_E { | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + | square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) , bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) } ≤ italic_k - italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | - italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | (21)

where |𝐗|xi𝐗xi𝐗subscriptsubscript𝑥𝑖𝐗subscript𝑥𝑖|\mathbf{X}|\equiv\sum_{x_{i}\in\mathbf{X}}x_{i}| bold_X | ≡ ∑ start_POSTSUBSCRIPT italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∈ bold_X end_POSTSUBSCRIPT italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT, |𝐗|2xi𝐗(xi)2superscript𝐗2subscriptsubscript𝑥𝑖𝐗superscriptsubscript𝑥𝑖2|\mathbf{X}|^{2}\equiv\sum_{x_{i}\in\mathbf{X}}(x_{i})^{2}| bold_X | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≡ ∑ start_POSTSUBSCRIPT italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∈ bold_X end_POSTSUBSCRIPT ( italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT, and |λ𝐗|2λxi𝐗(xi)2superscript𝜆𝐗2𝜆subscriptsubscript𝑥𝑖𝐗superscriptsubscript𝑥𝑖2|\sqrt{\lambda}\mathbf{X}|^{2}\equiv\lambda\sum_{x_{i}\in\mathbf{X}}(x_{i})^{2}| square-root start_ARG italic_λ end_ARG bold_X | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≡ italic_λ ∑ start_POSTSUBSCRIPT italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∈ bold_X end_POSTSUBSCRIPT ( italic_x start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT.

Using Eqs. (1) and (8), we obtain:

δl,m,nv(t)=xl,m,nv(t+1)xl,m,nv(t)=min(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))+kmin(C~k,l,mv(t)Sk,l,mv(t),xk,l,mv(t))Rl,m,nv(t+1)𝟙Lin(l,m)+dl,m,nv𝟙Lenter(l,m)subscriptsuperscript𝛿v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡1subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscript𝑘subscriptsuperscript~𝐶v𝑘𝑙𝑚𝑡subscriptsuperscript𝑆v𝑘𝑙𝑚𝑡subscriptsuperscript𝑥v𝑘𝑙𝑚𝑡subscriptsuperscript𝑅v𝑙𝑚𝑛𝑡1subscript1subscriptLin𝑙𝑚subscriptsuperscript𝑑v𝑙𝑚𝑛subscript1subscriptLenter𝑙𝑚\begin{split}\delta^{\mathrm{v}}_{l,m,n}(t)=&{x^{\mathrm{v}}_{l,m,n}(t+1)}-x^{% \mathrm{v}}_{l,m,n}(t)\\ =&-\min(\tilde{C}^{\mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(t),x^{\mathrm{% v}}_{l,m,n}(t))\\ &+\sum_{k}\min(\tilde{C}^{\mathrm{v}}_{k,l,m}(t)S^{\mathrm{v}}_{k,l,m}(t),x^{% \mathrm{v}}_{k,l,m}(t))R^{\mathrm{v}}_{l,m,n}(t+1)\mathbbm{1}_{\pazocal{L}_{% \mathrm{in}}}(l,m)\\ &+d^{\mathrm{v}}_{l,m,n}\mathbbm{1}_{\pazocal{L}_{\mathrm{enter}}}(l,m)\end{split}start_ROW start_CELL italic_δ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) = end_CELL start_CELL italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) - italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL - roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) end_CELL end_ROW (22)

Equation (22) leads to

|𝐗v(t+1)|2|𝐗v(t)|2=2𝐗v(t)Tδv(t)+|δv(t)|2=2ωv+χvsuperscriptsuperscript𝐗v𝑡12superscriptsuperscript𝐗v𝑡22superscript𝐗vsuperscript𝑡𝑇superscript𝛿v𝑡superscriptsuperscript𝛿v𝑡22superscript𝜔vsuperscript𝜒v|\mathbf{X}^{\mathrm{v}}(t+1)|^{2}-|\mathbf{X}^{\mathrm{v}}(t)|^{2}=2\mathbf{X% }^{\mathrm{v}}(t)^{T}\mathbf{\delta}^{\mathrm{v}}(t)+|\mathbf{\delta}^{\mathrm% {v}}(t)|^{2}=2\omega^{\mathrm{v}}+\chi^{\mathrm{v}}| bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = 2 bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT italic_δ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) + | italic_δ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = 2 italic_ω start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT + italic_χ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT (23)

where

χv=l,m,n(xl,m,nv(t+1)xl,m,nv(t))2=l,m,n{min(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))+kmin(C~k,l,mv(t)Sk,l,mv(t),xk,l,mv(t))Rl,m,nv(t+1)𝟙Lin(l,m)+dl,m,nv𝟙Lenter(l,m)}2superscript𝜒vsubscript𝑙𝑚𝑛superscriptsubscriptsuperscript𝑥v𝑙𝑚𝑛𝑡1subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡2subscript𝑙𝑚𝑛superscriptsubscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscript𝑘subscriptsuperscript~𝐶v𝑘𝑙𝑚𝑡subscriptsuperscript𝑆v𝑘𝑙𝑚𝑡subscriptsuperscript𝑥v𝑘𝑙𝑚𝑡subscriptsuperscript𝑅v𝑙𝑚𝑛𝑡1subscript1subscriptLin𝑙𝑚subscriptsuperscript𝑑v𝑙𝑚𝑛subscript1subscriptLenter𝑙𝑚2\begin{split}\chi^{\mathrm{v}}=&\sum_{l,m,n}(x^{\mathrm{v}}_{l,m,n}(t+1)-x^{% \mathrm{v}}_{l,m,n}(t))^{2}\\ &=\sum_{l,m,n}\{-\min(\tilde{C}^{\mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(% t),x^{\mathrm{v}}_{l,m,n}(t))\\ &+\sum_{k}\min(\tilde{C}^{\mathrm{v}}_{k,l,m}(t)S^{\mathrm{v}}_{k,l,m}(t),x^{% \mathrm{v}}_{k,l,m}(t))R^{\mathrm{v}}_{l,m,n}(t+1)\mathbbm{1}_{\pazocal{L}_{% \mathrm{in}}}(l,m)\\ &+d^{\mathrm{v}}_{l,m,n}\mathbbm{1}_{\pazocal{L}_{\mathrm{enter}}}(l,m)\}^{2}% \end{split}start_ROW start_CELL italic_χ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT = end_CELL start_CELL ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) - italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL = ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT { - roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) } start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_CELL end_ROW (24)

and

ωv=superscript𝜔vabsent\displaystyle\omega^{\mathrm{v}}=italic_ω start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT = 𝐗v(t)Tδv(t)superscript𝐗vsuperscript𝑡𝑇superscript𝛿v𝑡\displaystyle\mathbf{X}^{\mathrm{v}}(t)^{T}\mathbf{\delta}^{\mathrm{v}}(t)bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT italic_δ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) (25a)
=\displaystyle== l,m,nxl,m,nv(t)min(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡\displaystyle-\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)\min(\tilde{C}^{\mathrm{v}}% _{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(t),x^{\mathrm{v}}_{l,m,n}(t))- ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) (25b)
+l,m,nxl,m,nv(t)kmin(C~k,l,mv(t)Sk,l,mv(t),xk,l,mv(t))Rl,m,nv(t+1)𝟙Lin(l,m)subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscript𝑘subscriptsuperscript~𝐶v𝑘𝑙𝑚𝑡subscriptsuperscript𝑆v𝑘𝑙𝑚𝑡subscriptsuperscript𝑥v𝑘𝑙𝑚𝑡subscriptsuperscript𝑅v𝑙𝑚𝑛𝑡1subscript1subscriptLin𝑙𝑚\displaystyle+\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)\sum_{k}\min(\tilde{C}^{% \mathrm{v}}_{k,l,m}(t)S^{\mathrm{v}}_{k,l,m}(t),x^{\mathrm{v}}_{k,l,m}(t))R^{% \mathrm{v}}_{l,m,n}(t+1)\mathbbm{1}_{\pazocal{L}_{\mathrm{in}}}(l,m)+ ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ∑ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_k , italic_l , italic_m end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) (25c)
+l,m,nxl,m,nv(t)dl,m,nv𝟙Lenter(l,m)subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript𝑑v𝑙𝑚𝑛subscript1subscriptLenter𝑙𝑚\displaystyle+\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)d^{\mathrm{v}}_{l,m,n}% \mathbbm{1}_{\pazocal{L}_{\mathrm{enter}}}(l,m)+ ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) (25d)
=\displaystyle== l,m,nxl,m,nv(t)min(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡\displaystyle-\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)\min(\tilde{C}^{\mathrm{v}}% _{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(t),x^{\mathrm{v}}_{l,m,n}(t))- ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) (25e)
+m,n,kxm,n,kv(t)lmin(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))Rm,n,kv(t+1)𝟙Lin(m,n)subscript𝑚𝑛𝑘subscriptsuperscript𝑥v𝑚𝑛𝑘𝑡subscript𝑙subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript𝑅v𝑚𝑛𝑘𝑡1subscript1subscriptLin𝑚𝑛\displaystyle+\sum_{m,n,k}x^{\mathrm{v}}_{m,n,k}(t)\sum_{l}\min(\tilde{C}^{% \mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(t),x^{\mathrm{v}}_{l,m,n}(t))R^{% \mathrm{v}}_{m,n,k}(t+1)\mathbbm{1}_{\pazocal{L}_{\mathrm{in}}}(m,n)+ ∑ start_POSTSUBSCRIPT italic_m , italic_n , italic_k end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_m , italic_n , italic_k end_POSTSUBSCRIPT ( italic_t ) ∑ start_POSTSUBSCRIPT italic_l end_POSTSUBSCRIPT roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_m , italic_n , italic_k end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_m , italic_n ) (25f)
+l,m,nxl,m,nv(t)dl,m,nv𝟙Lenter(l,m)subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript𝑑v𝑙𝑚𝑛subscript1subscriptLenter𝑙𝑚\displaystyle+\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)d^{\mathrm{v}}_{l,m,n}% \mathbbm{1}_{\pazocal{L}_{\mathrm{enter}}}(l,m)+ ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) (25g)
=\displaystyle== l,m,nmin(C~l,m,nv(t)Sl,m,nv(t),xl,m,nv(t))(xl,m,nv(t)kDnxm,n,kv(t)Rm,n,kv(t+1)𝟙Lin(m,n))subscript𝑙𝑚𝑛subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscript𝑘superscriptDnsubscriptsuperscript𝑥v𝑚𝑛𝑘𝑡subscriptsuperscript𝑅v𝑚𝑛𝑘𝑡1subscript1subscriptLin𝑚𝑛\displaystyle-\sum_{l,m,n}\min(\tilde{C}^{\mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}% _{l,m,n}(t),x^{\mathrm{v}}_{l,m,n}(t))\left(x^{\mathrm{v}}_{l,m,n}(t)-\sum_{k% \in\pazocal{D}^{n}}x^{\mathrm{v}}_{m,n,k}(t)R^{\mathrm{v}}_{m,n,k}(t+1)% \mathbbm{1}_{\pazocal{L}_{\mathrm{in}}}(m,n)\right)- ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) ( italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) - ∑ start_POSTSUBSCRIPT italic_k ∈ roman_D start_POSTSUPERSCRIPT roman_n end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_m , italic_n , italic_k end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_m , italic_n , italic_k end_POSTSUBSCRIPT ( italic_t + 1 ) blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_m , italic_n ) ) (25h)
+l,m,nxl,m,nv(t)dl,m,nv𝟙Lenter(l,m)subscript𝑙𝑚𝑛subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡subscriptsuperscript𝑑v𝑙𝑚𝑛subscript1subscriptLenter𝑙𝑚\displaystyle+\sum_{l,m,n}x^{\mathrm{v}}_{l,m,n}(t)d^{\mathrm{v}}_{l,m,n}% \mathbbm{1}_{\pazocal{L}_{\mathrm{enter}}}(l,m)+ ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT blackboard_1 start_POSTSUBSCRIPT roman_L start_POSTSUBSCRIPT roman_enter end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_l , italic_m ) (25i)

Note that the expression of ωvsuperscript𝜔v\omega^{\mathrm{v}}italic_ω start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT has the same expression in (Varaiya, 2013). Using Equation (10) and the same manner as in (Varaiya, 2013), it is easy to obtain

E[ωv|𝐗v(𝐭)]=ωv1+ωv2𝐸delimited-[]conditionalsuperscript𝜔vsuperscript𝐗v𝐭superscript𝜔v1superscript𝜔v2E[\omega^{\mathrm{v}}|\mathbf{X^{\mathrm{v}}(t)}]=\omega^{\mathrm{v1}}+\omega^% {\mathrm{v2}}italic_E [ italic_ω start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ] = italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT + italic_ω start_POSTSUPERSCRIPT v2 end_POSTSUPERSCRIPT (26)

where

ωv1=l,m,n[fl,m,nvc~l,m,nv(t)Sl,m,nv(t)]wl,m,nv(t+1)superscript𝜔v1subscript𝑙𝑚𝑛delimited-[]subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1\omega^{\mathrm{v1}}=\sum_{l,m,n}\left[f^{\mathrm{v}}_{l,m,n}-\tilde{c}^{% \mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}(t)\right]w^{\mathrm{v}}_{l,m,n}(t% +1)italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT = ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT - over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ] italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) (27)
ωv2=l,m,n[c~l,m,nv(t)E[min(C~l,m,nv(t),xl,m,nv(t))|𝐗v(𝐭)]]Sl,m,nv(t)wl,m,nv(t+1)superscript𝜔v2subscript𝑙𝑚𝑛delimited-[]subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡𝐸delimited-[]conditionalsubscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡subscriptsuperscript𝑥v𝑙𝑚𝑛𝑡superscript𝐗v𝐭subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1\omega^{\mathrm{v2}}=\sum_{l,m,n}\left[\tilde{c}^{\mathrm{v}}_{l,m,n}(t)-E[% \min(\tilde{C}^{\mathrm{v}}_{l,m,n}(t),x^{\mathrm{v}}_{l,m,n}(t))|\mathbf{X^{% \mathrm{v}}(t)}]\right]S^{\mathrm{v}}_{l,m,n}(t)w^{\mathrm{v}}_{l,m,n}(t+1)italic_ω start_POSTSUPERSCRIPT v2 end_POSTSUPERSCRIPT = ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT [ over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) - italic_E [ roman_min ( over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ) | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ] ] italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) (28)

where c~l,m,nv(t)=E[C~l,m,nv(t)|𝐗v(𝐭)]subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡𝐸delimited-[]conditionalsubscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡superscript𝐗v𝐭\tilde{c}^{\mathrm{v}}_{l,m,n}(t)=E[\tilde{C}^{\mathrm{v}}_{l,m,n}(t)|\mathbf{% X^{\mathrm{v}}(t)}]over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) = italic_E [ over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ].

Lemma 1.

ωv2superscript𝜔v2\omega^{\mathrm{v2}}italic_ω start_POSTSUPERSCRIPT v2 end_POSTSUPERSCRIPT and E[χv|𝐗v(𝐭)]𝐸delimited-[]conditionalsuperscript𝜒vsuperscript𝐗v𝐭E[\chi^{\mathrm{v}}|\mathbf{X^{\mathrm{v}}(t)}]italic_E [ italic_χ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ] are always bounded by a positive number regardless of the control policy.

The proof for Lemma 1 can be found in (Varaiya, 2013), and it is omitted for simplicity.

Next, for pedestrian crosswalk movements, according to Equation (2), we obtain

δpc(iα,iβ)(t)=xiα,iβpc(t+1)xiα,iβpc(t)=min(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))+min(Ciγ,iαp(t)Siγ,iαp(t),xiγ,iαpc(t))Riγ,iα,iβp+jηUiαψ(𝐕(jη,iα))Rjη,iα,iβpsuperscript𝛿pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡1subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑆psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽subscriptsubscript𝑗𝜂superscriptUsubscripti𝛼𝜓𝐕subscript𝑗𝜂subscript𝑖𝛼subscriptsuperscript𝑅psubscript𝑗𝜂subscript𝑖𝛼subscript𝑖𝛽\begin{split}\delta^{\mathrm{pc}}(i_{\alpha},i_{\beta})(t)=&x^{\mathrm{pc}}_{i% _{\alpha},i_{\beta}}(t+1)-x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)\\ =&-\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p}}_{i_{\alpha},i_{% \beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t))+\min(C^{\mathrm{p}}_{i_{% \gamma},i_{\alpha}}(t)S^{\mathrm{p}}_{i_{\gamma},i_{\alpha}}(t),x^{\mathrm{pc}% }_{i_{\gamma},i_{\alpha}}(t))R^{\mathrm{p}}_{i_{\gamma},i_{\alpha},i_{\beta}}% \\ &+\sum_{j_{\eta}\in\pazocal{U}^{i_{\alpha}}}\psi(\mathbf{V}(j_{\eta},i_{\alpha% }))R^{\mathrm{p}}_{j_{\eta},i_{\alpha},i_{\beta}}\end{split}start_ROW start_CELL italic_δ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ( italic_t ) = end_CELL start_CELL italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) - italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL - roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) + roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_CELL end_ROW start_ROW start_CELL end_CELL start_CELL + ∑ start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ∈ roman_U start_POSTSUPERSCRIPT roman_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_ψ ( bold_V ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_CELL end_ROW (29)

Then,

|λ𝐗pc(t+1)|2|λ𝐗pc(t)|2=2λ𝐗pc(t)Tδpc(t)+λ|δpc(t)|2=2λωpc+λχpcsuperscript𝜆superscript𝐗pc𝑡12superscript𝜆superscript𝐗pc𝑡22𝜆superscript𝐗pcsuperscript𝑡𝑇superscript𝛿pc𝑡𝜆superscriptsuperscript𝛿pc𝑡22𝜆superscript𝜔pc𝜆superscript𝜒pc|\sqrt{\lambda}\mathbf{X}^{\mathrm{pc}}(t+1)|^{2}-|\sqrt{\lambda}\mathbf{X}^{% \mathrm{pc}}(t)|^{2}=2\lambda\mathbf{X}^{\mathrm{pc}}(t)^{T}\mathbf{\delta}^{% \mathrm{pc}}(t)+\lambda|\mathbf{\delta}^{\mathrm{pc}}(t)|^{2}=2\lambda\omega^{% \mathrm{pc}}+\lambda\chi^{\mathrm{pc}}| square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = 2 italic_λ bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT italic_δ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) + italic_λ | italic_δ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT = 2 italic_λ italic_ω start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT + italic_λ italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT (30)

where

χpc=|δpc(t)|2superscript𝜒pcsuperscriptsuperscript𝛿pc𝑡2\chi^{\mathrm{pc}}=|\mathbf{\delta}^{\mathrm{pc}}(t)|^{2}italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT = | italic_δ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (31)

and

ωpc=superscript𝜔pcabsent\displaystyle\omega^{\mathrm{pc}}=italic_ω start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT = 𝐗pc(t)Tδpc(t)superscript𝐗pcsuperscript𝑡𝑇superscript𝛿pc𝑡\displaystyle\mathbf{X}^{\mathrm{pc}}(t)^{T}\mathbf{\delta}^{\mathrm{pc}}(t)bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT italic_δ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) (32a)
=\displaystyle== i,α,βxiα,iβpc(t)min(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))subscript𝑖𝛼𝛽subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡\displaystyle-\sum_{i,\alpha,\beta}x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)% \min\left(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p}}_{i_{\alpha},i% _{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)\right)- ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) (32b)
+i,α,βxiα,iβpc(t)min(Ciγ,iαp(t)Siγ,iαp(t),xiγ,iαpc(t))Riγ,iα,iβpsubscript𝑖𝛼𝛽subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑆psubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽\displaystyle+\sum_{i,\alpha,\beta}x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)% \min(C^{\mathrm{p}}_{i_{\gamma},i_{\alpha}}(t)S^{\mathrm{p}}_{i_{\gamma},i_{% \alpha}}(t),x^{\mathrm{pc}}_{i_{\gamma},i_{\alpha}}(t))R^{\mathrm{p}}_{i_{% \gamma},i_{\alpha},i_{\beta}}+ ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT (32c)
+i,α,βxiα,iβpc(t)(jη𝐔iαψ(𝐕(jη,iα))Rjη,iα,iβp)subscript𝑖𝛼𝛽subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsubscript𝑗𝜂subscript𝐔subscript𝑖𝛼𝜓𝐕subscript𝑗𝜂subscript𝑖𝛼subscriptsuperscript𝑅psubscript𝑗𝜂subscript𝑖𝛼subscript𝑖𝛽\displaystyle+\sum_{i,\alpha,\beta}x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)% \left(\sum_{j_{\eta}\in\mathbf{U}_{i_{\alpha}}}\psi(\mathbf{V}(j_{\eta},i_{% \alpha}))R^{\mathrm{p}}_{j_{\eta},i_{\alpha},i_{\beta}}\right)+ ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ( ∑ start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT ∈ bold_U start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_ψ ( bold_V ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) (32d)
=\displaystyle== ωiα,iβpc1(t)+ωiα,iβpc2(t)+ωiα,iβpc3(t)subscriptsuperscript𝜔pc1subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝜔pc2subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝜔pc3subscript𝑖𝛼subscript𝑖𝛽𝑡\displaystyle\omega^{\mathrm{pc1}}_{i_{\alpha},i_{\beta}}(t)+\omega^{\mathrm{% pc2}}_{i_{\alpha},i_{\beta}}(t)+\omega^{\mathrm{pc3}}_{i_{\alpha},i_{\beta}}(t)italic_ω start_POSTSUPERSCRIPT pc1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) + italic_ω start_POSTSUPERSCRIPT pc2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) + italic_ω start_POSTSUPERSCRIPT pc3 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) (32e)
Lemma 2.

λχpc𝜆superscript𝜒pc\lambda\chi^{\mathrm{pc}}italic_λ italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT is upper bounded by a positive constant.

Proof.

Since the random saturation flow for pedestrians is bounded, the first two terms in Equation (29) are bounded. In addition, according to Equation (14), the number of pedestrians on sidewalks is bounded. Therefore, ψ(𝐕(jη,iα))𝜓𝐕subscript𝑗𝜂subscript𝑖𝛼\psi(\mathbf{V}(j_{\eta},i_{\alpha}))italic_ψ ( bold_V ( italic_j start_POSTSUBSCRIPT italic_η end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT ) ) in Equation (29) is also bounded. Consequently, λχpc𝜆superscript𝜒pc\lambda\chi^{\mathrm{pc}}italic_λ italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT is upper bounded. ∎

Next, we focus on ωpcsuperscript𝜔pc\omega^{\mathrm{pc}}italic_ω start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT. Changing the sequence of the subscripts for ωiα,iβpc2(t)subscriptsuperscript𝜔pc2subscript𝑖𝛼subscript𝑖𝛽𝑡\omega^{\mathrm{pc2}}_{i_{\alpha},i_{\beta}}(t)italic_ω start_POSTSUPERSCRIPT pc2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) obtains,

ωiα,iβpc2(t)=i,α,βxiβ,iγpc(t)min(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))Riα,iβ,iγpsubscriptsuperscript𝜔pc2subscript𝑖𝛼subscript𝑖𝛽𝑡subscript𝑖𝛼𝛽subscriptsuperscript𝑥pcsubscript𝑖𝛽subscript𝑖𝛾𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑅psubscript𝑖𝛼subscript𝑖𝛽subscript𝑖𝛾\omega^{\mathrm{pc2}}_{i_{\alpha},i_{\beta}}(t)=\sum_{i,\alpha,\beta}x^{% \mathrm{pc}}_{i_{\beta},i_{\gamma}}(t)\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta% }}(t)S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{% \beta}}(t))R^{\mathrm{p}}_{i_{\alpha},i_{\beta},i_{\gamma}}italic_ω start_POSTSUPERSCRIPT pc2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) = ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT (33)

Therefore, according to Equation (6), we obtain

ωiα,iβpc1(t)+ωiα,iβpc2(t)=i,α,βmin(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))(xiα,iβpc(t)xiβ,iγpc(t)Riα,iβ,iγp)=i,α,βmin(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))wiα,iβp(t+1)subscriptsuperscript𝜔pc1subscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝜔pc2subscript𝑖𝛼subscript𝑖𝛽𝑡subscript𝑖𝛼𝛽subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛽subscript𝑖𝛾𝑡subscriptsuperscript𝑅psubscript𝑖𝛼subscript𝑖𝛽subscript𝑖𝛾subscript𝑖𝛼𝛽subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\begin{split}&\omega^{\mathrm{pc1}}_{i_{\alpha},i_{\beta}}(t)+\omega^{\mathrm{% pc2}}_{i_{\alpha},i_{\beta}}(t)\\ =&-\sum_{i,\alpha,\beta}\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{% \mathrm{p}}_{i_{\alpha},i_{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t% ))\left(x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)-x^{\mathrm{pc}}_{i_{\beta},i% _{\gamma}}(t)R^{\mathrm{p}}_{i_{\alpha},i_{\beta},i_{\gamma}}\right)\\ =&-\sum_{i,\alpha,\beta}\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{% \mathrm{p}}_{i_{\alpha},i_{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t% ))w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)\end{split}start_ROW start_CELL end_CELL start_CELL italic_ω start_POSTSUPERSCRIPT pc1 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) + italic_ω start_POSTSUPERSCRIPT pc2 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL - ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) ( italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ) end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL - ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) end_CELL end_ROW (34)

The term in the parenthesis in ωiα,iβpc3(t)subscriptsuperscript𝜔pc3subscript𝑖𝛼subscript𝑖𝛽𝑡\omega^{\mathrm{pc3}}_{i_{\alpha},i_{\beta}}(t)italic_ω start_POSTSUPERSCRIPT pc3 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) in Equation (32) is the average pedestrian demand from upstream sidewalks to a crosswalk, which is equivalent to the total pedestrian demand for the crosswalk movement subtracted by the pedestrian demand from upstream crosswalks. Therefore,

E[ωiα,iβpc3(t)|𝐗pc(t)]=𝐸delimited-[]conditionalsubscriptsuperscript𝜔pc3subscript𝑖𝛼subscript𝑖𝛽𝑡superscript𝐗pc𝑡absent\displaystyle E[\omega^{\mathrm{pc3}}_{i_{\alpha},i_{\beta}}(t)|\mathbf{X}^{% \mathrm{pc}}(t)]=italic_E [ italic_ω start_POSTSUPERSCRIPT pc3 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) ] = i,α,βxiα,iβpc(t)(fiα,iβpc(t)fiγ,iαpc(t)Riγ,iα,iβp(t))subscript𝑖𝛼𝛽subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽𝑡\displaystyle\sum_{i,\alpha,\beta}x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)% \left(f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)-f^{\mathrm{pc}}_{i_{\gamma},i_% {\alpha}}(t)R^{\mathrm{p}}_{i_{\gamma},i_{\alpha},i_{\beta}}(t)\right)∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ( italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) (35a)
(For a crosswalk movement, only one upstream crosswalk movement exists)
=\displaystyle== i,α,β[xiα,iβpc(t)fiα,iβpc(t)xiα,iβpc(t)fiγ,iαpc(t)Riγ,iα,iβp(t)]subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛾subscript𝑖𝛼𝑡subscriptsuperscript𝑅psubscript𝑖𝛾subscript𝑖𝛼subscript𝑖𝛽𝑡\displaystyle\sum_{i,\alpha,\beta}\left[x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}% (t)f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)-x^{\mathrm{pc}}_{i_{\alpha},i_{% \beta}}(t)f^{\mathrm{pc}}_{i_{\gamma},i_{\alpha}}(t)R^{\mathrm{p}}_{i_{\gamma}% ,i_{\alpha},i_{\beta}}(t)\right]∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] (35b)
=\displaystyle== i,α,β[xiα,iβpc(t)fiα,iβpc(t)xiβ,iγpc(t)fiα,iβpc(t)Riα,iβ,iγp(t)]subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛽subscript𝑖𝛾𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑅psubscript𝑖𝛼subscript𝑖𝛽subscript𝑖𝛾𝑡\displaystyle\sum_{i,\alpha,\beta}\left[x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}% (t)f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)-x^{\mathrm{pc}}_{i_{\beta},i_{% \gamma}}(t)f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t)R^{\mathrm{p}}_{i_{\alpha}% ,i_{\beta},i_{\gamma}}(t)\right]∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_R start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_γ end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] (35c)
=\displaystyle== i,α,βfiα,iβpcwiα,iβp(t+1)subscript𝑖𝛼𝛽subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\displaystyle\sum_{i,\alpha,\beta}f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}w^{% \mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) (35d)

Therefore, by combining Equation (34) and Equation (35), we have

E[ωpc|𝐗pc(t)]=𝐸delimited-[]conditionalsuperscript𝜔pcsuperscript𝐗pc𝑡absent\displaystyle E\left[\omega^{\mathrm{pc}}|\mathbf{X}^{\mathrm{pc}}(t)\right]=italic_E [ italic_ω start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) ] = E[i,α,β[fiα,iβpcmin(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))]wiα,iβp(t+1)|𝐗pc(t)]𝐸delimited-[]conditionalsubscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1superscript𝐗pc𝑡\displaystyle E\left[\sum_{i,\alpha,\beta}\left[f^{\mathrm{pc}}_{i_{\alpha},i_% {\beta}}-\min(C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p}}_{i_{% \alpha},i_{\beta}}(t),x^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}(t))\right]w^{% \mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)|\mathbf{X}^{\mathrm{pc}}(t)\right]italic_E [ ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) ] italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) ] (36a)
=\displaystyle== i,α,β[fiα,iβpcciα,iβp(t)Siα,iβp(t)]wiα,iβp(t+1)subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\displaystyle\sum_{i,\alpha,\beta}\left[f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}% -c^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}% (t)\right]w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) (36b)
+[i,α,β[ciα,iβp(t)Siα,iβp(t)min(Ciα,iβp(t)Siα,iβp(t),xiα,iβpc(t))]wiα,iβp(t+1)|𝐗pc(t)]delimited-[]conditionalsubscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑥pcsubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1superscript𝐗pc𝑡\displaystyle+\left[\sum_{i,\alpha,\beta}\left[c^{\mathrm{p}}_{i_{\alpha},i_{% \beta}}(t)S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)-\min(C^{\mathrm{p}}_{i_{% \alpha},i_{\beta}}(t)S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t),x^{\mathrm{pc}}_% {i_{\alpha},i_{\beta}}(t))\right]w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)|% \mathbf{X}^{\mathrm{pc}}(t)\right]+ [ ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) - roman_min ( italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) , italic_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ) ] italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) ] (36c)
=\displaystyle== ωpc4+ωpc5superscript𝜔pc4superscript𝜔pc5\displaystyle\omega^{\mathrm{pc4}}+\omega^{\mathrm{pc5}}italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT + italic_ω start_POSTSUPERSCRIPT pc5 end_POSTSUPERSCRIPT (36d)

Again, using the same manner as in Lemma 1 can easily prove that ωpc5superscript𝜔pc5\omega^{\mathrm{pc5}}italic_ω start_POSTSUPERSCRIPT pc5 end_POSTSUPERSCRIPT is upper bounded by a positive number.

Combining Equations (23), (26), (30) and (36) obtains

E{|𝐗v(t+1)|2|𝐗v(t)|2+|λ𝐗pc(t+1)|2|λ𝐗pc(t)|2|𝐗v(t),𝐗pc(t)}=2ωv1+2ωv2+E[χv|𝐗v(𝐭)]+2λωpc4+2λωpc5+λE[χpc|𝐗pc(𝐭)]=2(ωv1+λωpc4)+(2ωv2+E[χv|𝐗v(𝐭)]+2λωpc5+λE[χpc|𝐗pc(𝐭)])𝐸superscriptsuperscript𝐗v𝑡12superscriptsuperscript𝐗v𝑡2superscript𝜆superscript𝐗pc𝑡12conditionalsuperscript𝜆superscript𝐗pc𝑡2superscript𝐗v𝑡superscript𝐗pc𝑡2superscript𝜔v12superscript𝜔v2𝐸delimited-[]conditionalsuperscript𝜒vsuperscript𝐗v𝐭2𝜆superscript𝜔pc42𝜆superscript𝜔pc5𝜆𝐸delimited-[]conditionalsuperscript𝜒pcsuperscript𝐗pc𝐭2superscript𝜔v1𝜆superscript𝜔pc42superscript𝜔v2𝐸delimited-[]conditionalsuperscript𝜒vsuperscript𝐗v𝐭2𝜆superscript𝜔pc5𝜆𝐸delimited-[]conditionalsuperscript𝜒pcsuperscript𝐗pc𝐭\begin{split}&E\{|\mathbf{X}^{\mathrm{v}}(t+1)|^{2}-|\mathbf{X}^{\mathrm{v}}(t% )|^{2}+|\sqrt{\lambda}\mathbf{X}^{\mathrm{pc}}(t+1)|^{2}-|\sqrt{\lambda}% \mathbf{X}^{\mathrm{pc}}(t)|^{2}|\mathbf{X}^{\mathrm{v}}(t),\mathbf{X}^{% \mathrm{pc}}(t)\}\\ =&2\omega^{\mathrm{v1}}+2\omega^{\mathrm{v2}}+E[\chi^{\mathrm{v}}|\mathbf{X^{% \mathrm{v}}(t)}]+2\lambda\omega^{\mathrm{pc4}}+2\lambda\omega^{\mathrm{pc5}}+% \lambda E[\chi^{\mathrm{pc}}|\mathbf{X^{\mathrm{pc}}(t)}]\\ =&2\left(\omega^{\mathrm{v1}}+\lambda\omega^{\mathrm{pc4}}\right)+\left(2% \omega^{\mathrm{v2}}+E[\chi^{\mathrm{v}}|\mathbf{X^{\mathrm{v}}(t)}]+2\lambda% \omega^{\mathrm{pc5}}+\lambda E[\chi^{\mathrm{pc}}|\mathbf{X^{\mathrm{pc}}(t)}% ]\right)\end{split}start_ROW start_CELL end_CELL start_CELL italic_E { | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + | square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | square-root start_ARG italic_λ end_ARG bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) , bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) } end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL 2 italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT + 2 italic_ω start_POSTSUPERSCRIPT v2 end_POSTSUPERSCRIPT + italic_E [ italic_χ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ] + 2 italic_λ italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT + 2 italic_λ italic_ω start_POSTSUPERSCRIPT pc5 end_POSTSUPERSCRIPT + italic_λ italic_E [ italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( bold_t ) ] end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL 2 ( italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT + italic_λ italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT ) + ( 2 italic_ω start_POSTSUPERSCRIPT v2 end_POSTSUPERSCRIPT + italic_E [ italic_χ start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) ] + 2 italic_λ italic_ω start_POSTSUPERSCRIPT pc5 end_POSTSUPERSCRIPT + italic_λ italic_E [ italic_χ start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( bold_t ) ] ) end_CELL end_ROW (37)

We already proved that the term in the second parenthesis in Equation (37) is bounded, so we next focus on ωv1+λωpc4superscript𝜔v1𝜆superscript𝜔pc4\omega^{\mathrm{v1}}+\lambda\omega^{\mathrm{pc4}}italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT + italic_λ italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT. Let 𝐒(t)superscript𝐒𝑡\mathbf{S}^{*}(t)bold_S start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ( italic_t ) be the optimal control array from PQ-MP. Since 𝐒(t)superscript𝐒𝑡\mathbf{S}^{*}(t)bold_S start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ( italic_t ) maximizes (h,i,j)Mviwh,i,jvC~h,i,jvSh,i,jij+λ(iα,iβ)Mpiwiα,iβpCiα,iβpSiα,iβijsubscript𝑖𝑗superscriptMvisubscriptsuperscript𝑤v𝑖𝑗subscriptsuperscript~𝐶v𝑖𝑗subscriptsuperscript𝑆𝑖𝑗𝑖𝑗𝜆subscriptsubscript𝑖𝛼subscript𝑖𝛽superscriptMpisubscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝐶psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑆𝑖𝑗subscript𝑖𝛼subscript𝑖𝛽\sum_{(h,i,j)\in\pazocal{M}^{vi}}w^{\mathrm{v}}_{h,i,j}\tilde{C}^{\mathrm{v}}_% {h,i,j}S^{ij}_{h,i,j}+\lambda\sum_{(i_{\alpha},i_{\beta})\in\pazocal{M}^{pi}}w% ^{\mathrm{p}}_{i_{\alpha},i_{\beta}}C^{\mathrm{p}}_{i_{\alpha},i_{\beta}}S^{ij% }_{i_{\alpha},i_{\beta}}∑ start_POSTSUBSCRIPT ( italic_h , italic_i , italic_j ) ∈ roman_M start_POSTSUPERSCRIPT roman_v roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT italic_i italic_j end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_h , italic_i , italic_j end_POSTSUBSCRIPT + italic_λ ∑ start_POSTSUBSCRIPT ( italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT ) ∈ roman_M start_POSTSUPERSCRIPT roman_p roman_i end_POSTSUPERSCRIPT end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_C start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT italic_i italic_j end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT which is a linear function of 𝐒(t)𝐒𝑡\mathbf{S}(t)bold_S ( italic_t ), based on the fundamental theorem of linear programming, 𝐒(t)superscript𝐒𝑡\mathbf{S}^{*}(t)bold_S start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT ( italic_t ) also maximizes this function over the entire convex hull. By combining Eqs. (27) and (36), for any control array 𝐒co(S)𝐒𝑐𝑜S\mathbf{S}\in co(\pazocal{S})bold_S ∈ italic_c italic_o ( roman_S ), we have

ωv1+λωpc4=l,m,n[fl,m,nvc~l,m,nv(t)Sl,m,nv(t)]wl,m,nv(t+1)+i,α,β[fiα,iβpcciα,iβpSiα,iβp(t)]λwiα,iβp(t+1)l,m,n[fl,m,nvc~l,m,nv(t)Sl,m,nv(t)]wl,m,nv(t+1)+i,α,β[fiα,iβpcciα,iβpSiα,iβp(t)]λwiα,iβp(t+1)superscript𝜔v1𝜆superscript𝜔pc4subscript𝑙𝑚𝑛delimited-[]subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡𝜆subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1subscript𝑙𝑚𝑛delimited-[]subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡𝜆subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\begin{split}&\omega^{\mathrm{v1}}+\lambda\omega^{\mathrm{pc4}}\\ =&\sum_{l,m,n}\left[f^{\mathrm{v}}_{l,m,n}-\tilde{c}^{\mathrm{v}}_{l,m,n}(t)S^% {\mathrm{v}*}_{l,m,n}(t)\right]w^{\mathrm{v}}_{l,m,n}(t+1)+\sum_{i,\alpha,% \beta}\left[f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}-c^{\mathrm{p}}_{i_{\alpha},% i_{\beta}}S^{\mathrm{p}*}_{i_{\alpha},i_{\beta}}(t)\right]\lambda w^{\mathrm{p% }}_{i_{\alpha},i_{\beta}}(t+1)\\ \\ \leq&\sum_{l,m,n}\left[f^{\mathrm{v}}_{l,m,n}-\tilde{c}^{\mathrm{v}}_{l,m,n}(t% )S^{\mathrm{v}}_{l,m,n}(t)\right]w^{\mathrm{v}}_{l,m,n}(t+1)+\sum_{i,\alpha,% \beta}\left[f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}-c^{\mathrm{p}}_{i_{\alpha},% i_{\beta}}S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)\right]\lambda w^{\mathrm{p}% }_{i_{\alpha},i_{\beta}}(t+1)\end{split}start_ROW start_CELL end_CELL start_CELL italic_ω start_POSTSUPERSCRIPT v1 end_POSTSUPERSCRIPT + italic_λ italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT end_CELL end_ROW start_ROW start_CELL = end_CELL start_CELL ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT - over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v ∗ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ] italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) + ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT roman_p ∗ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] italic_λ italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) end_CELL end_ROW start_ROW start_CELL end_CELL end_ROW start_ROW start_CELL ≤ end_CELL start_CELL ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT - over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ] italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) + ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] italic_λ italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) end_CELL end_ROW (38)

Since (𝐝v,𝐪in)superscript𝐝vsubscript𝐪in(\mathbf{d}^{\mathrm{v}},\mathbf{q}_{\mathrm{in}})( bold_d start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT , bold_q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT ) in (D0,Qin0)superscriptD0superscriptsubscriptQin0(\pazocal{D}^{0},\pazocal{Q}_{\mathrm{in}}^{0})( roman_D start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT , roman_Q start_POSTSUBSCRIPT roman_in end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 0 end_POSTSUPERSCRIPT ), there exist ϵ1>0,ϵ2>0formulae-sequencesubscriptitalic-ϵ10subscriptitalic-ϵ20\epsilon_{1}>0,\epsilon_{2}>0italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0 , italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 and a control array 𝐒co(S)𝐒𝑐𝑜S\mathbf{S}\in co(\pazocal{S})bold_S ∈ italic_c italic_o ( roman_S ) such that

c~l,m,nv(t)Sl,m,nvfl,m,nv+ϵ1subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptitalic-ϵ1\displaystyle\tilde{c}^{\mathrm{v}}_{l,m,n}(t)S^{\mathrm{v}}_{l,m,n}\geq f^{% \mathrm{v}}_{l,m,n}+\epsilon_{1}over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ≥ italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT + italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT if wl,m,nv(t+1)0subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡10w^{\mathrm{v}}_{l,m,n}(t+1)\geq 0italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) ≥ 0 (39a)
Sl,m,nv=0subscriptsuperscript𝑆v𝑙𝑚𝑛0\displaystyle S^{\mathrm{v}}_{l,m,n}=0italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT = 0 if wl,m,nv(t+1)<0subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡10w^{\mathrm{v}}_{l,m,n}(t+1)<0italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) < 0 (39b)
ciα,iβpSiα,iβp(t)fiα,iβpc+ϵ2subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptitalic-ϵ2\displaystyle c^{\mathrm{p}}_{i_{\alpha},i_{\beta}}S^{\mathrm{p}}_{i_{\alpha},% i_{\beta}}(t)\geq f^{\mathrm{pc}}_{i_{\alpha},i_{\beta}}+\epsilon_{2}italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ≥ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT + italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT if wiα,iβp(t+1)0subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡10w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)\geq 0italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) ≥ 0 (39c)
Siα,iβp(t)=0subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡0\displaystyle S^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t)=0italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) = 0 if wiα,iβp(t+1)<0subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡10w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)<0italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) < 0 (39d)

We assume that the distribution of the adjusted saturation flow, C~l,m,nv(t)subscriptsuperscript~𝐶v𝑙𝑚𝑛𝑡\tilde{C}^{\mathrm{v}}_{l,m,n}(t)over~ start_ARG italic_C end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ), is fixed, so the corresponding mean value c~l,m,nv(t)subscriptsuperscript~𝑐v𝑙𝑚𝑛𝑡\tilde{c}^{\mathrm{v}}_{l,m,n}(t)over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) is also fixed. Substituting 𝐒𝐒\mathbf{S}bold_S into Equation (38) obtains

ω1v+λωpc4subscriptsuperscript𝜔v1𝜆superscript𝜔pc4\displaystyle\omega^{\mathrm{v}}_{1}+\lambda\omega^{\mathrm{pc4}}italic_ω start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT + italic_λ italic_ω start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT (40a)
\displaystyle\leq l,m,n[fl,m,nvc~l,m,nv(Xv(t),𝐒(t))Sl,m,nv(t)]wl,m,nv(t+1)+i,α,β[fiα,iβpcciα,iβpSiα,iβp(t)]λwiα,iβp(t+1)subscript𝑙𝑚𝑛delimited-[]subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript~𝑐v𝑙𝑚𝑛superscript𝑋v𝑡𝐒𝑡subscriptsuperscript𝑆v𝑙𝑚𝑛𝑡subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1subscript𝑖𝛼𝛽delimited-[]subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑐psubscript𝑖𝛼subscript𝑖𝛽subscriptsuperscript𝑆psubscript𝑖𝛼subscript𝑖𝛽𝑡𝜆subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\displaystyle\sum_{l,m,n}\left[f^{\mathrm{v}}_{l,m,n}-\tilde{c}^{\mathrm{v}}_{% l,m,n}(X^{\mathrm{v}}(t),\mathbf{S}(t))S^{\mathrm{v}}_{l,m,n}(t)\right]w^{% \mathrm{v}}_{l,m,n}(t+1)+\sum_{i,\alpha,\beta}\left[f^{\mathrm{pc}}_{i_{\alpha% },i_{\beta}}-c^{\mathrm{p}}_{i_{\alpha},i_{\beta}}S^{\mathrm{p}}_{i_{\alpha},i% _{\beta}}(t)\right]\lambda w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT - over~ start_ARG italic_c end_ARG start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) , bold_S ( italic_t ) ) italic_S start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t ) ] italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) + ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT [ italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT - italic_c start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_S start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t ) ] italic_λ italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) (40b)
\displaystyle\leq {(l,m,n):wl,m,nv(t+1)0}ϵ1wl,m,nv(t+1)+{(l,m,n):wl,m,nv(t+1)<0}fl,m,nvwl,m,nv(t+1)subscriptconditional-set𝑙𝑚𝑛subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡10subscriptitalic-ϵ1subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1subscriptconditional-set𝑙𝑚𝑛subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡10subscriptsuperscript𝑓v𝑙𝑚𝑛subscriptsuperscript𝑤v𝑙𝑚𝑛𝑡1\displaystyle\sum_{\{(l,m,n):w^{\mathrm{v}}_{l,m,n}(t+1)\geq 0\}}-\epsilon_{1}% w^{\mathrm{v}}_{l,m,n}(t+1)+\sum_{\{(l,m,n):w^{\mathrm{v}}_{l,m,n}(t+1)<0\}}f^% {\mathrm{v}}_{l,m,n}w^{\mathrm{v}}_{l,m,n}(t+1)∑ start_POSTSUBSCRIPT { ( italic_l , italic_m , italic_n ) : italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) ≥ 0 } end_POSTSUBSCRIPT - italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) + ∑ start_POSTSUBSCRIPT { ( italic_l , italic_m , italic_n ) : italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) < 0 } end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT ( italic_t + 1 ) (40c)
+{(i,α,β):wiα,iβp(t+1)0}λϵ2wiα,iβp(t+1)+{(i,α,β):wiα,iβp(t+1)<0}fiα,iβpcλwiα,iβp(t+1)subscriptconditional-set𝑖𝛼𝛽subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡10𝜆subscriptitalic-ϵ2subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1subscriptconditional-set𝑖𝛼𝛽subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡10subscriptsuperscript𝑓pcsubscript𝑖𝛼subscript𝑖𝛽𝜆subscriptsuperscript𝑤psubscript𝑖𝛼subscript𝑖𝛽𝑡1\displaystyle+\sum_{\{(i,\alpha,\beta):w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t% +1)\geq 0\}}-\lambda\epsilon_{2}w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)+% \sum_{\{(i,\alpha,\beta):w^{\mathrm{p}}_{i_{\alpha},i_{\beta}}(t+1)<0\}}f^{% \mathrm{pc}}_{i_{\alpha},i_{\beta}}\lambda w^{\mathrm{p}}_{i_{\alpha},i_{\beta% }}(t+1)+ ∑ start_POSTSUBSCRIPT { ( italic_i , italic_α , italic_β ) : italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) ≥ 0 } end_POSTSUBSCRIPT - italic_λ italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) + ∑ start_POSTSUBSCRIPT { ( italic_i , italic_α , italic_β ) : italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) < 0 } end_POSTSUBSCRIPT italic_f start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_λ italic_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_i start_POSTSUBSCRIPT italic_α end_POSTSUBSCRIPT , italic_i start_POSTSUBSCRIPT italic_β end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( italic_t + 1 ) (40d)
\displaystyle\leq ϵ1l,m,n|𝐰v(𝐭)|λϵ2i,α,β|𝐰p(𝐭)|subscriptitalic-ϵ1subscript𝑙𝑚𝑛superscript𝐰v𝐭𝜆subscriptitalic-ϵ2subscript𝑖𝛼𝛽superscript𝐰p𝐭\displaystyle-\epsilon_{1}\sum_{l,m,n}|\mathbf{w^{\mathrm{v}}(t)}|-\lambda% \epsilon_{2}\sum_{i,\alpha,\beta}|\mathbf{w^{\mathrm{p}}(t)}|- italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_l , italic_m , italic_n end_POSTSUBSCRIPT | bold_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) | - italic_λ italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∑ start_POSTSUBSCRIPT italic_i , italic_α , italic_β end_POSTSUBSCRIPT | bold_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT ( bold_t ) | (40e)

Since 𝐰v(t)superscript𝐰v𝑡\mathbf{w}^{\mathrm{v}}(t)bold_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) and 𝐰p(t)superscript𝐰p𝑡\mathbf{w}^{\mathrm{p}}(t)bold_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT ( italic_t ) are linear functions of 𝐗v(t)superscript𝐗v𝑡\mathbf{X}^{\mathrm{v}}(t)bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) and 𝐗pc(t)superscript𝐗pc𝑡\mathbf{X}^{\mathrm{pc}}(t)bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ), respectively, it is easy to prove that there exist η1>0subscript𝜂10\eta_{1}>0italic_η start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0 and η2>0subscript𝜂20\eta_{2}>0italic_η start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 such that

|𝐰v(t)|η1|𝐗v(t)|and|𝐰p(t)|η2|𝐱pc(t)|formulae-sequencesuperscript𝐰v𝑡subscript𝜂1superscript𝐗v𝑡andsuperscript𝐰p𝑡subscript𝜂2superscript𝐱pc𝑡|\mathbf{w}^{\mathrm{v}}(t)|\geq\eta_{1}|\mathbf{X}^{\mathrm{v}}(t)|\quad\text% {and}\quad|\mathbf{w}^{\mathrm{p}}(t)|\geq\eta_{2}|\mathbf{x}^{\mathrm{pc}}(t)|| bold_w start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | ≥ italic_η start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | and | bold_w start_POSTSUPERSCRIPT roman_p end_POSTSUPERSCRIPT ( italic_t ) | ≥ italic_η start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | bold_x start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | (41)

Therefore, there exist ξ1>0subscript𝜉10\xi_{1}>0italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0 and ξ2>0subscript𝜉20\xi_{2}>0italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 such that

α1v+αpc4ξ1|𝐗v(𝐭)|ξ2|𝐗pc(𝐭)|subscriptsuperscript𝛼v1superscript𝛼pc4subscript𝜉1superscript𝐗v𝐭subscript𝜉2superscript𝐗pc𝐭\alpha^{\mathrm{v}}_{1}+\alpha^{\mathrm{pc4}}\leq-\xi_{1}|\mathbf{X^{\mathrm{v% }}(t)}|-\xi_{2}|\mathbf{X^{\mathrm{pc}}(t)}|italic_α start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT + italic_α start_POSTSUPERSCRIPT pc4 end_POSTSUPERSCRIPT ≤ - italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( bold_t ) | - italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( bold_t ) | (42)

Thus, Equation (21) holds under the control of PQ-MP.

Lemma 3.

If there exist ξ1>0subscript𝜉10\xi_{1}>0italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT > 0, ξ2>0subscript𝜉20\xi_{2}>0italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT > 0 such that the Lyapunov functions |𝐗v(t)|2superscriptsuperscript𝐗v𝑡2|\mathbf{X}^{\mathrm{v}}(t)|^{2}| bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT and |𝐗pc(t)|2superscriptsuperscript𝐗pc𝑡2|\mathbf{X}^{\mathrm{pc}}(t)|^{2}| bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT satisfy Equation (21) under a control sequence, then the control sequence stabilizes the queue process.

Proof.

Taking expectation for both sides of Eq. (21) obtains

|𝐗v(t+1)|2|𝐗v(t)|2+λ|𝐗pc(t+1)|2λ|𝐗pc(t)|2kξ1E[|𝐗v(t)|]ξ2E[|𝐗pc(t)|]superscriptsuperscript𝐗v𝑡12superscriptsuperscript𝐗v𝑡2𝜆superscriptsuperscript𝐗pc𝑡12𝜆superscriptsuperscript𝐗pc𝑡2𝑘subscript𝜉1𝐸delimited-[]superscript𝐗v𝑡subscript𝜉2𝐸delimited-[]superscript𝐗pc𝑡|\mathbf{X}^{\mathrm{v}}(t+1)|^{2}-|\mathbf{X}^{\mathrm{v}}(t)|^{2}+\lambda|% \mathbf{X}^{\mathrm{pc}}(t+1)|^{2}-\lambda|\mathbf{X}^{\mathrm{pc}}(t)|^{2}% \leq k-\xi_{1}E[|\mathbf{X}^{\mathrm{v}}(t)|]-\xi_{2}E[|\mathbf{X}^{\mathrm{pc% }}(t)|]| bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + italic_λ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - italic_λ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_k - italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT italic_E [ | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | ] - italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT italic_E [ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | ] (43)

Summing over t=1,2,3,,T𝑡123𝑇t=1,2,3,...,Titalic_t = 1 , 2 , 3 , … , italic_T for both sides of Eq. (45) gives

|𝐗v(T+1)|2|𝐗v(1)|2+λ|𝐗pc(T+1)|2λ|𝐗pc(1)|2kmin(ξ1,ξ2)t=1T(E[|𝐗v(t)|]+E[|𝐗pc(t)|])superscriptsuperscript𝐗v𝑇12superscriptsuperscript𝐗v12𝜆superscriptsuperscript𝐗pc𝑇12𝜆superscriptsuperscript𝐗pc12𝑘subscript𝜉1subscript𝜉2superscriptsubscript𝑡1𝑇𝐸delimited-[]superscript𝐗v𝑡𝐸delimited-[]superscript𝐗pc𝑡|\mathbf{X}^{\mathrm{v}}(T+1)|^{2}-|\mathbf{X}^{\mathrm{v}}(1)|^{2}+\lambda|% \mathbf{X}^{\mathrm{pc}}(T+1)|^{2}-\lambda|\mathbf{X}^{\mathrm{pc}}(1)|^{2}% \leq k-\min(\xi_{1},\xi_{2})\sum_{t=1}^{T}\left(E[|\mathbf{X}^{\mathrm{v}}(t)|% ]+E[|\mathbf{X}^{\mathrm{pc}}(t)|]\right)| bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_T + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + italic_λ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_T + 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT - italic_λ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ≤ italic_k - roman_min ( italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ( italic_E [ | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | ] + italic_E [ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | ] ) (44)

Therefore,

1Tt=1T(E[|𝐗v(t)|]+E[|𝐗pc(t)|])1min(ξ1,ξ2)T(k+|𝐗v(1)|2+λ|𝐗pc(1)|2)=M,Tformulae-sequence1𝑇superscriptsubscript𝑡1𝑇𝐸delimited-[]superscript𝐗v𝑡𝐸delimited-[]superscript𝐗pc𝑡1subscript𝜉1subscript𝜉2𝑇𝑘superscriptsuperscript𝐗v12𝜆superscriptsuperscript𝐗pc12𝑀for-all𝑇\frac{1}{T}\sum_{t=1}^{T}\left(E[|\mathbf{X}^{\mathrm{v}}(t)|]+E[|\mathbf{X}^{% \mathrm{pc}}(t)|]\right)\leq\frac{1}{\min(\xi_{1},\xi_{2})T}\left(k+|\mathbf{X% }^{\mathrm{v}}(1)|^{2}+\lambda|\mathbf{X}^{\mathrm{pc}}(1)|^{2}\right)=M,\;\forall Tdivide start_ARG 1 end_ARG start_ARG italic_T end_ARG ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT ( italic_E [ | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( italic_t ) | ] + italic_E [ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( italic_t ) | ] ) ≤ divide start_ARG 1 end_ARG start_ARG roman_min ( italic_ξ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ξ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) italic_T end_ARG ( italic_k + | bold_X start_POSTSUPERSCRIPT roman_v end_POSTSUPERSCRIPT ( 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + italic_λ | bold_X start_POSTSUPERSCRIPT roman_pc end_POSTSUPERSCRIPT ( 1 ) | start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) = italic_M , ∀ italic_T (45)

Theorem 1 is proved. ∎

The maximum stability property indicates that PQ-MP can accommodate the combined vehicular and pedestrian demand if it can be served by any signal control strategy. Thus, the proposed PQ-MP maximizes network throughput.

4 Numerical simulation

This section demonstrates the control performance of PQ-MP under various conditions in microscopic traffic simulations using the SUMO simulation software (Lopez et al., 2018). The original queue-based MP that does not consider pedestrians, referred to as Q-MP in the following, and the rule-based MP proposed in (Xu et al., 2023) are used as baseline models.

4.1 Network setup

A 5×\times×5 uniform grid network of two-way streets, as shown in Figure 2, is used in the simulation. All links have three dedicated lanes, one for each of left-turn, through and right-turn vehicle movement. Each link has a sidewalk on the right side, and each intersection has a crossing on each of the four sides. The length for all links is 300 m. The speed limit for vehicles on all links is 15 m/s, and the average pedestrian travel speed is 1.3 m/s.

Refer to caption
Figure 2: Network setup.

All intersections have an identical set of admissible signal phases, shown in Figure 3. There are 11 admissible phases in total. The first four rows in Figure 3 correspond to the four phases for vehicle movements: northbound-southbound (NS) through (T) and right-turn (R) movement, NS left (L) movement, eastbound-westbound (EW) T and R movement and EW L movement. Pedestrians can only be served during the phases for T-R vehicular movements or during an exclusive phase for pedestrian-only movement, shown as the bottom phase in Figure 3. In the former situation, pedestrians from either one side or both sides can be served, and the right-turn vehicles need to yield to the conflicting pedestrian crosswalk movements. The time step for signal timing update is equal to the free-flow travel time of vehicles traversing a link, which is 20 s. This value is chosen due to two reasons: 1. it matches with the step size defined in the store-and-forward vehicle traffic dynamics, shown by Equation (1); 2. according to the Traffic Signal Timing Manual (Koonce and Rodegerdts, 2008), the minimum pedestrian green time should be equal to the time required by a pedestrian to cross the intersection plus 4 seconds. Under the simulation settings, the minimum pedestrian green time is equal to 18.76 s, which is close to the time step. The yellow time and all-red time are set to 3 s and 1 s, respectively.

Refer to caption
Figure 3: Signal configuration.

Vehicles enter and exit the network through the entry links and exit links, respectively, as shown in Figure 2. For simplicity, identical vehicle demand value is used for all entry links, and four vehicle demand levels, i.e., {400, 500, 600, 700} veh/h/entry link, are tested. Each sidewalk serves as a pedestrian centroid to generate or attract trips. Every pedestrian (origin) centroid has a certain probability to generate a pedestrian trip to each of the rest (destination) centroid during the simulation. Different pedestrian demand levels are modeled. In Figure 2, the pedestrian generation probability is 0.6 if both the origin and destination centroids are in the green region; otherwise, the probability between an OD pair is 0.3.

The simulation time is 2 hours, and the second hour serves as a cool down period with zero demand. To consider the randomness, each simulation was run for 10 different starting seeds.

4.2 Implementation of signal control algorithms

We assume that the number of pedestrians waiting to cross the intersection is available for PQ-MP. The following values for λ𝜆\lambdaitalic_λ: {0.0005, 0.001, 0.002, 0.004, 0.006, 0.008, 0.01, 0.05, 0.1}, in Equation (7) are tested for the proposed PQ-MP.

For the rule-based MP, it is assumed that the waiting times of pedestrians in the pedestrian nodes are always available. A threshold value for the waiting time of the first arrival of crosswalk movements, denoted by τ𝜏\tauitalic_τ, is applied. At the instant of each signal update (every 20 s), if the waiting times from all crosswalk movements are lower than τ𝜏\tauitalic_τ, one of the four phases that include only vehicle movements shown in Figure 3 is activated based on the Q-MP. Only vehicles are considered in this pressure calculation, and no pedestrian crosswalk movements are allowed. On the contrary, if the waiting time of certain crosswalk movements exceeds τ𝜏\tauitalic_τ, the phase serving the corresponding movements will be activated for the next phase. For example, if only the waiting time on the eastern side crosswalk movement exceeds the threshold, the second phase in the first row in Figure 3 will be activated for the next step. For another example, if at least one crosswalk movement from each of the N-S and E-W directions incurs a waiting time longer than τ𝜏\tauitalic_τ, the no-vehicle phase, which is the bottom phase in Figure 3, will be activated. It is easy to imagine that a larger τ𝜏\tauitalic_τ leads to a higher operational efficiency for vehicles, but generates higher delays for pedestrians.

For the Q-MP, the signal phase is determined by the pressure only taking vehicles into consideration. However, the associated pedestrian movements will always be activated as well, and the right-turn vehicles need to yield to pedestrians. For example, if the N-S T-R phase has the highest vehicle pressure, the third phase in the first row in Figure 3 will be activated.

4.3 Results

4.3.1 Stable regions

As mentioned before, maximum stability is a desirable property of MP algorithms. Therefore, we first examined the stable region of each algorithm by monitoring the number of vehicles and pedestrians over time during the simulation. If a demand is stabilized under the control, the number of vehicles/pedestrians is expected to be stable after the network reaches equilibrium. Otherwise, the number of vehicles/pedestrians is expected to be continuously increasing until the demand starts decreasing. Figures 46 show the results under the control of the Q-MP, the rule-based MP and the PQ-MP, respectively.

Refer to caption
Figure 4: Evolution of number of vehicles and pedestrians under Q-MP.
Refer to caption
(a) Vehicle demand: 400 veh/h/entry link
Refer to caption
(b) Vehicle demand: 500 veh/h/entry link
Refer to caption
(c) Vehicle demand: 600 veh/h/entry link
Refer to caption
(d) Vehicle demand: 700 veh/h/entry link
Figure 5: Evolution of number of vehicles and pedestrians under rule-based MP.
Refer to caption
(a) Vehicle demand: 400 veh/h/entry link
Refer to caption
(b) Vehicle demand: 500 veh/h/entry link
Refer to caption
(c) Vehicle demand: 600 veh/h/entry link
Refer to caption
(d) Vehicle demand: 700 veh/h/entry link
Figure 6: Evolution of number of vehicles and pedestrians under PQ-MP.

Figure 4 shows that the variation of pedestrian evolution across different vehicle demand levels is insignificant compared to the variation in vehicle evolution. In addition to the fixed pedestrian demand, another reason is that under this control policy, pedestrians are always served during the T-R phases with higher priorities than the right-turn vehicles. Therefore, as long as the turning ratios do not change, the average service rate for pedestrians is expected to be relatively constant as well. On the other hand, since the right-turn vehicles are required to yield to pedestrians, under the fixed turning ratios, an increase in the vehicle demand level leads increases in delays for the right-turn vehicles. The evolution of the number of vehicles indicates that Q-MP can stabilize vehicle demands under 500 veh/h/entry link. Once the vehicle demand exceeds 600 veh/h/entry link, the number of vehicles continues to increase until the vehicle demand drops to zero at t=60𝑡60t=60italic_t = 60 min. Compared to Q-MP, both the proposed PQ-MP and the rule-based MP can still stabilize those vehicle demands with certain values for λ𝜆\lambdaitalic_λ and τ𝜏\tauitalic_τ, respectively, as shown in Figures 56. This finding unveils the necessity of the development of MP algorithms considering pedestrians for the network stability.

For the rule-based MP algorithm, the threshold for the waiting time determines the frequency that pedestrians receive green times. A lower threshold of pedestrian waiting time allows pedestrians to be served more frequently and thus, increases the number of vehicles in the network. The results in Figure 5 show that the rule-based MP algorithm can achieve a larger stable region for vehicles than the Q-MP if the threshold is large enough. For example, the rule-based model can even stabilize the vehicle demand of 700 veh/h/entry link if the threshold is larger than 60 s.

For the proposed PQ-MP, as λ𝜆\lambdaitalic_λ increases, the pedestrian-related term in Equation (7) makes higher contribution to the pressure calculation and the influence of the pedestrian states on the control outputs becomes greater. As a result, the number of vehicles in the network increases as λ𝜆\lambdaitalic_λ rises. For the lowest vehicle demand scenario, all coefficients can stabilize the vehicle demand level, as shown by Figure 6. As the vehicle demand level increases, the number of coefficients that can stabilize the network decreases. For example, when the entry demand is 600 veh/h/entry link, only the coefficients less than 0.002 can stabilize the network. When the vehicle demand reaches 700 veh/h/entry link, the network cannot be stabilized by any of the examined coefficients. Note although the rule-based model can stabilize this vehicle demand when the threshold value for the pedestrian waiting time is larger than 60 s, this superiority over PQ-MP is not surprising. Theoretically, under the control of the rule-based MP, the stable region for vehicles can be maximized when the threshold is infinity. However, this advantage is achieved with the sacrifice in the operational efficiency of pedestrians. This conflicts with the goal of the proposed model, which is to ensure the overall operational efficiency for both vehicles and pedestrians.

4.3.2 Travel delay

In addition to the stable region, travel delay—the most commonly used metric to evaluate the control efficiency in traffic operations—obtained from all models are examined in this section. Figure 7 and Figure 8 show the average delay and total delay for both vehicles and pedestrians under the control of the rule-based model and the PQ-MP, respectively.

Refer to caption
(a) Average delay (min)
Refer to caption
(b) Total delay (h)
Figure 7: Delay from the rule-based MP algorithm.
Refer to caption
(a) Average delay (min)
Refer to caption
(b) Total delay (h)
Figure 8: Delay from PQ-MP.

Figure 7 reveals that, under the rule-based MP algorithm, the delay of vehicles decreases as the threshold for the pedestrian waiting time increases, and the delay incurred by pedestrians is close to a linear function of the threshold. The reason is that a pedestrian phase is activated when the largest delay incurred by all pedestrians served by this phase is equal to the threshold. Therefore, the threshold can be regarded as an approximation of the largest delay that can be incurred by a pedestrian at an intersection. Assume that the pedestrian arrivals are random, then the average/total delay of pedestrians is linear to the largest delay, which is equivalent to the threshold value.

Figure 8 shows that when λ𝜆\lambdaitalic_λ is lower than 0.01, the delay of vehicles resulting from the PQ-MP is relatively stable against the change in the coefficient. However, the delay of pedestrians can be reduced significantly by increasing the coefficient. When the coefficient exceeds 0.01, the delay of vehicles increases rapidly.

The actual delay for the Q-MP is omitted since it has the worst overall performance. However, it is used as the baseline for the following comparison between PQ-MP and the rule-based MP.

In order to generate a fair comparison, we assume the average occupancy of vehicles is 1.3 pax/veh and calculate the total person delay to evaluate the performance of PQ-MP for all coefficients and the rule-based MP algorithm for all threshold values under all vehicle demand levels. We found that the coefficient of 0.0006 and threshold of 80 s generate the lowest person delay for both algorithms, respectively. Therefore, only the results from the corresponding models are compared. Note that these values do not necessarily generate the best performance for other scenarios. In practice, the values of both coefficients are determined by individual traffic engineers based on how they value the operational efficiencies between vehicles and pedestrians. For a better visualization, the delay reductions from both models compared to Q-MP are shown in Figure 9. A positive reduction in these figures represents the algorithm can reduce travel delay compared to the Q-MP, and vice versa. These results manifest that although the rule-based model can achieve a desirable performance for vehicles, the overall efficiency cannot be ensured. By considering the traffic states of both vehicles and pedestrians in the pressure calculation, the PQ-MP manages to improve the overall efficiency. This improvement is more significant for relatively low vehicle demand scenarios. Note that if we select a lower threshold for the waiting time, e.g., 60 s, both the vehicle delay and pedestrian delay from the rule-based model are higher than those of the PQ-MP.

Refer to caption
(a) Vehicle delay reduction.
Refer to caption
(b) Pedestrian delay reduction.
Refer to caption
(c) Person delay reduction.
Figure 9: Delay reduction compared to Q-MP.

Figure 9(a) indicates that compared to the Q-MP, both models can reduce the vehicle delay significantly, especially for the large vehicle demand scenarios. Moreover, the rule-based model generates a lower vehicle delay than the proposed algorithm when vehicle demand exceeds 600 veh/h/entry link, which is consistent with the findings on the stable region. On the contrary, both models increase the pedestrian delay compared to Q-MP, as shown in Figure 9(b). This is reasonable due to the same reason for the smaller vehicle stable region of Q-MP mentioned in the previous section.

The proposed PQ-MP produces considerably lower pedestrian delay than the rule-based model, as shown in Figure 9(b). Consequently, the person delay from PQ-MP is lower than the delay from the rule-based model under all tested vehicle demand levels, as shown in Figure 9(c). In addition, due to the large delay incurred by pedestrians, the person delay from the rule-based MP is significantly higher than the Q-MP when the vehicle demand is under 500 veh/h/entry link. The PQ-MP generates similar person delay to the Q-MP when the vehicle demand is 400 veh/h/entry link and significantly lower delay for all other vehicle demand levels. Compared to rule-based MP, the PQ-MP can reduce the total person delay by 114 hours when the vehicle demand is 400 veh/h/entry link. The reduction in person delay decreases with increasing vehicle demand. It reaches 20 hours when the vehicle demand is equal to 700 veh/h/entry link.

4.3.3 Influence of pedestrian demand on vehicle delays

We further explore the vehicle delay incurred in the high (green) and low (blue) pedestrian demand regions shown in 2 to investigate the impact of pedestrian demand level on vehicle delays from both the rule-based MP and the PQ-MP algorithms. The delay reductions compared to Q-MP, which still serves as the baseline algorithm, are shown in Figure 10. It shows that, consistent with the pattern of the entire network shown in Figure 9(a), the delay reductions from both models in both region increase with the vehicle demand, and the vehicle delay reduction from the PQ-MP, shown by the circle markers, is higher than that from the rule-based MP, shown by the cross markers, in both regions when the vehicle demand is less than 500 veh/h/entry link, and different pattern occurs when the vehicle demand exceeds 600 veh/h/entry link. In addition, two other interesting phenomena are observed.

Refer to caption
Figure 10: Impact of pedestrian demand on vehicle delay.

First, when the vehicle demand is very high, i.e., 700 veh/h/entry link, the difference of delay reduction between both models in the high pedestrian demand region, shown by the green markers, is larger than that in the low pedestrian demand region, shown by the blue markers. The rule-based MP employs the same threshold value for both regions. However, in PQ-MP, the pedestrian term has a higher proportion in the phase pressure, shown by Equation (7), in the high pedestrian demand region than that in the low pedestrian demand region. Consequently, under the control of PQ-MP, the phases serving pedestrians are activated more frequently, and thus, the vehicle delay is higher in the high demand region, which results in a larger difference of delay reduction between both models.

Second, for both models, the delay reduction in the region with low pedestrian demand region, shown by the blue markers, is higher than that in the region with high pedestrian demand region, shown by the green markers. Note that since all entry links have the same external inflows, and the turning ratios at all intersections are identical, the patterns of average vehicle flows in both regions are similar. In addition, because the Q-MP only considers vehicle states, in the long run, the signal timing of one intersection, in terms of the average service rate for each vehicle movement at that intersection, is expected to be similar to that of the symmetric intersection with respect to the common boarder of both regions. Unlike Q-MP, both the rule-based MP and PQ-MP tend to allocate less green time to pedestrians in the low pedestrian demand region than the other region. For the rule-based model, the average pedestrian arrival rate at an intersection is lower in the low pedestrian demand region, so the intervals between pedestrian signal activation condition being satisfied are longer. Therefore, the pedestrian phases are activated less frequently in the low pedestrian demand region. Consequently, the vehicle delay improvement in that region from the rule-based MP is higher. Similarly, when the pedestrian flow is low, the proportion of the pedestrian term in the phase pressure of the PQ-MP, shown by Equation (7), is low. Therefore, under the control of PQ-MP, the phase phase serving pedestrians is activated less frequently in the low pedestrian demand region as well, and the delay reduction in this region is higher.

4.3.4 Impact of measure errors on travel delays

All results from the proposed PQ-MP in previous sections are based on accurate measurement of pedestrian queues; however, this requirement is difficult or even impossible to meet under the available infrastructures at most intersections. Therefore, it is necessary to test the performance of the PQ-MP in the presence of measurement errors in pedestrian queues. To this end, we assume that the measurement of a pedestrian queue for a crosswalk movement follows a normal distribution with mean equal to the actual pedestrian queue length and standard deviation equal to a proportion of the mean, denoted by σ𝜎\sigmaitalic_σ. For example, if the actual pedestrian queue length is 10, and σ=0.1𝜎0.1\sigma=0.1italic_σ = 0.1, the measurement output is obtained by randomly drawing a value from the distribution of N(10,0.1×10)=N(10,1)𝑁100.110𝑁101N(10,0.1\times 10)=N(10,1)italic_N ( 10 , 0.1 × 10 ) = italic_N ( 10 , 1 ). Bounds are included to ensure that queues lengths are non-negative values. The following values for σ𝜎\sigmaitalic_σ are tested: {0.1,0.2,0.3,0.4,0.5}0.10.20.30.40.5\{0.1,0.2,0.3,0.4,0.5\}{ 0.1 , 0.2 , 0.3 , 0.4 , 0.5 }.

Since we already demonstrated that both the rule-based MP and PQ-MP can effectively reduce person travel delay compared to Q-MP, for simplicity, we use the rule-based MP (τ=80s𝜏80𝑠\tau=80sitalic_τ = 80 italic_s) with perfect knowledge of pedestrian waiting time as the baseline algorithm in this section. Figure 11 shows the influence of σ𝜎\sigmaitalic_σ on the delay reductions of vehicles, pedestrians and total persons. Figure 11(b) shows that the pedestrian delay improvement from the PQ-MP generally decreases with the increase of σ𝜎\sigmaitalic_σ. With the increase in the uncertainties in the measurement, the frequency of the PQ-MP makes the “correct” decision for pedestrian queues, in terms of serving the phase with longest pedestrian queues, is lower, which leads to an undermining of the pedestrian operational efficiency. However, its influence on vehicle delays is less predictable, especially when the vehicle demand is high, as shown in Figure 11(a). A possible reason is that pedestrians have a higher priority than right-turn vehicles, which can generate either an increase or a decrease in vehicle delays. For example, if the phase for a pedestrian crosswalk movement that has a relatively short queue length is activated due to the measurement error, compared to the case when the controller activates the phase serving the longest pedestrian queue, the associated right-turning vehicles could incur less delay resulting from the shorter yielding time. Overall, when the vehicle demand delay is less than 600 veh/h/entry link, the PQ-MP with measurement randomness can still outperform the rule-based MP under all tested uncertainty values, even though the rule-based MP has perfect information. When the vehicle demand reaches 700 veh/h/entry link, as shown in Figure 9(c), both models with accurate measurement generate similar person delay. After considering measurement errors in the PQ-MP, the person delay increases and exceeds that from the rule-based MP under this vehicle demand level.

Refer to caption
(a) Vehicle delay reduction.
Refer to caption
(b) Pedestrian delay reduction.
Refer to caption
(c) Person delay reduction.
Figure 11: Impact of measurement errors on delay.

5 Concluding remarks

This paper proposes a novel MP algorithm, PQ-MP, that incorporates pedestrians into pressure computation to determine signal timings while maintaining the MP control structure. Pedestrian movements are divided into two groups: sidewalk movements and crosswalk movements, and traffic dynamics models are developed for both groups. Then, an MP algorithm that updates signal phase based on both vehicle queues and pedestrian queues of the crosswalk movement is derived. The proposed PQ-MP is decentralized, and does not require the knowledge on external demand. More importantly, we proved that PQ-MP has the maximum stability property, which ensures the maximization of the combined vehicle and pedestrian throughput. The stability in both vehicular and pedestrian queues is critical for the overall operational efficiency. This is highlighted by the simulation results which demonstrate that the PQ-MP generates a lower person delay than the Q-MP and a recently proposed rule-based MP algorithm at various vehicle demand levels, although the stable vehicle region of the PQ-MP is smaller than that of the rule-based model with a high threshold for pedestrian waiting times. We also tested the performance of the PQ-MP with measurement errors in pedestrian queues. The simulation results show that, in general, pedestrian delay increases with the increase in the measurement error. However, the impact of the measurement error on vehicle delays is less predictable than that on the pedestrian delay. Moreover, the PQ-MP with measurement errors still outperforms the rule-based model when the vehicle demand is not extremely large.

The proposed PQ-MP requires the number of pedestrians of each crosswalk movement at an intersection to be available, which may restrict its practicability. It is promising to propose a method to predict this metric based on readily available information, such as the first pedestrian arrival from pushing the cross button and the number of pedestrians served by each phase in previous steps, etc. In addition, since the maximum occupancy of pedestrian nodes is usually greater than that of vehicle links, it may require a longer time step than the free flow travel time for vehicles traversing a link to serve all pedestrians that are already waiting at the pedestrian nodes. Moreover, extending green time for T-R phases can help reduce the number of right-turn vehicles blocked by the conflicting pedestrian movements. Therefore, the development of an MP algorithm with dynamic time step size is another meaningful research direction.

6 Acknowledgements

This research was supported by NSF, United States Grant CMMI-1749200.

References

  • Barman and Levin (2022) Barman, S., Levin, M.W., 2022. Performance evaluation of modified cyclic max-pressure controlled intersections in realistic corridors. Transportation Research Record 2676, 110–128.
  • Dixit et al. (2020) Dixit, V., Nair, D.J., Chand, S., Levin, M.W., 2020. A simple crowdsourced delay-based traffic signal control. PLoS one 15, e0230598.
  • Gartner (1983) Gartner, N.H., 1983. OPAC: A demand-responsive strategy for traffic signal control. 906.
  • Gregoire et al. (2014) Gregoire, J., Qian, X., Frazzoli, E., De La Fortelle, A., Wongpiromsarn, T., 2014. Capacity-aware backpressure traffic signal control. IEEE Transactions on Control of Network Systems 2, 164–173.
  • Hao et al. (2018) Hao, Z., Boel, R., Li, Z., 2018. Model based urban traffic control, part i: Local model and local model predictive controllers. Transportation Research Part C: Emerging Technologies 97, 61–81.
  • Hunt et al. (1981) Hunt, P., Robertson, D., Bretherton, R., Winton, R., 1981. SCOOT-a traffic responsive method of coordinating signals. Technical Report.
  • Koonce and Rodegerdts (2008) Koonce, P., Rodegerdts, L., 2008. Traffic signal timing manual. Technical Report. United States. Federal Highway Administration.
  • Kouvelas et al. (2014) Kouvelas, A., Lioris, J., Fayazi, S.A., Varaiya, P., 2014. Maximum pressure controller for stabilizing queues in signalized arterial networks. Transportation Research Record 2421, 133–141.
  • Le et al. (2015) Le, T., Kovács, P., Walton, N., Vu, H.L., Andrew, L.L., Hoogendoorn, S.S., 2015. Decentralized signal control for urban road networks. Transportation Research Part C: Emerging Technologies 58, 431–450.
  • Levin (2023) Levin, M.W., 2023. Max-pressure traffic signal timing: A summary of methodological and experimental results. Journal of Transportation Engineering, Part A: Systems 149, 03123001.
  • Levin et al. (2020) Levin, M.W., Hu, J., Odell, M., 2020. Max-pressure signal control with cyclical phase structure. Transportation Research Part C: Emerging Technologies 120, 102828.
  • Li and Jabari (2019) Li, L., Jabari, S.E., 2019. Position weighted backpressure intersection control for urban networks. Transportation Research Part B: Methodological 128, 435–461.
  • Liu and Gayah (2022) Liu, H., Gayah, V.V., 2022. A novel max pressure algorithm based on traffic delay. Transportation Research Part C: Emerging Technologies 143, 103803.
  • Liu and Gayah (2023) Liu, H., Gayah, V.V., 2023. Total-delay-based max pressure: A max pressure algorithm considering delay equity. Transportation Research Record , 03611981221147051.
  • Lopez et al. (2018) Lopez, P.A., Behrisch, M., Bieker-Walz, L., Erdmann, J., Flötteröd, Y.P., Hilbrich, R., Lücken, L., Rummel, J., Wagner, P., Wießner, E., 2018. Microscopic traffic simulation using sumo, in: The 21st IEEE International Conference on Intelligent Transportation Systems, IEEE. URL: https://elib.dlr.de/124092/.
  • Lowrie (1990) Lowrie, P., 1990. Scats, sydney co-ordinated adaptive traffic system: A traffic responsive method of controlling urban traffic .
  • Mauro and Di Taranto (1990) Mauro, V., Di Taranto, C., 1990. Utopia. IFAC Proceedings Volumes 23, 245–252.
  • Mercader et al. (2020) Mercader, P., Uwayid, W., Haddad, J., 2020. Max-pressure traffic controller based on travel times: An experimental analysis. Transportation Research Part C: Emerging Technologies 110, 275–290.
  • Mirchandani and Head (2001) Mirchandani, P., Head, L., 2001. A real-time traffic signal control system: architecture, algorithms, and analysis. Transportation Research Part C: Emerging Technologies 9, 415–432.
  • Rey and Levin (2019) Rey, D., Levin, M.W., 2019. Blue phase: Optimal network traffic control for legacy and autonomous vehicles. Transportation Research Part B: Methodological 130, 105–129.
  • Sun and Yin (2018) Sun, X., Yin, Y., 2018. A simulation study on max pressure control of signalized intersections. Transportation research record 2672, 117–127.
  • Tassiulas and Ephremides (1990) Tassiulas, L., Ephremides, A., 1990. Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks, in: 29th IEEE Conference on Decision and Control, IEEE. pp. 2130–2132.
  • Varaiya (2013) Varaiya, P., 2013. Max pressure control of a network of signalized intersections. Transportation Research Part C: Emerging Technologies 36, 177–195.
  • Wang et al. (2022) Wang, X., Yin, Y., Feng, Y., Liu, H.X., 2022. Learning the max pressure control for urban traffic networks considering the phase switching loss. Transportation Research Part C: Emerging Technologies 140, 103670.
  • Wu et al. (2017) Wu, J., Ghosal, D., Zhang, M., Chuah, C.N., 2017. Delay-based traffic signal control for throughput optimality and fairness at an isolated intersection. IEEE Transactions on Vehicular Technology 67, 896–909.
  • Xiao et al. (2014) Xiao, N., Frazzoli, E., Li, Y., Wang, Y., Wang, D., 2014. Pressure releasing policy in traffic signal control with finite queue capacities, in: 53rd IEEE Conference on Decision and Control, IEEE. pp. 6492–6497.
  • Xu et al. (2022) Xu, T., Barman, S., Levin, M.W., Chen, R., Li, T., 2022. Integrating public transit signal priority into max-pressure signal control: Methodology and simulation study on a downtown network. Transportation Research Part C: Emerging Technologies 138, 103614.
  • Xu et al. (2023) Xu, T., Bika, Y., Levin, M., 2023. Ped-mp: A pedestrian-friendly max-pressure signal control policy for city networks. Available at SSRN 4330375 .