HTML conversions sometimes display errors due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on.

  • failed: aliascnt

Authors: achieve the best HTML results from your LaTeX submissions by following these best practices.

License: CC BY 4.0
arXiv:2304.00355v2 [cs.SI] 19 Dec 2023

Human-Centric Resource Allocation in the
Metaverse over Wireless Communications

Jun Zhao Liangxin Qian Wenhan Yu Jun Zhao is a faculty member in the School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore. Liangxin Qian and Wenhan Yu are both PhD students supervised by Jun Zhao.
Emails: [email protected], {qian0080, wenhan002}@e.ntu.edu.sg
Corresponding author: Jun Zhao
Abstract

The Metaverse will provide numerous immersive applications for human users, by consolidating technologies like extended reality (XR), video streaming, and cellular networks. Optimizing wireless communications to enable the human-centric Metaverse is important to satisfy the demands of mobile users. In this paper, we formulate the optimization of the system utility-cost ratio (UCR) for the Metaverse over wireless networks. Our human-centric utility measure for virtual reality (VR) applications of the Metaverse represents users’ perceptual assessment of the VR video quality as a function of the data rate and the video resolution and is learned from real datasets. The variables jointly optimized in our problem include the allocation of both communication and computation resources as well as VR video resolutions. The system cost in our problem comprises the energy consumption and delay and is non-convex with respect to the optimization variables. To solve the non-convex optimization, we develop a novel fractional programming technique, which contributes to optimization theory and has broad applicability beyond our paper. Our proposed algorithm for the system UCR optimization is computationally efficient and finds a stationary point to the constrained optimization. Through extensive simulations, our algorithm is demonstrated to outperform other approaches.

Index Terms:
Metaverse, human-centric, resource allocation, virtual reality, wireless communications.

I Introduction

The Metaverse is expected to offer a myriad of opportunities for mobile users to interact with the immersive virtual world [1]. In various Augmented/Virtual Reality (AR/VR) applications for the Metaverse, humans are at the core since users judge whether the AR/VR videos or games provide a satisfying Quality of Experience (QoE) [2]. Compared with the traditional Quality of Service (QoS) that measures the objective service performance (e.g., bit rate, data accuracy), QoE as a utility measure concerns the enjoyment of users [3]. Providing satisfying utilities to multiple users in a resource-constrained system requires allocating resources wisely. In this paper, we formulate and solve human-centric resource allocation for VR in the Metaverse over wireless communications. Our goal is to reduce the Metaverse system’s cost in terms of delay and energy, as well as to enhance the human-centric utilities of mobile users accessing the Metaverse via wireless networks. Tackling this problem also motivates us to propose a new optimization technique.

Studied problem. Our researched system consists of one Metaverse Server (MS) and multiple VR Users (VUs). We consider downlink wireless communications, where the MS sends to each VU the corresponding VR video via frequency division multiple access (FDMA). The MS solves the system utility-cost ratio (UCR) optimization by allocating 1) communication resources (i.e., bandwidth and transmission power) for the MS’s communication with each VU, and 2) the MS’s computation resources for processing the videos to be sent to VUs, as well as deciding 3) the video resolution for all VUs, and 4) the CPU frequencies for the VUs. Then, the MS uses the allocated computation resource to process each VR video with the selected resolution, and transmits the videos to the VUs with the decided bandwidth and transmission power. Each VU receives VR frames of a video and processes the frames with the arranged CPU frequency. To perform the UCR optimization, the MS knows the human-centric utilities of all VUs and how the energy or delay depends on the optimization variables. The system cost is a weighted sum of the energy consumption and delay. For energy, we take into account both the MS and VUs. The energy usage on the MS comprises those for video processing and transmission, whereas the energy of VUs is for video processing. The delay computation includes the processing on the MS, the wireless transmission, and the processing on each VU. Next, we discuss VUs’ human-centric utilities.

Human-centric utility. Prior resource allocation studies [4, 5, 7, 6, 8, 9] for wireless communications typically do not consider human-centric utilities. Incorporating subjective user perception into the design is critical for the development of VR and the Metaverse, as it provides valuable insights into how the technologies can be improved to deliver the best possible experiences for VUs. A recent work [2] also argues the importance of develo** the Metaverse to be human-centric. In our paper, the human-centric utility for each VU is learned from the VU’s perceptual assessment of the VR video quality as a function of the data rate and the video resolution, as illustrated by a recent dataset reporting users’ evaluation of watching 360superscript360360^{\circ}360 start_POSTSUPERSCRIPT ∘ end_POSTSUPERSCRIPT VR videos [10]. Then UCR is the ratio of all VUs’ sum human-centric utilities to the system cost.

Our contributions include the problem formulation, a novel fractional programming technique, and an efficient optimization algorithm, as listed below.

  • To the best of our knowledge, our work is the first in the literature to consider the optimization of the system utility-cost ratio (UCR) for the Metaverse over wireless communications. Our work is also among pioneering studies that incorporate human-centric utility for Metaverse optimization.

  • We propose a novel technique for fractional programming (FP), where the objective to be minimized is the sum of a convex function and a series of non-convex ratios with convex numerators and concave denominators. FP of the above kind cannot be addressed by prior work [11, 12] (viz., Section IV). Our technique contributes to optimization theory and is applicable to many other problems.

  • Our UCR optimization is difficult to solve due to the following two aspects: 1) the objective function being the sum of a complicated function and a sequence of non-convex fractions, and 2) jointly deciding five vector variables (for bandwidth, transmission power, video resolution, allocation of the Metaverse server’s computing resource, CPU frequencies of VR users, respectively). Despite the challenges, we propose an efficient algorithm by leveraging our novel FP technique above and carefully identifying a roadmap (on Pages VI and VI) to solve the variables step-by-step.

  • Simulations demonstrate the superiority of our algorithm over other baselines. The human-centric utilities used in the simulations are learnt from real-world data including a recent VR dataset [10].

Roadmap. This work is organized as follows. We review related work in Section II. The system model is presented in Section III. We propose a novel technique for fractional programming (FP) in Section IV. Using this FP technique, we analyze how to solve the UCR optimization for the Metaverse over wireless communications in Sections V and VI. Based on the analysis, Section VII presents our algorithm for the UCR optimization, as well as its performance including solution quality, convergence, and time complexity. We model human-centric utilities from real datasets in Section VIII, and use the obtained utility functions to provide simulation results in Section IX. We conclude the paper in Section X.

II Related Work

We discuss related work from the following aspects: optimization in wireless networks, the Metaverse over wireless communications, human-centric utility, and the fractional programming technique.

Optimization for wireless networks. Many studies have addressed optimization related to delay, energy, or utility for wireless networks, as discussed below. Optimizing the system cost, defined as the weighted sum of system delay and system energy consumption, is investigated in [4, 5] for wireless federated learning, in [7] for UAV-enabled mobile edge computing, in [8] for 5G networks. In [9], the difference between the utility and the energy consumption in a heterogeneous network is maximized. There are also papers on ratio optimization to improve the system’s performance. The ratio is often energy efficiency (EE) [13, 14] or computation efficiency (CE) [15, 16], which denotes the ratio of the number of transmitted or computed bits to energy consumption. EE or CE above can be understood as utilityenergyutilityenergy\frac{\textnormal{utility}}{\textnormal{energy}}divide start_ARG utility end_ARG start_ARG energy end_ARG, but surprisingly there seems no existing work in communication/network publications on optimizing utilityenergy+delayutilityenergydelay\frac{\textnormal{utility}}{\textnormal{energy}+\textnormal{delay}}divide start_ARG utility end_ARG start_ARG energy + delay end_ARG like our paper, although we have conducted an extensive literature survey. Moreover, we consider human-centric utility for the Metaverse, which further increases the novelty of our studied problem.

Metaverse over wireless communications. Recently, researching the Metaverse over wireless communications and networks has become an emerging topic. Recent papers [1, 3] have surveyed Metaverse research from different aspects: [1] focusing on fundamental underlying technologies as well as security/privacy issues, [3] on how edge computing empowers the Metaverse. In addition to surveys [1, 3] above, we discuss representative technical work [17, 18, 19, 20, 21] below. In [17], sampling, communication and prediction are co-designed to minimize the communication load for synchronizing a real-world device and its digital model in the Metaverse. Yu et al. [18] optimize the delay and reliability of wireless Metaverse using deep reinforcement learning. Contest theory is utilized in [19] for the Metaverse with semantic communications, while game theory is applied in [20, 21] for the vehicular Metaverse. In [14] led by the current paper’s first author, fractional programming (FP) is leveraged for energy efficiency optimization of the Metaverse subject to physical-layer security of wireless communications. In addition to the difference in terms of problem formulation compared with ours, [14] allocates communication resources only without optimizing computing resources and video resolutions. Also [14] does not use our novel FP technique of Section IV.

Network Utility Maximization (NUM). Our work is related to the research on network utility maximization (NUM) [22]. For a network of users, NUM considers that all users act altruistically to maximize the total network utility [23], defined as the sum of all users’ individual utilities. In the classical NUM problem by Kelly et al. [24], the goal is to allocate traffic rates to users in order to maximize the total network utility subject to resource constraints (e.g., link capacity limitations). Since then, various NUM problems have been investigated in the literature [25, 26, 27]. The total network utility is also referred to as the social welfare in [28], where game theory is adopted to solve the problem. Despite the relevance of NUM research to our work, we emphasize that our objective is optimizing the ratio 𝒰𝒞𝒰𝒞\frac{\mathcal{U}}{\mathcal{C}}divide start_ARG caligraphic_U end_ARG start_ARG caligraphic_C end_ARG of the total system utility 𝒰𝒰\mathcal{U}caligraphic_U to the total system cost 𝒞𝒞\mathcal{C}caligraphic_C, rather than just maximizing 𝒰𝒰\mathcal{U}caligraphic_U. The optimization of the fraction 𝒰𝒞𝒰𝒞\frac{\mathcal{U}}{\mathcal{C}}divide start_ARG caligraphic_U end_ARG start_ARG caligraphic_C end_ARG is more challenging than that of 𝒰𝒰\mathcal{U}caligraphic_U due to the non-convexity of the fraction.

Human-centric utility. When utility is referred to as video quality, it can be measured using objective or subjective assessment methods. The subjective quality assessment (SQA) results in human-centric perceptual utility since human subjects are asked for their opinions directly. Higher human-centric utility means better Quality of Experience (QoE), which is in contrast with the traditional notion of Quality of Service (QoS) that quantifies the objective performance of the system. The survey [29] covers human-centric utility for traditional 2D video applications. Human-centric design for Augmented/Virtual Reality (AR/VR) and the Metaverse has received much interest recently. A 2023 survey [30] systematically reviews human-centric mobile AR. Elwardy et al. [10] report SQA of users watching 360° videos when wearing HTC Vive Pro VR headsets. In [2], the human-centric nature of the Metaverse and using it for personalized value creation are discussed. In the current paper on VR for the Metaverse, we model human-centric utility functions of VR users from SQA video datasets [10, 31], as elaborated on in Section VIII later. The logarithmic function form will be adopted, which has been used in [32] for crowdsourcing, in [33] for mobile edge computing, and in [34] for space-air-ground integrated networks.

Fractional programming (FP). In this paper, we present a novel FP technique and use it to transform a non-convex optimization problem into parametric convex optimization. The detailed comparison between our work and other FP papers [11, 12] is deferred to Section IV.

III System Model

Our studied system consists of one Metaverse Server (MS) and N𝑁Nitalic_N VR Users (VUs), indexed by 𝒩={1,2,,N}𝒩12𝑁\mathcal{N}=\left\{1,2,\cdots,\mathit{N}\right\}caligraphic_N = { 1 , 2 , ⋯ , italic_N }. In downlink wireless communications, the MS sends to each VU the corresponding VR video via frequency division multiple access (FDMA) so that communications do not interfere.

We have overviewed the system operation in the “Studied problem” paragraph on Page I. As already stated, our goal is to optimize the system utility-cost ratio (UCR), by deciding communication resources (i.e., bandwidth and transmission power) and computation resources (i.e., the MS’s computation allocation and the VUs’ CPU frequencies), as well as VR video resolutions. Figure 1 illustrates the system model.

Note that before the video transmission, there are message exchanges between the MS and VUs for control purpose; e.g., each VU informs the MS of its maximum CPU frequency and utility function, and the MS notifies the obtained CPU frequency for each VU from the system utility-cost ratio (UCR) optimization. We ignore the overhead of the control information since it is much smaller than the video data sizes. Below we first introduce notations, which are used to define the system utility and cost in Sections III-A and III-B. Then we formalize the UCR optimization in Section III-C.

Refer to caption
Figure 1: Optimizing the system utility-cost ratio (UCR), in a system of one Metaverse Server (MS) and N𝑁Nitalic_N VR Users (VUs), by deciding communication and computation resources as well as VR video resolutions.

For communications via FDMA, we define 𝒃=[b1,b2,,bN]𝒃subscript𝑏1subscript𝑏2subscript𝑏𝑁\bm{b}=[b_{1},b_{2},\ldots,b_{N}]bold_italic_b = [ italic_b start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_b start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_b start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ], 𝒑=[p1,p2,,pN]𝒑subscript𝑝1subscript𝑝2subscript𝑝𝑁\bm{p}=[p_{1},p_{2},\ldots,p_{N}]bold_italic_p = [ italic_p start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_p start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] as the bandwidths and transmission powers used for the MS to communicate with VUs. With gnsubscript𝑔𝑛g_{n}italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT being the channel attenuation from MS to VU n𝑛nitalic_n, the achievable rate from MS to VU n𝑛nitalic_n is given by the function notation below:

rn(bn,pn)=bnlog2(1+gnpnσ2bn).subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑏𝑛subscript21subscript𝑔𝑛subscript𝑝𝑛superscript𝜎2subscript𝑏𝑛\textstyle r_{n}(b_{n},p_{n})=b_{n}\log_{2}(1+\frac{g_{n}p_{n}}{\sigma^{2}b_{n% }}).italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) . (1)

III-A Modeling the human-centric utilities of VR users

Based on the subjective test in [10], for each VU n𝑛nitalic_n, we formulate the human-centric utility as Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), a function of the transmission rate rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and resolution snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying Assumption 1 below.

Assumption 1.

Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is non-decreasing in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, concave in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, and concave in snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.

The vector 𝒔=[s1,r2,,sN]𝒔subscript𝑠1subscript𝑟2subscript𝑠𝑁\bm{s}=[s_{1},r_{2},\ldots,s_{N}]bold_italic_s = [ italic_s start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_r start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_s start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] gives the resolutions of VR frames for the VUs. The system utility, defined as the sum of all N𝑁Nitalic_N VUs’ human-centric utilities, is given by

𝒰(𝒃,𝒑,𝒔)=𝒰𝒃𝒑𝒔absent\textstyle\mathcal{U}(\bm{b},\bm{p},\bm{s})=caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) = n𝒩Un(rn(bn,pn),sn).subscript𝑛𝒩subscript𝑈𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛\textstyle\sum_{n\in\mathcal{N}}U_{n}(r_{n}(b_{n},p_{n}),s_{n}).∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) . (2)

Our analysis and algorithm use Assumption 1, and do not need Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )’s joint concavity in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, though the expression of Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) in Section VIII from real datasets is jointly concave in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.

III-B System cost comprising delay and energy consumption

We start with defining some notations. For each n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, let fnMSsuperscriptsubscript𝑓𝑛MSf_{n}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT be the MS’s computational resource allocated to process the frames for VU n𝑛nitalic_n. Such allocation of computing resources is also considered in [35] for edge computing. The CPU frequency of VU n𝑛nitalic_n is denoted by fnVUsuperscriptsubscript𝑓𝑛VUf_{n}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT. Then 𝒇MS:=[f1MS,f2MS,,fNMS]assignsuperscript𝒇MSsuperscriptsubscript𝑓1MSsuperscriptsubscript𝑓2MSsuperscriptsubscript𝑓𝑁MS\bm{f}^{\textnormal{MS}}:=[f_{1}^{\textnormal{MS}},f_{2}^{\textnormal{MS}},% \ldots,f_{N}^{\textnormal{MS}}]bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT := [ italic_f start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , … , italic_f start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ] and 𝒇VU:=[f1VU,f2VU,,fNVU]assignsuperscript𝒇VUsuperscriptsubscript𝑓1VUsuperscriptsubscript𝑓2VUsuperscriptsubscript𝑓𝑁VU\bm{f}^{\textnormal{VU}}:=[f_{1}^{\textnormal{VU}},f_{2}^{\textnormal{VU}},% \ldots,f_{N}^{\textnormal{VU}}]bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT := [ italic_f start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , … , italic_f start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ]. About the frames for VU n𝑛nitalic_n, let μnsubscript𝜇𝑛\mu_{n}italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT be the number of bits per pixel, and νn>1subscript𝜈𝑛1\nu_{n}>1italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT > 1 be the compression ratio. The MS will generate a VR video of ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT frames for XU n𝑛nitalic_n. Let 𝒜n(sn,Λn)subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{A}_{n}(s_{n},\Lambda_{n})caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) (resp., n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{B}_{n}(s_{n},\Lambda_{n})caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )) be the number of CPU cycles on MS (resp., VU n𝑛nitalic_n) to process a part of those ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT frames before (resp., after) wireless transmission. While later frames of the VR video are yet to be generated, earlier frames can be transmitted from the MS to each VU n𝑛nitalic_n. Similarly, while later frames of the VR video are yet to be received, VU n𝑛nitalic_n can process earlier frames which have already been accepted. Hence, the following three stages partially overlap: processing at the MS, wireless transmission from the MS to VU n𝑛nitalic_n, and processing at VU n𝑛nitalic_n, as shown in Fig. 2.

Refer to caption
Figure 2: The timeline.

Then we define the following:

  • the time used on the MS to generate and process frames
    for VU n𝑛nitalic_n before wireless transmission: tnMS:Pro(sn,fnMS)=𝒜n(sn,Λn)fnMSsuperscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript𝑓𝑛MSsubscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsubscript𝑓𝑛MSt_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{MS}})=\frac{% \mathcal{A}_{n}(s_{n},\Lambda_{n})}{f_{n}^{\textnormal{MS}}}italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) = divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG,

  • the time expended to transmit all ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT VR frames from the MS to VU n𝑛nitalic_n: tnTx(bn,pn,sn)=snμnΛnrn(bn,pn)νnsuperscriptsubscript𝑡𝑛Txsubscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛t_{n}^{\textnormal{Tx}}(b_{n},p_{n},s_{n})=\frac{s_{n}{\color[rgb]{0,0,0}\mu_{% n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}\nu_{% n}}}italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = divide start_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG,

  • the time cost on VU n𝑛nitalic_n for processing frames after wireless transmission: tnVU:Pro(sn,fnVU)=n(sn,Λn)fnVUsuperscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript𝑓𝑛VUsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsubscript𝑓𝑛VUt_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{VU}})=\frac{% \mathcal{B}_{n}(s_{n},\Lambda_{n})}{f_{n}^{\textnormal{VU}}}italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) = divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG,

We will set the expressions of 𝒜n(),n()subscript𝒜𝑛subscript𝑛\mathcal{A}_{n}(\cdot),\mathcal{B}_{n}(\cdot)caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( ⋅ ) , caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( ⋅ ) in Section IX on simulations. Thus, the delay for VU n𝑛nitalic_n is

tn(bn,pn,sn,fnMS,fnVU)subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU\textstyle t_{n}(b_{n},p_{n},s_{n},f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{% VU}})italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) =tnMS:Pro(sn,fnMS)+tnTx(bn,pn,sn)absentsuperscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑡𝑛Txsubscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛\textstyle=t_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{% MS}})+t_{n}^{\textnormal{Tx}}(b_{n},p_{n},s_{n})= italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )
+tnVU:Pro(sn,fnVU).superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript𝑓𝑛VU\textstyle+t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{% VU}}).+ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) . (3)

Then, we let the maximum of all VUs’ delays be the system delay:

𝒯(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)𝒯𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU\textstyle\mathcal{T}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}})caligraphic_T ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) =maxn𝒩tn(bn,pn,sn,fnMS,fnVU).absentsubscript𝑛𝒩subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU\textstyle=\max_{n\in\mathcal{N}}t_{n}(b_{n},p_{n},s_{n},f_{n}^{\textnormal{MS% }},f_{n}^{\textnormal{VU}}).= roman_max start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) . (4)

Let κMS,κnVUsuperscript𝜅MSsuperscriptsubscript𝜅𝑛VU\kappa^{\textnormal{MS}},\kappa_{n}^{\textnormal{VU}}italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT be MS’s and VU n𝑛nitalic_n’s effective switched capacitance. From the process of generating ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT frames at MS to rendering them at VU n𝑛nitalic_n, the following energy will be consumed:

  • energy spent on MS to process ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT VR frames for VU n𝑛nitalic_n: EnMS:Pro(sn,fnMS)=κMSn(sn,Λn)(fnMS)2superscriptsubscript𝐸𝑛:MSProsubscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛MS2E_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{MS}})=\kappa% ^{\textnormal{MS}}{\color[rgb]{0,0,0}\mathcal{F}_{n}(s_{n},\Lambda_{n})}({f_{n% }^{\textnormal{MS}}})^{2}italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) = italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT,

  • energy spent for transmitting ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT VR frames from MS to VU n𝑛nitalic_n: EnTx(bn,pn,sn)=(pn+pncir)snμnΛnrn(bn,pn)νnsuperscriptsubscript𝐸𝑛Txsubscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛subscript𝑝𝑛superscriptsubscript𝑝𝑛cirsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛E_{n}^{\textnormal{Tx}}(b_{n},p_{n},s_{n})=\frac{(p_{n}+p_{n}^{\textnormal{cir% }})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{r_{n}(b_{n% },p_{n}){\color[rgb]{0,0,0}\nu_{n}}}italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = divide start_ARG ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG,

  • energy spent on VU n𝑛nitalic_n to process ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT VR frames: EnVU:Pro(sn,fnVU)=κnVU𝒢n(sn,Λn)(fnVU)2superscriptsubscript𝐸𝑛:VUProsubscript𝑠𝑛superscriptsubscript𝑓𝑛VUsuperscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛VU2E_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{VU}})=\kappa% _{n}^{\textnormal{VU}}{\color[rgb]{0,0,0}\mathcal{G}_{n}(s_{n},\Lambda_{n})}(f% _{n}^{\textnormal{VU}})^{2}italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) = italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT,

where we note that n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{F}_{n}(s_{n},\Lambda_{n})caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) (resp., 𝒢n(sn,Λn)subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{G}_{n}(s_{n},\Lambda_{n})caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )) is different from 𝒜n(sn,Λn)subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{A}_{n}(s_{n},\Lambda_{n})caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) (resp., n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{B}_{n}(s_{n},\Lambda_{n})caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )) above, since the latter is only before (resp., after) wireless transmission as shown in Fig. 2, while the former considers CPU cycles to process ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT frames. The notations above highlight the dependence on ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, but we do not write ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT in delay and energy functions as ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is not optimized. The total consumed energy is:

(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)=n𝒩EnMS:Pro(sn,fnMS)𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUsubscript𝑛𝒩superscriptsubscript𝐸𝑛:MSProsubscript𝑠𝑛superscriptsubscript𝑓𝑛MS\textstyle\mathcal{E}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}})=\sum_{n\in\mathcal{N}}E_{n}^{\textnormal{MS}:\textnormal{Pro% }}(s_{n},f_{n}^{\textnormal{MS}})caligraphic_E ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) = ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT )
+n𝒩EnTx(bn,pn,sn)+n𝒩EnVU:Pro(sn,fnVU).subscript𝑛𝒩superscriptsubscript𝐸𝑛Txsubscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛subscript𝑛𝒩superscriptsubscript𝐸𝑛:VUProsubscript𝑠𝑛superscriptsubscript𝑓𝑛VU\textstyle+\sum_{n\in\mathcal{N}}E_{n}^{\textnormal{Tx}}(b_{n},p_{n},s_{n})+% \sum_{n\in\mathcal{N}}E_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{% \textnormal{VU}}).+ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) + ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) . (5)

The system cost is a weighted sum of the system delay in Eq. (4) and energy consumption in Eq. (5):

𝒞(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)𝒞𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU\textstyle\mathcal{C}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}})caligraphic_C ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) =ce(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)absentsubscript𝑐e𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU\textstyle=c_{\hskip 0.5pt\textnormal{e}}\mathcal{E}(\bm{b},\bm{p},\bm{s},\bm{% f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}})= italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT )
+ct𝒯(𝒃,𝒑,𝒔,𝒇MS,𝒇VU),subscript𝑐t𝒯𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU\textstyle+c_{\hskip 0.8pt\textnormal{t}}\mathcal{T}(\bm{b},\bm{p},\bm{s},\bm{% f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}),+ italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT caligraphic_T ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) , (6)

where cesubscript𝑐ec_{\textnormal{e}}italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT and ctsubscript𝑐tc_{\textnormal{t}}italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT are the weight parameters for energy and delay, respectively. With the utility in Eq. (2) and the cost of the whole system in Eq. (6), we present the optimization problem in the next section.

III-C Optimization problem

The aim is to maximize the utility-cost ratio (UCR) of the system as follows:

Problem 1::Problem 1absent\textstyle\textnormal{Problem $\mathbb{P}_{1}$}:~{}Problem blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT : max𝒃,𝒑,𝒔,𝒇MS,𝒇VU𝒰(𝒃,𝒑,𝒔)𝒞(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)subscript𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU𝒰𝒃𝒑𝒔𝒞𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU\textstyle\max_{\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}}}\quad\frac{\mathcal{U}(\bm{b},\bm{p},\bm{s})}{\mathcal{C}(\bm% {b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}})}roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_POSTSUBSCRIPT divide start_ARG caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) end_ARG start_ARG caligraphic_C ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) end_ARG (III-C)
s.t. n𝒩bnbmax,subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max\textstyle\sum_{n\in\mathcal{N}}b_{n}\leq b_{\textnormal{max}},∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT , (7a)
n𝒩pnpmax,subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max\textstyle\sum_{n\in\mathcal{N}}p_{n}\leq p_{\textnormal{max}},∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT , (7b)
sn𝕊n,n𝒩, where the set 𝕊nformulae-sequencesubscript𝑠𝑛subscript𝕊𝑛for-all𝑛𝒩 where the set 𝕊n\textstyle s_{n}\in\mathbb{S}_{n},~{}\forall n\in\mathcal{N},\text{ where the % set $\mathbb{S}_{n}$}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , ∀ italic_n ∈ caligraphic_N , where the set blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
can be continuous or discrete,can be continuous or discrete\textstyle\text{ can be continuous or discrete},can be continuous or discrete , (7c)
n𝒩fnMSfmaxMS,subscript𝑛𝒩superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓maxMS\textstyle\sum_{n\in\mathcal{N}}f_{n}^{\textnormal{MS}}\leq f_{\textnormal{max% }}^{\textnormal{MS}},∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , (7d)
fnVUfn,maxVU,n𝒩.formulae-sequencesuperscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVUfor-all𝑛𝒩\textstyle f_{n}^{\textnormal{VU}}\leq f_{n,\textnormal{max}}^{\textnormal{VU}% },~{}\forall n\in\mathcal{N}.italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , ∀ italic_n ∈ caligraphic_N . (7e)

Constraints (7a), (7b), and (7d) mean the sum-limit of the bandwidth, power, and computing resources of the MS. Constraint (7c) gives the range of the resolution, and (7e) sets the CPU frequency limit of each VU. Our approach to solving 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT will use a fractional programming technique presented next.

IV Our Proposed Technique for Fractional Programming (FP)

In this section, we will first formulate the FP problem and then explain how our proposed FP technique differs from those in the state-of-the-art work [11, 12].

Fractional programming (FP) problem. Let An(𝒙),Bn(𝒙),G(𝒙)subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙𝐺𝒙A_{n}(\bm{x}),B_{n}(\bm{x}),G(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) , italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) , italic_G ( bold_italic_x ) be functions of variable(s) 𝒙𝒙\bm{x}bold_italic_x, and these functions have definitions on a convex set 𝒮𝒮\mathcal{S}caligraphic_S, which is a subset of a real vector space. Also, for 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S, we have An(𝒙)0subscript𝐴𝑛𝒙0A_{n}(\bm{x})\geq 0italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ≥ 0 and Bn(𝒙)>0subscript𝐵𝑛𝒙0B_{n}(\bm{x})>0italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) > 0. Then we consider:

FP-problem:optimizing H(𝒙):=G(𝒙)+n=1NAn(𝒙)Bn(𝒙)assign𝐻𝒙𝐺𝒙superscriptsubscript𝑛1𝑁subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙H(\bm{x}):=G(\bm{x})+\sum_{n=1}^{N}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}italic_H ( bold_italic_x ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG
subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S. (8)

Two specific instances of FP-problem above are as follows:

FP-maximization: maximizing H(𝒙)𝐻𝒙H(\bm{x})italic_H ( bold_italic_x ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S,
for concave An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and convex Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ), (9)
FP-minimization: minimizing H(𝒙)𝐻𝒙H(\bm{x})italic_H ( bold_italic_x ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S,
for convex An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and concave Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ). (10)

Note that the above problem formulations (8) (9) (10) cover constrained optimization where the constraints are convex so that we can incorporate the constraints into defining 𝒮𝒮\mathcal{S}caligraphic_S.

TABLE I: A comparison of our paper and other work [11, 12] on fractional programming (FP).
Paper Contribution to fractional programming
Jong [11]
Find the global solution to FP-maximization in (9)
and FP-minimization in (10), both only in the special case of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0,
but fail to tackle any problem in the case of G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0.
Shen and Yu [12]
Find a stationary point for FP-maximization in (9)
for both cases of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0 and G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0,
but fail to tackle FP-minimization.
Our current work
Find a stationary point for FP-minimization in (10)
for both cases of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0 and G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0.

An overview of our contribution in FP technique. With problems defined in (8) (9) (10) above, Table II compares our novel FP technique and those in [11, 12]. We present the details in the paragraphs below, describing [11][12] and our work, respectively.

Prior work [11] on FP. In case of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0[11] optimizes n=1NAn(𝒙)Bn(𝒙)superscriptsubscript𝑛1𝑁subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\sum_{n=1}^{N}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG, which is referred to as the sum of ratios (SoR). Then FP-maximization (resp., FP-minimization) under G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0 can be referred to SoR-maximization (resp., SoR-minimization). Via a transform into parametric convex optimization problems, [11] obtains a global optimum for SoR-maximization (i.e., maximizing n=1NAn(𝒙)Bn(𝒙)superscriptsubscript𝑛1𝑁subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\sum_{n=1}^{N}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG for concave An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and convex Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x )) and SoR-minimization (i.e., maximizing n=1NAn(𝒙)Bn(𝒙)superscriptsubscript𝑛1𝑁subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\sum_{n=1}^{N}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG for convex An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and concave Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x )). However, the approach of [11] is only applicable to the case of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0. The reason is that although the original SoR optimization and the transformed problem find the same optimal solution for the variable(s), the optimal objective-function values of the two problems are different.

Prior work [12] on FP. To address cases of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0 and G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0, in the breakthrough work [12], Shen and Yu transform each An(𝒙)Bn(𝒙)subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG into Jn(𝒙,yn):=assignsubscript𝐽𝑛𝒙subscript𝑦𝑛absentJ_{n}(\bm{x},y_{n}):=italic_J start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) :=2ynAn(𝒙)yn2Bn(𝒙)2subscript𝑦𝑛subscript𝐴𝑛𝒙superscriptsubscript𝑦𝑛2subscript𝐵𝑛𝒙2y_{n}\sqrt{A_{n}(\bm{x})}-{y_{n}}^{2}B_{n}(\bm{x})2 italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT square-root start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG - italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ), and prove that for concave An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and convex Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ), FP-maximization in (9) is the same as maximizing V(𝒙,𝒚):=G(𝒙)+n=1NJn(𝒙,yn)assign𝑉𝒙𝒚𝐺𝒙superscriptsubscript𝑛1𝑁subscript𝐽𝑛𝒙subscript𝑦𝑛V(\bm{x},\bm{y}):=G(\bm{x})+\sum_{n=1}^{N}J_{n}(\bm{x},y_{n})italic_V ( bold_italic_x , bold_italic_y ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT italic_J start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S and ynsubscript𝑦𝑛y_{n}\in\mathbb{R}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ blackboard_R (the set of real numbers). Then alternating optimization (AO) is adopted to optimize 𝒙𝒙\bm{x}bold_italic_x and 𝒚:=[y1,,yN]assign𝒚subscript𝑦1subscript𝑦𝑁\bm{y}:=[y_{1},\ldots,y_{N}]bold_italic_y := [ italic_y start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_y start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] in an alternating manner, since V(𝒙,𝒚)𝑉𝒙𝒚V(\bm{x},\bm{y})italic_V ( bold_italic_x , bold_italic_y ) is concave in 𝒙𝒙\bm{x}bold_italic_x and concave in 𝒚𝒚\bm{y}bold_italic_y, despite not being jointly concave in them. This AO algorithm leads to a stationary point for FP-maximization. Note that [12] tackles only FP-maximization and does not address FP-minimization. Jn(𝒙,yn)subscript𝐽𝑛𝒙subscript𝑦𝑛J_{n}(\bm{x},y_{n})italic_J start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) above can not be used for FP-minimization, since the minimum of Jn(𝒙,yn)subscript𝐽𝑛𝒙subscript𝑦𝑛J_{n}(\bm{x},y_{n})italic_J start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is -\infty- ∞.

Our new technique for FP. Based on the above discussions, [11, 12] do not cover FP-minimization in (10) with G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0. To fill this gap, our paper proposes the following technique for FP-minimization in both cases of G(𝒙)0𝐺𝒙0G(\bm{x})\equiv 0italic_G ( bold_italic_x ) ≡ 0 and G(𝒙)0not-equivalent-to𝐺𝒙0G(\bm{x})\not\equiv 0italic_G ( bold_italic_x ) ≢ 0. Specifically, we transform each An(𝒙)Bn(𝒙)subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG into Kn(𝒙,yn):=[An(𝒙)]2yn+14[Bn(𝒙)]2ynassignsubscript𝐾𝑛𝒙subscript𝑦𝑛superscriptdelimited-[]subscript𝐴𝑛𝒙2subscript𝑦𝑛14superscriptdelimited-[]subscript𝐵𝑛𝒙2subscript𝑦𝑛K_{n}(\bm{x},y_{n}):=[A_{n}(\bm{x})]^{2}y_{n}+\frac{1}{4[B_{n}(\bm{x})]^{2}y_{% n}}italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) := [ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 4 [ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG, and prove that for convex An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and concave Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ), FP-minimization in (10) is the same as minimizing W(𝒙,𝒚):=G(𝒙)+n=1NKn(𝒙,yn)assign𝑊𝒙𝒚𝐺𝒙superscriptsubscript𝑛1𝑁subscript𝐾𝑛𝒙subscript𝑦𝑛W(\bm{x},\bm{y}):=G(\bm{x})+\sum_{n=1}^{N}K_{n}(\bm{x},y_{n})italic_W ( bold_italic_x , bold_italic_y ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S and yn+subscript𝑦𝑛superscripty_{n}\in\mathbb{R}^{+}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT. The above holds because with 𝒚#(𝒙)superscript𝒚#𝒙\bm{y}^{\#}(\bm{x})bold_italic_y start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) denoting 𝒚(+)N𝒚superscriptsuperscript𝑁\bm{y}\in(\mathbb{R}^{+})^{N}bold_italic_y ∈ ( blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT which minimizes W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) given 𝒙𝒙\bm{x}bold_italic_x (i.e., yn#(𝒙):=12An(𝒙)Bn(𝒙)assignsuperscriptsubscript𝑦𝑛#𝒙12subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙y_{n}^{\#}(\bm{x}):=\frac{1}{2A_{n}(\bm{x})B_{n}(\bm{x})}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) := divide start_ARG 1 end_ARG start_ARG 2 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG), the partial derivative of W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) with respect to 𝒙𝒙\bm{x}bold_italic_x at 𝒚𝒚\bm{y}bold_italic_y being 𝒚#(𝒙)superscript𝒚#𝒙\bm{y}^{\#}(\bm{x})bold_italic_y start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) is the same as the derivative of H(𝒙)𝐻𝒙H(\bm{x})italic_H ( bold_italic_x ) with respect to 𝒙𝒙\bm{x}bold_italic_x, where the computations are straightforward and shown in the Appendix of our full version [36]. Then FP-minimization in (10) can be tackled by optimizing 𝒙𝒙\bm{x}bold_italic_x and 𝒚𝒚\bm{y}bold_italic_y in an alternating manner to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), since W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) is convex in 𝒙𝒙\bm{x}bold_italic_x (for convex G(𝒙)𝐺𝒙G(\bm{x})italic_G ( bold_italic_x )) and convex in 𝒚𝒚\bm{y}bold_italic_y (for any G(𝒙)𝐺𝒙G(\bm{x})italic_G ( bold_italic_x )), despite not being jointly convex in them. For non-convex G(𝒙)𝐺𝒙G(\bm{x})italic_G ( bold_italic_x ), optimizing W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) with respect to 𝒙𝒙\bm{x}bold_italic_x can employ techniques such as difference-of-convex programming or successive convex approximation [37]. The above alternating optimization finds a stationary point for FP-minimization in (10). Finally, we note that while our proposed FP technique will be used to solve the current paper’s Problem 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT of Section III-C, the technique can also be applied to many other FP problems [12] beyond our paper.

V Solve the Optimization Problem 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT

We present our method of solving 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT of (III-C) below. The denominator in the objective function of (III-C), i.e., the system cost, is given by (6) and involves a “maximize” term from the system delay in (4). We add an auxiliary variable T𝑇Titalic_T to circumvent that “maximize” so that 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT is transformed into Problem 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT:

Problem 2::Problem 2absent\textstyle\textnormal{Problem $\mathbb{P}_{2}$}:~{}Problem blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT : max𝒃,𝒑,𝒔,𝒇MS,𝒇VU,T𝒰(𝒃,𝒑,𝒔)ce(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)+ctTsubscript𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU𝑇𝒰𝒃𝒑𝒔subscript𝑐e𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUsubscript𝑐t𝑇\textstyle\max_{\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},T}\quad\frac{\mathcal{U}(\bm{b},\bm{p},\bm{s})}{c_{\hskip 0.5% pt\textnormal{e}}\mathcal{E}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm% {f}^{\textnormal{VU}})+c_{\hskip 0.8pt\textnormal{t}}T}roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT divide start_ARG caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) end_ARG start_ARG italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T end_ARG (V)
s.t. tn(bn,pn,sn,fnMS,fnVU)T,n𝒩,formulae-sequencesubscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇for-all𝑛𝒩\textstyle t_{n}(b_{n},p_{n},s_{n},f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{% VU}})\leq T,~{}\forall n\in\mathcal{N},italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ≤ italic_T , ∀ italic_n ∈ caligraphic_N , (11a)
(7a),(7b),(7c),(7d),(7e).(7a)(7b)(7c)(7d)(7e)\textstyle\textnormal{(\ref{constraintbn})},\textnormal{(\ref{constraintpn})},% \textnormal{(\ref{constraintsn})},\textnormal{(\ref{constraintfMS})},% \textnormal{(\ref{constraintfn})}.( ) , ( ) , ( ) , ( ) , ( ) . (11b)
1 Initialize i1𝑖1i\leftarrow-1italic_i ← - 1 and for all n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N: bn(0)=bmaxNsuperscriptsubscript𝑏𝑛0subscript𝑏𝑁b_{n}^{(0)}=\frac{b_{\max}}{N}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT = divide start_ARG italic_b start_POSTSUBSCRIPT roman_max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, pn(0)=pmaxNsuperscriptsubscript𝑝𝑛0subscript𝑝𝑁p_{n}^{(0)}=\frac{p_{\max}}{N}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT = divide start_ARG italic_p start_POSTSUBSCRIPT roman_max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, sn(0)=snmin+snmax2superscriptsubscript𝑠𝑛0superscriptsubscript𝑠𝑛minsuperscriptsubscript𝑠𝑛max2s_{n}^{(0)}=\frac{s_{n}^{\textnormal{min}}+s_{n}^{\textnormal{max}}}{2}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT = divide start_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT min end_POSTSUPERSCRIPT + italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT max end_POSTSUPERSCRIPT end_ARG start_ARG 2 end_ARG, (fnMS)(0)=fmaxMSNsuperscriptsuperscriptsubscript𝑓𝑛MS0superscriptsubscript𝑓maxMS𝑁(f_{n}^{\textnormal{MS}})^{(0)}=\frac{f_{\textnormal{max}}^{\textnormal{MS}}}{N}( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT = divide start_ARG italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG start_ARG italic_N end_ARG, (fnVU)(0)=fn,maxVUsuperscriptsuperscriptsubscript𝑓𝑛VU0superscriptsubscript𝑓𝑛maxVU(f_{n}^{\textnormal{VU}})^{(0)}=f_{n,\textnormal{max}}^{\textnormal{VU}}( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT = italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT; T(0)maxn𝒩tn(bn(0),pn(0),sn(0),(fnMS)(0),(fnVU)(0))superscript𝑇0subscript𝑛𝒩subscript𝑡𝑛superscriptsubscript𝑏𝑛0superscriptsubscript𝑝𝑛0superscriptsubscript𝑠𝑛0superscriptsuperscriptsubscript𝑓𝑛MS0superscriptsuperscriptsubscript𝑓𝑛VU0T^{(0)}\leftarrow\max_{n\in\mathcal{N}}t_{n}(b_{n}^{(0)},p_{n}^{(0)},s_{n}^{(0% )},(f_{n}^{\textnormal{MS}})^{(0)},(f_{n}^{\textnormal{VU}})^{(0)})italic_T start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ← roman_max start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ); repeat
2       Let ii+1𝑖𝑖1i\leftarrow i+1italic_i ← italic_i + 1; y(i)𝒰(𝒃(i),𝒑(i),𝒔(i))ce(𝒃(i),𝒑(i),𝒔(i),(𝒇MS)(i),(𝒇VU)(i))+ctT(i)superscript𝑦𝑖𝒰superscript𝒃𝑖superscript𝒑𝑖superscript𝒔𝑖subscript𝑐esuperscript𝒃𝑖superscript𝒑𝑖superscript𝒔𝑖superscriptsuperscript𝒇MS𝑖superscriptsuperscript𝒇VU𝑖subscript𝑐tsuperscript𝑇𝑖y^{(i)}\leftarrow\frac{\mathcal{U}(\bm{b}^{(i)},\bm{p}^{(i)},\bm{s}^{(i)})}{c_% {\hskip 0.5pt\textnormal{e}}\mathcal{E}(\bm{b}^{(i)},\bm{p}^{(i)},\bm{s}^{(i)}% ,(\bm{f}^{\textnormal{MS}})^{(i)},(\bm{f}^{\textnormal{VU}})^{(i)})+c_{\hskip 0% .8pt\textnormal{t}}T^{(i)}}italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ← divide start_ARG caligraphic_U ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT end_ARG; //Lines 8–25 solve 3(y(i))subscript3superscript𝑦𝑖\mathbb{P}_{3}(y^{(i)})blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) Initialize j1𝑗1j\leftarrow-1italic_j ← - 1, [𝒃(i,0),𝒑(i,0),𝒔(i,0),(𝒇MS)(i,0),(𝒇VU)(i,0),T(i,0)][𝒃(i),𝒑(i),𝒔(i),(𝒇MS)(i),(𝒇VU)(i),T(i)]superscript𝒃𝑖0superscript𝒑𝑖0superscript𝒔𝑖0superscriptsuperscript𝒇MS𝑖0superscriptsuperscript𝒇VU𝑖0superscript𝑇𝑖0superscript𝒃𝑖superscript𝒑𝑖superscript𝒔𝑖superscriptsuperscript𝒇MS𝑖superscriptsuperscript𝒇VU𝑖superscript𝑇𝑖[\bm{b}^{(i,0)},\bm{p}^{(i,0)},\bm{s}^{(i,0)},(\bm{f}^{\textnormal{MS}})^{(i,0% )},(\bm{f}^{\textnormal{VU}})^{(i,0)},T^{(i,0)}]\leftarrow[\bm{b}^{(i)},\bm{p}% ^{(i)},\bm{s}^{(i)},(\bm{f}^{\textnormal{MS}})^{(i)},(\bm{f}^{\textnormal{VU}}% )^{(i)},T^{(i)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , 0 ) end_POSTSUPERSCRIPT ] ← [ bold_italic_b start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ]; repeat
3             //Lines 13–22 solve 4(y(i),𝒔(i,j))subscript4superscript𝑦𝑖superscript𝒔𝑖𝑗\mathbb{P}_{4}(y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) Let jj+1𝑗𝑗1j\leftarrow j+1italic_j ← italic_j + 1. Initialize 11\ell\leftarrow-1roman_ℓ ← - 1; [𝒃(i,j,0),𝒑(i,j,0)][𝒃(i,j),𝒑(i,j)]superscript𝒃𝑖𝑗0superscript𝒑𝑖𝑗0superscript𝒃𝑖𝑗superscript𝒑𝑖𝑗[\bm{b}^{(i,j,0)},\bm{p}^{(i,j,0)}]\leftarrow[\bm{b}^{(i,j)},\bm{p}^{(i,j)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j , 0 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j , 0 ) end_POSTSUPERSCRIPT ] ← [ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ]; repeat
4                   Let +11\ell\leftarrow\ell+1roman_ℓ ← roman_ℓ + 1. Set zn(i,j,)12(pn(i,j,)+pncir)sn(i)μnΛnrn(bn(i,j,),pn(i,j,))νnsuperscriptsubscript𝑧𝑛𝑖𝑗12superscriptsubscript𝑝𝑛𝑖𝑗superscriptsubscript𝑝𝑛cirsuperscriptsubscript𝑠𝑛𝑖subscript𝜇𝑛subscriptΛ𝑛subscript𝑟𝑛superscriptsubscript𝑏𝑛𝑖𝑗superscriptsubscript𝑝𝑛𝑖𝑗subscript𝜈𝑛z_{n}^{(i,j,\ell)}\leftarrow\frac{1}{2\cdot(p_{n}^{(i,j,\ell)}+p_{n}^{% \textnormal{cir}})s_{n}^{(i)}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}% \Lambda_{n}}\cdot r_{n}(b_{n}^{(i,j,\ell)},p_{n}^{(i,j,\ell)}){\color[rgb]{% 0,0,0}\nu_{n}}}italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT ← divide start_ARG 1 end_ARG start_ARG 2 ⋅ ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG Obtain [𝒃(i,j,+1),𝒑(i,j,+1),(𝒇MS)(i,j,+1),(𝒇VU)(i,j,+1),T(i,j,+1)]superscript𝒃𝑖𝑗1superscript𝒑𝑖𝑗1superscriptsuperscript𝒇MS𝑖𝑗1superscriptsuperscript𝒇VU𝑖𝑗1superscript𝑇𝑖𝑗1[\bm{b}^{(i,j,\ell+1)},\bm{p}^{(i,j,\ell+1)},(\bm{f}^{\textnormal{MS}})^{(i,j,% \ell+1)},(\bm{f}^{\textnormal{VU}})^{(i,j,\ell+1)},T^{(i,j,\ell+1)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT ] through solving Problem 5(𝒛(i,j,),y(i),𝒔(i,j))subscript5superscript𝒛𝑖𝑗superscript𝑦𝑖superscript𝒔𝑖𝑗\mathbb{P}_{5}(\bm{z}^{(i,j,\ell)},y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) according to Algorithm 2, and denote the resulting optimal objective-function value of 5(𝒛(i,j,),y(i),𝒔(i,j))subscript5superscript𝒛𝑖𝑗superscript𝑦𝑖superscript𝒔𝑖𝑗\mathbb{P}_{5}(\bm{z}^{(i,j,\ell)},y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) by V5*(𝒛(i,j,),y(i),𝒔(i,j))subscriptsuperscript𝑉subscript5superscript𝒛𝑖𝑗superscript𝑦𝑖superscript𝒔𝑖𝑗V^{*}_{\mathbb{P}_{5}}(\bm{z}^{(i,j,\ell)},y^{(i)},\bm{s}^{(i,j)})italic_V start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT );
5            until 1normal-ℓ1\ell\geq 1roman_ℓ ≥ 1 and the relative difference between the optimal objective-function values for Problem 5(𝐳(i,j,),y(i),𝐬(i,j))subscript5superscript𝐳𝑖𝑗normal-ℓsuperscript𝑦𝑖superscript𝐬𝑖𝑗\mathbb{P}_{5}(\bm{z}^{(i,j,\ell)},y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) and Problem 5(𝐳(i,j,1),y(i),𝐬(i,j))subscript5superscript𝐳𝑖𝑗normal-ℓ1superscript𝑦𝑖superscript𝐬𝑖𝑗\mathbb{P}_{5}(\bm{z}^{(i,j,\ell-1)},y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ - 1 ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) is no greater than ϵ3subscriptitalic-ϵ3\epsilon_{3}italic_ϵ start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT for a small positive number ϵ3subscriptitalic-ϵ3\epsilon_{3}italic_ϵ start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT (i.e., V5*(𝐳(i,j,),y(i),𝐬(i,j))V5*(𝐳(i,j,1),y(i),𝐬(i,j))1ϵ3subscriptsuperscript𝑉subscript5superscript𝐳𝑖𝑗normal-ℓsuperscript𝑦𝑖superscript𝐬𝑖𝑗subscriptsuperscript𝑉subscript5superscript𝐳𝑖𝑗normal-ℓ1superscript𝑦𝑖superscript𝐬𝑖𝑗1subscriptitalic-ϵ3\frac{V^{*}_{\mathbb{P}_{5}}(\bm{z}^{(i,j,\ell)},y^{(i)},\bm{s}^{(i,j)})}{V^{*% }_{\mathbb{P}_{5}}(\bm{z}^{(i,j,\ell-1)},y^{(i)},\bm{s}^{(i,j)})}-1\leq% \epsilon_{3}divide start_ARG italic_V start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_V start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ - 1 ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ) end_ARG - 1 ≤ italic_ϵ start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT);
6            Set [𝒃(i,j+1),𝒑(i,j+1),(𝒇MS)(i,j+1),(𝒇VU)(i,j+1),T(i,j+1)][𝒃(i,j,+1),𝒑(i,j,+1),(𝒇MS)(i,j,+1),(𝒇VU)(i,j,+1),T(i,j,+1)]superscript𝒃𝑖𝑗1superscript𝒑𝑖𝑗1superscriptsuperscript𝒇MS𝑖𝑗1superscriptsuperscript𝒇VU𝑖𝑗1superscript𝑇𝑖𝑗1superscript𝒃𝑖𝑗1superscript𝒑𝑖𝑗1superscriptsuperscript𝒇MS𝑖𝑗1superscriptsuperscript𝒇VU𝑖𝑗1superscript𝑇𝑖𝑗1[\bm{b}^{(i,j+1)},\bm{p}^{(i,j+1)},(\bm{f}^{\textnormal{MS}})^{(i,j+1)},(\bm{f% }^{\textnormal{VU}})^{(i,j+1)},T^{(i,j+1)}]\leftarrow[\bm{b}^{(i,j,\ell+1)},% \bm{p}^{(i,j,\ell+1)},(\bm{f}^{\textnormal{MS}})^{(i,j,\ell+1)},(\bm{f}^{% \textnormal{VU}})^{(i,j,\ell+1)},T^{(i,j,\ell+1)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT ] ← [ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j , roman_ℓ + 1 ) end_POSTSUPERSCRIPT ], which we consider as a solution to 4(y(i),𝒔(i,j))subscript4superscript𝑦𝑖superscript𝒔𝑖𝑗\mathbb{P}_{4}(y^{(i)},\bm{s}^{(i,j)})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ); Set 𝒔𝒔\bm{s}bold_italic_s as 𝒔(i,j+1)superscript𝒔𝑖𝑗1\bm{s}^{(i,j+1)}bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT denoting the optimal solution of Problem 6(𝒃(i,j+1),𝒑(i,j+1),(𝒇MS)(i,j+1),(𝒇VU)(i,j+1),T(i,j+1),y(i))subscript6superscript𝒃𝑖𝑗1superscript𝒑𝑖𝑗1superscriptsuperscript𝒇MS𝑖𝑗1superscriptsuperscript𝒇VU𝑖𝑗1superscript𝑇𝑖𝑗1superscript𝑦𝑖\mathbb{P}_{6}(\bm{b}^{(i,j+1)},\bm{p}^{(i,j+1)},(\bm{f}^{\textnormal{MS}})^{(% i,j+1)},(\bm{f}^{\textnormal{VU}})^{(i,j+1)},T^{(i,j+1)},y^{(i)})blackboard_P start_POSTSUBSCRIPT 6 end_POSTSUBSCRIPT ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ), which is obtained from (V-D).
7      until the relative difference between H3(𝐛(i,j+1),𝐩(i,j+1),𝐬(i,j+1),(𝐟MS)(i,j+1),(𝐟VU)(i,j+1),T(i,j+1)y(i))subscript𝐻subscript3superscript𝐛𝑖𝑗1superscript𝐩𝑖𝑗1superscript𝐬𝑖𝑗1superscriptsuperscript𝐟MS𝑖𝑗1superscriptsuperscript𝐟VU𝑖𝑗1conditionalsuperscript𝑇𝑖𝑗1superscript𝑦𝑖H_{\mathbb{P}_{3}}(\bm{b}^{(i,j+1)},\bm{p}^{(i,j+1)},\bm{s}^{(i,j+1)},(\bm{f}^% {\textnormal{MS}})^{(i,j+1)},(\bm{f}^{\textnormal{VU}})^{(i,j+1)},T^{(i,j+1)}% \mid y^{(i)})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT ∣ italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) and H3(𝐛(i,j),𝐩(i,j),𝐬(i,j),(𝐟MS)(i,j),(𝐟VU)(i,j),T(i,j)y(i))subscript𝐻subscript3superscript𝐛𝑖𝑗superscript𝐩𝑖𝑗superscript𝐬𝑖𝑗superscriptsuperscript𝐟MS𝑖𝑗superscriptsuperscript𝐟VU𝑖𝑗conditionalsuperscript𝑇𝑖𝑗superscript𝑦𝑖H_{\mathbb{P}_{3}}(\bm{b}^{(i,j)},\bm{p}^{(i,j)},\bm{s}^{(i,j)},(\bm{f}^{% \textnormal{MS}})^{(i,j)},(\bm{f}^{\textnormal{VU}})^{(i,j)},T^{(i,j)}\mid y^{% (i)})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ∣ italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) is no greater than ϵ2subscriptitalic-ϵ2\epsilon_{2}italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT for a small positive number ϵ2subscriptitalic-ϵ2\epsilon_{2}italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT (i.e., H3(𝐛(i,j+1),𝐩(i,j+1),𝐬(i,j+1),(𝐟MS)(i,j+1),(𝐟VU)(i,j+1),T(i,j+1)y(i))H3(𝐛(i,j),𝐩(i,j),𝐬(i,j),(𝐟MS)(i,j),(𝐟VU)(i,j),T(i,j)y(i))1ϵ2subscript𝐻subscript3superscript𝐛𝑖𝑗1superscript𝐩𝑖𝑗1superscript𝐬𝑖𝑗1superscriptsuperscript𝐟MS𝑖𝑗1superscriptsuperscript𝐟VU𝑖𝑗1conditionalsuperscript𝑇𝑖𝑗1superscript𝑦𝑖subscript𝐻subscript3superscript𝐛𝑖𝑗superscript𝐩𝑖𝑗superscript𝐬𝑖𝑗superscriptsuperscript𝐟MS𝑖𝑗superscriptsuperscript𝐟VU𝑖𝑗conditionalsuperscript𝑇𝑖𝑗superscript𝑦𝑖1subscriptitalic-ϵ2\frac{H_{\mathbb{P}_{3}}(\bm{b}^{(i,j+1)},\bm{p}^{(i,j+1)},\bm{s}^{(i,j+1)},(% \bm{f}^{\textnormal{MS}})^{(i,j+1)},(\bm{f}^{\textnormal{VU}})^{(i,j+1)},T^{(i% ,j+1)}\mid y^{(i)})}{H_{\mathbb{P}_{3}}(\bm{b}^{(i,j)},\bm{p}^{(i,j)},\bm{s}^{% (i,j)},(\bm{f}^{\textnormal{MS}})^{(i,j)},(\bm{f}^{\textnormal{VU}})^{(i,j)},T% ^{(i,j)}\mid y^{(i)})}-1\leq\epsilon_{2}divide start_ARG italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT ∣ italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j ) end_POSTSUPERSCRIPT ∣ italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) end_ARG - 1 ≤ italic_ϵ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT) ;
8      Set [𝒃(i+1),𝒑(i+1),𝒔(i+1),(𝒇MS)(i+1),(𝒇VU)(i+1),T(i+1)][𝒃(i,j+1),𝒑(i,j+1),𝒔(i,j+1),(𝒇MS)(i,j+1),(𝒇VU)(i,j+1),T(i,j+1)]superscript𝒃𝑖1superscript𝒑𝑖1superscript𝒔𝑖1superscriptsuperscript𝒇MS𝑖1superscriptsuperscript𝒇VU𝑖1superscript𝑇𝑖1superscript𝒃𝑖𝑗1superscript𝒑𝑖𝑗1superscript𝒔𝑖𝑗1superscriptsuperscript𝒇MS𝑖𝑗1superscriptsuperscript𝒇VU𝑖𝑗1superscript𝑇𝑖𝑗1[\bm{b}^{(i+1)},\bm{p}^{(i+1)},\bm{s}^{(i+1)},(\bm{f}^{\textnormal{MS}})^{(i+1% )},(\bm{f}^{\textnormal{VU}})^{(i+1)},T^{(i+1)}]\leftarrow[\bm{b}^{(i,j+1)},% \bm{p}^{(i,j+1)},\bm{s}^{(i,j+1)},(\bm{f}^{\textnormal{MS}})^{(i,j+1)},(\bm{f}% ^{\textnormal{VU}})^{(i,j+1)},T^{(i,j+1)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT ] ← [ bold_italic_b start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i , italic_j + 1 ) end_POSTSUPERSCRIPT ], which we consider as a solution to Problem 3(y(i))subscript3superscript𝑦𝑖\mathbb{P}_{3}(y^{(i)})blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT );
9until the relative difference between y(i+1)superscript𝑦𝑖1y^{(i+1)}italic_y start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT (i.e., 𝒰(𝐛(i+1),𝐩(i+1),𝐬(i+1))ce(𝐛(i+1),𝐩(i+1),𝐬(i+1),(𝐟MS)(i+1),(𝐟VU)(i+1))+ctT(i+1)𝒰superscript𝐛𝑖1superscript𝐩𝑖1superscript𝐬𝑖1subscript𝑐esuperscript𝐛𝑖1superscript𝐩𝑖1superscript𝐬𝑖1superscriptsuperscript𝐟MS𝑖1superscriptsuperscript𝐟VU𝑖1subscript𝑐tsuperscript𝑇𝑖1\frac{\mathcal{U}(\bm{b}^{(i+1)},\bm{p}^{(i+1)},\bm{s}^{(i+1)})}{c_{\hskip 0.5% pt\textnormal{e}}\mathcal{E}(\bm{b}^{(i+1)},\bm{p}^{(i+1)},\bm{s}^{(i+1)},(\bm% {f}^{\textnormal{MS}})^{(i+1)},(\bm{f}^{\textnormal{VU}})^{(i+1)})+c_{\hskip 0% .8pt\textnormal{t}}T^{(i+1)}}divide start_ARG caligraphic_U ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT end_ARG) and y(i)superscript𝑦𝑖y^{(i)}italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT is no greater than ϵ1subscriptitalic-ϵ1\epsilon_{1}italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT for a small positive number ϵ1subscriptitalic-ϵ1\epsilon_{1}italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT (i.e., y(i+1)y(i)1ϵ1superscript𝑦𝑖1superscript𝑦𝑖1subscriptitalic-ϵ1\frac{y^{(i+1)}}{y^{(i)}}-1\leq\epsilon_{1}divide start_ARG italic_y start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT end_ARG start_ARG italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT end_ARG - 1 ≤ italic_ϵ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT);
Return [𝒃(i+1),𝒑(i+1),𝒔(i+1),(𝒇MS)(i+1),(𝒇VU)(i+1),T(i+1)]superscript𝒃𝑖1superscript𝒑𝑖1superscript𝒔𝑖1superscriptsuperscript𝒇MS𝑖1superscriptsuperscript𝒇VU𝑖1superscript𝑇𝑖1[\bm{b}^{(i+1)},\bm{p}^{(i+1)},\bm{s}^{(i+1)},(\bm{f}^{\textnormal{MS}})^{(i+1% )},(\bm{f}^{\textnormal{VU}})^{(i+1)},T^{(i+1)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , italic_T start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT ] as a solution to Problem 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT, which means [𝒃(i+1),𝒑(i+1),𝒔(i+1),(𝒇MS)(i+1),(𝒇VU)(i+1)]superscript𝒃𝑖1superscript𝒑𝑖1superscript𝒔𝑖1superscriptsuperscript𝒇MS𝑖1superscriptsuperscript𝒇VU𝑖1[\bm{b}^{(i+1)},\bm{p}^{(i+1)},\bm{s}^{(i+1)},(\bm{f}^{\textnormal{MS}})^{(i+1% )},(\bm{f}^{\textnormal{VU}})^{(i+1)}][ bold_italic_b start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_p start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , bold_italic_s start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT ] is a solution to Problem 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT;
Algorithm 1 Solve Problem 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT and hence Problem 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT for the system UCR optimization.

The subsections below present our steps for solving 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT. These steps together induce our Algorithm 1 on Page 1, which can be better understood after readers have finished all subsections below.

V-A Dinkelbach’s transform for the ratio optimization

For 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT maximizing a ratio (i.e., numerator of (V)denominator of (V)numerator of (V)denominator of (V)\frac{\textnormal{numerator of (\ref{problemP2})}}{\textnormal{denominator of % (\ref{problemP2})}}divide start_ARG numerator of ( ) end_ARG start_ARG denominator of ( ) end_ARG), we use Dinkelbach’s transform [12] to transform 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT into a series of parametric optimization 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) which maximizes “numerator of (V)ydenominator of (V)numerator of (V)𝑦denominator of (V)\textnormal{numerator of (\ref{problemP2})}-y\cdot\textnormal{denominator of (% \ref{problemP2})}numerator of ( ) - italic_y ⋅ denominator of ( )” subject to 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT’s constraints, where solving the current 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) decides “y𝑦yitalic_y” used in the next 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ). For an optimization problem isubscript𝑖\mathbb{P}_{i}blackboard_P start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT, let Hisubscript𝐻subscript𝑖H_{\mathbb{P}_{i}}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT end_POSTSUBSCRIPT denote its objective function. Then H3subscript𝐻subscript3H_{\mathbb{P}_{3}}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT and 3subscript3\mathbb{P}_{3}blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT are as follows:

H3subscript𝐻subscript3\textstyle H_{\mathbb{P}_{3}}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT (𝒃,𝒑,𝒔,𝒇MS,𝒇VU,Ty)::𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUconditional𝑇𝑦absent\textstyle(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{% VU}},T\mid y):( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ italic_y ) :
=numerator of (V)ydenominator of (V)absentnumerator of (V)𝑦denominator of (V)\textstyle=\textnormal{numerator of (\ref{problemP2})}-y\cdot\textnormal{% denominator of (\ref{problemP2})}= numerator of ( ) - italic_y ⋅ denominator of ( )
=𝒰(𝒃,𝒑,𝒔)y(ce(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)+ctT),absent𝒰𝒃𝒑𝒔𝑦subscript𝑐e𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUsubscript𝑐t𝑇\textstyle=\mathcal{U}(\bm{b},\bm{p},\bm{s})-y\cdot(c_{\hskip 0.5pt\textnormal% {e}}\mathcal{E}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}})+c_{\hskip 0.8pt\textnormal{t}}T),= caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) - italic_y ⋅ ( italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T ) , (12)
Pro blem3(y)::blemsubscript3𝑦absent\textstyle\textnormal{blem}~{}\textnormal{$\mathbb{P}_{3}(y)$}:blem blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) :
max𝒃,𝒑,𝒔,𝒇MS,𝒇VU,TH3(𝒃,𝒑,𝒔,𝒇MS,𝒇VU,Ty)subscript𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU𝑇subscript𝐻subscript3𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUconditional𝑇𝑦\textstyle\max_{\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},T}\quad H_{\mathbb{P}_{3}}(\bm{b},\bm{p},\bm{s},\bm{f}^{% \textnormal{MS}},\bm{f}^{\textnormal{VU}},T\mid y)roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ italic_y ) (13)
s.t.(7a),(7b),(7c),(7d),(7e),(11a).s.t.(7a)(7b)(7c)(7d)(7e)(11a)\textstyle\textrm{s.t.}\quad\textnormal{(\ref{constraintbn})},\textnormal{(% \ref{constraintpn})},\textnormal{(\ref{constraintsn})},\textnormal{(\ref{% constraintfMS})},\textnormal{(\ref{constraintfn})},\textnormal{(\ref{% constraintTtau})}.s.t. ( ) , ( ) , ( ) , ( ) , ( ) , ( ) .

The process of using 3subscript3\mathbb{P}_{3}blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT to solve 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT is as follows. For ease of explanation, we denote [𝒃,𝒑,𝒔,𝒇MS,𝒇VU,T]𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VU𝑇[\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T][ bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ] by 𝒙𝒙\bm{x}bold_italic_x, and write the objective function of 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) as U(𝒙)yC(𝒙)𝑈𝒙𝑦𝐶𝒙U(\bm{x})-y\cdot C(\bm{x})italic_U ( bold_italic_x ) - italic_y ⋅ italic_C ( bold_italic_x ). Then starting from a feasible 𝒙(0)superscript𝒙0\bm{x}^{(0)}bold_italic_x start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT at initialization, we set 𝒚(0)superscript𝒚0\bm{y}^{(0)}bold_italic_y start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT as U(𝒙(0))C(𝒙(0))𝑈superscript𝒙0𝐶superscript𝒙0\frac{U(\bm{x}^{(0)})}{C(\bm{x}^{(0)})}divide start_ARG italic_U ( bold_italic_x start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_C ( bold_italic_x start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) end_ARG. Then we solve 3(𝒚(0))subscript3superscript𝒚0\mathbb{P}_{3}(\bm{y}^{(0)})blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( bold_italic_y start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ), denote the obtained solution as 𝒙(1)superscript𝒙1\bm{x}^{(1)}bold_italic_x start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, set 𝒚(1)superscript𝒚1\bm{y}^{(1)}bold_italic_y start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT as U(𝒙(1))C(𝒙(1))𝑈superscript𝒙1𝐶superscript𝒙1\frac{U(\bm{x}^{(1)})}{C(\bm{x}^{(1)})}divide start_ARG italic_U ( bold_italic_x start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_C ( bold_italic_x start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) end_ARG. This process continues iteratively: in the (i+1)𝑖1(i+1)( italic_i + 1 )th iteration, 𝒚(i)superscript𝒚𝑖\bm{y}^{(i)}bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT is set as U(𝒙(i))C(𝒙(i))𝑈superscript𝒙𝑖𝐶superscript𝒙𝑖\frac{U(\bm{x}^{(i)})}{C(\bm{x}^{(i)})}divide start_ARG italic_U ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_C ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) end_ARG (given by Line 1 of Algorithm 1 on Page 1), and 𝒙(i+1)superscript𝒙𝑖1\bm{x}^{(i+1)}bold_italic_x start_POSTSUPERSCRIPT ( italic_i + 1 ) end_POSTSUPERSCRIPT is obtained from solving 3(𝒚(i))subscript3superscript𝒚𝑖\mathbb{P}_{3}(\bm{y}^{(i)})blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ). As stated in [12], the above process converges and does not lose optimality; i.e., under global optimization of each P3(y)subscript𝑃3𝑦P_{3}(y)italic_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) (not achieved in our current paper, as discussed later), global optimization of P2subscript𝑃2P_{2}italic_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT is also achieved.

We will solve each 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) by alternating optimizing (AO) 𝒔𝒔\bm{s}bold_italic_s and 𝒃,𝒑,𝒇MS,𝒇VU,T𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T. Section V-B optimizes 𝒃,𝒑,𝒇MS,𝒇VU,T𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T given 𝒔𝒔\bm{s}bold_italic_s, while Section V-D optimizes 𝒔𝒔\bm{s}bold_italic_s given 𝒃,𝒑,𝒇MS,𝒇VU,T𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T. AO means loo** through these two steps until convergence; i.e., the relative difference between the objective-function values of consecutive iterations is no more than the error tolerance, as shown in Line 1 of Algorithm 1.

V-B Optimizing 𝐛,𝐩,𝐟MS,𝐟VU,T𝐛𝐩superscript𝐟MSsuperscript𝐟VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T given 𝐬𝐬\bm{s}bold_italic_s for Problem 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y )

For Problem 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ), given 𝒔𝒔\bm{s}bold_italic_s, optimizing 𝒃,𝒑,𝒇MS,𝒇VU,T𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T means the following optimization:

Problem 4(y,𝒔)::Problem 4(y,𝒔)absent\textstyle\textnormal{Problem $\mathbb{P}_{4}(y,\bm{s})$}:Problem blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y , bold_italic_s ) :
max𝒃,𝒑,𝒇MS,𝒇VU,TF(𝒃,𝒑,𝒇MS,𝒇VU𝒔,y)yceETx(𝒃,𝒑,𝒔)subscript𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝐹𝒃𝒑superscript𝒇MSconditionalsuperscript𝒇VU𝒔𝑦𝑦subscript𝑐esuperscript𝐸Tx𝒃𝒑𝒔\textstyle\max_{\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}% },T}~{}F(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}\mid% \bm{s},y)-yc_{\hskip 0.5pt\textnormal{e}}\cdot E^{\textnormal{Tx}}(\bm{b},\bm{% p},\bm{s})roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ∣ bold_italic_s , italic_y ) - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ italic_E start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_s ) (14)
s.t.(7a),(7b),(7d),(7e),(11a).s.t.(7a)(7b)(7d)(7e)(11a)\textstyle\textrm{s.t.}~{}\textnormal{(\ref{constraintbn})},\textnormal{(\ref{% constraintpn})},\textnormal{(\ref{constraintfMS})},\textnormal{(\ref{% constraintfn})},\textnormal{(\ref{constraintTtau})}.s.t. ( ) , ( ) , ( ) , ( ) , ( ) .
where F(𝒃,𝒑,𝒇MS,𝒇VU,T𝒔,y)=𝒰(𝒃,𝒑,𝒔)where 𝐹𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝒔𝑦𝒰𝒃𝒑𝒔\textstyle\textnormal{where }F(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},T\mid\bm{s},y)=\mathcal{U}(\bm{b},\bm{p},\bm{s})where italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ bold_italic_s , italic_y ) = caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s )
y[ce(n𝒩EnMS:Pro(sn,fnMS)\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{% }~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}-y\cdot[c_{\hskip 0.5pt\textnormal{e}}% \cdot(\sum\limits_{n\in\mathcal{N}}E_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_% {n},f_{n}^{\textnormal{MS}})- italic_y ⋅ [ italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT )
+n𝒩EnVU:Pro(sn,fnVU))+ctT],\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{% }~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}+\sum\limits_{n\in\mathcal{N}}E_{n}^{% \textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{VU}}))+c_{\hskip 0.% 8pt\textnormal{t}}T],+ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T ] ,
and ETx(𝒃,𝒑,𝒔):=n𝒩EnTx(bn,pn,sn)assignand superscript𝐸Tx𝒃𝒑𝒔subscript𝑛𝒩superscriptsubscript𝐸𝑛Txsubscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛\textstyle\text{and }E^{\textnormal{Tx}}(\bm{b},\bm{p},\bm{s}):=\sum_{n\in% \mathcal{N}}E_{n}^{\textnormal{Tx}}(b_{n},p_{n},s_{n})and italic_E start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_s ) := ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )
=n𝒩(pn+pncir)snμnΛnrn(bn,pn)νn.absentsubscript𝑛𝒩subscript𝑝𝑛superscriptsubscript𝑝𝑛cirsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}=\sum_{n% \in\mathcal{N}}\frac{(p_{n}+p_{n}^{\textnormal{cir}})s_{n}{\color[rgb]{0,0,0}% \mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}% \nu_{n}}}.= ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT divide start_ARG ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG . (15)

Eq. (15) has a summation of non-convex ratios, which we address using our fractional programming technique of Section IV, as detailed soon. Note that we cannot use the sum-of-ratios approach in [12], since the objective function in (14) includes not just the sum of ratios, but also F(𝒃,𝒑,𝒇MS,𝒇VU,T𝒔,y)𝐹𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝒔𝑦F(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T\mid\bm{s},y)italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ bold_italic_s , italic_y ).

V-C Leveraging our fractional programming technique to solve 4(y,𝐬)subscript4𝑦𝐬\mathbb{P}_{4}(y,\bm{s})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y , bold_italic_s )

We utilize our fractional programming technique of Section IV to transform 4subscript4\mathbb{P}_{4}blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT into a series of 5subscript5\mathbb{P}_{5}blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT:

5(𝒛,y,𝒔):max𝒃,𝒑,𝒇MS,𝒇VU,TF(𝒃,𝒑,𝒇MS,𝒇VU,T𝒔,y):subscript5𝒛𝑦𝒔subscript𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝐹𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝒔𝑦\textstyle\textnormal{$\mathbb{P}_{5}(\bm{z},y,\bm{s})$}:\max\limits_{\bm{b},% \bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T}F(\bm{b},\bm{p},\bm% {f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T\mid\bm{s},y)blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) : roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ bold_italic_s , italic_y )
ycen𝒩{[(pn+pncir)snμnΛn]2zn+14(rn(bn,pn)νn)2zn}𝑦subscript𝑐esubscript𝑛𝒩superscriptdelimited-[]subscript𝑝𝑛superscriptsubscript𝑝𝑛cirsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2subscript𝑧𝑛14superscriptsubscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛2subscript𝑧𝑛\textstyle-yc_{\hskip 0.5pt\textnormal{e}}\cdot\sum_{n\in\mathcal{N}}\left\{[(% p_{n}+p_{n}^{\textnormal{cir}})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{% 0,0,0}\Lambda_{n}}]^{2}z_{n}+\frac{1}{4(r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}% \nu_{n}})^{2}z_{n}}\right\}- italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT { [ ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 4 ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG } (16)
s.t.(7a),(7b),(7d),(7e),(11a),s.t.(7a)(7b)(7d)(7e)(11a)\textstyle\textrm{s.t.}\quad\textnormal{(\ref{constraintbn})},\textnormal{(% \ref{constraintpn})},\textnormal{(\ref{constraintfMS})},\textnormal{(\ref{% constraintfn})},\textnormal{(\ref{constraintTtau})},s.t. ( ) , ( ) , ( ) , ( ) , ( ) , (17)

where we introduce the auxiliary 𝒛:=[z1,z2,,zN]assign𝒛subscript𝑧1subscript𝑧2subscript𝑧𝑁\bm{z}:=[z_{1},z_{2},\ldots,z_{N}]bold_italic_z := [ italic_z start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_z start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_z start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] with zn>0subscript𝑧𝑛0z_{n}>0italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT > 0. We solve 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) in Section VI.

The process of using 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) to solve 4(y,𝒔)subscript4𝑦𝒔\mathbb{P}_{4}(y,\bm{s})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y , bold_italic_s ) is as follows. For ease of explanation, we denote [𝒃,𝒑,𝒇MS,𝒇VU,T]𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T][ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ] by 𝝌𝝌\bm{\chi}bold_italic_χ, and write the objective function of 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) as A(𝝌)n𝒩(Bn(𝝌)zn+Cn(𝝌)zn)𝐴𝝌subscript𝑛𝒩subscript𝐵𝑛𝝌subscript𝑧𝑛subscript𝐶𝑛𝝌subscript𝑧𝑛A(\bm{\chi})-\sum_{n\in\mathcal{N}}(B_{n}(\bm{\chi})z_{n}+\frac{C_{n}(\bm{\chi% })}{z_{n}})italic_A ( bold_italic_χ ) - ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ( italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ ) italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG italic_C start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ ) end_ARG start_ARG italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ). Then starting from a feasible 𝝌(0)superscript𝝌0\bm{\chi}^{(0)}bold_italic_χ start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT at initialization, we set zn(0)superscriptsubscript𝑧𝑛0z_{n}^{(0)}italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT as Cn(𝝌(0))Bn(𝝌(0))subscript𝐶𝑛superscript𝝌0subscript𝐵𝑛superscript𝝌0\sqrt{\frac{C_{n}(\bm{\chi}^{(0)})}{B_{n}(\bm{\chi}^{(0)})}}square-root start_ARG divide start_ARG italic_C start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) end_ARG end_ARG (i.e., optimizing the above objective function with respect to 𝒛𝒛\bm{z}bold_italic_z given 𝝌=𝝌(0)𝝌superscript𝝌0\bm{\chi}=\bm{\chi}^{(0)}bold_italic_χ = bold_italic_χ start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT). Then we solve 5(𝒛(0),y,𝒔)subscript5superscript𝒛0𝑦𝒔\mathbb{P}_{5}(\bm{z}^{(0)},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , italic_y , bold_italic_s ), denote the obtained solution as 𝝌(1)superscript𝝌1\bm{\chi}^{(1)}bold_italic_χ start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, set zn(1)superscriptsubscript𝑧𝑛1z_{n}^{(1)}italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT as Cn(𝝌(1))Bn(𝝌(1))subscript𝐶𝑛superscript𝝌1subscript𝐵𝑛superscript𝝌1\sqrt{\frac{C_{n}(\bm{\chi}^{(1)})}{B_{n}(\bm{\chi}^{(1)})}}square-root start_ARG divide start_ARG italic_C start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) end_ARG end_ARG. This process continues iteratively: in the (+1)1(\ell+1)( roman_ℓ + 1 )th iteration, zn()superscriptsubscript𝑧𝑛z_{n}^{(\ell)}italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( roman_ℓ ) end_POSTSUPERSCRIPT is set as Cn(𝝌())Bn(𝝌())subscript𝐶𝑛superscript𝝌subscript𝐵𝑛superscript𝝌\sqrt{\frac{C_{n}(\bm{\chi}^{(\ell)})}{B_{n}(\bm{\chi}^{(\ell)})}}square-root start_ARG divide start_ARG italic_C start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( roman_ℓ ) end_POSTSUPERSCRIPT ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_χ start_POSTSUPERSCRIPT ( roman_ℓ ) end_POSTSUPERSCRIPT ) end_ARG end_ARG, and 𝝌(+1)superscript𝝌1\bm{\chi}^{(\ell+1)}bold_italic_χ start_POSTSUPERSCRIPT ( roman_ℓ + 1 ) end_POSTSUPERSCRIPT is obtained from solving 5(𝒛(),y,𝒔)subscript5superscript𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z}^{(\ell)},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z start_POSTSUPERSCRIPT ( roman_ℓ ) end_POSTSUPERSCRIPT , italic_y , bold_italic_s ). As explained in Section V-C, the above process is alternating optimization and thus converges. We will discuss its performance in Section VI.

V-D Optimizing 𝐬𝐬\bm{s}bold_italic_s given 𝐛,𝐩,𝐟MS,𝐟VU,T𝐛𝐩superscript𝐟MSsuperscript𝐟VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T for Problem 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y )

When 𝕊nsubscript𝕊𝑛\mathbb{S}_{n}blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT in (7c) is [snmin,snmax]superscriptsubscript𝑠𝑛minsuperscriptsubscript𝑠𝑛max[s_{n}^{\textnormal{min}},s_{n}^{\textnormal{max}}][ italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT min end_POSTSUPERSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT max end_POSTSUPERSCRIPT ], given 𝒃,𝒑,𝒇MS,𝒇VU,T𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},Tbold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T, optimizing 𝒔𝒔\bm{s}bold_italic_s for 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) means the following:

Problem 6(𝒃,𝒑,𝒇MS,𝒇VU,T,y)::Problem 6(𝒃,𝒑,𝒇MS,𝒇VU,T,y)absent\textstyle\textnormal{Problem $\mathbb{P}_{6}(\bm{b},\bm{p},\bm{f}^{% \textnormal{MS}},\bm{f}^{\textnormal{VU}},T,y)$}:Problem blackboard_P start_POSTSUBSCRIPT 6 end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_y ) :
max𝒔𝒰(𝒃,𝒑,𝒔)y(ce(𝒃,𝒑,𝒔,𝒇MS,𝒇VU)+ctT)subscript𝒔𝒰𝒃𝒑𝒔𝑦subscript𝑐e𝒃𝒑𝒔superscript𝒇MSsuperscript𝒇VUsubscript𝑐t𝑇\textstyle\max_{\bm{s}}\quad\mathcal{U}(\bm{b},\bm{p},\bm{s})-y\cdot(c_{\hskip 0% .5pt\textnormal{e}}\mathcal{E}(\bm{b},\bm{p},\bm{s},\bm{f}^{\textnormal{MS}},% \bm{f}^{\textnormal{VU}})+c_{\hskip 0.8pt\textnormal{t}}T)roman_max start_POSTSUBSCRIPT bold_italic_s end_POSTSUBSCRIPT caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) - italic_y ⋅ ( italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT caligraphic_E ( bold_italic_b , bold_italic_p , bold_italic_s , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) + italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T ) (18)
s.t.snminsnmin{snmax,vn(bn,pn,fnMS,fnVU,T)},s.t.superscriptsubscript𝑠𝑛minsubscript𝑠𝑛superscriptsubscript𝑠𝑛maxsubscript𝑣𝑛subscript𝑏𝑛subscript𝑝𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇\textstyle\textrm{s.t.}\quad s_{n}^{\textnormal{min}}\leq s_{n}\leq\min\{s_{n}% ^{\textnormal{max}},\,v_{n}(b_{n},p_{n},f_{n}^{\textnormal{MS}},f_{n}^{% \textnormal{VU}},T)\},s.t. italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT min end_POSTSUPERSCRIPT ≤ italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ roman_min { italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT max end_POSTSUPERSCRIPT , italic_v start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ) } ,
n𝒩,for-all𝑛𝒩\textstyle~{}~{}~{}~{}~{}~{}\forall n\in\mathcal{N},∀ italic_n ∈ caligraphic_N ,

where vn(bn,pn,fnMS,fnVU,T)subscript𝑣𝑛subscript𝑏𝑛subscript𝑝𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇v_{n}(b_{n},p_{n},f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{VU}},T)italic_v start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ) is defined as snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT which makes tn(bn,pn,sn,fnMS,fnVU)subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VUt_{n}(b_{n},p_{n},s_{n},f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{VU}})italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) equal T𝑇Titalic_T.

Assuming 𝒜n(sn,Λn)subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{A}_{n}(s_{n},\Lambda_{n})caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{B}_{n}(s_{n},\Lambda_{n})caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{F}_{n}(s_{n},\Lambda_{n})caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), and 𝒢n(sn,Λn)subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{G}_{n}(s_{n},\Lambda_{n})caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) of Section III-B to be convex in snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT (which hold in our simulations in Section IX), 6(𝒃,𝒑,𝒇MS,𝒇VU,T,y)subscript6𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝑦\mathbb{P}_{6}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}% ,T,y)blackboard_P start_POSTSUBSCRIPT 6 end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_y ) is convex optimization for 𝒔𝒔\bm{s}bold_italic_s, for which the Karush–Kuhn–Tucker (KKT) conditions give a global optimum. Using the KKT conditions, we obtain that with sn#superscriptsubscript𝑠𝑛#s_{n}^{\#}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT denoting the maximum point of the function Vn(sn):=Un(rn(bn,pn),sn)yce×(κMSn(sn,Λn)(fnMS)2+(pn+pncir)snμnΛnrn(bn,pn)νn+κnVU𝒢n(sn,Λn)(fnVU)2)assignsubscript𝑉𝑛subscript𝑠𝑛subscript𝑈𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛𝑦subscript𝑐esuperscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛MS2subscript𝑝𝑛superscriptsubscript𝑝𝑛cirsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛superscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛VU2V_{n}(s_{n}):=U_{n}(r_{n}(b_{n},p_{n}),s_{n})-yc_{\hskip 0.5pt\textnormal{e}}% \times\big{(}\kappa^{\textnormal{MS}}{\color[rgb]{0,0,0}\mathcal{F}_{n}(s_{n},% \Lambda_{n})}({f_{n}^{\textnormal{MS}}})^{2}+\frac{(p_{n}+p_{n}^{\textnormal{% cir}})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{r_{n}(b% _{n},p_{n}){\color[rgb]{0,0,0}\nu_{n}}}+\kappa_{n}^{\textnormal{VU}}{\color[% rgb]{0,0,0}\mathcal{G}_{n}(s_{n},\Lambda_{n})}(f_{n}^{\textnormal{VU}})^{2}% \big{)}italic_V start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) := italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT × ( italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ) that is concave with respect to sn(0,)subscript𝑠𝑛0s_{n}\in(0,\infty)italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ ( 0 , ∞ ), the optimal solution of snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to 6(𝒃,𝒑,𝒇MS,𝒇VU,T,y)subscript6𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝑦\mathbb{P}_{6}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}% ,T,y)blackboard_P start_POSTSUBSCRIPT 6 end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_y ) is

{for continuous 𝕊n=[snmin,snmax]s~n:=max{snmin,min{sn#,snmax,vn(bn,pn,fnMS,fnVU,T)}},for discrete 𝕊n: one of snup and snlow which gives a higher  Vn(), for snup (resp., snlow) denoting the smallest (resp., largest) sn in 𝕊n greater (resp., less) than s~n.casesfor continuous 𝕊n=[snmin,snmax]𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒assignsubscript~𝑠𝑛superscriptsubscript𝑠𝑛minsuperscriptsubscript𝑠𝑛#superscriptsubscript𝑠𝑛maxsubscript𝑣𝑛subscript𝑏𝑛subscript𝑝𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for discrete 𝕊n: one of snup and snlow which gives a higher 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 Vn(), for snup (resp., snlow) denoting the𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 smallest (resp., largest) sn in 𝕊n greater𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 (resp., less) than s~n.𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒\textstyle\begin{cases}\text{for continuous $\mathbb{S}_{n}=[s_{n}^{% \textnormal{min}},s_{n}^{\textnormal{max}}]$: }\\ \widetilde{s}_{n}:=\max\{s_{n}^{\textnormal{min}},\min\{s_{n}^{\#},~{}s_{n}^{% \textnormal{max}},~{}v_{n}(b_{n},p_{n},f_{n}^{\textnormal{MS}},f_{n}^{% \textnormal{VU}},T)\}\},\\ \text{for discrete $\mathbb{S}_{n}$: one of $s_{n}^{\textnormal{up}}$ and $s_{% n}^{\textnormal{low}}$ which gives a higher }\\[-5.0pt] \text{~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}$V_{n}(\cdot)$,% for $s_{n}^{\textnormal{up}}$ (resp., $s_{n}^{\textnormal{low}}$) denoting % the}\\[-5.0pt] \text{~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}smallest (resp.% , largest) $s_{n}$ in $\mathbb{S}_{n}$ greater}\\[-5.0pt] \text{~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}(resp., less) % than $\widetilde{s}_{n}$.}\end{cases}{ start_ROW start_CELL for continuous blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = [ italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT min end_POSTSUPERSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT max end_POSTSUPERSCRIPT ] : end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL over~ start_ARG italic_s end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT := roman_max { italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT min end_POSTSUPERSCRIPT , roman_min { italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT max end_POSTSUPERSCRIPT , italic_v start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ) } } , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for discrete blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT : one of italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT up end_POSTSUPERSCRIPT and italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT low end_POSTSUPERSCRIPT which gives a higher end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL italic_V start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( ⋅ ) , for italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT up end_POSTSUPERSCRIPT (resp., italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT low end_POSTSUPERSCRIPT ) denoting the end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL smallest (resp., largest) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT in blackboard_S start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT greater end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL (resp., less) than over~ start_ARG italic_s end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT . end_CELL start_CELL end_CELL end_ROW

V-E Putting the above together: Our Algorithm 1 on Page 1

Based on the above, we present Algorithm 1 on Page 1 to solve 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT. Algorithm 1 consists of three levels of iterations: the outermost iteration based on Dinkelbach’s transform in Section V-A, the mid-level iteration for alternating optimization based on Sections V-B and V-D, and the innermost iteration using our fractional programming technique as discussed in Section V-C. In Algorithm 1’s pseudocode, Line 3 represents the outermost iteration based on Dinkelbach’s transform, which solves a series of Problem 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) for iteratively-updated y𝑦yitalic_y, in order to solve Problem 2subscript2\mathbb{P}_{2}blackboard_P start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT at convergence. Line 9 corresponding to the mid-level iteration is to alternating solve Problem 4(y,𝒔)subscript4𝑦𝒔\mathbb{P}_{4}(y,\bm{s})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y , bold_italic_s ) and Problem 6(𝒃,𝒑,𝒇MS,𝒇VU,T,y)subscript6𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝑦\mathbb{P}_{6}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}% ,T,y)blackboard_P start_POSTSUBSCRIPT 6 end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_y ), in order to resolve Problem 3(y)subscript3𝑦\mathbb{P}_{3}(y)blackboard_P start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT ( italic_y ) at convergence. In Line 14, the innermost iteration is executed to solve Problem 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) for iteratively-updated 𝒛𝒛\bm{z}bold_italic_z, in order to settle Problem 4(y,𝒔)subscript4𝑦𝒔\mathbb{P}_{4}(y,\bm{s})blackboard_P start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT ( italic_y , bold_italic_s ) at convergence.

We defer the solution quality and time complexity of Algorithm 1 to Section VII after explaining in Section VI below how each 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) in Line 1 of Algorithm 1 is solved.

VI Global Optimization of Problem 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) in (16)

The transmission rate rn(bn,pn)subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛r_{n}(b_{n},p_{n})italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is jointly concave in bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT [6]. Then from the composition rule in Eq. (3.11) of [38] and our Assumption 1 on Page 1, 𝒰(𝒃,𝒑,𝒔)𝒰𝒃𝒑𝒔\mathcal{U}(\bm{b},\bm{p},\bm{s})caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) in Eq. (2) is jointly concave in 𝒃𝒃\bm{b}bold_italic_b and 𝒑𝒑\bm{p}bold_italic_p. Thus, 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) belongs to convex optimization. The CVX tool [38] can be used to solve it. However, the worst-case complexity of global convex optimization grows exponentially with the problem size N𝑁Nitalic_N from Section 1.4.2 of [38]. Below we analyze the KKT conditions [38] to globally optimize 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ).

The Lagrange function of 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) is given below, where α,β,γ,𝜹,𝜻𝛼𝛽𝛾𝜹𝜻\alpha,\beta,\gamma,\bm{\delta},\bm{\zeta}italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ denote the multipliers:

L5(𝒃,𝒑,𝒇MS,𝒇VU,T,α,β,γ,𝜹,𝜻𝒛,y,𝒔)subscript𝐿subscript5𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝛼𝛽𝛾𝜹conditional𝜻𝒛𝑦𝒔\textstyle L_{\mathbb{P}_{5}}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},T,\alpha,\beta,\gamma,\bm{\delta},\bm{\zeta}\mid\bm{z},y,\bm{% s})italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ ∣ bold_italic_z , italic_y , bold_italic_s )
=F(𝒃,𝒑,𝒇MS,𝒇VU,Ty,𝒔)absent𝐹𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝑦𝒔\textstyle=-F(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},% T\mid y,\bm{s})= - italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ italic_y , bold_italic_s )
+ycen𝒩{[(pn+pncir)snμnΛn]2zn+14(rn(bn,pn)νn)2zn}𝑦subscript𝑐esubscript𝑛𝒩superscriptdelimited-[]subscript𝑝𝑛superscriptsubscript𝑝𝑛cirsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2subscript𝑧𝑛14superscriptsubscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝜈𝑛2subscript𝑧𝑛\textstyle+yc_{\hskip 0.5pt\textnormal{e}}\cdot\sum_{n\in\mathcal{N}}\left\{[(% p_{n}+p_{n}^{\textnormal{cir}})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{% 0,0,0}\Lambda_{n}}]^{2}z_{n}+\frac{1}{4(r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}% \nu_{n}})^{2}z_{n}}\right\}+ italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT { [ ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 4 ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG }
+α(n𝒩bnbmax)+β(n𝒩pnpmax)𝛼subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max𝛽subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max\textstyle+\alpha\cdot\big{(}\sum_{n\in\mathcal{N}}b_{n}-b_{\textnormal{max}}% \big{)}+\beta\cdot\big{(}\sum_{n\in\mathcal{N}}p_{n}-p_{\textnormal{max}}\big{)}+ italic_α ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) + italic_β ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT )
+γ(n𝒩fnMSfmaxMS)+n𝒩[δn(fnVUfn,maxVU)]𝛾subscript𝑛𝒩superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓maxMSsubscript𝑛𝒩delimited-[]subscript𝛿𝑛superscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVU\textstyle+\gamma\cdot\big{(}\sum_{n\in\mathcal{N}}f_{n}^{\textnormal{MS}}-f_{% \textnormal{max}}^{\textnormal{MS}}\big{)}+\sum_{n\in\mathcal{N}}\big{[}\delta% _{n}\cdot(f_{n}^{\textnormal{VU}}-f_{n,\textnormal{max}}^{\textnormal{VU}})% \big{]}+ italic_γ ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT - italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) + ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT [ italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT - italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ]
+n𝒩[ζn(tn(bn,pn,sn,fnMS,fnVU)T)].subscript𝑛𝒩delimited-[]subscript𝜁𝑛subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇\textstyle+\sum_{n\in\mathcal{N}}\big{[}\zeta_{n}\cdot(t_{n}(b_{n},p_{n},s_{n}% ,f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{VU}})-T)\big{]}.+ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT [ italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) - italic_T ) ] . (19)

Abbreviating L5(𝒃,𝒑,𝒇MS,𝒇VU,T,α,β,γ,𝜹,𝜻𝒛,y,𝒔),𝒇VU,T𝒔,y)L_{\mathbb{P}_{5}}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{% VU}},T,\alpha,\beta,\gamma,\bm{\delta},\bm{\zeta}\mid\bm{z},y,\bm{s}),\bm{f}^{% \textnormal{VU}},T\mid\bm{s},y)italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ ∣ bold_italic_z , italic_y , bold_italic_s ) , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ bold_italic_s , italic_y ), Un(rn(bn,pn),sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛U_{n}(r_{n}(b_{n},p_{n}),s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) and rn(bn,pn)subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛r_{n}(b_{n},p_{n})italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) as L5subscript𝐿subscript5L_{\mathbb{P}_{5}}italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT, Unsubscript𝑈𝑛U_{n}italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT for simplicity, we present the KKT conditions of 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) as (20)-(33) below.

• Stationarity:

n𝒩:L5bn=0, meaning:for-all𝑛𝒩subscript𝐿subscript5subscript𝑏𝑛0 meaning\textstyle\forall n\in\mathcal{N}:\frac{\partial L_{\mathbb{P}_{5}}}{\partial b% _{n}}=0,\text{ meaning }∀ italic_n ∈ caligraphic_N : divide start_ARG ∂ italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG = 0 , meaning
Unrnrnbnyce2rn3νn2znrnbnsubscript𝑈𝑛subscript𝑟𝑛subscript𝑟𝑛subscript𝑏𝑛𝑦subscript𝑐e2superscriptsubscript𝑟𝑛3superscriptsubscript𝜈𝑛2subscript𝑧𝑛subscript𝑟𝑛subscript𝑏𝑛\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}-\frac{\partial U_{n}}{\partial r_{n}}% \cdot\frac{\partial r_{n}}{\partial b_{n}}-\frac{yc_{\hskip 0.5pt\textnormal{e% }}}{2{r_{n}}^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}}z_{n}}\frac{\partial r_{n}}{% \partial b_{n}}- divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ⋅ divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG - divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG
+αζnsnμnΛnrn2νnrnbn=0;𝛼subscript𝜁𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛superscriptsubscript𝑟𝑛2subscript𝜈𝑛subscript𝑟𝑛subscript𝑏𝑛0\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}+\alpha-\zeta_{n}\frac{s_{n}{\color[rgb]{% 0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{{r_{n}}^{2}{\color[rgb]{0,0,0}% \nu_{n}}}\frac{\partial r_{n}}{\partial b_{n}}=0;+ italic_α - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG = 0 ; (20)
n𝒩:L5pn=0, meaning:for-all𝑛𝒩subscript𝐿subscript5subscript𝑝𝑛0 meaning\textstyle\forall n\in\mathcal{N}:\frac{\partial L_{\mathbb{P}_{5}}}{\partial p% _{n}}=0,\text{ meaning }∀ italic_n ∈ caligraphic_N : divide start_ARG ∂ italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG = 0 , meaning
Unrnrnpn+2ycezn(snμnΛn)2(pn+pncir)subscript𝑈𝑛subscript𝑟𝑛subscript𝑟𝑛subscript𝑝𝑛2𝑦subscript𝑐esubscript𝑧𝑛superscriptsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2subscript𝑝𝑛superscriptsubscript𝑝𝑛cir\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}-\frac{\partial U_{n}}{\partial r_{n}}% \cdot\frac{\partial r_{n}}{\partial p_{n}}+2yc_{\hskip 0.5pt\textnormal{e}}z_{% n}(s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}})^{2}(p_{n}+% p_{n}^{\textnormal{cir}})- divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ⋅ divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + 2 italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT )
yce2rn3νn2znrnpn+βζnsnμnΛnrn2νnrnpn=0;𝑦subscript𝑐e2superscriptsubscript𝑟𝑛3superscriptsubscript𝜈𝑛2subscript𝑧𝑛subscript𝑟𝑛subscript𝑝𝑛𝛽subscript𝜁𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛superscriptsubscript𝑟𝑛2subscript𝜈𝑛subscript𝑟𝑛subscript𝑝𝑛0\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}-\frac{yc_{\hskip 0.5pt\textnormal{e}}}{2% {r_{n}}^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}}z_{n}}\frac{\partial r_{n}}{% \partial p_{n}}+\beta-\zeta_{n}\frac{s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[% rgb]{0,0,0}\Lambda_{n}}}{{r_{n}}^{2}{\color[rgb]{0,0,0}\nu_{n}}}\frac{\partial r% _{n}}{\partial p_{n}}=0;- divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + italic_β - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG divide start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG = 0 ; (21)
n𝒩:L5fnMS=0, meaning:for-all𝑛𝒩subscript𝐿subscript5superscriptsubscript𝑓𝑛MS0 meaning\textstyle\forall n\in\mathcal{N}:\frac{\partial L_{\mathbb{P}_{5}}}{\partial f% _{n}^{\textnormal{MS}}}=0,\text{ meaning }∀ italic_n ∈ caligraphic_N : divide start_ARG ∂ italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG = 0 , meaning
yce2κMSn(sn,Λn)fnMS+γζn𝒜n(sn,Λn)(fnMS)2=0;𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsubscript𝑓𝑛MS𝛾subscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛MS20\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}yc_{\hskip 0.5pt\textnormal{e}}\cdot 2% \kappa^{\textnormal{MS}}{\color[rgb]{0,0,0}\mathcal{F}_{n}(s_{n},\Lambda_{n})}% {f_{n}^{\textnormal{MS}}}+\gamma-\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_% {n})}{(f_{n}^{\textnormal{MS}})^{2}}=0;italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT + italic_γ - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG = 0 ; (22)
n𝒩:L5fnVU=0, meaning:for-all𝑛𝒩subscript𝐿subscript5superscriptsubscript𝑓𝑛VU0 meaning\textstyle\forall n\in\mathcal{N}:\frac{\partial L_{\mathbb{P}_{5}}}{\partial f% _{n}^{\textnormal{VU}}}=0,\text{ meaning }∀ italic_n ∈ caligraphic_N : divide start_ARG ∂ italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG = 0 , meaning
yce2κnVU𝒢n(sn,Λn)fnVU+δnζnn(sn,Λn)(fnVU)2=0;𝑦subscript𝑐e2superscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsubscript𝑓𝑛VUsubscript𝛿𝑛subscript𝜁𝑛subscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscriptsuperscriptsubscript𝑓𝑛VU20\textstyle~{}~{}~{}~{}~{}~{}~{}~{}~{}yc_{\hskip 0.5pt\textnormal{e}}\cdot 2% \kappa_{n}^{\textnormal{VU}}{\color[rgb]{0,0,0}\mathcal{G}_{n}(s_{n},\Lambda_{% n})}{f_{n}^{\textnormal{VU}}}+\delta_{n}-\zeta_{n}\frac{{\color[rgb]{0,0,0}% \mathcal{B}_{n}(s_{n},\Lambda_{n})}}{(f_{n}^{\textnormal{VU}})^{2}}=0;italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT + italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG = 0 ; (23)
L5T=0, meaning n𝒩ζn=yct.formulae-sequencesubscript𝐿subscript5𝑇0 meaning subscript𝑛𝒩subscript𝜁𝑛𝑦subscript𝑐t\textstyle\frac{\partial L_{\mathbb{P}_{5}}}{\partial T}=0,\text{ meaning }% \sum_{n\in\mathcal{N}}\zeta_{n}=yc_{\hskip 0.8pt\textnormal{t}}.divide start_ARG ∂ italic_L start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT end_ARG start_ARG ∂ italic_T end_ARG = 0 , meaning ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = italic_y italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT . (24)
• Complementary slackness:
α(n𝒩bnbmax)=0;𝛼subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max0\textstyle\alpha\cdot\big{(}\sum_{n\in\mathcal{N}}b_{n}-b_{\textnormal{max}}% \big{)}=0;italic_α ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) = 0 ; (25)
β(n𝒩pnpmax)=0;𝛽subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max0\textstyle\beta\cdot\big{(}\sum_{n\in\mathcal{N}}p_{n}-p_{\textnormal{max}}% \big{)}=0;italic_β ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) = 0 ; (26)
γ(n𝒩fnMSfmaxMS)=0;𝛾subscript𝑛𝒩superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓maxMS0\textstyle\gamma\cdot\big{(}\sum_{n\in\mathcal{N}}f_{n}^{\textnormal{MS}}-f_{% \textnormal{max}}^{\textnormal{MS}}\big{)}=0;italic_γ ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT - italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) = 0 ; (27)
δn(fnVUfn,maxVU)=0 for all n𝒩;subscript𝛿𝑛superscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVU0 for all 𝑛𝒩\textstyle\delta_{n}\cdot(f_{n}^{\textnormal{VU}}-f_{n,\textnormal{max}}^{% \textnormal{VU}})=0\textnormal{ for all }n\in\mathcal{N};italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT - italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) = 0 for all italic_n ∈ caligraphic_N ; (28)
ζn(tn(bn,pn,sn,fnMS,fnVU)T)=0 for all n𝒩.subscript𝜁𝑛subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇0 for all 𝑛𝒩\textstyle\zeta_{n}\cdot(t_{n}(b_{n},p_{n},s_{n},f_{n}^{\textnormal{MS}},f_{n}% ^{\textnormal{VU}})-T)=0\textnormal{ for all }n\in\mathcal{N}.italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) - italic_T ) = 0 for all italic_n ∈ caligraphic_N . (29)
• Primal feasibility: (7a),(7b),(7d),(7e),(11a).• Primal feasibility: (7a)(7b)(7d)(7e)(11a)\textstyle\textbf{\textbullet~{}Primal feasibility: }\textnormal{(\ref{% constraintbn})},\textnormal{(\ref{constraintpn})},\textnormal{(\ref{% constraintfMS})},\textnormal{(\ref{constraintfn})},\textnormal{(\ref{% constraintTtau})}.bold_• bold_Primal bold_feasibility: () , ( ) , ( ) , ( ) , ( ) . (30)
• Dual feasibility:
(33a): α0;(33b): β0;(33c): γ0;(33d): δn0 for all n𝒩;(33e): ζn0 for all n𝒩.formulae-sequence(33a): 𝛼0formulae-sequence(33b): 𝛽0(33c): 𝛾0formulae-sequence(33d): subscript𝛿𝑛0 for all 𝑛𝒩(33e): subscript𝜁𝑛0 for all 𝑛𝒩\textstyle\begin{array}[]{l}\text{(\ref{Dualfeasibility}a):~{}}\alpha\geq 0;~{% }~{}~{}\text{(\ref{Dualfeasibility}b):~{}}\beta\geq 0;~{}~{}~{}\text{(\ref{% Dualfeasibility}c):~{}}\gamma\geq 0;\\ \text{(\ref{Dualfeasibility}d):~{}}\delta_{n}\geq 0\textnormal{ for all }n\in% \mathcal{N};\text{(\ref{Dualfeasibility}e):~{}}\zeta_{n}\geq 0\textnormal{ for% all }n\in\mathcal{N}.\end{array}start_ARRAY start_ROW start_CELL ( a): italic_α ≥ 0 ; ( b): italic_β ≥ 0 ; ( c): italic_γ ≥ 0 ; end_CELL end_ROW start_ROW start_CELL ( d): italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≥ 0 for all italic_n ∈ caligraphic_N ; ( e): italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≥ 0 for all italic_n ∈ caligraphic_N . end_CELL end_ROW end_ARRAY (33)

We now analyze the KKT conditions of (20)–(33), to solve 5()subscript5\mathbb{P}_{5}(\textnormal{\footnotesize$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ), where “\bigstar” denotes “𝒛,y,𝒔𝒛𝑦𝒔\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s” from now on for notation simplicity. Among the Lagrange multipliers, it is clear from (20) that

α>0.𝛼0\textstyle\alpha>0.italic_α > 0 . (34)

Then using (34) in (25), we obtain

n𝒩bn=bmax.subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max\textstyle\sum_{n\in\mathcal{N}}b_{n}=b_{\textnormal{max}}.∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT . (35)

Thus, (25) (7a) (33a) can be replaced by (34) (35). Hence,

the KKT conditions of Problem 5(), which include (20)–(29), (30) (i.e., (7a), (7b), (7d), (7e), (11a)), and (33(i.e., (33a), (33b), (33c), (33d), (33e)),can be expressed as 𝒮KKT, which denotes the collection of(20)–(24), (26)–(29), (7b), (7d), (7e), (11a), (33b), (33c),(33d), (33e), (34), and (35).the KKT conditions of Problem 5(), which include (20)–(29), (30) (i.e., (7a), (7b), (7d), (7e), (11a)), and (33(i.e., (33a), (33b), (33c), (33d), (33e))can be expressed as 𝒮KKT, which denotes the collection of(20)–(24), (26)–(29), (7b), (7d), (7e), (11a), (33b), (33c)(33d), (33e), (34), and (35).\textstyle\begin{array}[]{l}\textnormal{the KKT conditions of Problem $\mathbb% {P}_{5}(\textnormal{\footnotesize$\bigstar$})$, which include }\\ \textnormal{(\ref{Stationaritybn})--(\ref{Complementarytime}), (\ref{% Primalfeasibility}) (i.e., {(\ref{constraintbn})}, {(\ref{constraintpn})}, {(% \ref{constraintfMS})}, {(\ref{constraintfn})}, {(\ref{constraintTtau})}), and % (\ref{Dualfeasibility}) }\\ \textnormal{(i.e., (\ref{Dualfeasibility}a), (\ref{Dualfeasibility}b), (\ref{% Dualfeasibility}c), (\ref{Dualfeasibility}d), (\ref{Dualfeasibility}e))},\\ \textnormal{can be expressed as $\mathcal{S}_{KKT}$, which denotes the % collection of}\\ \textnormal{(\ref{Stationaritybn})--(\ref{partialLpartialT}), (\ref{% Complementarybeta})--(\ref{Complementarytime}), {(\ref{constraintpn})}, {(\ref% {constraintfMS})}, {(\ref{constraintfn})}, {(\ref{constraintTtau})}, (\ref{% Dualfeasibility}b), (\ref{Dualfeasibility}c)},\\ \textnormal{(\ref{Dualfeasibility}d), (\ref{Dualfeasibility}e), (\ref{% Stationaritypn3alpha}), and (\ref{Complementaryalpha2}).}\end{array}start_ARRAY start_ROW start_CELL the KKT conditions of Problem blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) , which include end_CELL end_ROW start_ROW start_CELL ( )–( ), ( ) (i.e., ( ), ( ), ( ), ( ), ( )), and ( ) end_CELL end_ROW start_ROW start_CELL (i.e., ( a), ( b), ( c), ( d), ( e)) , end_CELL end_ROW start_ROW start_CELL can be expressed as caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT , which denotes the collection of end_CELL end_ROW start_ROW start_CELL ( )–( ), ( )–( ), ( ), ( ), ( ), ( ), ( b), ( c) , end_CELL end_ROW start_ROW start_CELL ( d), ( e), ( ), and ( ). end_CELL end_ROW end_ARRAY (42)
(43)

Identifying a roadmap to compute the variables step-by-step. Given “𝒛,y,𝒔𝒛𝑦𝒔\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s” (denoted by “\bigstar” below), we will find 𝒃,𝒑,𝒇MS,𝒇VU,T,α,β,γ,𝜹,𝜻𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇𝛼𝛽𝛾𝜹𝜻\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T,\alpha,\beta% ,\gamma,\bm{\delta},\bm{\zeta}bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ to satisfy the KKT conditions 𝒮KKTsubscript𝒮𝐾𝐾𝑇\mathcal{S}_{KKT}caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT defined above.

We will partition the KKT conditions given in 𝒮KKTsubscript𝒮𝐾𝐾𝑇\mathcal{S}_{KKT}caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT of (43) for 5()subscript5\mathbb{P}_{5}(\textnormal{\footnotesize$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) into the sets 𝒮1.1,𝒮1.2.1,𝒮1.2.2.1,subscript𝒮1.1subscript𝒮1.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.1},\mathcal{S}_{1.2.1},\mathcal{S}_{1.2.2.1},caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT , 𝒮1.2.2.2,𝒮2.1,𝒮2.2subscript𝒮1.2.2.2subscript𝒮2.1subscript𝒮2.2\mathcal{S}_{1.2.2.2},\mathcal{S}_{2.1},\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined below to enable a step-by-step approach, in order to solve for the variables:

{Step 1: Considering 𝜻 as an parameter, find [𝒃,𝒑,𝒇MS,𝒇VU,α,β,γ,𝜹] satisfying 𝒮1.1𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2as functions of [𝜻,] through Steps 1.1 and 1.2 below, where𝒮1.1𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2={(20), (21), (22), (23), (26), (27), (28),(7b),(7d), (7e), (33b), (33c), (33d), (34), (35)},(44) for 𝒮1.1𝒮1.2.1𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (45), (47),(49) and (50) below,{Step 1.1: Find 𝒇MS,𝒇VU,γ,𝜹 satisfying 𝒮1.1 as functions of [𝜻,]:𝒮1.1:={(22), (23), (27), (28), (7d), (7e), (33c), (33d)},(45) Step 1.2: Find 𝒃,𝒑,α,β satisfying 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2 as functions of [𝜻,] through Steps 1.2.1, 1.2.2.1, and 1.2.2.2 below, where 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2={(20), (21), (26), (7b), (33b), (34), (35)},(46) for 𝒮1.2.1𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (47), (49)and (50) below,{Step 1.2.1: Considering [α,β] as parameters, find 𝒃,𝒑 satisfying 𝒮1.2.1 as functions of [α,β,𝜻,], for 𝒮1.2.1:={(20), (21)},(47) Step 1.2.2: Using results of Step 1.2.1, find [α,β] satisfying 𝒮1.2.2.1𝒮1.2.2.2 as functions of [𝜻,] through Steps 1.2.2.1 and 1.2.2.2 below, where 𝒮1.2.2.1𝒮1.2.2.2={(26), (7b), (33b), (34), (35)},(48) for 𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (49) and (50) below,{Step 1.2.2.1: considering β as a parameter, find αsatisfying 𝒮1.2.2.1 as a function of [β,𝜻,], for 𝒮1.2.2.1:={(34), (35)},(49) Step 1.2.2.2: using results of Step 1.2.2.1, find β satisfying 𝒮1.2.2.2 as a function of [𝜻,],for 𝒮1.2.2.2:={(26),(7b),(33b)},(50) Step 2: Using results of Steps 1.1 and 1.2, find [T,𝜻] satisfying 𝒮2.1𝒮2.2 as a function of “” through Steps  2.1 and 2.2 below, where 𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)},(51) for 𝒮2.1 and 𝒮2.2 defined in (52) and (53) below,{Step 2.1: considering T as a parameter, find 𝜻 satisfying 𝒮2.1 as a function of [T,],for 𝒮2.1:={(29), (11a), (33e)},(52)Step 2.2: using results of Steps 1.1 and 1.2, find T satisfying 𝒮2.2 as a function of “”,for 𝒮2.2:={(24)},(53)casesStep 1: Considering 𝜻 as an parameter, find [𝒃,𝒑,𝒇MS,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝒇VU,α,β,γ,𝜹] satisfying 𝒮1.1𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒as functions of [𝜻,] through Steps 1.1 and 1.2 below, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒wheresubscript𝒮1.1subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2absent𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒(20), (21), (22), (23), (26), (27), (28),(7b)(7d), (7e), (33b), (33c), (33d), (34), (35)(44) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮1.1𝒮1.2.1𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (45), (47),𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒(49) and (50) below,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒casesStep 1.1: Find 𝒇MS,𝒇VU,γ,𝜹 satisfying 𝒮1.1 as𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 functions of [𝜻,]:𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒assignsubscript𝒮1.1(22), (23), (27), (28), (7d), (7e), (33c), (33d)𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒(45) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Step 1.2: Find 𝒃,𝒑,α,β satisfying𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2 as functions of [𝜻,] through 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Steps 1.2.1, 1.2.2.1, and 1.2.2.2 below, where 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2absent𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒(20), (21), (26), (7b), (33b), (34), (35)(46) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮1.2.1𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (47), (49)𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒and (50) below,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒casesStep 1.2.1: Considering [α,β] as parameters, find𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 𝒃,𝒑 satisfying 𝒮1.2.1 as functions of [α,β,𝜻,],𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 for 𝒮1.2.1:={(20), (21)},(47) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Step 1.2.2: Using results of Step 1.2.1, find [α,β]𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 satisfying 𝒮1.2.2.1𝒮1.2.2.2 as functions of𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 [𝜻,] through Steps 1.2.2.1 and 1.2.2.2 below, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒where subscript𝒮1.2.2.1subscript𝒮1.2.2.2absent𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒(26), (7b), (33b), (34), (35)(48) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮1.2.2.1 and 𝒮1.2.2.2 defined in (49) and (50) below,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒casesStep 1.2.2.1: considering β as a parameter, find α𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒satisfying 𝒮1.2.2.1 as a function of [β,𝜻,], for𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 𝒮1.2.2.1:={(34), (35)},(49) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Step 1.2.2.2: using results of Step 1.2.2.1, find β 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒satisfying 𝒮1.2.2.2 as a function of [𝜻,],𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮1.2.2.2:={(26),(7b),(33b)},(50) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Step 2: Using results of Steps 1.1 and 1.2, find [T,𝜻]𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 satisfying 𝒮2.1𝒮2.2 as a function of “” through Steps 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 2.1 and 2.2 below, where 𝒮2.1𝒮2.2:=𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒{(24), (29), (11a), (33e)},(51) 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮2.1 and 𝒮2.2 defined in (52) and (53) below,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒casesStep 2.1: considering T as a parameter, find 𝜻 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒satisfying 𝒮2.1 as a function of [T,],𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮2.1:={(29), (11a), (33e)},(52)𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒Step 2.2: using results of Steps 1.1 and 1.2, find T 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒satisfying 𝒮2.2 as a function of “”,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒for 𝒮2.2:={(24)},(53)𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒\textstyle\begin{cases}\textnormal{{Step 1:} Considering $\bm{\zeta}$ as an % parameter, find $[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}}$,}\\ \textnormal{$\bm{f}^{\textnormal{VU}},\alpha,\beta,\gamma,\bm{\delta}]$ % satisfying }\textnormal{$\mathcal{S}_{1.1}\cup\mathcal{S}_{1.2.1}\cup\mathcal{% S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}$}\\ \textnormal{as functions of $[\bm{\zeta},\textnormal{\small$\bigstar$}]$ % through Steps 1.1 and 1.2 below, }\\ \textnormal{where}\mathcal{S}_{1.1}\cup\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2% .2.1}\cup\mathcal{S}_{1.2.2.2}=\\ \bigg{\{}\begin{array}[]{l}\textnormal{(\ref{Stationaritybn}), (\ref{% Stationaritypn}), (\ref{partialLpartialfMS}), (\ref{partialLpartialfVU}), (% \ref{Complementarybeta}), (\ref{Complementarygamma}), (\ref{Complementarydelta% }),}\\[-5.0pt] \textnormal{(\ref{constraintpn})},\textnormal{(\ref{constraintfMS}), {(\ref{% constraintfn})}, (\ref{Dualfeasibility}b), (\ref{Dualfeasibility}c), (\ref{% Dualfeasibility}d), (\ref{Stationaritypn3alpha}), (\ref{Complementaryalpha2})}% \end{array}\bigg{\}},\hfill\textnormal{(44)\hskip 42.0pt}\\ \textnormal{for $\mathcal{S}_{1.1}$, $\mathcal{S}_{1.2.1}$, $\mathcal{S}_{1.2.% 2.1}$ and $\mathcal{S}_{1.2.2.2}$ defined in~{}(45),~{}(47),}\\ \textnormal{(49) and~{}(50) below,}\\ \begin{cases}\textnormal{{Step 1.1}: Find $\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},\gamma,\bm{\delta}$ satisfying $\mathcal{S}_{1.1}$ as}\\ \textnormal{ functions of $[\bm{\zeta},\textnormal{\small$\bigstar$}]$:}\\ \mathcal{S}_{1.1}:=\big{\{}\textnormal{(\ref{partialLpartialfMS}), (\ref{% partialLpartialfVU}), (\ref{Complementarygamma}), (\ref{Complementarydelta}), % {(\ref{constraintfMS})}, {(\ref{constraintfn})}, (\ref{Dualfeasibility}c), (% \ref{Dualfeasibility}d)}\big{\}},\hfill\\ ~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}% ~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}~{}% ~{}~{}~{}~{}~{}~{}~{}\textnormal{(45)\hskip 29.0pt}\\ \textnormal{{Step 1.2}: Find $\bm{b},\bm{p},\alpha,\beta$ satisfying}\\ \textnormal{ $\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2% .2.2}$ as functions of $[\bm{\zeta},\textnormal{\small$\bigstar$}]$ through }% \\ \textnormal{Steps 1.2.1, 1.2.2.1, and 1.2.2.2 below, where }\\ \mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}=\\ \big{\{}\textnormal{(\ref{Stationaritybn}), (\ref{Stationaritypn}), (\ref{% Complementarybeta}), {(\ref{constraintpn})}, (\ref{Dualfeasibility}b), (\ref{% Stationaritypn3alpha}), (\ref{Complementaryalpha2})}\big{\}},\hfill\textnormal% {(46)\hskip 55.0pt}\\ \textnormal{for $\mathcal{S}_{1.2.1}$, $\mathcal{S}_{1.2.2.1}$ and $\mathcal{S% }_{1.2.2.2}$ defined in~{}(47),~{}(49)}\\ \textnormal{and~{}(50) below,}\\ \begin{cases}\textnormal{{Step 1.2.1}: Considering $[\alpha,\beta]$ as % parameters, find}\\ \textnormal{ $\bm{b},\bm{p}$ satisfying $\mathcal{S}_{1.2.1}$ as functions of % $[\alpha,\beta,\bm{\zeta},\textnormal{\small$\bigstar$}]$,}\\ \textnormal{ for $\mathcal{S}_{1.2.1}:=\big{\{}\textnormal{(\ref{% Stationaritybn}), (\ref{Stationaritypn})}\big{\}}$,}\hfill\textnormal{(47)\hskip 15.0pt}\\ \textnormal{{Step 1.2.2}: Using results of Step 1.2.1, find $[\alpha,\beta]$}% \\ \textnormal{ satisfying $\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}$ as % functions of}\\ \textnormal{ $[\bm{\zeta},\textnormal{\small$\bigstar$}]$ through Steps 1.2.2.% 1 and 1.2.2.2 below, }\\ \textnormal{where }\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}=\\ \big{\{}\textnormal{(\ref{Complementarybeta}), {(\ref{constraintpn})}, (\ref{% Dualfeasibility}b), (\ref{Stationaritypn3alpha}), (\ref{Complementaryalpha2})}% \big{\}},\hfill\textnormal{(48)\hskip 15.0pt}\\ \textnormal{for $\mathcal{S}_{1.2.2.1}$ and $\mathcal{S}_{1.2.2.2}$ defined in% ~{}(49) and~{}(50) below,}\\ \begin{cases}\textnormal{{Step 1.2.2.1:} considering $\beta$ as a parameter, % find $\alpha$}\\ \textnormal{satisfying $\mathcal{S}_{1.2.2.1}$ as a function of $[\beta,\bm{% \zeta},\textnormal{\small$\bigstar$}]$, for}\\ \textnormal{ $\mathcal{S}_{1.2.2.1}:=\big{\{}\textnormal{(\ref{Stationaritypn3% alpha}), (\ref{Complementaryalpha2})}\big{\}}$,}\hfill\textnormal{(49)\hskip 1% .0pt}\\ \textnormal{{Step 1.2.2.2}: using results of Step 1.2.2.1, find $\beta$ }\\ \textnormal{satisfying $\mathcal{S}_{1.2.2.2}$ as a function of $[\bm{\zeta},% \textnormal{\small$\bigstar$}]$,}\\ \textnormal{for $\mathcal{S}_{1.2.2.2}:=\big{\{}\textnormal{(\ref{% Complementarybeta})},\textnormal{(\ref{constraintpn})},\textnormal{(\ref{% Dualfeasibility}b)}\big{\}}$,}\hfill\textnormal{(50)\hskip 1.0pt}\\ \end{cases}\end{cases}\end{cases}\\ \textnormal{{Step 2:} Using results of Steps 1.1 and 1.2, find $[T,\bm{\zeta}]% $}\\ \textnormal{ satisfying $\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}$ as a function% of ``$\textnormal{\small$\bigstar$}$'' through Steps }\\ \textnormal{ 2.1 and 2.2 below, where $\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}:% =$}\\ \textnormal{$\big{\{}\textnormal{(\ref{partialLpartialT}), (\ref{% Complementarytime}), (\ref{constraintTtau}), (\ref{Dualfeasibility}e)}\big{\}}% $,}\hskip 115.0pt\textnormal{(51)~{}}\\ \textnormal{for $\mathcal{S}_{2.1}$ and $\mathcal{S}_{2.2}$ defined in~{}(52) % and~{}(53) below,}\\ \begin{cases}\textnormal{{Step 2.1}: considering $T$ as a parameter, find $\bm% {\zeta}$ }\\ \textnormal{satisfying $\mathcal{S}_{2.1}$ as a function of $[T,\textnormal{% \small$\bigstar$}]$,}\\ \textnormal{for $\mathcal{S}_{2.1}:=\big{\{}\textnormal{(\ref{% Complementarytime}), (\ref{constraintTtau}), (\ref{Dualfeasibility}e)}\big{\}}% $,}\hfill\textnormal{(52)}\\ \textnormal{{Step 2.2}: using results of Steps 1.1 and 1.2, find $T$ }\\ \textnormal{satisfying $\mathcal{S}_{2.2}$ as a function of ``$\textnormal{% \small$\bigstar$}$'',}\\ \textnormal{for $\mathcal{S}_{2.2}:=\{\textnormal{(\ref{partialLpartialT})}\}$% ,}\hfill\textnormal{(53)}\end{cases}\end{cases}{ start_ROW start_CELL bold_typewriter_Step bold_typewriter_1: Considering bold_italic_ζ as an parameter, find [ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL fVU,α,β,γ,δ] satisfying S1.1∪S1.2.1∪S1.2.2.1∪S1.2.2.2 end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL as functions of [ bold_italic_ζ , ★ ] through Steps 1.1 and 1.2 below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL where caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT = end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { start_ARRAY start_ROW start_CELL ( ), ( ), ( ), ( ), ( ), ( ), ( ), end_CELL end_ROW start_ROW start_CELL ( ) , ( ), ( ), ( b), ( c), ( d), ( ), ( ) end_CELL end_ROW end_ARRAY } , (44) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT and caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (45), (47), end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL (49) and (50) below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.1 : Find bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ satisfying caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT as end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL functions of [ bold_italic_ζ , ★ ] : end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT := { ( ), ( ), ( ), ( ), ( ), ( ), ( c), ( d) } , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL (45) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.2 : Find bold_italic_b , bold_italic_p , italic_α , italic_β satisfying end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT as functions of [ bold_italic_ζ , ★ ] through end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL Steps 1.2.1, 1.2.2.1, and 1.2.2.2 below, where end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT = end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { ( ), ( ), ( ), ( ), ( b), ( ), ( ) } , (46) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT and caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (47), (49) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL and (50) below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.2.1 : Considering [ italic_α , italic_β ] as parameters, find end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_italic_b , bold_italic_p satisfying caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT as functions of [ italic_α , italic_β , bold_italic_ζ , ★ ] , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT := { ( ), ( ) } , (47) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.2.2 : Using results of Step 1.2.1, find [ italic_α , italic_β ] end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT as functions of end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL [ bold_italic_ζ , ★ ] through Steps 1.2.2.1 and 1.2.2.2 below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL where caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT = end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { ( ), ( ), ( b), ( ), ( ) } , (48) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT and caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (49) and (50) below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.2.2.1: considering italic_β as a parameter, find italic_α end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT as a function of [ italic_β , bold_italic_ζ , ★ ] , for end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT := { ( ), ( ) } , (49) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_typewriter_Step bold_typewriter_1.2.2.2 : using results of Step 1.2.2.1, find italic_β end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT as a function of [ bold_italic_ζ , ★ ] , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT := { ( ) , ( ) , ( b) } , (50) end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_typewriter_Step bold_typewriter_2: Using results of Steps 1.1 and 1.2, find [ italic_T , bold_italic_ζ ] end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT as a function of “ ★ ” through Steps end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL 2.1 and 2.2 below, where caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT := end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { ( ), ( ), ( ), ( e) } , (51) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT and caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined in (52) and (53) below, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL { start_ROW start_CELL bold_typewriter_Step bold_typewriter_2.1 : considering italic_T as a parameter, find bold_italic_ζ end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT as a function of [ italic_T , ★ ] , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT := { ( ), ( ), ( e) } , (52) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL bold_typewriter_Step bold_typewriter_2.2 : using results of Steps 1.1 and 1.2, find italic_T end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL satisfying caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT as a function of “ ★ ”, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL for caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT := { ( ) } , (53) end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW
(54)

Steps 1.1, 1.2.1, 1.2.2.1, 1.2.2.2, 2.1, and 2.2 use 𝒮1.1,𝒮1.2.1,𝒮1.2.2.1,𝒮1.2.2.2,𝒮2.1,subscript𝒮1.1subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2subscript𝒮2.1\mathcal{S}_{1.1},\mathcal{S}_{1.2.1},\mathcal{S}_{1.2.2.1},\mathcal{S}_{1.2.2% .2},\mathcal{S}_{2.1},caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT , caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT , and 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT, respectively. Each step uses a subset of the KKT conditions 𝒮KKTsubscript𝒮𝐾𝐾𝑇\mathcal{S}_{KKT}caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT (defined in (43)) of Problem 5()subscript5\mathbb{P}_{5}(\textnormal{\footnotesize$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ), and all steps combined together utilize all the conditions, since it holds from (45), (47), (49), (50), (52) and (53) that

𝒮1.1𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2𝒮2.1𝒮2.2subscript𝒮1.1subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2subscript𝒮2.1subscript𝒮2.2\textstyle\mathcal{S}_{1.1}\cup\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}% \cup\mathcal{S}_{1.2.2.2}\cup\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT (55)
=KKT conditions 𝒮KKT in (43).absentKKT conditions 𝒮KKT in (43).\textstyle=\textnormal{KKT conditions $\mathcal{S}_{KKT}$ in (\ref{KKTP5}).}= KKT conditions caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT in ( ).

We introduce notations to denote the computed results in the steps. The goal is to obtain

[𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),α#(),β#(),γ#(),𝜹#(),𝜻#()],denoting a solution of[𝒃,𝒑,𝒇MS,𝒇VU,T,α,β,γ,𝜹,𝜻] to the KKT conditions 𝒮KKT in (43);i.e., [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#()]denotes a global optimum to 5().[𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),α#(),β#(),γ#(),𝜹#(),𝜻#()],denoting a solution of[𝒃,𝒑,𝒇MS,𝒇VU,T,α,β,γ,𝜹,𝜻] to the KKT conditions 𝒮KKT in (43);i.e., [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#()]denotes a global optimum to 5().\textstyle\begin{array}[]{l}\textnormal{$[\bm{b}^{\#}(\textnormal{\small$% \bigstar$}),\bm{p}^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{MS% }})^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(% \textnormal{\small$\bigstar$}),T^{\#}(\textnormal{\small$\bigstar$}),\alpha^{% \#}(\textnormal{\small$\bigstar$})$,}\\ \textnormal{$\beta^{\#}(\textnormal{\small$\bigstar$}),\gamma^{\#}(\textnormal% {\small$\bigstar$}),\bm{\delta}^{\#}(\textnormal{\small$\bigstar$}),\bm{\zeta}% ^{\#}(\textnormal{\small$\bigstar$})]$,}\textnormal{denoting a solution of}\\ \textnormal{$[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},% T,\alpha,\beta,\gamma,\bm{\delta},\bm{\zeta}]$ to the KKT conditions }\\ \textnormal{$\mathcal{S}_{KKT}$ in (\ref{KKTP5});}\\ \textnormal{i.e., $[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(% \textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{% \small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar% $}),T^{\#}(\textnormal{\small$\bigstar$})]$}\\ \textnormal{denotes a global optimum to $\mathbb{P}_{5}(\textnormal{\small$% \bigstar$})$.}\end{array}start_ARRAY start_ROW start_CELL [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL β#(★),γ#(★),δ#(★),ζ#(★)], denoting a solution of end_CELL end_ROW start_ROW start_CELL [ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T , italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ ] to the KKT conditions end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT in ( ); end_CELL end_ROW start_ROW start_CELL i.e., [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL denotes a global optimum to blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) . end_CELL end_ROW end_ARRAY (62)

For X being 1.1, 1.2, 1.2.1, 1.2.2.1, 1.2.2.2, 2.1, or 2.2, Proposition X below is a formal presentation of Step X above. For better clarity, we also present the following table to help understand notations.

TABLE II: Notes for notations, where “   ” denotes a wildcard symbol hereinafter for convenience.
Notations Notes
\bigstar Represent “𝒛,y,𝒔𝒛𝑦𝒔\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s
 ´()´ \acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations Defined in Propositions 1.1 and 1.2
 #()superscript #\rule{5.0pt}{6.99997pt}^{\#}(\cdot)start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ⋅ ),  ~()~ \widetilde{\rule{5.0pt}{6.99997pt}}(\cdot)over~ start_ARG end_ARG ( ⋅ ),  ˘()˘ \breve{\rule{5.0pt}{6.99997pt}}(\cdot)over˘ start_ARG end_ARG ( ⋅ ),  `()` \grave{\rule{5.0pt}{6.99997pt}}(\cdot)over` start_ARG end_ARG ( ⋅ )
Defined in (62), and Propositions 1.2.1, 1.2.2.1, and 2.1, respectively
Proposition 1.1.

We have the following results which formally explain Step 1.1 of Page 54.
(i) Given “normal-★\bigstar”, if in 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT defined in (45), we substitute 𝛇𝛇\bm{\zeta}bold_italic_ζ with 𝛇#()superscript𝛇normal-#normal-★\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) defined in (62), then
[𝐟MS,𝐟VU,γ,𝛅]superscript𝐟MSsuperscript𝐟VU𝛾𝛅[\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\gamma,\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ ] satisfying 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT is [(𝐟MS)#(),(𝐟VU)#(),γ#(),𝛅#()]superscriptsuperscript𝐟MSnormal-#normal-★superscriptsuperscript𝐟VUnormal-#normal-★superscript𝛾normal-#normal-★superscript𝛅normal-#normal-★[(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{% \textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),\gamma^{\#}(\textnormal{% \small$\bigstar$}),\bm{\delta}^{\#}(\textnormal{\small$\bigstar$})][ ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] defined in (62).
(ii) Given “normal-★\bigstar” and 𝛇𝛇\bm{\zeta}bold_italic_ζ, let the solution of [𝐟MS,𝐟VU,γ,𝛅]superscript𝐟MSsuperscript𝐟VU𝛾𝛅[\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\gamma,\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ ] to 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT be[𝐟´MS(𝛇),𝐟´VU(𝛇),γ´(𝛇),𝛅´(𝛇)]superscriptnormal-´𝐟MSconditional𝛇normal-★superscriptnormal-´𝐟VUconditional𝛇normal-★normal-´𝛾conditional𝛇normal-★normal-´𝛅conditional𝛇normal-★[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\gamma}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{\delta% }}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ]. Then

[𝒇´MS(𝜻#()),𝒇´VU(𝜻#()),γ´(𝜻#())[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$% })\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{% \zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$}),% \acute{\gamma}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$})[ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ),
𝜹´(𝜻#())]\acute{\bm{\delta}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid% \textnormal{\small$\bigstar$})]over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ] = [(𝒇MS)#(),(𝒇VU)#(),γ#(),𝜹#()]superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#superscript𝛾#superscript𝜹#[(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{% \textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),\gamma^{\#}(\textnormal{% \small$\bigstar$}),\bm{\delta}^{\#}(\textnormal{\small$\bigstar$})][ ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ]. (63)

Proof of Proposition 1.1: Given “\bigstar” and 𝜻𝜻\bm{\zeta}bold_italic_ζ, the conditions in 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT of (45) are necessary and sufficient to decide [𝒇MS,𝒇VU,γ,𝜹]superscript𝒇MSsuperscript𝒇VU𝛾𝜹[\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\gamma,\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ ]. Since setting [𝜻,𝒇MS,𝒇VU,γ,𝜹]𝜻superscript𝒇MSsuperscript𝒇VU𝛾𝜹[\bm{\zeta},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\gamma,\bm{% \delta}][ bold_italic_ζ , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ ] as [𝜻#(),(𝒇MS)#(),(𝒇VU)#(),γ#(),𝜹#()]superscript𝜻#superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#superscript𝛾#superscript𝜹#[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#% }(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{% \small$\bigstar$}),\gamma^{\#}(\textnormal{\small$\bigstar$}),\bm{\delta}^{\#}% (\textnormal{\small$\bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT due to (62), Results (i) and (ii) of Proposition 1.1 clearly hold. ∎

Proposition 1.2.

We have the following results, which formally explain Step 1.2 of Page 54.
(i) Given “normal-★\bigstar”, if in 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (46), we substitute 𝛇𝛇\bm{\zeta}bold_italic_ζ with 𝛇#()superscript𝛇normal-#normal-★\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) defined in (62), then [𝐛,𝐩,α,β]𝐛𝐩𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ] satisfying 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT is [𝐛#(),𝐩#(),α#(),β#()]superscript𝐛normal-#normal-★superscript𝐩normal-#normal-★superscript𝛼normal-#normal-★superscript𝛽normal-#normal-★[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$}),\alpha^{\#}(\textnormal{\small$\bigstar$}),\beta^{\#}(\textnormal{% \small$\bigstar$})][ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] defined in (62).
(ii) Given “normal-★\bigstar” and 𝛇𝛇\bm{\zeta}bold_italic_ζ, let the solution of [𝐛,𝐩,α,β]𝐛𝐩𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ] to 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT
be [𝐛´(𝛇),𝐩´(𝛇),α´(𝛇),β´(𝛇)]normal-´𝐛conditional𝛇normal-★normal-´𝐩conditional𝛇normal-★normal-´𝛼conditional𝛇normal-★normal-´𝛽conditional𝛇normal-★[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ]. Then

[𝒃´(𝜻#()),𝒑´(𝜻#()),α´(𝜻#())[\acute{\bm{b}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$% })\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}^{\#}(% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$})[ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ),β´(𝜻#())]\acute{\beta}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$})]over´ start_ARG italic_β end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ]
=[𝒃#(),𝒑#(),α#(),β#()].absent[𝒃#(),𝒑#(),α#(),β#()].\textstyle=\textnormal{$[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#% }(\textnormal{\small$\bigstar$}),\alpha^{\#}(\textnormal{\small$\bigstar$}),% \beta^{\#}(\textnormal{\small$\bigstar$})]$.}= [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] . (64)

Proof of Proposition 1.2: Given “\bigstar” and 𝜻𝜻\bm{\zeta}bold_italic_ζ, the conditions in 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT of (46) are necessary and sufficient to decide [𝒃,𝒑,α,β]𝒃𝒑𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ]. Since setting [𝜻,𝒃,𝒑,α,β]𝜻𝒃𝒑𝛼𝛽[\bm{\zeta},\bm{b},\bm{p},\alpha,\beta][ bold_italic_ζ , bold_italic_b , bold_italic_p , italic_α , italic_β ] as [𝜻#(),𝒃#(),𝒑#(),α#(),β#()]superscript𝜻#superscript𝒃#superscript𝒑#superscript𝛼#superscript𝛽#[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),\bm{b}^{\#}(\textnormal{\small% $\bigstar$}),\bm{p}^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(% \textnormal{\small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT due to (62), Results (i) and (ii) of Proposition 1.2 clearly hold. ∎

Proposition 1.2.1.

We have the following result which formally explains Step 1.2.1 of Page 54.
(i) Given “normal-★\bigstar” and 𝛇𝛇\bm{\zeta}bold_italic_ζ, if in 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT defined in (47), we substitute [α,β]𝛼𝛽[\alpha,\beta][ italic_α , italic_β ] with [α´(𝛇),β´(𝛇)]normal-´𝛼conditional𝛇normal-★normal-´𝛽conditional𝛇normal-★[\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm% {\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2, then [𝐛,𝐩]𝐛𝐩[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ] satisfying 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT is [𝐛´(𝛇),𝐩´(𝛇)]normal-´𝐛conditional𝛇normal-★normal-´𝐩conditional𝛇normal-★[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.
(ii) Given “normal-★\bigstar” and [α,β,𝛇]𝛼𝛽𝛇[\alpha,\beta,\bm{\zeta}][ italic_α , italic_β , bold_italic_ζ ], let the solution of [𝐛,𝐩]𝐛𝐩[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ] to 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT be [𝐛~(α,β,𝛇),𝐩~(α,β,𝛇)]normal-~𝐛𝛼𝛽conditional𝛇normal-★normal-~𝐩𝛼𝛽conditional𝛇normal-★[\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ]. Then

[𝒃~(α´(𝜻),β´(𝜻),𝜻),𝒑~(α´(𝜻),β´(𝜻),𝜻)]~𝒃´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻~𝒑´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻[\widetilde{\bm{b}}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}% ),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\acute{\alpha}(\bm{\zeta}% \mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) ]
= [𝒃´(𝜻),𝒑´(𝜻)].absent [𝒃´(𝜻),𝒑´(𝜻)].\textstyle=\textnormal{ $[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})]$.}= [ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ] . (65)

Proof of Proposition 1.2.1: Given “\bigstar” and [α,β,𝜻]𝛼𝛽𝜻[\alpha,\beta,\bm{\zeta}][ italic_α , italic_β , bold_italic_ζ ], the conditions in 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT of (47) are necessary and sufficient to decide [𝒃,𝒑]𝒃𝒑[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ]. Since setting [𝒃,𝒑,α,β]𝒃𝒑𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ] as [𝒃´(𝜻),𝒑´(𝜻),α´(𝜻),β´(𝜻)]´𝒃conditional𝜻´𝒑conditional𝜻´𝛼conditional𝜻´𝛽conditional𝜻[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] satisfies 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT by the  ´()´ \acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations in Proposition 1.2, Results (i) and (ii) of Proposition 1.2.1 clearly hold. ∎

Proposition 1.2.2.

We have the following result which formally explains Step 1.2.2 of Page 54.
Given “normal-★\bigstar” and [α,β,𝛇]𝛼𝛽𝛇[\alpha,\beta,\bm{\zeta}][ italic_α , italic_β , bold_italic_ζ ], if in 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT given in (48), we substitute [𝐛,𝐩]𝐛𝐩[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ]
with [𝐛~(α,β,𝛇),𝐩~(α,β,𝛇)]normal-~𝐛𝛼𝛽conditional𝛇normal-★normal-~𝐩𝛼𝛽conditional𝛇normal-★[\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.1, then [α,β]𝛼𝛽[\alpha,\beta][ italic_α , italic_β ] satisfying 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT is [α´(𝛇),β´(𝛇)]normal-´𝛼conditional𝛇normal-★normal-´𝛽conditional𝛇normal-★[\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm% {\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.

Proof of Proposition 1.2.2: Given “\bigstar” and [α,β,𝜻]𝛼𝛽𝜻[\alpha,\beta,\bm{\zeta}][ italic_α , italic_β , bold_italic_ζ ], if in 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT of (48), we substitute [𝒃,𝒑]𝒃𝒑[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ] with [𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)]~𝒃𝛼𝛽conditional𝜻~𝒑𝛼𝛽conditional𝜻[\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.1, the conditions in 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT of (48) are necessary and sufficient to decide [α,β]𝛼𝛽[\alpha,\beta][ italic_α , italic_β ]. Since setting [𝒃,𝒑,α,β]𝒃𝒑𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ] as
[𝒃~(α´(𝜻),β´(𝜻),𝜻),𝒑~(α´(𝜻),β´(𝜻),𝜻),α´(𝜻),β´(𝜻)]~𝒃´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻~𝒑´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻´𝛼conditional𝜻´𝛽conditional𝜻[\widetilde{\bm{b}}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}% ),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\acute{\alpha}(\bm{\zeta}% \mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ]
(i.e., [𝒃´(𝜻),𝒑´(𝜻),α´(𝜻),β´(𝜻)]´𝒃conditional𝜻´𝒑conditional𝜻´𝛼conditional𝜻´𝛽conditional𝜻[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] according to (65)) satisfies 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT by the definition of the  ´()´ \acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations in Proposition 1.2, Proposition 1.2.2 clearly follows. ∎

Despite Proposition 1.2.2, simultaneously solving for [α,β]𝛼𝛽[\alpha,\beta][ italic_α , italic_β ] to 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT is challenging. Instead, we solve for α𝛼\alphaitalic_α as a function of β𝛽\betaitalic_β first and then decide β𝛽\betaitalic_β in Propositions 1.2.2.1 and 1.2.2.2 below.

Proposition 1.2.2.1.

We have the following results which formally explain Step 1.2.2.1 of Page 54.
(i) Given “normal-★\bigstar” and 𝛇𝛇\bm{\zeta}bold_italic_ζ, if in 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT defined in (49), we substitute 𝐛𝐛\bm{b}bold_italic_b with 𝐛~(α,β´(𝛇),𝛇)normal-~𝐛𝛼normal-´𝛽conditional𝛇normal-★conditional𝛇normal-★\widetilde{\bm{b}}(\alpha,\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_b end_ARG ( italic_α , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ), then α𝛼\alphaitalic_α satisfying 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT is α´(𝛇)normal-´𝛼conditional𝛇normal-★\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ), where the  ´()normal-´ normal-⋅\acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) and  ~()normal-~ normal-⋅\widetilde{\rule{5.0pt}{6.99997pt}}(\cdot)over~ start_ARG end_ARG ( ⋅ ) notations are defined in Propositions 1.2 and 1.2.1.
(ii) Given “normal-★\bigstar” and 𝛇𝛇\bm{\zeta}bold_italic_ζ, if in 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT, we substitute 𝐛𝐛\bm{b}bold_italic_b with 𝐛~(α,β,𝛇)normal-~𝐛𝛼𝛽conditional𝛇normal-★\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) defined in Proposition 1.2.1, let the solution of α𝛼\alphaitalic_α to 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT be α˘(β,𝛇)normal-˘𝛼𝛽conditional𝛇normal-★\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ). Then

α˘(β´(𝜻),𝜻)˘𝛼´𝛽conditional𝜻conditional𝜻\breve{\alpha}(\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{% \zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) equals α´(𝜻)´𝛼conditional𝜻\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ), and (66)
[𝒃~(α˘(β´(𝜻),𝜻),β´(𝜻),𝜻),𝒑~(α˘(β´(𝜻),𝜻),[\widetilde{\bm{b}}(\breve{\alpha}(\acute{\beta}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\acute{\beta}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$}),[ over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) ,
β´(𝜻),𝜻)]\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$})]over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) ] equals [𝒃´(𝜻),𝒑´(𝜻)]´𝒃conditional𝜻´𝒑conditional𝜻[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ]. (67)

Proof of Proposition 1.2.2.1: Given “\bigstar” and 𝜻𝜻\bm{\zeta}bold_italic_ζ, if in 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT defined in (49), we substitute 𝒃𝒃\bm{b}bold_italic_b with 𝒃~(α,β´(𝜻),𝜻)~𝒃𝛼´𝛽conditional𝜻conditional𝜻\widetilde{\bm{b}}(\alpha,\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_b end_ARG ( italic_α , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ), then the conditions in 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT of (49) are necessary and sufficient to decide α𝛼\alphaitalic_α. Since setting α𝛼\alphaitalic_α as α´(𝜻)´𝛼conditional𝜻\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) and setting 𝒃𝒃\bm{b}bold_italic_b as 𝒃~(α´(𝜻),β´(𝜻),𝜻)~𝒃´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻\widetilde{\bm{b}}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$})over~ start_ARG bold_italic_b end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) (i.e., 𝒃´(𝜻)´𝒃conditional𝜻\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) according to (65)) satisfies 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT by the definition of the  ´()´ \acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations in Proposition 1.2, Proposition 1.2.2.1 clearly follows. In particular, after we have (66), we further obtain (67) from (65) and (66).∎

Proposition 1.2.2.2.

We have the following result which formally explains Step 1.2.2.2 of Page 54.
Given “normal-★\bigstar”, if in 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (50), we substitute 𝐩𝐩\bm{p}bold_italic_p with 𝐩~(α˘(β,𝛇),β,𝛇)normal-~𝐩normal-˘𝛼𝛽conditional𝛇normal-★𝛽conditional𝛇normal-★\widetilde{\bm{p}}(\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ), then β𝛽\betaitalic_β satisfying 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT is β´(𝛇)normal-´𝛽conditional𝛇normal-★\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ), where  ˘()normal-˘ normal-⋅\breve{\rule{5.0pt}{6.99997pt}}(\cdot)over˘ start_ARG end_ARG ( ⋅ ),  ~()normal-~ normal-⋅\widetilde{\rule{5.0pt}{6.99997pt}}(\cdot)over~ start_ARG end_ARG ( ⋅ ), and  ´()normal-´ normal-⋅\acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations are defined in Propositions 1.2.2.1, 1.2.1, and 1.2.

Proof of Proposition 1.2.2.2: Given “\bigstar”, if in 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT defined in (50), we substitute 𝒑𝒑\bm{p}bold_italic_p with 𝒑~(α˘(β,𝜻),β,𝜻)~𝒑˘𝛼𝛽conditional𝜻𝛽conditional𝜻\widetilde{\bm{p}}(\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ), then the conditions in 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT of (50) are necessary and sufficient to decide β𝛽\betaitalic_β. Since setting β𝛽\betaitalic_β as β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) and setting 𝒑𝒑\bm{p}bold_italic_p as 𝒑~(α˘(β´(𝜻),𝜻),β´(𝜻),𝜻)~𝒑˘𝛼´𝛽conditional𝜻conditional𝜻´𝛽conditional𝜻conditional𝜻\widetilde{\bm{p}}(\breve{\alpha}(\acute{\beta}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$% \bigstar$})over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) (i.e., 𝒑´(𝜻)´𝒑conditional𝜻\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) based on (66) and (67)) satisfies 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT by the  ´()´ \acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations in Proposition 1.2, Proposition 1.2.2.2 clearly follows. ∎

Proposition 2.

We have the following result which formally explains Step 2 of Page 54.
Given “normal-★\bigstar”, if in 𝒮2.1𝒮2.2subscript𝒮2.1subscript𝒮2.2\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined in (51), we substitute [𝐛,𝐩,𝐟MS,𝐟VU,α,β,γ,𝛅]𝐛𝐩superscript𝐟MSsuperscript𝐟VU𝛼𝛽𝛾𝛅[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\alpha,\beta,% \gamma,\bm{\delta}][ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_α , italic_β , italic_γ , bold_italic_δ ] with
[𝐛´(𝛇),𝐩´(𝛇),𝐟´MS(𝛇),𝐟´VU(𝛇),α´(𝛇),β´(𝛇),γ´(𝛇),𝛅´(𝛇)]normal-´𝐛conditional𝛇normal-★normal-´𝐩conditional𝛇normal-★superscriptnormal-´𝐟MSconditional𝛇normal-★superscriptnormal-´𝐟VUconditional𝛇normal-★normal-´𝛼conditional𝛇normal-★normal-´𝛽conditional𝛇normal-★normal-´𝛾conditional𝛇normal-★normal-´𝛅conditional𝛇normal-★[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\acute{\gamma}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute% {\bm{\delta}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Propositions 1.1 and 1.2, then [𝛇,T]𝛇𝑇[\bm{\zeta},T][ bold_italic_ζ , italic_T ] satisfying 𝒮2.1𝒮2.2subscript𝒮2.1subscript𝒮2.2\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT is [𝛇#(),T#()]superscript𝛇normal-#normal-★superscript𝑇normal-#normal-★[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(\textnormal{\small$% \bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] defined in (62).

Despite Proposition 2, simultaneously solving for [𝜻,T]𝜻𝑇[\bm{\zeta},T][ bold_italic_ζ , italic_T ] to 𝒮1.2.2.1𝒮1.2.2.2subscript𝒮1.2.2.1subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT is challenging. Instead, we solve for ζ𝜁\zetaitalic_ζ as a function of T𝑇Titalic_T first and then decide T𝑇Titalic_T in Propositions 2.1 and 2.2 below.

Proposition 2.1.

We have the following result which formally explains Step 2.1 of Page 54.
(i) Given “normal-★\bigstar”, if in 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT defined in (52), we substitute [T,𝐛,𝐩,𝐟MS,𝐟VU]𝑇𝐛𝐩superscript𝐟MSsuperscript𝐟VU[T,\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ italic_T , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] with
[T#(),𝐛´(𝛇),𝐩´(𝛇),𝐟´MS(𝛇),𝐟´VU(𝛇)]superscript𝑇normal-#normal-★normal-´𝐛conditional𝛇normal-★normal-´𝐩conditional𝛇normal-★superscriptnormal-´𝐟MSconditional𝛇normal-★superscriptnormal-´𝐟VUconditional𝛇normal-★[T^{\#}(\textnormal{\small$\bigstar$}),\acute{\bm{b}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$})][ italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ], then 𝛇𝛇\bm{\zeta}bold_italic_ζ satisfying 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT is 𝛇#()superscript𝛇normal-#normal-★\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ), where the  #()superscript normal-#normal-⋅\rule{5.0pt}{6.99997pt}^{\#}(\cdot)start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ⋅ ) and  ´()normal-´ normal-⋅\acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ) notations are defined in (62) and Proposition 1.2 respectively.
(ii) Given “normal-★\bigstar”, if in 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT defined in (52), we substitute [𝐛,𝐩,𝐟MS,𝐟VU]𝐛𝐩superscript𝐟MSsuperscript𝐟VU[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] with
[𝐛´(𝛇),𝐩´(𝛇),𝐟´MS(𝛇),𝐟´VU(𝛇)]normal-´𝐛conditional𝛇normal-★normal-´𝐩conditional𝛇normal-★superscriptnormal-´𝐟MSconditional𝛇normal-★superscriptnormal-´𝐟VUconditional𝛇normal-★[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ], let the solution of 𝛇𝛇\bm{\zeta}bold_italic_ζ to 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT be 𝛇`(T)normal-`𝛇conditional𝑇normal-★\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ). Then

𝜻`(T#())`𝜻conditionalsuperscript𝑇#\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{\small% $\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) equals 𝜻#()superscript𝜻#\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ), and (68)
[𝒃´(𝜻`(T#()|)|),𝒑´(𝜻`(T#()|)|),𝒇´MS(𝜻`(T#()|)|),\textstyle[\acute{\bm{b}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$% \bigstar$}})|\textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),% \acute{\bm{p}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$\bigstar$}})|% \textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),\acute{\bm{f}}% ^{\textnormal{MS}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$\bigstar$}})|% \textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),[ over´ start_ARG bold_italic_b end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) , over´ start_ARG bold_italic_p end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) ,
𝒇´VU(𝜻`(T#()|)|),α´(𝜻`(T#()|)|),β´(𝜻`(T#()|)|),superscript´𝒇VUconditional`𝜻conditionalsuperscript𝑇#´𝛼conditional`𝜻conditionalsuperscript𝑇#´𝛽conditional`𝜻conditionalsuperscript𝑇#\textstyle\acute{\bm{f}}^{\textnormal{VU}}(\grave{\bm{\zeta}}(T^{\#}(% \textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}})|\textnormal{{% \tiny$\bigstar$}}),\acute{\alpha}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny% $\bigstar$}})|\textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),% \acute{\beta}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$\bigstar$}})|% \textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) , over´ start_ARG italic_α end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) , over´ start_ARG italic_β end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) ,
γ´(𝜻`(T#()|)|),𝜹´(𝜻`(T#()|)|)]\textstyle\acute{\gamma}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$\bigstar% $}})|\textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}}),\acute{% \bm{\delta}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{{\tiny$\bigstar$}})|% \textnormal{{\tiny$\bigstar$}})|\textnormal{{\tiny$\bigstar$}})]over´ start_ARG italic_γ end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) , over´ start_ARG bold_italic_δ end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) | ★ ) | ★ ) ]
equals [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(% \bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),[ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ,
α#(),β#(),γ#(),𝜹#()]\alpha^{\#}(\textnormal{\small$\bigstar$}),\beta^{\#}(\textnormal{\small$% \bigstar$}),\gamma^{\#}(\textnormal{\small$\bigstar$}),\bm{\delta}^{\#}(% \textnormal{\small$\bigstar$})]italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ]. (69)

Proof of Proposition 2.1: Given “\bigstar”, if in 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT defined in (52), we substitute [T,𝒃,𝒑,𝒇MS,𝒇VU]𝑇𝒃𝒑superscript𝒇MSsuperscript𝒇VU[T,\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ italic_T , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] with [T#(),𝒃´(𝜻),𝒑´(𝜻),𝒇´MS(𝜻),𝒇´VU(𝜻)]superscript𝑇#´𝒃conditional𝜻´𝒑conditional𝜻superscript´𝒇MSconditional𝜻superscript´𝒇VUconditional𝜻[T^{\#}(\textnormal{\small$\bigstar$}),\acute{\bm{b}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$})][ italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ], then the conditions in 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT of (52) are necessary and sufficient to decide 𝜻𝜻\bm{\zeta}bold_italic_ζ. Since setting [𝜻,T,𝒃,𝒑,𝒇MS,𝒇VU]𝜻𝑇𝒃𝒑superscript𝒇MSsuperscript𝒇VU[\bm{\zeta},T,\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_ζ , italic_T , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] as [𝜻#(),T#(),𝒃´(𝜻#()),𝒑´(𝜻#()),𝒇´MS(𝜻#()),𝒇´VU(𝜻#())]superscript𝜻#superscript𝑇#´𝒃conditionalsuperscript𝜻#´𝒑conditionalsuperscript𝜻#superscript´𝒇MSconditionalsuperscript𝜻#superscript´𝒇VUconditionalsuperscript𝜻#[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(\textnormal{\small$% \bigstar$}),\acute{\bm{b}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$})\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{% \textnormal{MS}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal% {\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}^{\#}(% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ] (i.e., [𝜻#(),T#(),𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#()]superscript𝜻#superscript𝑇#superscript𝒃#superscript𝒑#superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(\textnormal{\small$% \bigstar$}),\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] according to (63) and (64)) satisfies 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT by the  #()superscript #\rule{5.0pt}{6.99997pt}^{\#}(\cdot)start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ⋅ ) notations in (62), Proposition 2.1 clearly follows. ∎

Proposition 2.2.

We have the following result which formally explains Step 2.2 of Page 54.
Given “normal-★\bigstar”, if in 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined in (53), we substitute [𝛇,𝐛,𝐩,𝐟MS,𝐟VU]𝛇𝐛𝐩superscript𝐟MSsuperscript𝐟VU[\bm{\zeta},\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_ζ , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] with
[𝛇`(T),𝐛´(𝛇`(T)),𝐩´(𝛇`(T)),𝐟´MS(𝛇`(T)),𝐟´VU(𝛇`(T))]normal-`𝛇conditional𝑇normal-★normal-´𝐛conditionalnormal-`𝛇conditional𝑇normal-★normal-★normal-´𝐩conditionalnormal-`𝛇conditional𝑇normal-★normal-★superscriptnormal-´𝐟MSconditionalnormal-`𝛇conditional𝑇normal-★normal-★superscriptnormal-´𝐟VUconditionalnormal-`𝛇conditional𝑇normal-★normal-★[\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$}),\acute{\bm{b}}(\grave{% \bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar% $}),\acute{\bm{p}}(\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})\mid% \textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(\grave{\bm{% \zeta}}(T\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$}),% \acute{\bm{f}}^{\textnormal{VU}}(\grave{\bm{\zeta}}(T\mid\textnormal{\small$% \bigstar$})\mid\textnormal{\small$\bigstar$})][ over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) , over´ start_ARG bold_italic_b end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) ], then T𝑇Titalic_T satisfying 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT is T#()superscript𝑇normal-#normal-★T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ), where  ´()normal-´ normal-⋅\acute{\rule{5.0pt}{6.99997pt}}(\cdot)over´ start_ARG end_ARG ( ⋅ ),  `()normal-` normal-⋅\grave{\rule{5.0pt}{6.99997pt}}(\cdot)over` start_ARG end_ARG ( ⋅ ), and  #()superscript normal-#normal-⋅\rule{5.0pt}{6.99997pt}^{\#}(\cdot)start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ⋅ ) notations are in Proposition 1.2, Proposition 2.1, and (62).

Proof of Proposition 2.2: Given “\bigstar”, if in 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined in (53), we substitute [𝜻,𝒃,𝒑,𝒇MS,𝒇VU]𝜻𝒃𝒑superscript𝒇MSsuperscript𝒇VU[\bm{\zeta},\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_ζ , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] with
[𝜻`(T),𝒃´(𝜻`(T)),𝒑´(𝜻`(T)),𝒇´MS(𝜻`(T)),𝒇´VU(𝜻`(T))]`𝜻conditional𝑇´𝒃conditional`𝜻conditional𝑇´𝒑conditional`𝜻conditional𝑇superscript´𝒇MSconditional`𝜻conditional𝑇superscript´𝒇VUconditional`𝜻conditional𝑇[\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$}),\acute{\bm{b}}(\grave{% \bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar% $}),\acute{\bm{p}}(\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})\mid% \textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{MS}}(\grave{\bm{% \zeta}}(T\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$}),% \acute{\bm{f}}^{\textnormal{VU}}(\grave{\bm{\zeta}}(T\mid\textnormal{\small$% \bigstar$})\mid\textnormal{\small$\bigstar$})][ over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) , over´ start_ARG bold_italic_b end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ∣ ★ ) ], then the conditions in 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT of (53) are necessary and sufficient to decide T𝑇Titalic_T. Since setting [𝜻,T,𝒃,𝒑,𝒇MS,𝒇VU]𝜻𝑇𝒃𝒑superscript𝒇MSsuperscript𝒇VU[\bm{\zeta},T,\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_ζ , italic_T , bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] as
[𝜻`(T#()),𝒃´(𝜻`(T#())),𝒑´(𝜻`(T#())),𝒇´MS(𝜻`(T#())),𝒇´VU(𝜻`(T#()))]`𝜻conditionalsuperscript𝑇#´𝒃conditional`𝜻conditionalsuperscript𝑇#´𝒑conditional`𝜻conditionalsuperscript𝑇#superscript´𝒇MSconditional`𝜻conditionalsuperscript𝑇#superscript´𝒇VUconditional`𝜻conditionalsuperscript𝑇#[\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$}),\acute{\bm{b}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small% $\bigstar$})\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$% }),\acute{\bm{p}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$\bigstar$})\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}% }^{\textnormal{MS}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$\bigstar$})% \mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$}),\acute{% \bm{f}}^{\textnormal{VU}}(\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$% \bigstar$})\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$})][ over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_b end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ∣ ★ ) ] (i.e., [𝜻#(),T#(),𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#()]superscript𝜻#superscript𝑇#superscript𝒃#superscript𝒑#superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#[\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(\textnormal{\small$% \bigstar$}),\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$})][ bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] according to (63) (64) and (68)) satisfies 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT by the definition of the  #()superscript #\rule{5.0pt}{6.99997pt}^{\#}(\cdot)start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ⋅ ) notations in (62), Proposition 2.2 clearly follows. ∎

• Computing [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#()]superscript𝒃#superscript𝒑#superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#superscript𝑇#[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(% \bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(% \textnormal{\small$\bigstar$})][ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ]
which denotes a globally optimal solution to Problem 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) as defined in (62)
Via (69){• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.1: Computing [𝒇´MS(𝜻),𝒇´VU(𝜻),γ´(𝜻),𝜹´(𝜻)] defined in Proposition 1.1,¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2: Computing [𝒃´(𝜻),𝒑´(𝜻)] defined in Proposition 1.2,¯Via (65)• Computing [𝒃~(α´(𝜻),β´(𝜻),𝜻),𝒑~(α´(𝜻),β´(𝜻),𝜻)],{• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.1: Computing [𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)] defined in Proposition 1.2.1,¯• Computing [α´(𝜻),β´(𝜻)] defined in Proposition 1.2Via (66) andProposition 1.2.2.2{• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.2.1¯Computing α˘(β,𝜻) defined in Proposition 1.2.2.1¯(which needs Algorithm 1.2.1 above),• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.2.2:¯use Algorithm 1.2.2.1 to compute β´(𝜻)¯according to Proposition 1.2.2.2.• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 2.1: Computing 𝜻`(T) defined in Proposition 2.1¯, which needs[𝒃´(𝜻),𝒑´(𝜻),𝒇´MS(𝜻),𝒇´VU(𝜻)]; i.e., Algorithms 1.1,1.2.1,1.2.2.1,1.2.2.2 above,• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 2.2: Computing T#() according to Proposition 2.2,¯which needs Algorithm 2.1 as well as Algorithms 1.1,1.2.1,1.2.2.1,1.2.2.2 above.superscriptVia (69)absentcases¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.1: Computing [𝒇´MS(𝜻),𝒇´VU(𝜻),γ´(𝜻),𝜹´(𝜻)] defined in Proposition 1.1,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2: Computing [𝒃´(𝜻),𝒑´(𝜻)] defined in Proposition 1.2,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒superscriptVia (65)absent• Computing [𝒃~(α´(𝜻),β´(𝜻),𝜻),𝒑~(α´(𝜻),β´(𝜻),𝜻)],𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒absentcases¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.1: Computing [𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)] defined in Proposition 1.2.1,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒• Computing [α´(𝜻),β´(𝜻)] defined in Proposition 1.2𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒superscriptVia (66) andProposition 1.2.2.2absentcases¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.2.1¯Computing α˘(β,𝜻) defined in Proposition 1.2.2.1(which needs Algorithm 1.2.1 above),𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 1.2.2.2:¯use Algorithm 1.2.2.1 to compute β´(𝜻)according to Proposition 1.2.2.2.𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 2.1: Computing 𝜻`(T) defined in Proposition 2.1, which needs𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒[𝒃´(𝜻),𝒑´(𝜻),𝒇´MS(𝜻),𝒇´VU(𝜻)]; i.e., Algorithms 1.1,1.2.1,1.2.2.1,1.2.2.2 above,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒¯• 𝙰𝚕𝚐𝚘𝚛𝚒𝚝𝚑𝚖 2.2: Computing T#() according to Proposition 2.2,𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒which needs Algorithm 2.1 as well as Algorithms 1.1,1.2.1,1.2.2.1,1.2.2.2 above.𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒\textstyle\stackrel{{\scriptstyle\textnormal{Via (\ref{eqproposition2.1v2})}}}% {{\Longleftrightarrow}}\begin{cases}\small\underline{\textnormal{\textbullet~{% }{Algorithm} $\text{1.1}$:~{}Computing $[\acute{\bm{f}}^{\textnormal{MS}}(\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\acute{\gamma}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{\delta}}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$})]$ defined in Proposition~{}1.1,}}\\ \small\underline{\textnormal{\textbullet~{}{Algorithm} $\text{1.2}$:~{}% Computing $[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute% {\bm{p}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})]$ defined in Proposition% ~{}1.2,}}\\ \small\stackrel{{\scriptstyle\textnormal{Via (\ref{eqproposition1.2.1})}}}{{% \Longleftrightarrow}}\textnormal{\textbullet~{}Computing $[\widetilde{\bm{b}}(% \acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\beta}(\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\widetilde{\bm{p}}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{% \zeta}\mid\textnormal{\small$\bigstar$})]$,}\\ \Longleftrightarrow\begin{cases}\small\underline{\textnormal{\textbullet~{}{% Algorithm} $\text{1.2.1}$:~{}Computing $[\widetilde{\bm{b}}(\alpha,\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha,\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$})]$ defined in Proposition~{}1.2.1,}}\\ \small\textnormal{\textbullet~{}Computing $[\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})]$ defined in Proposition~{}1.2}\\ \stackrel{{\scriptstyle\begin{subarray}{c}\textnormal{Via (\ref{eqproposition1% .2.2.1v1}) and}\\ \textnormal{Proposition 1.2.2.2}\end{subarray}}}{{\Longleftrightarrow}}\begin{% cases}\small\underline{\textnormal{\textbullet~{}{Algorithm} $\text{1.2.2.1}$:% }}\begin{array}[]{l}\small\underline{\textnormal{Computing $\breve{\alpha}(% \beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})$ defined in Proposition~{}1% .2.2.1}}\\ \small\textnormal{(which needs Algorithm $\text{1.2.1}$ above),}\end{array}\\ \small\underline{\textnormal{\textbullet~{}{Algorithm} $\text{1.2.2.2}$:}}~{}% \begin{array}[]{l}\small\underline{\textnormal{use Algorithm $\text{1.2.2.1}$ % to compute $\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})$}}\\ \small{\textnormal{according to Proposition~{}1.2.2.2.}}\end{array}\end{cases}% \end{cases}\\ \small\underline{\textnormal{\textbullet~{}{Algorithm} $\text{2.1}$:~{}% Computing $\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})$ defined in % Proposition 2.1}}\textnormal{, which needs}\\ \small\textnormal{$[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}% ),\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{% \textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{% \textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})]$; i.e., % Algorithms $\text{1.1},\text{1.2.1},\text{1.2.2.1},\text{1.2.2.2}$ above,}\\ \small\underline{\textnormal{\textbullet~{}{Algorithm} $\text{2.2}$:~{}% Computing $T^{\#}(\textnormal{\small$\bigstar$})$ according to Proposition 2.2% ,}}\\ \small\textnormal{which needs Algorithm $\text{2.1}$ as well as Algorithms $% \text{1.1},\text{1.2.1},\text{1.2.2.1},\text{1.2.2.2}$ above.}\vspace{-10pt}% \end{cases}start_RELOP SUPERSCRIPTOP start_ARG ⟺ end_ARG start_ARG Via ( ) end_ARG end_RELOP { start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 1.1 : Computing [ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.1, end_ARG end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 1.2 : Computing [ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2, end_ARG end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL start_RELOP SUPERSCRIPTOP start_ARG ⟺ end_ARG start_ARG Via ( ) end_ARG end_RELOP • Computing [ over~ start_ARG bold_italic_b end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) ] , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL ⟺ { start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 1.2.1 : Computing [ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.1, end_ARG end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL • Computing [ over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2 end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL start_RELOP SUPERSCRIPTOP start_ARG ⟺ end_ARG start_ARG start_ARG start_ROW start_CELL Via ( ) and end_CELL end_ROW start_ROW start_CELL Proposition 1.2.2.2 end_CELL end_ROW end_ARG end_ARG end_RELOP { start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 1.2.2.1 : end_ARG start_ARRAY start_ROW start_CELL under¯ start_ARG Computing over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) defined in Proposition 1.2.2.1 end_ARG end_CELL end_ROW start_ROW start_CELL (which needs Algorithm 1.2.1 above), end_CELL end_ROW end_ARRAY end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 1.2.2.2 : end_ARG start_ARRAY start_ROW start_CELL under¯ start_ARG use Algorithm 1.2.2.1 to compute over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) end_ARG end_CELL end_ROW start_ROW start_CELL according to Proposition 1.2.2.2. end_CELL end_ROW end_ARRAY end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 2.1 : Computing over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) defined in Proposition 2.1 end_ARG , which needs end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL [ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ] ; i.e., Algorithms 1.1 , 1.2.1 , 1.2.2.1 , 1.2.2.2 above, end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL under¯ start_ARG • bold_typewriter_Algorithm 2.2 : Computing italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) according to Proposition 2.2, end_ARG end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL which needs Algorithm 2.1 as well as Algorithms 1.1 , 1.2.1 , 1.2.2.1 , 1.2.2.2 above. end_CELL start_CELL end_CELL end_ROW
Figure 3: Our procedure to solve Problem 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ).

Based on the above propositions, Fig. 3 and Algorithm 2 present our procedure to solve 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ). For clarity, the function “Alg-Solve-x()𝑥x(\cdot)italic_x ( ⋅ )” is to compute x()𝑥x(\cdot)italic_x ( ⋅ ); e.g., Alg-Solve-T#()Alg-Solve-superscript𝑇#\textnormal{Alg-Solve-}T^{\#}(\textnormal{\small$\bigstar$})Alg-Solve- italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) obtains T#()superscript𝑇#T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ).

Use Alg-Solve-T#()Alg-Solve-superscript𝑇#\textnormal{Alg-Solve-}T^{\#}(\textnormal{\small$\bigstar$})Alg-Solve- italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) of Algorithm 2.2 on Page 10 to obtain T#()superscript𝑇#T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ); Use Algorithm 2.1 on Page 9 to obtain 𝜻`(T#())`𝜻conditionalsuperscript𝑇#\grave{\bm{\zeta}}(T^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{\small% $\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ), which is 𝜻#()superscript𝜻#\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) from (68); Use Algorithm 1.2 on Page VI to obtain [𝒃´(𝜻#()),𝒑´(𝜻#()),α´(𝜻#())]´𝒃conditionalsuperscript𝜻#´𝒑conditionalsuperscript𝜻#´𝛼conditionalsuperscript𝜻#[\acute{\bm{b}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$% })\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}^{\#}(% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ], which equals [𝒃#(),𝒑#()]superscript𝒃#superscript𝒑#[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$})][ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] from (64); //Comment: Algorithm 1.2 uses Algorithms 1.2.1, 1.2.2.1, and 1.2.2.2. Use Algorithm 1.1 on Page 4 to obtain [𝒇´MS(𝜻#()),𝒇´VU(𝜻#())]superscript´𝒇MSconditionalsuperscript𝜻#superscript´𝒇VUconditionalsuperscript𝜻#[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$% })\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{% \zeta}^{\#}(\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ∣ ★ ) ], which equals [(𝒇MS)#(),(𝒇VU)#()]superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#[(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(\bm{f}^{% \textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$})][ ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] from (63);
Algorithm 2 Given 𝒛,y,𝒔𝒛𝑦𝒔\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s (written as “\bigstar” below), find a globally optimal solution to Problem 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ), denoted as [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#()]superscript𝒃#superscript𝒑#superscriptsuperscript𝒇MS#superscriptsuperscript𝒇VU#superscript𝑇#[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$\bigstar$}),(% \bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(% \textnormal{\small$\bigstar$})][ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ].

For X being 1.1, 1.2, 1.2.1, 1.2.2.1, 1.2.2.2, 2.1, or 2.2, Algorithm X will be presented for the computation in Proposition X, as shown in Fig. 3 and explained in detail below.

Algorithm 1.1: Computing [f´MS(ζ),f´VU(ζ),γ´(ζ),δ´(ζ)]superscriptnormal-´𝑓MSconditional𝜁normal-★superscriptnormal-´𝑓VUconditional𝜁normal-★normal-´𝛾conditional𝜁normal-★normal-´𝛿conditional𝜁normal-★[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\gamma}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{\delta% }}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.1 using 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT of (45). Among 𝒮1.1subscript𝒮1.1\mathcal{S}_{1.1}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT, [𝒇´MS(𝜻),γ´(𝜻)]superscript´𝒇MSconditional𝜻´𝛾conditional𝜻[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\gamma}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) ] is [𝒇MS,γ]superscript𝒇MS𝛾[\bm{f}^{\textnormal{MS}},\gamma][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_γ ] satisfying (22) (27) (7d) (33c), while [𝒇´VU(𝜻),𝜹´(𝜻)]superscript´𝒇VUconditional𝜻´𝜹conditional𝜻[\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\bm{\delta}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ] is [𝒇VU,𝜹]superscript𝒇VU𝜹[\bm{f}^{\textnormal{VU}},\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , bold_italic_δ ] satisfying (23) (28) (7e) (33d). From (22) and (23), with PositiveRoot(𝔼)PositiveRoot𝔼\text{PositiveRoot}(\mathbb{E})PositiveRoot ( blackboard_E ) for an equation 𝔼𝔼\mathbb{E}blackboard_E denoting the positive root of 𝔼𝔼\mathbb{E}blackboard_E, we have

fnMSsuperscriptsubscript𝑓𝑛MS\textstyle f_{n}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT
=PositiveRoot(ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)x=γ),absentPositiveRootsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥𝛾\textstyle=\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n% })}{x^{2}}-yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}% \mathcal{F}_{n}(s_{n},\Lambda_{n})x=\gamma),= PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = italic_γ ) , (70)
fnVUsuperscriptsubscript𝑓𝑛VU\textstyle f_{n}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT
=PositiveRoot(ζnn(sn,Λn)x2yce2κnVU𝒢n(sn,Λn)x=δn).absentPositiveRootsubscript𝜁𝑛subscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥subscript𝛿𝑛\textstyle=\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n% })}{x^{2}}-yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa_{n}^{\textnormal{VU}}% \mathcal{G}_{n}(s_{n},\Lambda_{n})x=\delta_{n}).= PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) . (71)

To obtain [𝒇VU,𝜹]superscript𝒇VU𝜹[\bm{f}^{\textnormal{VU}},\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , bold_italic_δ ] satisfying (23) (28) (7e) (33d), we have the following two cases:

  • If PositiveRoot(ζnn(sn,Λn)x2yce2κnVU𝒢n(sn,Λn)x=0)>fn,maxVUPositiveRootsubscript𝜁𝑛subscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥0superscriptsubscript𝑓𝑛maxVU\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n})}{x^{2}}-% yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa_{n}^{\textnormal{VU}}\mathcal{G}_% {n}(s_{n},\Lambda_{n})x=0)>f_{n,\textnormal{max}}^{\textnormal{VU}}PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = 0 ) > italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT; i.e., if n(sn,Λn)ζn2𝒢n(sn,Λn)yceκnVU3>fn,maxVU3subscript𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscriptsubscript𝜅𝑛VUsuperscriptsubscript𝑓𝑛maxVU\sqrt[3]{\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n})\zeta_{n}}{2\mathcal{G}_{n}(s% _{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa_{n}^{\textnormal{VU}}}}% >f_{n,\textnormal{max}}^{\textnormal{VU}}nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG end_ARG > italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT, setting δnsubscript𝛿𝑛\delta_{n}italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as 00 violates (7e). This with (33d) means δn>0subscript𝛿𝑛0\delta_{n}>0italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT > 0, which with (28) induces fnVU=fn,maxVUsuperscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVUf_{n}^{\textnormal{VU}}=f_{n,\textnormal{max}}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT = italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT;

  • If PositiveRoot(ζnn(sn,Λn)x2yce2κnVU𝒢n(sn,Λn)x=0)fn,maxVUPositiveRootsubscript𝜁𝑛subscript𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscriptsubscript𝜅𝑛VUsubscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥0superscriptsubscript𝑓𝑛maxVU\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n})}{x^{2}}-% yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa_{n}^{\textnormal{VU}}\mathcal{G}_% {n}(s_{n},\Lambda_{n})x=0)\leq f_{n,\textnormal{max}}^{\textnormal{VU}}PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = 0 ) ≤ italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT; i.e., if n(sn,Λn)ζn2𝒢n(sn,Λn)yceκnVU3fn,maxVU3subscript𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscriptsubscript𝜅𝑛VUsuperscriptsubscript𝑓𝑛maxVU\sqrt[3]{\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n})\zeta_{n}}{2\mathcal{G}_{n}(s% _{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa_{n}^{\textnormal{VU}}}}% \leq f_{n,\textnormal{max}}^{\textnormal{VU}}nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG end_ARG ≤ italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT, then setting δnsubscript𝛿𝑛\delta_{n}italic_δ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as 00 and fnVU=n(sn,Λn)ζn2𝒢n(sn,Λn)yceκnVU3superscriptsubscript𝑓𝑛VU3subscript𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscriptsubscript𝜅𝑛VUf_{n}^{\textnormal{VU}}=\sqrt[3]{\frac{\mathcal{B}_{n}(s_{n},\Lambda_{n})\zeta% _{n}}{2\mathcal{G}_{n}(s_{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa% _{n}^{\textnormal{VU}}}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT = nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG end_ARG satisfies (23) (28) (7e) (33d).

To obtain [𝒇MS,γ]superscript𝒇MS𝛾[\bm{f}^{\textnormal{MS}},\gamma][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_γ ] satisfying (22) (27) (7d) (33c), we discuss the following two cases:

  • If PositiveRoot(ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)x=0)>fmaxMSPositiveRootsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥0superscriptsubscript𝑓maxMS\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})}{x^{2}}-% yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}\mathcal{F}_{n}(% s_{n},\Lambda_{n})x=0)>f_{\textnormal{max}}^{\textnormal{MS}}PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = 0 ) > italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT; i.e., if n𝒩𝒜n(sn,Λn)ζn2n(sn,Λn)yceκMS3>fmaxMSsubscript𝑛𝒩3subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscript𝜅MSsuperscriptsubscript𝑓maxMS\sum_{n\in\mathcal{N}}\sqrt[3]{\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})\zeta_{% n}}{2\mathcal{F}_{n}(s_{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa^{% \textnormal{MS}}}}>f_{\textnormal{max}}^{\textnormal{MS}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG end_ARG > italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT, then setting γ𝛾\gammaitalic_γ as 00 violates (7d). This with (33c) means γ>0𝛾0\gamma>0italic_γ > 0, which is used in (27) to induce

    n𝒩PositiveRoot(ζn𝒜n(sn,Λn)x2\textstyle\sum_{n\in\mathcal{N}}\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}% _{n}(s_{n},\Lambda_{n})}{x^{2}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG
    yce2κMSn(sn,Λn)x=γ)=fmaxMS.\textstyle-yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}% \mathcal{F}_{n}(s_{n},\Lambda_{n})x=\gamma)=f_{\textnormal{max}}^{\textnormal{% MS}}.- italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = italic_γ ) = italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT . (72)

    After obtaining the desired γ𝛾\gammaitalic_γ, we use it in (70) to get fnMSsuperscriptsubscript𝑓𝑛MSf_{n}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT.

  • If PositiveRoot(ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)x=0)fmaxMSPositiveRootsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥0superscriptsubscript𝑓maxMS\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})}{x^{2}}-% yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}\mathcal{F}_{n}(% s_{n},\Lambda_{n})x=0)\leq f_{\textnormal{max}}^{\textnormal{MS}}PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = 0 ) ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT; i.e., if n𝒩𝒜n(sn,Λn)ζn2n(sn,Λn)yceκMS3fmaxMSsubscript𝑛𝒩3subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscript𝜅MSsuperscriptsubscript𝑓maxMS\sum_{n\in\mathcal{N}}\sqrt[3]{\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})\zeta_{% n}}{2\mathcal{F}_{n}(s_{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa^{% \textnormal{MS}}}}\leq f_{\textnormal{max}}^{\textnormal{MS}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG end_ARG ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT, then setting γ𝛾\gammaitalic_γ as 00 and fnMS=𝒜n(sn,Λn)ζn2n(sn,Λn)yceκMS3superscriptsubscript𝑓𝑛MS3subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscript𝜅MSf_{n}^{\textnormal{MS}}=\sqrt[3]{\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})\zeta% _{n}}{2\mathcal{F}_{n}(s_{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa% ^{\textnormal{MS}}}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT = nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG end_ARG satisfies (22) (27) (7d) (33c).

Set f´nVU(𝜻)superscriptsubscript´𝑓𝑛VUconditional𝜻\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) as min{fn,maxVU,n(sn,Λn)ζn2𝒢n(sn,Λn)yceκnVU3}superscriptsubscript𝑓𝑛maxVU3subscript𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscriptsubscript𝜅𝑛VU\min\big{\{}f_{n,\textnormal{max}}^{\textnormal{VU}},~{}\sqrt[3]{\frac{% \mathcal{B}_{n}(s_{n},\Lambda_{n})\zeta_{n}}{2\mathcal{G}_{n}(s_{n},\Lambda_{n% })yc_{\hskip 0.5pt\textnormal{e}}\kappa_{n}^{\textnormal{VU}}}}\big{\}}roman_min { italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_ARG end_ARG }; if n𝒩𝒜n(sn,Λn)ζn2n(sn,Λn)yceκMS3fmaxMSsubscript𝑛𝒩3subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscript𝜅MSsuperscriptsubscript𝑓maxMS\sum_{n\in\mathcal{N}}\sqrt[3]{\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})\zeta_{% n}}{2\mathcal{F}_{n}(s_{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa^{% \textnormal{MS}}}}\leq f_{\textnormal{max}}^{\textnormal{MS}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG end_ARG ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT, then set f´nMS(𝜻)superscriptsubscript´𝑓𝑛MSconditional𝜻\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) as 𝒜n(sn,Λn)ζn2n(sn,Λn)yceκMS33subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛subscript𝜁𝑛2subscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑦subscript𝑐esuperscript𝜅MS\sqrt[3]{\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})\zeta_{n}}{2\mathcal{F}_{n}(s% _{n},\Lambda_{n})yc_{\hskip 0.5pt\textnormal{e}}\kappa^{\textnormal{MS}}}}nth-root start_ARG 3 end_ARG start_ARG divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG 2 caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG end_ARG; else with function C()𝐶C(\cdot)italic_C ( ⋅ ) being set as n𝒩PositiveRoot(ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)x=γ)subscript𝑛𝒩PositiveRootsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥𝛾\sum_{n\in\mathcal{N}}\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}_{n}(s_{n}% ,\Lambda_{n})}{x^{2}}-yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{% \textnormal{MS}}\mathcal{F}_{n}(s_{n},\Lambda_{n})x=\gamma)∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = italic_γ ), and Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT being set as fmaxMSsuperscriptsubscript𝑓maxMSf_{\textnormal{max}}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT, run Standard-Bisection-Search([𝜻,],function C(),Ctarget,0,fmaxMS)Standard-Bisection-Search𝜻function 𝐶subscript𝐶target0superscriptsubscript𝑓maxMS\textnormal{Standard-Bisection-Search}([\bm{\zeta},\textnormal{\small$\bigstar% $}],\textnormal{function~{}}C(\cdot),\newline C_{\textnormal{target}},0,f_{\textnormal{max}}^{\textnormal{MS}})Standard-Bisection-Search ( [ bold_italic_ζ , ★ ] , function italic_C ( ⋅ ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT , 0 , italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) based on Algorithm 12 on Page 12 to obtain the desired γ𝛾\gammaitalic_γ satisfying Eq. (72), let the obtained γ𝛾\gammaitalic_γ be γ´´𝛾\acute{\gamma}over´ start_ARG italic_γ end_ARG, and set set f´nMS(𝜻)superscriptsubscript´𝑓𝑛MSconditional𝜻\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) as PositiveRoot(ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)x=γ´)PositiveRootsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥´𝛾\text{PositiveRoot}(\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})}{x^{2}}-% yc_{\hskip 0.5pt\textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}\mathcal{F}_{n}(% s_{n},\Lambda_{n})x=\acute{\gamma})PositiveRoot ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x = over´ start_ARG italic_γ end_ARG ) for each n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N; Return 𝒇´VU(𝜻)superscript´𝒇VUconditional𝜻\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) (resp., 𝒇´MS(𝜻)superscript´𝒇MSconditional𝜻\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ )) as [f´nVU(𝜻)|n𝒩]delimited-[]evaluated-atsuperscriptsubscript´𝑓𝑛VUconditional𝜻𝑛𝒩[\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})|% _{n\in\mathcal{N}}][ over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) | start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ] (resp., [f´nMS(𝜻)|n𝒩]delimited-[]evaluated-atsuperscriptsubscript´𝑓𝑛MSconditional𝜻𝑛𝒩[\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})|% _{n\in\mathcal{N}}][ over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) | start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ]);
Algorithm 3
Alg-Solve-𝒇´MS(𝜻)-and-𝒇´VU(𝜻)Alg-Solve-superscript´𝒇MSconditional𝜻-and-superscript´𝒇VUconditional𝜻\textnormal{Alg-Solve-}\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$})\text{-and-}\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}\mid\textnormal{\small$\bigstar$})Alg-Solve- over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) -and- over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ).

Algorithm 1.2: Computing [b´(ζ),p´(ζ)]normal-´𝑏conditional𝜁normal-★normal-´𝑝conditional𝜁normal-★[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2. As shown in the pseudocode, Algorithm 1.2 calls Algorithms 1.2.1, 1.2.2.1, and 1.2.2.2 detailed below.

Run Alg-Solve-β´(𝜻)Alg-Solve-´𝛽conditional𝜻\textnormal{Alg-Solve-}\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar% $})Alg-Solve- over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) of Algorithm 1.2.2.2 to obtain β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ); Use the just obtained β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) as an input to Alg-Solve-α˘(β,𝜻)Alg-Solve-˘𝛼𝛽conditional𝜻\textnormal{Alg-Solve-}\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$})Alg-Solve- over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) of Algorithm 1.2.2.1 to get α˘(β´(𝜻),𝜻)˘𝛼´𝛽conditional𝜻conditional𝜻\breve{\alpha}(\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{% \zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ), which equals α´(𝜻)´𝛼conditional𝜻\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) according to (66); For each n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, use Lines 2 and 1’s obtained α´(𝜻)´𝛼conditional𝜻\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) and β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) as inputs to Alg-Solve-b~n(α,β,𝜻)Alg-Solve-subscript~𝑏𝑛𝛼𝛽conditional𝜻\textnormal{Alg-Solve-}\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})Alg-Solve- over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) (resp., Alg-Solve-p~n(α,β,𝜻)Alg-Solve-subscript~𝑝𝑛𝛼𝛽conditional𝜻\textnormal{Alg-Solve-}\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})Alg-Solve- over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ )) of Algorithm 1.2.1 to get b~n(α´(𝜻),β´(𝜻),𝜻)subscript~𝑏𝑛´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻\widetilde{b}_{n}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$})over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ ) (resp., p~n(α´(𝜻),β´(𝜻),𝜻)subscript~𝑝𝑛´𝛼conditional𝜻´𝛽conditional𝜻conditional𝜻\widetilde{p}_{n}(\acute{\alpha}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\bm{\zeta}\mid% \textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) , bold_italic_ζ ∣ ★ )), which equals b´n(𝜻)subscript´𝑏𝑛conditional𝜻\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) (resp., p´n(𝜻)subscript´𝑝𝑛conditional𝜻\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ )) according to (65); Return 𝒃´(𝜻)´𝒃conditional𝜻\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) (resp., 𝒑´(𝜻)´𝒑conditional𝜻\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ )) as [b´n(𝜻)|n𝒩]delimited-[]evaluated-atsubscript´𝑏𝑛conditional𝜻𝑛𝒩[\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})|_{n\in\mathcal{N}}][ over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) | start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ] (resp., [p´n(𝜻)|n𝒩]delimited-[]evaluated-atsubscript´𝑝𝑛conditional𝜻𝑛𝒩[\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})|_{n\in\mathcal{N}}][ over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) | start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ]);
Algorithm 4
Alg-Solve-𝒃´(𝜻)-and-𝒑´(𝜻)Alg-Solve-´𝒃conditional𝜻-and-´𝒑conditional𝜻\textnormal{Alg-Solve-}\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})\text{-and-}\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})Alg-Solve- over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) -and- over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ).

Algorithm 1.2.1: Computing [b~(α,β,ζ),p~(α,β,ζ)]normal-~𝑏𝛼𝛽conditional𝜁normal-★normal-~𝑝𝛼𝛽conditional𝜁normal-★[\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] defined in Proposition 1.2.1 using 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT of (47). Recall that 𝒮1.2.1subscript𝒮1.2.1\mathcal{S}_{1.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT includes (20) (21). From (20) (21) and (1), with ϑnsubscriptitalic-ϑ𝑛\vartheta_{n}italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT defined by

ϑn:=gnpnσn2bn,assignsubscriptitalic-ϑ𝑛subscript𝑔𝑛subscript𝑝𝑛superscriptsubscript𝜎𝑛2subscript𝑏𝑛\textstyle\vartheta_{n}:=\frac{g_{n}p_{n}}{\sigma_{n}^{2}b_{n}},italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT := divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG , (73)

we obtain that [b~n(α,β,𝜻),p~n(α,β,𝜻)]subscript~𝑏𝑛𝛼𝛽conditional𝜻subscript~𝑝𝑛𝛼𝛽conditional𝜻[\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] is the solution of [bn,pn]subscript𝑏𝑛subscript𝑝𝑛[b_{n},p_{n}][ italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] to

(Un(rn,sn)rn+yce2znrn3νn2+ζnsnμnΛnrn2νn)×\textstyle\big{(}\frac{\partial U_{n}(r_{n},s_{n})}{\partial r_{n}}+\frac{yc_{% \hskip 0.5pt\textnormal{e}}}{2z_{n}{r_{n}}^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}% }}+\frac{\zeta_{n}s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{% n}}}{{r_{n}}^{2}{\color[rgb]{0,0,0}\nu_{n}}}\big{)}\times( divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG + divide start_ARG italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) ×
(log2(1+ϑn)ϑn(1+ϑn)ln2)=α, andsubscript21subscriptitalic-ϑ𝑛subscriptitalic-ϑ𝑛1subscriptitalic-ϑ𝑛2𝛼 and\textstyle\big{(}\log_{2}(1+\vartheta_{n})-\frac{\vartheta_{n}}{(1+\vartheta_{% n})\ln 2}\big{)}=\alpha,\textnormal{ and}( roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) - divide start_ARG italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) roman_ln 2 end_ARG ) = italic_α , and (74)
(Un(rn,sn)rn+yce2znrn3νn2+ζnsnμnΛnrn2νn)gnσn2(1+ϑn)ln2subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝑟𝑛𝑦subscript𝑐e2subscript𝑧𝑛superscriptsubscript𝑟𝑛3superscriptsubscript𝜈𝑛2subscript𝜁𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛superscriptsubscript𝑟𝑛2subscript𝜈𝑛subscript𝑔𝑛superscriptsubscript𝜎𝑛21subscriptitalic-ϑ𝑛2\textstyle\big{(}\frac{\partial U_{n}(r_{n},s_{n})}{\partial r_{n}}+\frac{yc_{% \hskip 0.5pt\textnormal{e}}}{2z_{n}{r_{n}}^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}% }}+\frac{\zeta_{n}s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{% n}}}{{r_{n}}^{2}{\color[rgb]{0,0,0}\nu_{n}}}\big{)}\cdot\frac{g_{n}}{\sigma_{n% }^{2}(1+\vartheta_{n})\ln 2}( divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG + divide start_ARG italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) ⋅ divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) roman_ln 2 end_ARG
=β+2(pn+pncir)ycezn(snμnΛn)2.absent𝛽2subscript𝑝𝑛superscriptsubscript𝑝𝑛cir𝑦subscript𝑐esubscript𝑧𝑛superscriptsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2\textstyle=\beta+2(p_{n}+p_{n}^{\textnormal{cir}})yc_{\hskip 0.5pt\textnormal{% e}}z_{n}(s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}})^{2}.= italic_β + 2 ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT . (75)

With (74) divided by (75), it holds that

log2(1+ϑn)ϑn(1+ϑn)ln2gnσn2(1+ϑn)ln2=αβ+2(pn+pncir)ycezn(snμnΛn)2.subscript21subscriptitalic-ϑ𝑛subscriptitalic-ϑ𝑛1subscriptitalic-ϑ𝑛2subscript𝑔𝑛superscriptsubscript𝜎𝑛21subscriptitalic-ϑ𝑛2𝛼𝛽2subscript𝑝𝑛superscriptsubscript𝑝𝑛cir𝑦subscript𝑐esubscript𝑧𝑛superscriptsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2\textstyle\frac{\log_{2}(1+\vartheta_{n})-\frac{\vartheta_{n}}{(1+\vartheta_{n% })\ln 2}}{\frac{g_{n}}{\sigma_{n}^{2}(1+\vartheta_{n})\ln 2}}=\frac{\alpha}{% \beta+2(p_{n}+p_{n}^{\textnormal{cir}})yc_{\hskip 0.5pt\textnormal{e}}z_{n}(s_% {n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}})^{2}}.divide start_ARG roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) - divide start_ARG italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) roman_ln 2 end_ARG end_ARG start_ARG divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ( 1 + italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) roman_ln 2 end_ARG end_ARG = divide start_ARG italic_α end_ARG start_ARG italic_β + 2 ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG . (76)

Based on (76), we get

ϑn=ψn(pn,α,β), for ψn(pn,α,β)subscriptitalic-ϑ𝑛subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽 for subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽\textstyle\vartheta_{n}=\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$% \bigstar$}),\textnormal{ for }\textstyle{\psi_{n}(p_{n},\alpha,\beta\mid% \textnormal{\small$\bigstar$})}italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) , for italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ )
:=exp{1+W(1e(gnα[β+2(pn+pncir)ycezn(snμnΛn)2]σn21))}1.assignabsent1𝑊1𝑒subscript𝑔𝑛𝛼delimited-[]𝛽2subscript𝑝𝑛superscriptsubscript𝑝𝑛cir𝑦subscript𝑐esubscript𝑧𝑛superscriptsubscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛2superscriptsubscript𝜎𝑛211\textstyle\textstyle{:=\exp\big{\{}1+W\big{(}\frac{1}{e}(\frac{g_{n}\alpha}{[% \beta+2(p_{n}+p_{n}^{\textnormal{cir}})yc_{\hskip 0.5pt\textnormal{e}}z_{n}(s_% {n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}})^{2}]\sigma_{n}^% {2}}-1)\big{)}\big{\}}-1}.:= roman_exp { 1 + italic_W ( divide start_ARG 1 end_ARG start_ARG italic_e end_ARG ( divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_α end_ARG start_ARG [ italic_β + 2 ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - 1 ) ) } - 1 . (77)

Then we can substitute ϑnsubscriptitalic-ϑ𝑛\vartheta_{n}italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT from (77) into (74) and (75), to decide [𝒃,𝒑]𝒃𝒑[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ], as shown in Lemma 1 below.

Lemma 1.

Given [α,β,𝛇,]𝛼𝛽𝛇normal-★[\alpha,\beta,\bm{\zeta},\textnormal{\small$\bigstar$}][ italic_α , italic_β , bold_italic_ζ , ★ ], we know from Proposition 1.2.1 that p~n(α,β,𝛇)subscriptnormal-~𝑝𝑛𝛼𝛽conditional𝛇normal-★\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) and b~n(α,β,𝛇)subscriptnormal-~𝑏𝑛𝛼𝛽conditional𝛇normal-★\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) denote the values of pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying (20) and (21). We define ψn(pn,α,β)subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽normal-★\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) in (77), and define

r¯n(pn,α,β):=gnpnlog2(1+ψn(pn,α,β))σn2ψn(pn,α,β).assignsubscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽subscript𝑔𝑛subscript𝑝𝑛subscript21subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽superscriptsubscript𝜎𝑛2subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽\textstyle\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$}% ):=\frac{g_{n}p_{n}\log_{2}(1+\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{% \small$\bigstar$}))}{\sigma_{n}^{2}\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{% \small$\bigstar$})}.over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) := divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ) end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_ARG . (78)

Then p~n(α,β,𝛇)subscriptnormal-~𝑝𝑛𝛼𝛽conditional𝛇normal-★\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) is a solution of pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to

[(Un(rn,sn)rn)|rn=r¯n(pn,α,β)+yce2zn[r¯n(pn,α,β)]3νn2+ζnsnμnΛn[r¯n(pn,α,β)]2νn]×\textstyle\Bigg{[}\begin{array}[]{l}\big{(}\frac{\partial U_{n}(r_{n},s_{n})}{% \partial r_{n}}\big{)}|_{r_{n}=\overline{r}_{n}(p_{n},\alpha,\beta\mid% \textnormal{\small$\bigstar$})}\\ +\frac{yc_{\textnormal{e}}}{2z_{n}\cdot[\overline{r}_{n}(p_{n},\alpha,\beta% \mid\textnormal{\small$\bigstar$})]^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}}}+% \frac{\zeta_{n}s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}% }{[\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})]^{2}{% \color[rgb]{0,0,0}\nu_{n}}}\end{array}\Bigg{]}\times[ start_ARRAY start_ROW start_CELL ( divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) | start_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_POSTSUBSCRIPT end_CELL end_ROW start_ROW start_CELL + divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ [ over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ] start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG + divide start_ARG italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG [ over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG end_CELL end_ROW end_ARRAY ] × (81)
[log2(1+ψn(pn,α,β))ψn(pn,α,β)(1+ψn(pn,α,β))ln2]=α.delimited-[]subscript21subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽1subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽2𝛼\textstyle\textstyle{\left[\log_{2}\big{(}1+\psi_{n}(p_{n},\alpha,\beta\mid% \textnormal{\small$\bigstar$})\big{)}-\frac{\psi_{n}(p_{n},\alpha,\beta\mid% \textnormal{\small$\bigstar$})}{(1+\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{% \small$\bigstar$}))\ln 2}\right]}=\alpha.[ roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ) - divide start_ARG italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_ARG start_ARG ( 1 + italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ) roman_ln 2 end_ARG ] = italic_α . (82)

With p~n(α,β,𝛇)subscriptnormal-~𝑝𝑛𝛼𝛽conditional𝛇normal-★\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) decided according to (82) above, the corresponding bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying (20) and (21) is

b~n(α,β,𝜻)=gnp~n(α,β,𝜻)σn2ψn(p~n(α,β,𝜻),α,β).subscript~𝑏𝑛𝛼𝛽conditional𝜻subscript𝑔𝑛subscript~𝑝𝑛𝛼𝛽conditional𝜻superscriptsubscript𝜎𝑛2subscript𝜓𝑛subscript~𝑝𝑛𝛼𝛽conditional𝜻𝛼conditional𝛽\textstyle\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$})=\frac{g_{n}\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})}{\sigma_{n}^{2}\psi_{n}(\widetilde{p}_{n}(% \alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\alpha,\beta\mid% \textnormal{\small$\bigstar$})}.over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) = divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , italic_α , italic_β ∣ ★ ) end_ARG . (83)

Proof of Lemma 1: First, for pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying (20) and (21), we have already explained above that gnpnσn2bnsubscript𝑔𝑛subscript𝑝𝑛superscriptsubscript𝜎𝑛2subscript𝑏𝑛\frac{g_{n}p_{n}}{\sigma_{n}^{2}b_{n}}divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG (i.e., ϑnsubscriptitalic-ϑ𝑛\vartheta_{n}italic_ϑ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT defined in (73)) equals ψn(pn,α,β)subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) defined in (77). Then bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT equals gnpnσn2ψn(pn,α,β)subscript𝑔𝑛subscript𝑝𝑛superscriptsubscript𝜎𝑛2subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽\frac{g_{n}p_{n}}{\sigma_{n}^{2}\cdot\psi_{n}(p_{n},\alpha,\beta\mid% \textnormal{\small$\bigstar$})}divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ⋅ italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_ARG, and rn(bn,pn)subscript𝑟𝑛subscript𝑏𝑛subscript𝑝𝑛r_{n}(b_{n},p_{n})italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) denoting bnlog2(1+gnpnσ2bn)subscript𝑏𝑛subscript21subscript𝑔𝑛subscript𝑝𝑛superscript𝜎2subscript𝑏𝑛b_{n}\log_{2}(1+\frac{g_{n}p_{n}}{\sigma^{2}b_{n}})italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + divide start_ARG italic_g start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_σ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) equals the right hand side of (78), which we denote as r¯n(pn,α,β)subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) in (78) for notation simplicity. Then letting rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT be r¯n(pn,α,β)subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) in (74), we obtain (82) which will be used to solve pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. With p~n(α,β,𝜻)subscript~𝑝𝑛𝛼𝛽conditional𝜻\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) denoting the obtained pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, the corresponding bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is given by (83). Hence, we have proved that p~n(α,β,𝜻)subscript~𝑝𝑛𝛼𝛽conditional𝜻\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) and b~n(α,β,𝜻)subscript~𝑏𝑛𝛼𝛽conditional𝜻\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ), denoting pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying (20) and (21), are given by (82) and (83), respectively. ∎

Then we use (82) and (83) of Lemma 1 to solve p~n(α,β,𝜻)subscript~𝑝𝑛𝛼𝛽conditional𝜻\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) and b~n(α,β,𝜻)subscript~𝑏𝑛𝛼𝛽conditional𝜻\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ), respectively. They are considered as two subprocedures of Algorithm 1.2.1, as described below.

With function C()𝐶C(\cdot)italic_C ( ⋅ ) being set as the left hand side of (82), and Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT being set as α𝛼\alphaitalic_α, run Standard-Bisection-Search([α,β,𝜻,],function C(),Ctarget,0,pmax)Standard-Bisection-Search𝛼𝛽𝜻function 𝐶subscript𝐶target0subscript𝑝max\textnormal{Standard-Bisection-Search}([\alpha,\beta,\bm{\zeta},\textnormal{% \small$\bigstar$}],\textnormal{function~{}}C(\cdot),\newline C_{\textnormal{target}},0,p_{\textnormal{max}})Standard-Bisection-Search ( [ italic_α , italic_β , bold_italic_ζ , ★ ] , function italic_C ( ⋅ ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT , 0 , italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) based on Algorithm 12 on Page 12 to obtain the desired pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT satisfying Eq. (82), and set this pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as p~n(α,β,𝜻)subscript~𝑝𝑛𝛼𝛽conditional𝜻\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ );
Algorithm 5 Alg-Solve-p~n(α,β,𝜻)Alg-Solve-subscript~𝑝𝑛𝛼𝛽conditional𝜻\textnormal{Alg-Solve-}\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})Alg-Solve- over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ).
Run Alg-Solve-p~n(α,β,𝜻,)Alg-Solve-subscript~𝑝𝑛𝛼𝛽𝜻\textnormal{Alg-Solve-}\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta},\textnormal{% \small$\bigstar$})Alg-Solve- over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ , ★ ) (i.e., Algorithm 1.2.1’s Subprocedure 1 above) to obtain p~n(α,β,𝜻)subscript~𝑝𝑛𝛼𝛽conditional𝜻\widetilde{p}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ); Compute b~n(α,β,𝜻)subscript~𝑏𝑛𝛼𝛽conditional𝜻\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) according to Eq. (83);
Algorithm 6 Alg-Solve-b~n(α,β,𝜻,)Alg-Solve-subscript~𝑏𝑛𝛼𝛽𝜻\textnormal{Alg-Solve-}\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta},\textnormal{% \small$\bigstar$})Alg-Solve- over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ , ★ ).

Algorithm 1.2.2.1: Computing α˘(β,ζ)normal-˘𝛼𝛽conditional𝜁normal-★\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) defined in Proposition 1.2.2.1 using 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT of (49). Recall that 𝒮1.2.2.1subscript𝒮1.2.2.1\mathcal{S}_{1.2.2.1}caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT includes (34) and (35). Proposition 1.2.2.1 defines α˘(β,𝜻)˘𝛼𝛽conditional𝜻\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) as the solution of α𝛼\alphaitalic_α to

n𝒩b~n(α,β,𝜻)=bmax and α>0.subscript𝑛𝒩subscript~𝑏𝑛𝛼𝛽conditional𝜻subscript𝑏max and 𝛼0\textstyle\sum_{n\in\mathcal{N}}\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})=b_{\textnormal{max}}\textnormal{ and }\alpha>0.∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) = italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT and italic_α > 0 . (84)
With function C()𝐶C(\cdot)italic_C ( ⋅ ) being set as n𝒩Alg-Solve-b~n(α,β,𝜻,)subscript𝑛𝒩Alg-Solve-subscript~𝑏𝑛𝛼𝛽𝜻\sum_{n\in\mathcal{N}}\textnormal{Alg-Solve-}\widetilde{b}_{n}(\alpha,\beta,% \bm{\zeta},\textnormal{\small$\bigstar$})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT Alg-Solve- over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ , ★ ) (whose computation requires Algorithm 1.2.1’s Subprocedure 2), and Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT being set as bmaxsubscript𝑏maxb_{\textnormal{max}}italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT, run Bisection-Search-with-No-Known-Upper-Bound([β,𝒛,y,𝒔],function C(),Ctarget)Bisection-Search-with-No-Known-Upper-Bound𝛽𝒛𝑦𝒔function 𝐶subscript𝐶target\textnormal{Bisection-Search-with-No-Known-Upper-Bound}([\beta,\bm{z},y,\bm{s}% ],\newline \textnormal{function~{}}C(\cdot),C_{\textnormal{target}})Bisection-Search-with-No-Known-Upper-Bound ( [ italic_β , bold_italic_z , italic_y , bold_italic_s ] , function italic_C ( ⋅ ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT ) based on Algorithm 11 on Page 11 to obtain the desired α𝛼\alphaitalic_α satisfying Eq. (84), and set this α𝛼\alphaitalic_α as α˘(β𝒛,y,𝒔)˘𝛼conditional𝛽𝒛𝑦𝒔\breve{\alpha}(\beta\mid\bm{z},y,\bm{s})over˘ start_ARG italic_α end_ARG ( italic_β ∣ bold_italic_z , italic_y , bold_italic_s );
Algorithm 7
Alg-Solve-α˘(β,𝜻)Alg-Solve-˘𝛼𝛽conditional𝜻\textnormal{Alg-Solve-}\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$})Alg-Solve- over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ).

Algorithm 1.2.2.2 (Pseudocode on Page 8 based on the following analysis): Using Algorithm 1.2.2.1 to compute β´(ζ)normal-´𝛽conditional𝜁normal-★\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) according to Proposition 1.2.2.2 using 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT of (50). Recall from (50) that 𝒮1.2.2.2subscript𝒮1.2.2.2\mathcal{S}_{1.2.2.2}caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT includes (26), (7b), and (33b). Then β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) is the solution of β𝛽\betaitalic_β to

based on (26), we ensure
β(n𝒩p~n(α˘(β,𝜻),β,𝜻)pmax)=0;𝛽subscript𝑛𝒩subscript~𝑝𝑛˘𝛼𝛽conditional𝜻𝛽conditional𝜻subscript𝑝max0\displaystyle\textstyle{\beta\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{p}_{% n}(\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta,\bm% {\zeta}\mid\textnormal{\small$\bigstar$})-p_{\textnormal{max}}\big{)}=0};italic_β ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) = 0 ; (85a)
based on (7b), we ensure
n𝒩p~n(α˘(β,𝜻),β,𝜻)pmax;subscript𝑛𝒩subscript~𝑝𝑛˘𝛼𝛽conditional𝜻𝛽conditional𝜻subscript𝑝max\displaystyle\textstyle{\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}% (\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$})\leq p_{\textnormal{max}};}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ; (85b)
based on (33b), we ensure β0.based on (33b), we ensure 𝛽0\displaystyle\textnormal{based on (\ref{Dualfeasibility}b), we ensure }\beta% \geq 0.based on ( b), we ensure italic_β ≥ 0 . (85c)

We have the following two cases:

  • If n𝒩p~n(α˘(0,𝜻),0,𝜻)>pmaxsubscript𝑛𝒩subscript~𝑝𝑛˘𝛼0conditional𝜻0conditional𝜻subscript𝑝max\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(0,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),0,\bm{\zeta}\mid\textnormal{\small$\bigstar$})>% p_{\textnormal{max}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( 0 , bold_italic_ζ ∣ ★ ) , 0 , bold_italic_ζ ∣ ★ ) > italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT, then the solution of β𝛽\betaitalic_β to (85a)–(85c) cannot be 00 (which along with (85c) means β>0𝛽0\beta>0italic_β > 0), since setting β𝛽\betaitalic_β as 00 violates (85b). We use β>0𝛽0\beta>0italic_β > 0 in (85a) to get

    n𝒩p~n(α˘(β,𝜻),β,𝜻)=pmax.subscript𝑛𝒩subscript~𝑝𝑛˘𝛼𝛽conditional𝜻𝛽conditional𝜻subscript𝑝max\textstyle\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid\textnormal{% \small$\bigstar$})=p_{\textnormal{max}}.∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) = italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT . (86)
  • If n𝒩p~n(α˘(0,𝜻),0,𝜻)pmaxsubscript𝑛𝒩subscript~𝑝𝑛˘𝛼0conditional𝜻0conditional𝜻subscript𝑝max\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(0,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),0,\bm{\zeta}\mid\textnormal{\small$\bigstar$})% \leq p_{\textnormal{max}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( 0 , bold_italic_ζ ∣ ★ ) , 0 , bold_italic_ζ ∣ ★ ) ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT, then 00 is a solution of β𝛽\betaitalic_β to (85a)–(85c).

if n𝒩p~n(α˘(0,𝜻),0,𝜻)pmaxsubscript𝑛𝒩subscript~𝑝𝑛˘𝛼0conditional𝜻0conditional𝜻subscript𝑝max\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(0,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),0,\bm{\zeta}\mid\textnormal{\small$\bigstar$})% \leq p_{\textnormal{max}}∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( 0 , bold_italic_ζ ∣ ★ ) , 0 , bold_italic_ζ ∣ ★ ) ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT, then set β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) as 00; else with function C()𝐶C(\cdot)italic_C ( ⋅ ) being set as n𝒩p~n(α˘(β,𝜻),β,𝜻)subscript𝑛𝒩subscript~𝑝𝑛˘𝛼𝛽conditional𝜻𝛽conditional𝜻\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar% $})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) (whose computation requires Algorithm 1.2.2.1 and Algorithm 1.2.1’s Subprocedure 1), and Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT being set as pmaxsubscript𝑝maxp_{\textnormal{max}}italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT, run Bisection-Search-with-No-Known-Upper-Bound([𝜻,],function C(),Ctarget)Bisection-Search-with-No-Known-Upper-Bound𝜻function 𝐶subscript𝐶target\textnormal{Bisection-Search-with-No-Known-Upper-Bound}\newline ([\bm{\zeta},\textnormal{\small$\bigstar$}],\textnormal{function~{}}C(\cdot),C% _{\textnormal{target}})Bisection-Search-with-No-Known-Upper-Bound ( [ bold_italic_ζ , ★ ] , function italic_C ( ⋅ ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT ) based on Algorithm 11 on Page 11 to obtain the desired β𝛽\betaitalic_β satisfying Eq. (86), and set this β𝛽\betaitalic_β as β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ );
Algorithm 8 Alg-Solve-β´(𝜻)Alg-Solve-´𝛽conditional𝜻\textnormal{Alg-Solve-}\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar% $})Alg-Solve- over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ).

Algorithm 2.1: Computing ζ`(T)normal-`𝜁conditional𝑇normal-★\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) defined in Proposition 2.1 using 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT defined in (52). Recall from (52) that 𝒮2.1subscript𝒮2.1\mathcal{S}_{2.1}caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT includes (29), (11a), and (33e). Then for each n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, Proposition 2.1 means ζ`n(T)subscript`𝜁𝑛conditional𝑇\grave{{\zeta}}_{n}(T\mid\textnormal{\small$\bigstar$})over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) is ζnsubscript𝜁𝑛{\zeta_{n}}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT which satisfies the following:

based on (29), we ensure
ζn(tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),\displaystyle\zeta_{n}\cdot(t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% s_{n},\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ,
f´nVU(𝜻))T)=0;\displaystyle\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}))-T)=0;over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) - italic_T ) = 0 ; (87a)
based on (11a), we ensure
tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),\displaystyle t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n% }^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ,
f´nVU(𝜻))T;\displaystyle\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}))\leq T;over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) ≤ italic_T ; (87b)
based on (33e), we ensure ζn0.based on (33e), we ensure subscript𝜁𝑛0\displaystyle\textnormal{based on (\ref{Dualfeasibility}e), we ensure }\zeta_{% n}\geq 0.based on ( e), we ensure italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≥ 0 . (87c)

Given n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, we can discuss two cases for ζnsubscript𝜁𝑛{\zeta_{n}}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as follows:

  • Case 1:

    If setting ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to 00 violates (87b), then ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT must be strictly positive, which is used in (87a) to show that the inequality in (87b) actually becomes equality in this case.

  • Case 2:

    If setting ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to 00 satisfies (87b), then we can just set ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as 00.

Summarizing the above two cases, we know that after defining

𝜻̊(n):=[ζ1,ζ2,,ζn1,0,ζn+1,,ζN], andassignsuperscript̊𝜻𝑛subscript𝜁1subscript𝜁2subscript𝜁𝑛10subscript𝜁𝑛1subscript𝜁𝑁 and\textstyle\mathring{\bm{\zeta}}^{(n)}:=[\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1}% ,0,\zeta_{n+1},\ldots,\zeta_{N}],\textnormal{ and}over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT := [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , 0 , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] , and (88)
hn(𝜻T):={ζn, if tn(b´n(𝜻̊(n)),p´n(𝜻̊(n)),sn,f´nMS(𝜻̊(n)),f´nVU(𝜻̊(n)))T,(89a)tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),f´nVU(𝜻))T, otherwise,(89b)\textstyle h_{n}(\bm{\zeta}\mid T):=\begin{cases}-\zeta_{n},\textnormal{ if }t% _{n}(\acute{b}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar$% }),\acute{p}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar$})% ,s_{n},\\ \hskip 25.0pt\acute{f}_{n}^{\textnormal{MS}}(\mathring{\bm{\zeta}}^{(n)}\mid% \textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{VU}}(\mathring{\bm{% \zeta}}^{(n)}\mid\textnormal{\small$\bigstar$}))\leq T,~{}~{}~{}\text{(\ref{% definehn}a)}\\[-3.0pt] t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n}^{\textnormal% {MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\\ \hskip 30.0pt\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}))-T,\textnormal{ otherwise,}~{}~{}~{}~{}~{}~{}~{}\text{(\ref{% definehn}b)}\end{cases}italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) := { start_ROW start_CELL - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , if italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) ) ≤ italic_T , ( a) end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , end_CELL start_CELL end_CELL end_ROW start_ROW start_CELL over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) - italic_T , otherwise, ( b) end_CELL start_CELL end_CELL end_ROW (89)

setting 𝜻𝜻\bm{\zeta}bold_italic_ζ as 𝜻`(T)`𝜻conditional𝑇\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) always ensures that hn(𝜻T)=0subscript𝑛conditional𝜻𝑇0h_{n}(\bm{\zeta}\mid T)=0italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) = 0. Letting n𝑛nitalic_n iterate through 𝒩𝒩\mathcal{N}caligraphic_N and defining

𝒉(𝜻T):=[hn(𝜻T)|n𝒩],assign𝒉conditional𝜻𝑇delimited-[]evaluated-atsubscript𝑛conditional𝜻𝑇𝑛𝒩\textstyle\bm{h}(\bm{\zeta}\mid T):=[h_{n}(\bm{\zeta}\mid T)|_{n\in\mathcal{N}% }],bold_italic_h ( bold_italic_ζ ∣ italic_T ) := [ italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) | start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ] , (90)

we know that setting 𝜻𝜻\bm{\zeta}bold_italic_ζ as 𝜻`(T)`𝜻conditional𝑇\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ensures that

𝒉(𝜻T) equals the N-dimensional zero vector 𝟎.𝒉conditional𝜻𝑇 equals the N-dimensional zero vector 0\textstyle\bm{h}(\bm{\zeta}\mid T)\textnormal{ equals the}\textnormal{ $N$-% dimensional zero vector }\bm{0}.bold_italic_h ( bold_italic_ζ ∣ italic_T ) equals the N-dimensional zero vector bold_0 . (91)

We define ζnuppersuperscriptsubscript𝜁𝑛upper\zeta_{n}^{\textnormal{upper}}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT such that when 𝜻𝜻\bm{\zeta}bold_italic_ζ is [0n1,ζnupper,0Nn]superscript0𝑛1superscriptsubscript𝜁𝑛uppersuperscript0𝑁𝑛[0^{n-1},\zeta_{n}^{\textnormal{upper}},0^{N-n}][ 0 start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT , 0 start_POSTSUPERSCRIPT italic_N - italic_n end_POSTSUPERSCRIPT ],

hn(𝜻T)=0.subscript𝑛conditional𝜻𝑇0\textstyle h_{n}(\bm{\zeta}\mid T)=0.italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) = 0 . (92)

We will prove the following results and Lemma 2:

  • ζ`n(T)ζnuppersubscript`𝜁𝑛conditional𝑇superscriptsubscript𝜁𝑛upper\grave{{\zeta}}_{n}(T\mid\textnormal{\small$\bigstar$})\leq\zeta_{n}^{% \textnormal{upper}}over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) ≤ italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT, which along with ζn0subscript𝜁𝑛0\zeta_{n}\geq 0italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≥ 0 means
ζn[0,ζnupper]subscript𝜁𝑛0superscriptsubscript𝜁𝑛upper\zeta_{n}\in[0,\zeta_{n}^{\textnormal{upper}}]italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ [ 0 , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT ]; (93)
• Given any n𝒩, for any ζ1,ζ2,,ζn1,ζn+1,,ζNwe have hn([ζ1,ζ2,,ζn1,ζnupper,ζn+1,,ζN]T)0;• Given any n𝒩, for any ζ1,ζ2,,ζn1,ζn+1,,ζNwe have hn([ζ1,ζ2,,ζn1,ζnupper,ζn+1,,ζN]T)0;\textstyle\begin{array}[]{l}\text{\textbullet~{}Given any $n\in\mathcal{N}$, % for any $\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},\zeta_{n+1},\ldots,\zeta_{N}$,% }\\ \text{we have~{}~{}$h_{n}([\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},\zeta_{n}^{% \textnormal{upper}},\zeta_{n+1},\ldots,\zeta_{N}]\mid T)\leq 0$;}\end{array}start_ARRAY start_ROW start_CELL • Given any italic_n ∈ caligraphic_N , for any italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT , end_CELL end_ROW start_ROW start_CELL we have italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ∣ italic_T ) ≤ 0 ; end_CELL end_ROW end_ARRAY (96)
• Given any n𝒩, for any ζ1,ζ2,,ζn1,ζn+1,,ζNwe have hn([ζ1,ζ2,,ζn1,0,ζn+1,,ζN]T)0;i.e., hn(𝜻̊(n))0 for 𝜻̊(n) defined in (88).• Given any n𝒩, for any ζ1,ζ2,,ζn1,ζn+1,,ζNwe have hn([ζ1,ζ2,,ζn1,0,ζn+1,,ζN]T)0;i.e., hn(𝜻̊(n))0 for 𝜻̊(n) defined in (88).\textstyle\begin{array}[]{l}\text{\textbullet~{}Given any $n\in\mathcal{N}$, % for any $\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},\zeta_{n+1},\ldots,\zeta_{N}$,% }\\ \text{we have~{}~{}$h_{n}([\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},0,\zeta_{n+1% },\ldots,\zeta_{N}]\mid T)\geq 0$;}\\ \text{i.e., $h_{n}(\mathring{\bm{\zeta}}^{(n)})\geq 0$ for $\mathring{\bm{% \zeta}}^{(n)}$ defined in~{}(\ref{mathringzetadefine}).}\end{array}start_ARRAY start_ROW start_CELL • Given any italic_n ∈ caligraphic_N , for any italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT , end_CELL end_ROW start_ROW start_CELL we have italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , 0 , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ∣ italic_T ) ≥ 0 ; end_CELL end_ROW start_ROW start_CELL i.e., italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) ≥ 0 for over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT defined in ( ). end_CELL end_ROW end_ARRAY (100)

Lemma 2 (Proved in the Appendix of our full version [36]).

Given 𝛇𝛇\bm{\zeta}bold_italic_ζ and T𝑇Titalic_T, given n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, given ζ1,ζ2,,ζn1,ζn+1,,ζNsubscript𝜁1subscript𝜁2normal-…subscript𝜁𝑛1subscript𝜁𝑛1normal-…subscript𝜁𝑁\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},\zeta_{n+1},\ldots,\zeta_{N}italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT, then hn(𝛇T)subscript𝑛conditional𝛇𝑇h_{n}(\bm{\zeta}~{}\mid~{}T)italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases.

We prove the above Result (93). From Lemma 2 and (92), it holds that

hn([0n1,ζnupper,0Nn]T)=0=hn(𝜻T)subscript𝑛conditionalsuperscript0𝑛1superscriptsubscript𝜁𝑛uppersuperscript0𝑁𝑛𝑇0subscript𝑛conditional𝜻𝑇\textstyle h_{n}([0^{n-1},\zeta_{n}^{\textnormal{upper}},0^{N-n}]\mid T)=0=h_{% n}(\bm{\zeta}\mid T)italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( [ 0 start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT , 0 start_POSTSUPERSCRIPT italic_N - italic_n end_POSTSUPERSCRIPT ] ∣ italic_T ) = 0 = italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T )
hn([0n1,ζn,0Nn]T)0,absentsubscript𝑛conditionalsuperscript0𝑛1subscript𝜁𝑛superscript0𝑁𝑛𝑇0\textstyle\leq h_{n}([0^{n-1},\zeta_{n},0^{N-n}]\mid T)\leq 0,≤ italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( [ 0 start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , 0 start_POSTSUPERSCRIPT italic_N - italic_n end_POSTSUPERSCRIPT ] ∣ italic_T ) ≤ 0 , (101)

which with Lemma 2 means ζ`n(T)ζnuppersubscript`𝜁𝑛conditional𝑇superscriptsubscript𝜁𝑛upper\grave{{\zeta}}_{n}(T\mid\textnormal{\small$\bigstar$})\leq\zeta_{n}^{% \textnormal{upper}}over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) ≤ italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT.

The above Result (96) clearly follows from Result (93) and Lemma 2.

We prove the above Result (100). From (89), it holds that

hn(𝜻̊(n)):={0, if tn(b´n(𝜻̊(n)),p´n(𝜻̊(n)),sn,f´nMS(𝜻̊(n)),f´nVU(𝜻̊(n)))T,tn(b´n(𝜻̊(n)),p´n(𝜻̊(n)),sn,f´nMS(𝜻̊(n)),f´nVU(𝜻̊(n)))T, otherwise,}0.\textstyle h_{n}(\mathring{\bm{\zeta}}^{(n)}):=\left\{\begin{array}[]{l}0,% \textnormal{ if }t_{n}(\acute{b}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid% \textnormal{\small$\bigstar$}),\acute{p}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid% \textnormal{\small$\bigstar$}),\\ s_{n},\acute{f}_{n}^{\textnormal{MS}}(\mathring{\bm{\zeta}}^{(n)}\mid% \textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{VU}}(\mathring{\bm{% \zeta}}^{(n)}\mid\textnormal{\small$\bigstar$}))\leq T,\\ t_{n}(\acute{b}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar% $}),\acute{p}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar$}% ),\\ s_{n},\acute{f}_{n}^{\textnormal{MS}}(\mathring{\bm{\zeta}}^{(n)}\mid% \textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{VU}}(\mathring{\bm{% \zeta}}^{(n)}\mid\textnormal{\small$\bigstar$}))-T,\\ \textnormal{ otherwise,}\end{array}\right\}\geq 0.italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ) := { start_ARRAY start_ROW start_CELL 0 , if italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) ) ≤ italic_T , end_CELL end_ROW start_ROW start_CELL italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) ) - italic_T , end_CELL end_ROW start_ROW start_CELL otherwise, end_CELL end_ROW end_ARRAY } ≥ 0 . (107)

With the above Results (93) (96) (100), we apply the Poincaré–Miranda theorem [39] and solve (91) to obtain 𝜻`(T)`𝜻conditional𝑇\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) using the multivariate bisection algorithm of [40]. The pseudocode is given as Algorithm 2.1 below. Readers may wonder why the multivariate bisection is not used to jointly solve [𝒃,𝒑,𝒇MS,𝒇VU,α,β,γ,𝜹]𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝛼𝛽𝛾𝜹[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\alpha,\beta,% \gamma,\bm{\delta}][ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_α , italic_β , italic_γ , bold_italic_δ ]. The reason is that the conditions to use the multivariate bisection are quite strict; e.g., Results (93) (96) (100) are for any ζ1,ζ2,,ζn1,ζn+1,,ζNsubscript𝜁1subscript𝜁2subscript𝜁𝑛1subscript𝜁𝑛1subscript𝜁𝑁\zeta_{1},\zeta_{2},\ldots,\zeta_{n-1},\zeta_{n+1},\ldots,\zeta_{N}italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT given any n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N. We do not have such strong conditions if we try to solve [𝒃,𝒑,𝒇MS,𝒇VU,α,β,γ,𝜹]𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝛼𝛽𝛾𝜹[\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\alpha,\beta,% \gamma,\bm{\delta}][ bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_α , italic_β , italic_γ , bold_italic_δ ] together.

For 𝜻:=[ζ1,ζ2,,ζN]n𝒩[0,ζnupper]assign𝜻subscript𝜁1subscript𝜁2subscript𝜁𝑁subscriptproduct𝑛𝒩0superscriptsubscript𝜁𝑛upper\bm{\zeta}:=[\zeta_{1},\zeta_{2},\ldots,\zeta_{N}]\in\prod_{n\in\mathcal{N}}[0% ,\zeta_{n}^{\textnormal{upper}}]bold_italic_ζ := [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ∈ ∏ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT [ 0 , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT ] for ζnuppersuperscriptsubscript𝜁𝑛upper\zeta_{n}^{\textnormal{upper}}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT defined in (92), given Results (93) (96) (100), use the multivariate bisection algorithm proposed by [40] to obtain 𝜻𝜻\bm{\zeta}bold_italic_ζ which induces 𝒉(𝜻T)𝒉conditional𝜻𝑇\bm{h}(\bm{\zeta}\mid T)bold_italic_h ( bold_italic_ζ ∣ italic_T ) to be the N𝑁Nitalic_N-dimensional zero vector 𝟎0\bm{0}bold_0, to achieve the tolerance level of 𝒉(𝜻T)2ϵ5\|\bm{h}(\bm{\zeta}\mid T)\|_{2}\leq\epsilon_{5}∥ bold_italic_h ( bold_italic_ζ ∣ italic_T ) ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ≤ italic_ϵ start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT, where computing 𝒉(𝜻T)𝒉conditional𝜻𝑇\bm{h}(\bm{\zeta}\mid T)bold_italic_h ( bold_italic_ζ ∣ italic_T ) defined in (89) and (90) will call Algorithm 1.1 (resp., Algorithm 1.2) to compute f´nMS(𝜻̊(n))superscriptsubscript´𝑓𝑛MSconditionalsuperscript̊𝜻𝑛\acute{f}_{n}^{\textnormal{MS}}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{% \small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) and f´nVU(𝜻̊(n))superscriptsubscript´𝑓𝑛VUconditionalsuperscript̊𝜻𝑛\acute{f}_{n}^{\textnormal{VU}}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{% \small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) as well as f´nMS(𝜻)superscriptsubscript´𝑓𝑛MSconditional𝜻\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) and f´nVU(𝜻)superscriptsubscript´𝑓𝑛VUconditional𝜻\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) (resp., b´n(𝜻̊(n))subscript´𝑏𝑛conditionalsuperscript̊𝜻𝑛\acute{b}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) and p´n(𝜻̊(n))subscript´𝑝𝑛conditionalsuperscript̊𝜻𝑛\acute{p}_{n}(\mathring{\bm{\zeta}}^{(n)}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT ∣ ★ ) as well as b´n(𝜻)subscript´𝑏𝑛conditional𝜻\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) and p´n(𝜻)subscript´𝑝𝑛conditional𝜻\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ )) as inputs to the function tn()subscript𝑡𝑛t_{n}()italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( ) defined in (3), where 𝜻̊(n)superscript̊𝜻𝑛\mathring{\bm{\zeta}}^{(n)}over̊ start_ARG bold_italic_ζ end_ARG start_POSTSUPERSCRIPT ( italic_n ) end_POSTSUPERSCRIPT is defined in (88); Return the obtained 𝜻𝜻\bm{\zeta}bold_italic_ζ as 𝜻`(T)`𝜻conditional𝑇\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ );
Algorithm 9 Alg-Solve-𝜻`(T)Alg-Solve-`𝜻conditional𝑇\textnormal{Alg-Solve-}\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})Alg-Solve- over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ).

Algorithm 2.2: Computing T#()superscript𝑇normal-#normal-★T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) according to Proposition 2.2 using 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT defined in (53). Recall from (53) that 𝒮2.2subscript𝒮2.2\mathcal{S}_{2.2}caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT includes (24). Then Proposition 2.2 defines T#()superscript𝑇#T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) as the solution of T𝑇Titalic_T to

n𝒩ζ`n(T)=yct.subscript𝑛𝒩subscript`𝜁𝑛conditional𝑇𝑦subscript𝑐t\textstyle\sum_{n\in\mathcal{N}}\grave{\zeta}_{n}(T\mid\textnormal{\small$% \bigstar$})=yc_{\hskip 0.8pt\textnormal{t}}.∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) = italic_y italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT . (108)
Run Bisection-Search-with-No-Known-Upper-Bound (,n𝒩ζ`n(T),yct)subscript𝑛𝒩subscript`𝜁𝑛conditional𝑇𝑦subscript𝑐t(\textnormal{\small$\bigstar$},\sum_{n\in\mathcal{N}}\grave{\zeta}_{n}(T\mid% \textnormal{\small$\bigstar$}),yc_{\hskip 0.8pt\textnormal{t}})( ★ , ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) , italic_y italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT ) based on Algorithm 11 on Page 11 to obtain the desired T𝑇Titalic_T satisfying Eq. (108), and set this T𝑇Titalic_T as T#()superscript𝑇#T^{\#}(\textnormal{\small$\bigstar$})italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ), where computing n𝒩ζ`n(T)subscript𝑛𝒩subscript`𝜁𝑛conditional𝑇\sum_{n\in\mathcal{N}}\grave{\zeta}_{n}(T\mid\textnormal{\small$\bigstar$})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ) will call Algorithm 2.1;
Algorithm 10 Alg-Solve-T#()Alg-Solve-superscript𝑇#\textnormal{Alg-Solve-}T^{\#}(\textnormal{\small$\bigstar$})Alg-Solve- italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ).

The bisection method is used repeatedly in the algorithms above. The pseudocodes are given below.

Randomly pick u(0)superscript𝑢0u^{(0)}italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT from (0,)0(0,\infty)( 0 , ∞ ); if C(u(0),𝒗)=Ctarget𝐶superscript𝑢0𝒗subscript𝐶targetC(u^{(0)},\bm{v})=C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , bold_italic_v ) = italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT: return u(0)superscript𝑢0u^{(0)}italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT as the desired u𝑢uitalic_u; if C(u(0),𝒗)<Ctarget𝐶superscript𝑢0𝒗subscript𝐶targetC(u^{(0)},\bm{v})<C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , bold_italic_v ) < italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT
//In this case, the solution u𝑢uitalic_u is in [0,u(0))0superscript𝑢0[0,u^{(0)})[ 0 , italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT )  Use Standard-Bisection-Search(𝒗,function C(u,𝒗),\textnormal{Standard-Bisection-Search}(\bm{v},\textnormal{function~{}}C(u,\bm{% v}),Standard-Bisection-Search ( bold_italic_v , function italic_C ( italic_u , bold_italic_v ) , Ctarget,0,u(0))C_{\textnormal{target}},0,u^{(0)})italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT , 0 , italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ) based on Algorithm 12 to find the result, and return it as the desired u𝑢uitalic_u; if C(u(0),𝒗)>Ctarget𝐶superscript𝑢0𝒗subscript𝐶targetC(u^{(0)},\bm{v})>C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , bold_italic_v ) > italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT
//In this case, the solution u𝑢uitalic_u is in (u(0),)superscript𝑢0(u^{(0)},\infty)( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT , ∞ )  Find i0𝑖0i\geq 0italic_i ≥ 0 such that C(u(0)2i,𝒗)>Ctarget𝐶superscript𝑢0superscript2𝑖𝒗subscript𝐶targetC(u^{(0)}\cdot 2^{i},\bm{v})>C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT , bold_italic_v ) > italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT but C(u(0)2i+1,𝒗)Ctarget𝐶superscript𝑢0superscript2𝑖1𝒗subscript𝐶targetC(u^{(0)}\cdot 2^{i+1},\bm{v})\leq C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i + 1 end_POSTSUPERSCRIPT , bold_italic_v ) ≤ italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPTif C(u(0)2i+1,𝒗)=Ctarget𝐶superscript𝑢0superscript2𝑖1𝒗subscript𝐶targetC(u^{(0)}\cdot 2^{i+1},\bm{v})=C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i + 1 end_POSTSUPERSCRIPT , bold_italic_v ) = italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT: return u(0)2i+1superscript𝑢0superscript2𝑖1u^{(0)}\cdot 2^{i+1}italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i + 1 end_POSTSUPERSCRIPT as the desired u𝑢uitalic_u;  elsif C(u(0)2i+1,𝒗)<Ctarget𝐶superscript𝑢0superscript2𝑖1𝒗subscript𝐶targetC(u^{(0)}\cdot 2^{i+1},\bm{v})<C_{\textnormal{target}}italic_C ( italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i + 1 end_POSTSUPERSCRIPT , bold_italic_v ) < italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT   Use Standard-Bisection-Search(𝒗,\textnormal{Standard-Bisection-Search}(\bm{v},Standard-Bisection-Search ( bold_italic_v ,
     function C(u,𝒗),Ctarget,u(0)2i,u(0)2i+1)\textnormal{function~{}}C(u,\bm{v}),C_{\textnormal{target}},u^{(0)}\cdot 2^{i}% ,u^{(0)}\cdot 2^{i+1})function italic_C ( italic_u , bold_italic_v ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT , italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i end_POSTSUPERSCRIPT , italic_u start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ⋅ 2 start_POSTSUPERSCRIPT italic_i + 1 end_POSTSUPERSCRIPT )
      based on Algorithm 12 to find the result,
      and return it as the desired u𝑢uitalic_u;  endif endif
Algorithm 11
Bisection-Search-with-No-Known-Upper-Bound (𝒗,function C(u,𝒗),Ctarget)𝒗function 𝐶𝑢𝒗subscript𝐶target(\bm{v},\textnormal{function~{}}C(u,\bm{v}),C_{\textnormal{target}})( bold_italic_v , function italic_C ( italic_u , bold_italic_v ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT ), which returns u[0,)𝑢0u\in[0,\infty)italic_u ∈ [ 0 , ∞ ) such that C(u,𝒗)𝐶𝑢𝒗C(u,\bm{v})italic_C ( italic_u , bold_italic_v ) equals (or is arbitrarily close to) Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT given 𝒗𝒗\bm{v}bold_italic_v, where C(u,𝒗)𝐶𝑢𝒗C(u,\bm{v})italic_C ( italic_u , bold_italic_v ) is non-increasing in u𝑢uitalic_u given 𝒗𝒗\bm{v}bold_italic_v.
1 Initialize BlowerL0subscript𝐵lowersubscript𝐿0B_{\textnormal{lower}}\leftarrow L_{0}italic_B start_POSTSUBSCRIPT lower end_POSTSUBSCRIPT ← italic_L start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, BupperU0subscript𝐵uppersubscript𝑈0B_{\textnormal{upper}}\leftarrow U_{0}italic_B start_POSTSUBSCRIPT upper end_POSTSUBSCRIPT ← italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT; repeat
2       uBlower+Bupper2𝑢subscript𝐵lowersubscript𝐵upper2u\leftarrow\frac{B_{\textnormal{lower}}+B_{\textnormal{upper}}}{2}italic_u ← divide start_ARG italic_B start_POSTSUBSCRIPT lower end_POSTSUBSCRIPT + italic_B start_POSTSUBSCRIPT upper end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG; if C(u,𝒗)=Ctarget𝐶𝑢𝒗subscript𝐶targetC(u,\bm{v})=C_{\textnormal{target}}italic_C ( italic_u , bold_italic_v ) = italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT: return u𝑢uitalic_u; if C(u,𝒗)>Ctarget𝐶𝑢𝒗subscript𝐶targetC(u,\bm{v})>C_{\textnormal{target}}italic_C ( italic_u , bold_italic_v ) > italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT: Blowerusubscript𝐵lower𝑢B_{\textnormal{lower}}\leftarrow uitalic_B start_POSTSUBSCRIPT lower end_POSTSUBSCRIPT ← italic_u; else: Bupperusubscript𝐵upper𝑢B_{\textnormal{upper}}\leftarrow uitalic_B start_POSTSUBSCRIPT upper end_POSTSUBSCRIPT ← italic_u; endif
3until BupperBlowersubscript𝐵uppersubscript𝐵lowerB_{\textnormal{upper}}-B_{\textnormal{lower}}italic_B start_POSTSUBSCRIPT upper end_POSTSUBSCRIPT - italic_B start_POSTSUBSCRIPT lower end_POSTSUBSCRIPT is no greater than ϵ4subscriptitalic-ϵ4\epsilon_{4}italic_ϵ start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT for a small positive number ϵ4subscriptitalic-ϵ4\epsilon_{4}italic_ϵ start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT;
Algorithm 12
Standard-Bisection-Search (𝒗,function C(u,𝒗),Ctarget,lower boundL0,upper boundU0)𝒗function 𝐶𝑢𝒗subscript𝐶targetlower boundsubscript𝐿0upper boundsubscript𝑈0(\bm{v},\textnormal{function~{}}C(u,\bm{v}),C_{\textnormal{target}},% \textnormal{lower bound}~{}L_{0},\textnormal{upper bound}~{}U_{0})( bold_italic_v , function italic_C ( italic_u , bold_italic_v ) , italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT , lower bound italic_L start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , upper bound italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ), which returns u[L0,U0]𝑢subscript𝐿0subscript𝑈0u\in[L_{0},U_{0}]italic_u ∈ [ italic_L start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT , italic_U start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ] such that C(u,𝒗)𝐶𝑢𝒗C(u,\bm{v})italic_C ( italic_u , bold_italic_v ) equals (or is arbitrarily close to) Ctargetsubscript𝐶targetC_{\textnormal{target}}italic_C start_POSTSUBSCRIPT target end_POSTSUBSCRIPT given 𝒗𝒗\bm{v}bold_italic_v, where C(u,𝒗)𝐶𝑢𝒗C(u,\bm{v})italic_C ( italic_u , bold_italic_v ) is non-increasing in u𝑢uitalic_u given 𝒗𝒗\bm{v}bold_italic_v.

To better understand bisection search in our algorithms above, we prove in the Appendix of our full paper [36] that the left-hand side of (72) (resp., (82), (84), (86), (108)) is non-increasing with respect to γ𝛾\gammaitalic_γ (resp., pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, α𝛼\alphaitalic_α, β𝛽\betaitalic_β, T𝑇Titalic_T). In simulations, the above often decreases so that there is a unique solution.

VII Our Algorithm to Solve Problem 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT

Algorithm 1 has been presented on Page 1 to solve the system UCR optimization 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT. In Section V-E, we have also explained how the different building blocks in Sections V-AV-BV-C, and V-D are combined together to produce Algorithm 1’s pseudocode. We now discuss the performance of Algorithm 1.

Solution quality and convergence. Algorithm 1 comprises three levels of iterations, with the innermost iteration from Line 17 containing Algorithm 2 in Line 20. Algorithm 2 obtains a global optimum for Problem 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ). The outermost iteration from Line 4 is based on Dinkelbach’s transform and does not lose optimality. However, the mid-level iteration from Line 11 is based on alternating optimization and cannot guarantee local/global optimality. Hence, Algorithm 1 cannot guarantee local/global optimality for 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT. Yet, using the terminology of stationary points in [12] for constrained optimization, Algorithm 1 finds a stationary point for 1subscript1\mathbb{P}_{1}blackboard_P start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT. The convergence of Algorithm 1 is also clear from the above analysis.

Time Complexity. In Algorithm 1 and its subroutine Algorithm 2, the bisection search is repeatedly used. Then the complexity of Algorithm 1 is polylogarithmic in the error tolerance’s reciprocal in various calls of the bisection search. Below we analyze the complexities of Algorithms 1 and 2 with respect to the number N𝑁Nitalic_N of users. Line 1 of Algorithm 2 calls Algorithm 2.2, which calls Algorithm 2.1. Algorithm 2.1 called in the above and in Line 2 of Algorithm 2 calls Algorithms 1.1 and 1.2. Algorithm 1.2 called in the above and in Line 3 of Algorithm 2 calls Algorithms 1.2.2.2, 1.2.2.1, and 1.2.1. For the multivariate bisection search in Algorithm 2.1, from Theorem 2.3 of [40], to achieve the tolerance level of 𝒉(𝜻T)2ϵ5\|\bm{h}(\bm{\zeta}\mid T)\|_{2}\leq\epsilon_{5}∥ bold_italic_h ( bold_italic_ζ ∣ italic_T ) ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ≤ italic_ϵ start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT, the number of iterations required is log2n𝒩ζnupperϵ5subscript2subscript𝑛𝒩superscriptsubscript𝜁𝑛uppersubscriptitalic-ϵ5\log_{2}\frac{\sum_{n\in\mathcal{N}}\zeta_{n}^{\textnormal{upper}}}{\epsilon_{% 5}}roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT divide start_ARG ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT end_ARG start_ARG italic_ϵ start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_ARG for ζnuppersuperscriptsubscript𝜁𝑛upper\zeta_{n}^{\textnormal{upper}}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT upper end_POSTSUPERSCRIPT define in (92); i.e., logarithmic in N𝑁Nitalic_N. Computing 𝒃~(α,β,𝜻)~𝒃𝛼𝛽conditional𝜻\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) and 𝒑~(α,β,𝜻)~𝒑𝛼𝛽conditional𝜻\widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) takes 𝒪(N)𝒪𝑁\mathcal{O}(N)caligraphic_O ( italic_N ). Then calculating α˘(β,𝜻)˘𝛼𝛽conditional𝜻\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) costs 𝒪(N)𝒪𝑁\mathcal{O}(N)caligraphic_O ( italic_N ). Thus, obtaining β´(𝜻)´𝛽conditional𝜻\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) takes 𝒪(N)𝒪𝑁\mathcal{O}(N)caligraphic_O ( italic_N ). Finally, computing 𝒉(𝜻T)𝒉conditional𝜻𝑇\bm{h}(\bm{\zeta}\mid T)bold_italic_h ( bold_italic_ζ ∣ italic_T ) costs 𝒪(N)𝒪𝑁\mathcal{O}(N)caligraphic_O ( italic_N ). Line 1 of Alg. 2 takes 𝒪(NlogN)𝒪𝑁𝑁\mathcal{O}(N\log N)caligraphic_O ( italic_N roman_log italic_N ). We analyze other lines of Alg. 2 similarly. Then Alg. 2 and each innermost iteration of Alg. 1 cost 𝒪(NlogN)𝒪𝑁𝑁\mathcal{O}(N\log N)caligraphic_O ( italic_N roman_log italic_N ). In the outermost and mid-level iterations, each computation of the utility 𝒰()𝒰\mathcal{U}()caligraphic_U ( ) in (2) and the cost in (6) requires 𝒪(N)𝒪𝑁\mathcal{O}(N)caligraphic_O ( italic_N ). To summarize, Algorithm 1 takes 𝒪(N2logN)𝒪superscript𝑁2𝑁\mathcal{O}(N^{2}\log N)caligraphic_O ( italic_N start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT roman_log italic_N ).

VIII Modeling the Human-centric Utility from Real Data

We now model users’ human-centric utilities in the Metaverse over wireless communications using two datasets [10, 31] explained below, which are both based on real experiments of humans assessing videos.

SSV360 dataset. This dataset of [10] captures users’ evaluation of 360° videos when wearing HTC Vive Pro Virtual Reality (VR) headsets. Each data point exhibits a user’s perceptual quality assessment of a 360° scene of a given bitrate and a given video resolution, under standing or seated viewing (SSV).

Netflix dataset. This dataset is a part of Netflix’s Emmy Award-winning VMAF project [31]. Each data point represents users’ mean opinion score for a video at a given bitrate and a given resolution.

The wireless data rate needs to be large enough for users’ smooth watching experience at the given video bitrate [41]. We consider the bitrate as a constant fraction (say θ𝜃\thetaitalic_θ) of the wireless rate. Then substituting the bitrate rbitratesubscript𝑟bitrater_{\text{bitrate}}italic_r start_POSTSUBSCRIPT bitrate end_POSTSUBSCRIPT with the wireless rate rwirelesssubscript𝑟wirelessr_{\text{wireless}}italic_r start_POSTSUBSCRIPT wireless end_POSTSUBSCRIPT just involves replacing rbitratesubscript𝑟bitrater_{\text{bitrate}}italic_r start_POSTSUBSCRIPT bitrate end_POSTSUBSCRIPT with rwireless/θsubscript𝑟wireless𝜃r_{\text{wireless}}/\thetaitalic_r start_POSTSUBSCRIPT wireless end_POSTSUBSCRIPT / italic_θ. Hence, for both datasets above, we perform curve-fitting with the bitrate and the resolution to obtain the utility functions.

Modeling human-centric utilities. Based on the two datasets above, the human-centric utility of each user n𝑛nitalic_n, denoted by Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), is modeled as a function of the bitrate rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT and the video resolution snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. We adopt the logarithmic utility function, which is used in [32, 33, 34] for various communication/network systems. The logarithmic function reflects users’ diminishing marginal gain as the bitrate and the resolution increase. Formally, we have Un(rn,sn)=κnln(1+lnssn+lnrrn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝜅𝑛1subscriptsuperscript𝑙𝑠𝑛subscript𝑠𝑛subscriptsuperscript𝑙𝑟𝑛subscript𝑟𝑛U_{n}(r_{n},s_{n})=\kappa_{n}\ln(1+l^{s}_{n}s_{n}+l^{r}_{n}r_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_ln ( 1 + italic_l start_POSTSUPERSCRIPT italic_s end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_l start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) for coefficients κn,lns,lnrsubscript𝜅𝑛subscriptsuperscript𝑙𝑠𝑛subscriptsuperscript𝑙𝑟𝑛\kappa_{n},l^{s}_{n},l^{r}_{n}italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_l start_POSTSUPERSCRIPT italic_s end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_l start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, which are decided by fitting data. Since using a three-dimensional plot to show the two-variable function Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is difficult for visual interpretation, we use the following transform to obtain a two-dimensional plot. Let rnmaxsuperscriptsubscript𝑟𝑛r_{n}^{\max}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_max end_POSTSUPERSCRIPT (resp., snmaxsuperscriptsubscript𝑠𝑛s_{n}^{\max}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_max end_POSTSUPERSCRIPT) be the maximum rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT (resp., snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT) from the dataset. After defining αn:=lnrrnmax+lnssnmaxassignsubscript𝛼𝑛subscriptsuperscript𝑙𝑟𝑛superscriptsubscript𝑟𝑛subscriptsuperscript𝑙𝑠𝑛superscriptsubscript𝑠𝑛\alpha_{n}:=l^{r}_{n}r_{n}^{\max}+l^{s}_{n}s_{n}^{\max}italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT := italic_l start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_max end_POSTSUPERSCRIPT + italic_l start_POSTSUPERSCRIPT italic_s end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT roman_max end_POSTSUPERSCRIPT, we let lnrαnrn+lnsαnsnsubscriptsuperscript𝑙𝑟𝑛subscript𝛼𝑛subscript𝑟𝑛subscriptsuperscript𝑙𝑠𝑛subscript𝛼𝑛subscript𝑠𝑛\frac{l^{r}_{n}}{\alpha_{n}}r_{n}+\frac{l^{s}_{n}}{\alpha_{n}}s_{n}divide start_ARG italic_l start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG italic_l start_POSTSUPERSCRIPT italic_s end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT be the x𝑥xitalic_x-axis coordinate, and plot κnln(1+αnx)subscript𝜅𝑛1subscript𝛼𝑛𝑥\kappa_{n}\ln(1+\alpha_{n}x)italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_ln ( 1 + italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_x ) as the y𝑦yitalic_y-axis coordinate, since it holds that Un(rn,sn)=κnln(1+αn(lnrαnrn+lnsαnsn))=κnln(1+αnx)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝜅𝑛1subscript𝛼𝑛subscriptsuperscript𝑙𝑟𝑛subscript𝛼𝑛subscript𝑟𝑛subscriptsuperscript𝑙𝑠𝑛subscript𝛼𝑛subscript𝑠𝑛subscript𝜅𝑛1subscript𝛼𝑛𝑥U_{n}(r_{n},s_{n})=\kappa_{n}\ln(1+\alpha_{n}\cdot(\frac{l^{r}_{n}}{\alpha_{n}% }r_{n}+\frac{l^{s}_{n}}{\alpha_{n}}s_{n}))=\kappa_{n}\ln(1+\alpha_{n}x)italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_ln ( 1 + italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( divide start_ARG italic_l start_POSTSUPERSCRIPT italic_r end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG italic_l start_POSTSUPERSCRIPT italic_s end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ) = italic_κ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_ln ( 1 + italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_x ). With the above transformation, each data point’s x𝑥xitalic_x-coordinate is between 00 and 1111.

In Fig. 4(a) for the SSV360 dataset, the data and curves are about two users watching a 360° video (“Alcatraz” or “FormationPace” [10]) under seated or standing view. The score is an integer from 1111 to 5555 based on the well-known Absolute Category Rating. In Fig. 4(b) for the Netflix dataset, the data and curves present users’ average assessment (from 00 to 100100100100) of different videos (BirdsInCage, BigBuckBunny, ElFuente1, or CrowdRun [31]). Both subfigures demonstrate that the curves of the logarithmic human-centric utility functions fit the data. The specific expressions of the functions are provided in the legends.

Refer to caption
\thesubsubfigure SSV360 dataset.
Refer to caption
\thesubsubfigure Netflix dataset.
Figure 4: Modeling the logarithmic human-centric utility functions from the SSV360 and Netflix datasets.

IX Simulations

In this section on simulations, we first describe the default settings and then report various results.

Default settings. We consider a macro-cell wireless channel model for urban areas. With dnsubscript𝑑𝑛d_{n}italic_d start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT denoting the distance between the Metaverse server (MS) and a virtual-reality user (VU) indexed by n𝑛nitalic_n, the path loss between them is 128.1+37.6logdn128.137.6subscript𝑑𝑛128.1+37.6\log d_{n}128.1 + 37.6 roman_log italic_d start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT along with 8 decibels (dB) for the standard deviation of shadow fading [6], where the unit of dnsubscript𝑑𝑛d_{n}italic_d start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is kilometer. The power spectral density of Gaussian noise σn2superscriptsubscript𝜎𝑛2{\sigma_{n}}^{2}italic_σ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT is 174174-174- 174 dBm/Hz (i.e., the thermal noise amount at 20 °C room temperature). VUs are randomly located in a circle of radius 500m centered at the MU. The default total bandwidth bmaxsubscript𝑏maxb_{\textnormal{max}}italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT is 20GHz, and the total transmission power pmaxsubscript𝑝maxp_{\textnormal{max}}italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT is 30W. The effective switched capacitance κMSsuperscript𝜅MS\kappa^{\textnormal{MS}}italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT and κVUsuperscript𝜅VU\kappa^{\textnormal{VU}}italic_κ start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT are set as 1027superscript102710^{-27}10 start_POSTSUPERSCRIPT - 27 end_POSTSUPERSCRIPT. The number μnsubscript𝜇𝑛\mu_{n}italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT of bits per pixel is 16, and the compression rate νnsubscript𝜈𝑛\nu_{n}italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is 100. The maximum CPU frequencies at the MS and VUs, fmaxMSsuperscriptsubscript𝑓maxMSf_{\textnormal{max}}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT and fn,maxVUsuperscriptsubscript𝑓𝑛maxVUf_{n,\textnormal{max}}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT, are 300GHz and 50GHz, respectively. The default weights for energy and delay are ce=0.5subscript𝑐𝑒0.5c_{e}=0.5italic_c start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT = 0.5 and ct=0.5subscript𝑐𝑡0.5c_{t}=0.5italic_c start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = 0.5. The default VU number is 5. Based on measurements, Section V of [41] quantifies the computational complexity of processing a video frame of resolution snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as w(sn)=(7×1010×sn3/2+0.083)𝑤subscript𝑠𝑛7superscript1010superscriptsubscript𝑠𝑛320.083w(s_{n})=(7\times 10^{-10}\times{s_{n}}^{3/2}+0.083)italic_w ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) = ( 7 × 10 start_POSTSUPERSCRIPT - 10 end_POSTSUPERSCRIPT × italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 / 2 end_POSTSUPERSCRIPT + 0.083 ) tera (i.e., trillion) floating-point operations (FLOPs). From Fig. 2 in Section III-B, we know that 𝒜n(sn,Λn)subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{A}_{n}(s_{n},\Lambda_{n})caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) (resp., n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{B}_{n}(s_{n},\Lambda_{n})caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )) of Page 2 for delay is less than n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{F}_{n}(s_{n},\Lambda_{n})caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) (resp., 𝒢n(sn,Λn)subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{G}_{n}(s_{n},\Lambda_{n})caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )) of Page 2 for energy. In the simulations, we set both 𝒜n(sn,Λn)subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{A}_{n}(s_{n},\Lambda_{n})caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) and n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{B}_{n}(s_{n},\Lambda_{n})caligraphic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) as Λnw(sn)/30subscriptΛ𝑛𝑤subscript𝑠𝑛30\Lambda_{n}w(s_{n})/30roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_w ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) / 30, and set both n(sn,Λn)subscript𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{F}_{n}(s_{n},\Lambda_{n})caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) and 𝒢n(sn,Λn)subscript𝒢𝑛subscript𝑠𝑛subscriptΛ𝑛\mathcal{G}_{n}(s_{n},\Lambda_{n})caligraphic_G start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) as Λnw(sn)subscriptΛ𝑛𝑤subscript𝑠𝑛\Lambda_{n}w(s_{n})roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_w ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), which make all of them convex in snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. For all VU n𝑛nitalic_n, we let ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT be the same ΛΛ\Lambdaroman_Λ. Then the optimization objective becomes a multiple of ΛΛ\Lambdaroman_Λ, which thus has no impact. The above avoids considering the impact of heterogeneous ΛnsubscriptΛ𝑛\Lambda_{n}roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT for simplicity. Possible values for the resolution snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT are 4096×2160409621604096\times 21604096 × 2160, 3072×1620307216203072\times 16203072 × 1620, 2048×1080204810802048\times 10802048 × 1080, 1920×1080192010801920\times 10801920 × 1080, and 1280×72012807201280\times 7201280 × 720 pixels, which are also referred to as 4k, 3k, 2k, 1080p, and 720p. The SSV360 dataset [10] in Section VIII includes the perceptual assessment of users watching VR videos. We use those data for curve-fitting different logarithmic utility functions, and assign the functions to users in the simulations: one function for one user.

Comparison with baselines. For the simulation results, we first compare our algorithm with baselines:

  • average allocation, which sets each bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as bmaxNsubscript𝑏max𝑁\frac{b_{\textnormal{max}}}{N}divide start_ARG italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, each pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as pmaxNsubscript𝑝max𝑁\frac{p_{\textnormal{max}}}{N}divide start_ARG italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, each snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as 2048×1080204810802048\times 10802048 × 1080 (i.e., 2k resolution), each fnMSsuperscriptsubscript𝑓𝑛MSf_{n}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT as fmaxMSNsuperscriptsubscript𝑓maxMS𝑁\frac{f_{\textnormal{max}}^{\textnormal{MS}}}{N}divide start_ARG italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG start_ARG italic_N end_ARG, and each fnVUsuperscriptsubscript𝑓𝑛VUf_{n}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT as fn,maxVUsuperscriptsubscript𝑓𝑛maxVUf_{n,\textnormal{max}}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT;

  • optimize 𝒃𝒃\bm{b}bold_italic_b, 𝒑𝒑\bm{p}bold_italic_p, and 𝒔𝒔\bm{s}bold_italic_s only, while setting each fnMSsuperscriptsubscript𝑓𝑛MSf_{n}^{\textnormal{MS}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT as fmaxMSNsuperscriptsubscript𝑓maxMS𝑁\frac{f_{\textnormal{max}}^{\textnormal{MS}}}{N}divide start_ARG italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT end_ARG start_ARG italic_N end_ARG and each fnVUsuperscriptsubscript𝑓𝑛VUf_{n}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT as fn,maxVUsuperscriptsubscript𝑓𝑛maxVUf_{n,\textnormal{max}}^{\textnormal{VU}}italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT,

  • optimize 𝒇MSsuperscript𝒇MS\bm{f^{\textnormal{MS}}}bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT and 𝒇VUsuperscript𝒇VU\bm{f^{\textnormal{VU}}}bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT only, while setting each bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as bmaxNsubscript𝑏max𝑁\frac{b_{\textnormal{max}}}{N}divide start_ARG italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, each pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as pmaxNsubscript𝑝max𝑁\frac{p_{\textnormal{max}}}{N}divide start_ARG italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT end_ARG start_ARG italic_N end_ARG, and each snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT as 2048×1080204810802048\times 10802048 × 1080.

Various simulation results are plotted in the subfigures of Fig. 5 for a detailed comparison and examining the impact of different parameters on the system utility-cost ratio (UCR). We discuss the results below.

  • UCR versus the total bandwidth. Here we vary the total bandwidth from 1GHz to 20GHz. In Fig. 5(a), larger bandwidth induces higher data rates, which reduce latency and energy consumption, thus increasing the system UCR. In addition, the difference in UCR between the proposed algorithm and the average allocation baseline rises from 522.3% to 630.4% as the total bandwidth increases.

  • UCR versus minimum resolution. We fix the maximum resolution as 4096×2160409621604096\times 21604096 × 2160 (4k) and change the minimum resolution from 1280×72012807201280\times 7201280 × 720 (720P) to 4096×2160409621604096\times 21604096 × 2160. From Fig. 5(b), the UCR performance of all the algorithms improves as the minimum resolution decreases, with our proposed algorithm showing a significant improvement. The reason for this is that the high data volumes associated with high resolution can lead to higher energy consumption and system delay. The UCR of the proposed algorithm gradually plateaus when the minimum resolution reaches below 1920×1080192010801920\times 10801920 × 1080 (1080p).

  • UCR versus transmission power. Here we configure the maximum downlink transmission power from 0.03W to 100W. From Fig. 5(c), the UCR of all algorithms increases as the transmission power grows, since raising the transmission power widens the search space for the optimization. When the transmission power is very small (e.g., 0.03W or 0.3W), the UCR of the proposed algorithm is slightly higher than other algorithms, but as the transmission power increases, the performance of the proposed algorithm far exceeds others. The UCR of all methods plateaus when the transmission power reaches 50W.

  • UCR versus computation resource. We vary the maximum server CPU frequency from 0.5GHz to 60GHz and all VU’s maximum CPU frequencies from 10MHz to 10GHz. In Fig. 5(d) and Fig. 5(e), the system UCR increases as the maximum CPU frequency grows, since the optimization problem has a wider search space. The proposed algorithm outperforms the average allocation, reaching a difference of 660.9% and 653.2% for server CPU frequency at 60GHz and VU CPU frequencies at 10GHz, respectively.

  • Impact of user number on UCR. We now amplify the bandwidth, transmission power, and server’s CPU frequency by 10 times and fix other parameters to see the impact of user number N𝑁Nitalic_N on UCR. In Fig. 7, as the user number increases from 10 to 160, the average UCR decreases. This is because the server allocates fewer resources to each VU and induces decreasing utility. In general, the comfortable frame rate for VR applications is at least 90 [42], i.e., at most 11ms for one frame. Note that the system delay in Fig. 7 is to complete each user’s all frames. In all user scenarios shown in Fig. 7, the delay for one frame (i.e., delayframe numberdelayframe number\frac{\text{delay}}{\text{frame number}}divide start_ARG delay end_ARG start_ARG frame number end_ARG) is less than 7 ms, which satisfies the comfortable frame rate requirement.

All the above simulations compare our algorithm with the baselines. Below we provide additional simulation results to show the impact of other settings to our algorithm.

Refer to caption
\thesubsubfigure
Refer to caption
\thesubsubfigure
Refer to caption
\thesubsubfigure
Refer to caption
\thesubsubfigure
Refer to caption
\thesubsubfigure
Refer to caption
\thesubsubfigure
Figure 5: The system utility-cost ratio (UCR) versus various parameters.

Impact of cost weights on UCR. We configure different cost weights of energy and delay (ce,ct)subscript𝑐𝑒subscript𝑐𝑡(c_{e},c_{t})( italic_c start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT , italic_c start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT ) to see the effect on the system UCR, where we enforce ce+ct=1subscript𝑐𝑒subscript𝑐𝑡1c_{e}+c_{t}=1italic_c start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT + italic_c start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT = 1. In Fig. 5(f), as ctsubscript𝑐𝑡c_{t}italic_c start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT rises to 0.8, the system UCR also increases, reflecting the importance of delay optimization for the whole system. However, as ctsubscript𝑐𝑡c_{t}italic_c start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT increases to 0.9, the system UCR instead drops significantly, since emphasizing the latency overwhelmingly while undervaluing the energy may enlarge the system cost.

Figure 6: Metrics with respect to the number of users.
Refer to caption
Refer to caption \thesubsubfigure Allocated parameters for each user. Refer to caption \thesubsubfigure Comparing individual users’ UCR.
Figure 6: Metrics with respect to the number of users.
Figure 7: Reviewing the allocated results of different users and the impact of user scenarios on UCR.

Reviewing different users’ allocated results. In Fig. 7(a), we present the optimized bandwidth bnsubscript𝑏𝑛b_{n}italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, transmit power pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, resolution snsubscript𝑠𝑛s_{n}italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, MS resource allocation fnMSsubscriptsuperscript𝑓MS𝑛f^{\textnormal{MS}}_{n}italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, and user CPU frequency fnVUsubscriptsuperscript𝑓VU𝑛f^{\textnormal{VU}}_{n}italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT of five users to visualize the resource allocation. Fig. 7(b) shows the impact of user scenarios on individual UCRs. Different user preferences and physical states affect subjective scores. For example, users who prefer high-quality videos may give stricter subjective scores than those who do not require high video quality. Generally, many users found sitting to provide more comfort than standing, as indicated by a higher UCR in most seated scenarios. However, it’s important to note that individual differences were observed, and this trend did not hold true for all participants.

To summarize, extensive simulation results above confirm the effectiveness of our proposed algorithm.

X Conclusion

In this paper, we optimize the system utility-cost ratio (UCR) for the Metaverse over wireless networks. The optimization variables include the allocation of both communication and computation resources as well as the resolutions of virtual reality (VR) videos. Our human-centric utility measure represents users’ subjective assessment of the VR video quality, and is supported by real datasets. We tackle the non-convex system UCR optimization by proposing a novel technique for fractional programming. Our computationally efficient algorithm for the system UCR optimization is validated by extensive simulations. Three future directions are as follows. Firstly, since the current paper solves the optimization problem via alternating optimization (AO) of video frame resolution and other variables, a future task is to see whether we can optimize all variables simultaneously to obtain the globally optimal solution. Secondly, we may incorporate the priorities of different users into computing the system utility (e.g., using a weighted sum with weights representing users’ priorities), and investigate the impact of such formulation on the optimization. Thirdly, while the current paper contains extensive simulation results to support the analysis, we can implement real-world systems to evaluate the performance of our proposed algorithm in practice.

Acknowledgement

This research is partly supported by the Singapore Ministry of Education Academic Research Fund under Grant Tier 1 RG90/22, Grant Tier 1 RG97/20, Grant Tier 1 RG24/20 and Grant Tier 2 MOE2019-T2-1-176; and partly by the Nanyang Technological University (NTU)-Wallenberg AI, Autonomous Systems and Software Program (WASP) Joint Project.

 
References

  • [1] Y. Wang, Z. Su, N. Zhang, R. Xing, D. Liu, T. H. Luan, and X. Shen, “A survey on Metaverse: Fundamentals, security, and privacy,” IEEE Communications Surveys & Tutorials (COMST), 2022.
  • [2] D. Mourtzis, N. Panopoulos, J. Angelopoulos, B. Wang, and L. Wang, “Human centric platforms for personalized value creation in Metaverse,” Journal of Manufacturing Systems, vol. 65, pp. 653–659, 2022.
  • [3] M. Xu, W. C. Ng, W. Y. B. Lim, J. Kang, Z. Xiong, D. Niyato, Q. Yang, X. Shen, and C. Miao, “A full dive into realizing the edge-enabled Metaverse: Visions, enabling technologies, and challenges,” IEEE Communications Surveys & Tutorials (COMST), 2022.
  • [4] S. Luo, X. Chen, Q. Wu, Z. Zhou, and S. Yu, “HFEL: Joint edge association and resource allocation for cost-efficient hierarchical federated edge learning,” IEEE Transactions on Wireless Communications, vol. 19, no. 10, pp. 6535–6548, 2020.
  • [5] Y. Zhan, P. Li, L. Wu, and S. Guo, “L4L: Experience-driven computational resource control in federated learning,” IEEE Transactions on Computers, vol. 71, no. 4, pp. 971–983, 2021.
  • [6] X. Zhou, J. Zhao, H. Han, and C. Guet, “Joint optimization of energy consumption and completion time in federated learning,” in IEEE 42nd International Conference on Distributed Computing Systems (ICDCS), 2022, pp. 1005-1017.
  • [7] Z. Yu, Y. Gong, S. Gong, and Y. Guo, “Joint task offloading and resource allocation in UAV-enabled mobile edge computing,” IEEE Internet of Things Journal, vol. 7, no. 4, pp. 3147–3159, 2020.
  • [8] Y. Lu, X. Chen, Y. Zhang, and Y. Chen, “Cost-efficient resources scheduling for mobile edge computing in ultra-dense networks,” IEEE Transactions on Network and Service Management, vol. 19, no. 3, pp. 3163–3173, 2022.
  • [9] L. P. Qian, Y. Wu, B. Ji, and X. S. Shen, “Optimal ADMM-based spectrum and power allocation for heterogeneous small-cell networks with hybrid energy supplies,” IEEE Transactions on Mobile Computing, vol. 20, no. 2, pp. 662–677, 2019.
  • [10] M. Elwardy, H.-J. Zepernick, and Y. Hu, “SSV360: A dataset on subjetive quality assessment of 360° videos for standing and seated viewing on an hmd,” in IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022.
  • [11] Y. Jong, “An efficient global optimization algorithm for nonlinear sum-of-ratios problem,” Optimization Online, pp. 1–21, 2012.
  • [12] K. Shen and W. Yu, “Fractional programming for communication systems-Part I: Power control and beamforming,” IEEE Transactions on Signal Processing, 2018.
  • [13] J. Jiang, M. Dianati, M. A. Imran, R. Tafazolli, and Y. Chen, “On the relation between energy efficiency and spectral efficiency of multiple-antenna systems,” IEEE Transactions on Vehicular Technology, vol. 62, no. 7, pp. 3463–3469, 2013.
  • [14] J. Zhao, X. Zhou, Y. Li, and L. Qian, “Optimizing utility-energy efficiency for the Metaverse over wireless networks under physical layer security,” to appear in ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc), 2023. https://arxiv.longhoe.net/abs/2303.04683
  • [15] Z. Hu, F. Zeng, Z. Xiao, B. Fu, H. Jiang, and H. Chen, “Computation efficiency maximization and QoE-provisioning in UAV-enabled MEC communication systems,” IEEE Transactions on Network Science and Engineering, vol. 8, no. 2, pp. 1630–1645, 2021.
  • [16] H. Hu, W. Song, Q. Wang, R. Q. Hu, and H. Zhu, “Energy efficiency and delay tradeoff in an MEC-enabled mobile IoT network,” IEEE Internet of Things Journal, vol. 9, no. 17, pp. 15 942–15 956, 2022.
  • [17] Z. Meng, C. She, G. Zhao, and D. De Martini, “Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in Metaverse,” IEEE Journal on Selected Areas in Communications (JSAC), 2022.
  • [18] W. Yu, T. J. Chua, and J. Zhao, “Asynchronous hybrid reinforcement learning for latency and reliability optimization in the Metaverse over wireless communications,” IEEE Journal on Selected Areas in Communications (JSAC), 2023. https://arxiv.longhoe.net/abs/2212.14749
  • [19] J. Wang, H. Du, Z. Tian, D. Niyato, J. Kang, and X. Shen, “Semantic-aware sensing information transmission for Metaverse: A contest theoretic approach,” IEEE Transactions on Wireless Communications (TWC), 2023.
  • [20] Y. Jiang, J. Kang, D. Niyato, X. Ge, Z. Xiong, C. Miao, and X. Shen, “Reliable distributed computing for Metaverse: A hierarchical game-theoretic approach,” IEEE Transactions on Vehicular Technology, 2022.
  • [21] Y. Ren, R. Xie, F. R. Yu, T. Huang, and Y. Liu, “Quantum collective learning and many-to-many matching game in the Metaverse for connected and autonomous vehicles,” IEEE Transactions on Vehicular Technology, 2022.
  • [22] D. P. Palomar and M. Chiang, “A tutorial on decomposition methods for network utility maximization,” IEEE Journal on Selected Areas in Communications, vol. 24, no. 8, pp. 1439–1451, 2006.
  • [23] X. Chen, X. Gong, L. Yang, and J. Zhang, “A social group utility maximization framework with applications in database assisted spectrum access,” in IEEE Conference on Computer Communications (INFOCOM), 2014, pp. 1959–1967.
  • [24] F. P. Kelly, A. K. Maulloo, and D. K. H. Tan, “Rate control for communication networks: Shadow prices, proportional fairness and stability,” Journal of the Operational Research Society, vol. 49, pp. 237–252, 1998.
  • [25] N. Heydaribeni and A. Anastasopoulos, “Distributed mechanism design for network resource allocation problems,” IEEE Transactions on Network Science and Engineering, vol. 7, no. 2, pp. 621–636, 2019.
  • [26] L. Gu, D. Zeng, S. Tao, S. Guo, H. **, A. Y. Zomaya, and W. Zhuang, “Fairness-aware dynamic rate control and flow scheduling for network utility maximization in network service chain,” IEEE Journal on Selected Areas in Communications, vol. 37, no. 5, pp. 1059–1071, 2019.
  • [27] X. Wang, Z. Fei, J. A. Zhang, J. Huang, and J. Yuan, “Constrained utility maximization in dual-functional radar-communication multi-uav networks,” IEEE Transactions on Communications, vol. 69, no. 4, pp. 2660–2672, 2020.
  • [28] X. Gong, X. Chen, K. Xing, D.-H. Shin, M. Zhang, and J. Zhang, “From social group utility maximization to personalized location privacy in mobile networks,” IEEE/ACM Transactions on Networking, vol. 25, no. 3, pp. 1703–1716, 2017.
  • [29] Y. Chen, K. Wu, and Q. Zhang, “From QoS to QoE: A tutorial on video quality assessment,” IEEE Communications Surveys & Tutorials, vol. 17, no. 2, pp. 1126–1165, 2014.
  • [30] J. Cao, K.-Y. Lam, L.-H. Lee, X. Liu, P. Hui, and X. Su, “Mobile augmented reality: User interfaces, frameworks, and intelligence,” ACM Computing Surveys, vol. 55, no. 9, pp. 1–36, 2023.
  • [31] Netflix, “Datasets for video multimethod assessment fusion,” https://github.com/Netflix/vmaf/blob/master/resource/doc/datasets.md
  • [32] D. Yang, G. Xue, X. Fang, and J. Tang, “Crowdsourcing to smartphones: Incentive mechanism design for mobile phone sensing,” in ACM International Conference on Mobile Computing and Networking (MobiCom), 2012, pp. 173–184.
  • [33] X. Deng, J. Li, L. Shi, Z. Wei, X. Zhou, and J. Yuan, “Wireless powered mobile edge computing: Dynamic resource allocation and throughput maximization,” IEEE Transactions on Mobile Computing, vol. 21, no. 6, pp. 2271–2288, 2020.
  • [34] F. Lyu, P. Yang, H. Wu, C. Zhou, J. Ren, Y. Zhang, and X. Shen, “Service-oriented dynamic resource slicing and optimization for space-air-ground integrated vehicular networks,” IEEE Transactions on Intelligent Transportation Systems, 2021.
  • [35] J. Feng, L. Liu, Q. Pei, and K. Li, “Min-max cost optimization for efficient hierarchical federated learning in wireless edge networks,” IEEE Transactions on Parallel and Distributed Systems, 2021.
  • [36] J. Zhao, L. Qian, and W. Yu, “Human-centric resource allocation in the Metaverse over wireless communications,” 2023, full version of this paper and available online at https://personal.ntu.edu.sg/JunZhao/JSAC2023.pdf
  • [37] R. Zhou and D. P. Palomar, “Solving high-order portfolios via successive convex approximation algorithms,” IEEE Transactions on Signal Processing, vol. 69, pp. 892–904, 2021.
  • [38] S. Boyd and L. Vandenberghe, Convex Optimization.   Cambridge University Press, 2004.
  • [39] A. Fonda and P. Gidoni, “Generalizing the Poincaré–Miranda theorem: The avoiding cones condition,” Annali di Matematica Pura ed Applicata (Annals of Pure and Applied Mathematics), vol. 195, no. 4, pp. 1347–1371, 2016.
  • [40] M. L. Galván, “The multivariate bisection algorithm,” arXiv:1702.05542, 2017, https://arxiv.longhoe.net/pdf/1702.05542.pdf
  • [41] Q. Liu, S. Huang, J. Opadere, and T. Han, “An edge network orchestrator for mobile augmented reality,” in IEEE INFOCOM, 2018.
  • [42] E. Bastug, M. Bennis, M. Médard, and M. Debbah, “Toward interconnected virtual reality: Opportunities, challenges, and enablers,” IEEE Communications Magazine, vol. 55, no. 6, pp. 110–117, 2017.
[Uncaptioned image] Jun Zhao (Member, IEEE) received a bachelor’s degree in Information Engineering from Shanghai Jiao Tong University, China, in July 2010, and a Ph.D. degree in Electrical and Computer Engineering from Carnegie Mellon University (CMU), USA, in May 2015, (advisors: Virgil Gligor and Osman Yagan; collaborator: Adrian Perrig), affiliating with CMU’s renowned CyLab Security & Privacy Institute. He is currently an Assistant Professor in the School of Computer Science and Engineering (SCSE), Nanyang Technological University (NTU), Singapore. Before joining NTU as a Faculty Member, he was a Postdoctoral Researcher under the supervision of Xiaokui Xiao at NTU. Before that, he was a Postdoctoral Researcher at Arizona State University as an Arizona Computing Post-Doctoral Researcher Best Practices Fellow (advisors: Junshan Zhang and Vincent Poor).
[Uncaptioned image] Liangxin Qian received bachelor’s and master’s degrees in communication engineering from the University of Electronic Science and Technology of China, Chengdu, China, in 2019 and 2022, respectively. He is currently working toward his Ph.D. at the School of Computer Science and Engineering, Nanyang Technological University, Singapore. His research interests include Metaverse, mobile edge computing, and communication theory.
[Uncaptioned image] Wenhan Yu (Student Member, IEEE) received his B.S. degree in Computer Science and Technology from Sichuan University, Sichuan, China in 2021. He is currently pursuing a Ph.D. degree in the School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore. His research interests cover wireless communications, deep reinforcement learning, optimization, and Metaverse.

-A Proving the relationship between FP-minimization in (10) and minimizing W(𝐱,𝐲):=G(𝐱)+n=1NKn(𝐱,yn)assign𝑊𝐱𝐲𝐺𝐱superscriptsubscript𝑛1𝑁subscript𝐾𝑛𝐱subscript𝑦𝑛W(\bm{x},\bm{y}):=G(\bm{x})+\sum_{n=1}^{N}K_{n}(\bm{x},y_{n})italic_W ( bold_italic_x , bold_italic_y ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) subject to 𝐱𝒮𝐱𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S and yn+subscript𝑦𝑛superscripty_{n}\in\mathbb{R}^{+}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ∈ blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT, stated in Section IV on Pages IV and I

Recall that FP-minimization in (10) means minimizing H(𝒙):=G(𝒙)+n=1NAn(𝒙)Bn(𝒙)assign𝐻𝒙𝐺𝒙superscriptsubscript𝑛1𝑁subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙H(\bm{x}):=G(\bm{x})+\sum_{n=1}^{N}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}italic_H ( bold_italic_x ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG subject to 𝒙𝒙\bm{x}bold_italic_x in a convex set 𝒮𝒮\mathcal{S}caligraphic_S, for convex An(𝒙)subscript𝐴𝑛𝒙A_{n}(\bm{x})italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) and concave Bn(𝒙)subscript𝐵𝑛𝒙B_{n}(\bm{x})italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ).

We now consider alternating optimization (AO) of 𝒙𝒙\bm{x}bold_italic_x and 𝒚𝒚\bm{y}bold_italic_y to minimize W(𝒙,𝒚):=G(𝒙)+n=1NKn(𝒙,yn)assign𝑊𝒙𝒚𝐺𝒙superscriptsubscript𝑛1𝑁subscript𝐾𝑛𝒙subscript𝑦𝑛W(\bm{x},\bm{y}):=G(\bm{x})+\sum_{n=1}^{N}K_{n}(\bm{x},y_{n})italic_W ( bold_italic_x , bold_italic_y ) := italic_G ( bold_italic_x ) + ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S and 𝒚:=[y1,,yN](+)Nassign𝒚subscript𝑦1subscript𝑦𝑁superscriptsuperscript𝑁\bm{y}:=[y_{1},\ldots,y_{N}]\in(\mathbb{R}^{+})^{N}bold_italic_y := [ italic_y start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_y start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ∈ ( blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT, where Kn(𝒙,yn):=[An(𝒙)]2yn+14[Bn(𝒙)]2ynassignsubscript𝐾𝑛𝒙subscript𝑦𝑛superscriptdelimited-[]subscript𝐴𝑛𝒙2subscript𝑦𝑛14superscriptdelimited-[]subscript𝐵𝑛𝒙2subscript𝑦𝑛K_{n}(\bm{x},y_{n}):=[A_{n}(\bm{x})]^{2}y_{n}+\frac{1}{4[B_{n}(\bm{x})]^{2}y_{% n}}italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) := [ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 4 [ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG, and +superscript\mathbb{R}^{+}blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT denotes the set of positive numbers. We will show that

if the above AO process of minimizing W(𝒙,𝒚) convergesto (𝒙*,𝒚*)𝒙* is a stationary point for FP-minimizationin (10).if the above AO process of minimizing W(𝒙,𝒚) convergesto (𝒙*,𝒚*)𝒙* is a stationary point for FP-minimizationin (10).\displaystyle\begin{array}[]{l}\text{if the above AO process of minimizing $W(% \bm{x},\bm{y})$ converges}\\ \text{to $(\bm{x}^{*},\bm{y}^{*})$, $\bm{x}^{*}$ is a stationary point for % \mbox{{FP-minimization}}}\\ \text{in~{}(\ref{FP-minimization}).}\end{array}start_ARRAY start_ROW start_CELL if the above AO process of minimizing italic_W ( bold_italic_x , bold_italic_y ) converges end_CELL end_ROW start_ROW start_CELL to ( bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT ) , bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT is a stationary point for typewriter_FP-minimization end_CELL end_ROW start_ROW start_CELL in ( ). end_CELL end_ROW end_ARRAY (112)

The AO process is as follows: We start with a randomly initialized 𝒙(0)𝒮superscript𝒙0𝒮\bm{x}^{(0)}\in\mathcal{S}bold_italic_x start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT ∈ caligraphic_S. Then we optimize 𝒚𝒚\bm{y}bold_italic_y with 𝒙𝒙\bm{x}bold_italic_x being 𝒙(0)superscript𝒙0\bm{x}^{(0)}bold_italic_x start_POSTSUPERSCRIPT ( 0 ) end_POSTSUPERSCRIPT to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), and denote the obtained 𝒚(+)N𝒚superscriptsuperscript𝑁\bm{y}\in(\mathbb{R}^{+})^{N}bold_italic_y ∈ ( blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT as 𝒚(1)superscript𝒚1\bm{y}^{(1)}bold_italic_y start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT. Given 𝒚𝒚\bm{y}bold_italic_y as 𝒚(1)superscript𝒚1\bm{y}^{(1)}bold_italic_y start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, we optimize 𝒙𝒙\bm{x}bold_italic_x to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), and denote the obtained 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S as 𝒙(1)superscript𝒙1\bm{x}^{(1)}bold_italic_x start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT. Given 𝒙𝒙\bm{x}bold_italic_x as 𝒙(1)superscript𝒙1\bm{x}^{(1)}bold_italic_x start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, we optimize 𝒚𝒚\bm{y}bold_italic_y to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), and denote the obtained 𝒚(+)N𝒚superscriptsuperscript𝑁\bm{y}\in(\mathbb{R}^{+})^{N}bold_italic_y ∈ ( blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT as 𝒚(2)superscript𝒚2\bm{y}^{(2)}bold_italic_y start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT. The above process continues iteratively. The i𝑖iitalic_i-th iteration includes the following two steps:

  • Given 𝒙𝒙\bm{x}bold_italic_x as 𝒙(i1)superscript𝒙𝑖1\bm{x}^{(i-1)}bold_italic_x start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT, we optimize 𝒚𝒚\bm{y}bold_italic_y to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), and denote the obtained 𝒚(+)N𝒚superscriptsuperscript𝑁\bm{y}\in(\mathbb{R}^{+})^{N}bold_italic_y ∈ ( blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT as 𝒚(i)superscript𝒚𝑖\bm{y}^{(i)}bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT.

  • Given 𝒚𝒚\bm{y}bold_italic_y as 𝒚(i)superscript𝒚𝑖\bm{y}^{(i)}bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT, we optimize 𝒙𝒙\bm{x}bold_italic_x to minimize W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), and denote the obtained 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S as 𝒙(i)superscript𝒙𝑖\bm{x}^{(i)}bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT.

The above AO process converges when the relative difference between W(𝒙(i1),𝒚(i1))𝑊superscript𝒙𝑖1superscript𝒚𝑖1W(\bm{x}^{(i-1)},\bm{y}^{(i-1)})italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT ) and W(𝒙(i),𝒚(i))𝑊superscript𝒙𝑖superscript𝒚𝑖W(\bm{x}^{(i)},\bm{y}^{(i)})italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) is smaller than a predefined small error tolerance.

To examine the AO process of minimizing W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), we will analyze 1) optimizing 𝒚𝒚\bm{y}bold_italic_y given 𝒙𝒙\bm{x}bold_italic_x, and 2) optimizing 𝒙𝒙\bm{x}bold_italic_x given 𝒚𝒚\bm{y}bold_italic_y. Optimizing 𝒚𝒚\bm{y}bold_italic_y given 𝒙𝒙\bm{x}bold_italic_x means minimizing Kn(𝒙,yn):=[An(𝒙)]2yn+14[Bn(𝒙)]2ynassignsubscript𝐾𝑛𝒙subscript𝑦𝑛superscriptdelimited-[]subscript𝐴𝑛𝒙2subscript𝑦𝑛14superscriptdelimited-[]subscript𝐵𝑛𝒙2subscript𝑦𝑛K_{n}(\bm{x},y_{n}):=[A_{n}(\bm{x})]^{2}y_{n}+\frac{1}{4[B_{n}(\bm{x})]^{2}y_{% n}}italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) := [ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG 4 [ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG with respect to ynsubscript𝑦𝑛y_{n}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT for each n=1,2,,N𝑛12𝑁n=1,2,\ldots,Nitalic_n = 1 , 2 , … , italic_N; i.e., letting ynsubscript𝑦𝑛y_{n}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT be yn#(𝒙):=12An(𝒙)Bn(𝒙)assignsuperscriptsubscript𝑦𝑛#𝒙12subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙y_{n}^{\#}(\bm{x}):=\frac{1}{2A_{n}(\bm{x})B_{n}(\bm{x})}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) := divide start_ARG 1 end_ARG start_ARG 2 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG. If such 𝒚𝒚\bm{y}bold_italic_y is substituted back to Kn(𝒙,yn)subscript𝐾𝑛𝒙subscript𝑦𝑛K_{n}(\bm{x},y_{n})italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), then Kn(𝒙,yn)subscript𝐾𝑛𝒙subscript𝑦𝑛K_{n}(\bm{x},y_{n})italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) will become the desired An(𝒙)Bn(𝒙)subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG. Moreover, we now show that the partial derivative of W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) with respect to 𝒙𝒙\bm{x}bold_italic_x at 𝒚𝒚\bm{y}bold_italic_y being 𝒚#(𝒙)superscript𝒚#𝒙\bm{y}^{\#}(\bm{x})bold_italic_y start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) is the same as the derivative of H(𝒙)𝐻𝒙H(\bm{x})italic_H ( bold_italic_x ) with respect to 𝒙𝒙\bm{x}bold_italic_x. In fact, we have

Kn(𝒙,yn)𝒙subscript𝐾𝑛𝒙subscript𝑦𝑛𝒙\displaystyle\frac{\partial K_{n}(\bm{x},y_{n})}{\partial\bm{x}}divide start_ARG ∂ italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ bold_italic_x end_ARG =2An(𝒙)ynAn(𝒙)𝒙12[Bn(𝒙)]3ynBn(𝒙)𝒙,absent2subscript𝐴𝑛𝒙subscript𝑦𝑛subscript𝐴𝑛𝒙𝒙12superscriptdelimited-[]subscript𝐵𝑛𝒙3subscript𝑦𝑛subscript𝐵𝑛𝒙𝒙\displaystyle=2A_{n}(\bm{x})y_{n}\frac{\partial A_{n}(\bm{x})}{\partial\bm{x}}% -\frac{1}{2[B_{n}(\bm{x})]^{3}y_{n}}\cdot\frac{\partial B_{n}(\bm{x})}{% \partial\bm{x}},= 2 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG ∂ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG ∂ bold_italic_x end_ARG - divide start_ARG 1 end_ARG start_ARG 2 [ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ] start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ⋅ divide start_ARG ∂ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG ∂ bold_italic_x end_ARG , (113)

and

(An(𝒙)Bn(𝒙))𝒙subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙𝒙\displaystyle\frac{\partial\big{(}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}\big{)}}{% \partial\bm{x}}divide start_ARG ∂ ( divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG ) end_ARG start_ARG ∂ bold_italic_x end_ARG =An(𝒙)𝒙Bn(𝒙)Bn(𝒙)𝒙An(𝒙)(Bn(𝒙))2.absentsubscript𝐴𝑛𝒙𝒙subscript𝐵𝑛𝒙subscript𝐵𝑛𝒙𝒙subscript𝐴𝑛𝒙superscriptsubscript𝐵𝑛𝒙2\displaystyle=\frac{\frac{\partial A_{n}(\bm{x})}{\partial\bm{x}}\cdot B_{n}(% \bm{x})-\frac{\partial B_{n}(\bm{x})}{\partial\bm{x}}\cdot A_{n}(\bm{x})}{(B_{% n}(\bm{x}))^{2}}.= divide start_ARG divide start_ARG ∂ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG ∂ bold_italic_x end_ARG ⋅ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) - divide start_ARG ∂ italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG ∂ bold_italic_x end_ARG ⋅ italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG ( italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG . (114)

From (113) and (114), it holds that

(Kn(𝒙,yn)𝒙)|yn=12An(𝒙)Bn(𝒙)evaluated-atsubscript𝐾𝑛𝒙subscript𝑦𝑛𝒙subscript𝑦𝑛12subscript𝐴𝑛𝒙subscript𝐵𝑛𝒙\displaystyle\bigg{(}\frac{\partial K_{n}(\bm{x},y_{n})}{\partial\bm{x}}\bigg{% )}|_{y_{n}=\frac{1}{2A_{n}(\bm{x})B_{n}(\bm{x})}}( divide start_ARG ∂ italic_K start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x , italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ bold_italic_x end_ARG ) | start_POSTSUBSCRIPT italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG 2 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG end_POSTSUBSCRIPT =(An(𝒙)Bn(𝒙))𝒙,absentsubscript𝐴𝑛𝒙subscript𝐵𝑛𝒙𝒙\displaystyle=\frac{\partial\big{(}\frac{A_{n}(\bm{x})}{B_{n}(\bm{x})}\big{)}}% {\partial\bm{x}},= divide start_ARG ∂ ( divide start_ARG italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG start_ARG italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x ) end_ARG ) end_ARG start_ARG ∂ bold_italic_x end_ARG , (115)

which further implies

(W(𝒙,𝒚)𝒙)|𝒚=𝒚#(𝒙)evaluated-at𝑊𝒙𝒚𝒙𝒚superscript𝒚#𝒙\displaystyle\bigg{(}\frac{\partial W(\bm{x},\bm{y})}{\partial\bm{x}}\bigg{)}|% _{\bm{y}=\bm{y}^{\#}(\bm{x})}( divide start_ARG ∂ italic_W ( bold_italic_x , bold_italic_y ) end_ARG start_ARG ∂ bold_italic_x end_ARG ) | start_POSTSUBSCRIPT bold_italic_y = bold_italic_y start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) end_POSTSUBSCRIPT =H(𝒙)𝒙.absent𝐻𝒙𝒙\displaystyle=\frac{\partial H(\bm{x})}{\partial\bm{x}}.= divide start_ARG ∂ italic_H ( bold_italic_x ) end_ARG start_ARG ∂ bold_italic_x end_ARG . (116)

Moreover, as explained, we have

W(𝒙,𝒚)|𝒚=𝒚#(𝒙)evaluated-at𝑊𝒙𝒚𝒚superscript𝒚#𝒙\displaystyle W(\bm{x},\bm{y})|_{\bm{y}=\bm{y}^{\#}(\bm{x})}italic_W ( bold_italic_x , bold_italic_y ) | start_POSTSUBSCRIPT bold_italic_y = bold_italic_y start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( bold_italic_x ) end_POSTSUBSCRIPT =H(𝒙).absent𝐻𝒙\displaystyle=H(\bm{x}).= italic_H ( bold_italic_x ) . (117)

Using (116) and (117), we now show (112). The AO process of minimizing W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) is non-decreasing. Specifically, we have W(𝒙(i),𝒚(i))W(𝒙(i1),𝒚(i))W(𝒙(i1),𝒚(i1))𝑊superscript𝒙𝑖superscript𝒚𝑖𝑊superscript𝒙𝑖1superscript𝒚𝑖𝑊superscript𝒙𝑖1superscript𝒚𝑖1W(\bm{x}^{(i)},\bm{y}^{(i)})\leq W(\bm{x}^{(i-1)},\bm{y}^{(i)})\leq W(\bm{x}^{% (i-1)},\bm{y}^{(i-1)})italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) ≤ italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) ≤ italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i - 1 ) end_POSTSUPERSCRIPT ). For lower-bounded W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ), we know W(𝒙(i),𝒚(i))𝑊superscript𝒙𝑖superscript𝒚𝑖W(\bm{x}^{(i)},\bm{y}^{(i)})italic_W ( bold_italic_x start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT ( italic_i ) end_POSTSUPERSCRIPT ) converges as the iteration number i𝑖i\to\inftyitalic_i → ∞. Supposing the variable solution of the AO process converges to (𝒙*,𝒚*)superscript𝒙superscript𝒚(\bm{x}^{*},\bm{y}^{*})( bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT , bold_italic_y start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT ), we know that

  • 𝒚*superscript𝒚\bm{y}^{*}bold_italic_y start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT is the optimal 𝒚𝒚\bm{y}bold_italic_y for minimizing W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) given 𝒙𝒙\bm{x}bold_italic_x as 𝒙*superscript𝒙\bm{x}^{*}bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT (i.e., yn*:=12An(𝒙*)Bn(𝒙*)assignsuperscriptsubscript𝑦𝑛12subscript𝐴𝑛superscript𝒙subscript𝐵𝑛superscript𝒙y_{n}^{*}:=\frac{1}{2A_{n}(\bm{x}^{*})B_{n}(\bm{x}^{*})}italic_y start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT := divide start_ARG 1 end_ARG start_ARG 2 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT ) italic_B start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT ) end_ARG), and

  • 𝒙*superscript𝒙\bm{x}^{*}bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT is the optimal 𝒙𝒙\bm{x}bold_italic_x for minimizing W(𝒙,𝒚)𝑊𝒙𝒚W(\bm{x},\bm{y})italic_W ( bold_italic_x , bold_italic_y ) given 𝒚𝒚\bm{y}bold_italic_y as 𝒚*superscript𝒚\bm{y}^{*}bold_italic_y start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT.

Result “②” means that 𝒙*superscript𝒙\bm{x}^{*}bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT satisfies the KKT conditions for optimizing 𝒙𝒙\bm{x}bold_italic_x to minimize W(𝒙,𝒚*)𝑊𝒙superscript𝒚W(\bm{x},\bm{y}^{*})italic_W ( bold_italic_x , bold_italic_y start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S. Suppose 𝒙𝒙\bm{x}bold_italic_x is M𝑀Mitalic_M-dimensional, and 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S means

{𝒬q(𝒙)0,q=1,2,,Q,r(𝒙)=0,r=1,2,,R,𝒙M.casessubscript𝒬𝑞𝒙0𝑞12𝑄subscript𝑟𝒙0𝑟12𝑅𝒙superscript𝑀𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒\displaystyle\begin{cases}\mathcal{Q}_{q}(\bm{x})\leq 0,&q=1,2,\ldots,Q,\\ \mathcal{R}_{r}(\bm{x})=0,&r=1,2,\ldots,R,\\ \bm{x}\in\mathbb{R}^{M}.\end{cases}{ start_ROW start_CELL caligraphic_Q start_POSTSUBSCRIPT italic_q end_POSTSUBSCRIPT ( bold_italic_x ) ≤ 0 , end_CELL start_CELL italic_q = 1 , 2 , … , italic_Q , end_CELL end_ROW start_ROW start_CELL caligraphic_R start_POSTSUBSCRIPT italic_r end_POSTSUBSCRIPT ( bold_italic_x ) = 0 , end_CELL start_CELL italic_r = 1 , 2 , … , italic_R , end_CELL end_ROW start_ROW start_CELL bold_italic_x ∈ blackboard_R start_POSTSUPERSCRIPT italic_M end_POSTSUPERSCRIPT . end_CELL start_CELL end_CELL end_ROW

Then with 𝜶𝜶\bm{\alpha}bold_italic_α and 𝜷𝜷\bm{\beta}bold_italic_β denoting the multipliers, the KKT conditions mean

(118e)
(118i)
(118k)
(118m)

Using (116) in (118e), we know that (118e)–(118m) are equivalent to

(118doe)
(118doi)
(118dok)
(118dom)

The above (118doe)–(118dom) mean that 𝒙*superscript𝒙\bm{x}^{*}bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT is a stationary point for optimizing 𝒙𝒙\bm{x}bold_italic_x to minimize H(𝒙)𝐻𝒙H(\bm{x})italic_H ( bold_italic_x ) subject to 𝒙𝒮𝒙𝒮\bm{x}\in\mathcal{S}bold_italic_x ∈ caligraphic_S; i.e., 𝒙*superscript𝒙\bm{x}^{*}bold_italic_x start_POSTSUPERSCRIPT * end_POSTSUPERSCRIPT is a stationary point of FP-minimization in (10). Hence, we have proved (112).∎

-B Proving that the left-hand side of (72) is non-increasing with respect to γ𝛾\gammaitalic_γ

With v(x)𝑣𝑥v(x)italic_v ( italic_x ) defined by ζn𝒜n(sn,Λn)x2yce2κMSn(sn,Λn)xsubscript𝜁𝑛subscript𝒜𝑛subscript𝑠𝑛subscriptΛ𝑛superscript𝑥2𝑦subscript𝑐e2superscript𝜅MSsubscript𝑛subscript𝑠𝑛subscriptΛ𝑛𝑥\zeta_{n}\frac{\mathcal{A}_{n}(s_{n},\Lambda_{n})}{x^{2}}-yc_{\hskip 0.5pt% \textnormal{e}}\cdot 2\kappa^{\textnormal{MS}}\mathcal{F}_{n}(s_{n},\Lambda_{n% })xitalic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT divide start_ARG caligraphic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG - italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ 2 italic_κ start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT caligraphic_F start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_x, clearly v(x)𝑣𝑥v(x)italic_v ( italic_x ) is non-increasing with respect to x𝑥xitalic_x. Then PositiveRoot(v(x)=γ)PositiveRoot𝑣𝑥𝛾\text{PositiveRoot}(v(x)=\gamma)PositiveRoot ( italic_v ( italic_x ) = italic_γ ), denoting the positive root satisfying v(x)=γ𝑣𝑥𝛾v(x)=\gammaitalic_v ( italic_x ) = italic_γ, is non-increasing with respect to γ𝛾\gammaitalic_γ. Thus, the left-hand side of (72) is non-increasing with respect to γ𝛾\gammaitalic_γ. ∎

-C Proving that the left-hand side of (82) is non-increasing with respect to pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT

From (77), we know (i) ψn(pn,α,β)subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) is positive and decreasing in pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, where “\bigstar” denotes “𝒛,y,𝒔𝒛𝑦𝒔\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s”. In addition, (ii) the function log2(1+x)x(1+x)ln2subscript21𝑥𝑥1𝑥2\log_{2}(1+x)-\frac{x}{(1+x)\ln 2}roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_x ) - divide start_ARG italic_x end_ARG start_ARG ( 1 + italic_x ) roman_ln 2 end_ARG is increasing and positive for x>0𝑥0x>0italic_x > 0 since the derivative x(1+x)2ln2𝑥superscript1𝑥22\frac{x}{(1+x)^{2}\ln 2}divide start_ARG italic_x end_ARG start_ARG ( 1 + italic_x ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT roman_ln 2 end_ARG is positive for x>0𝑥0x>0italic_x > 0, and log2(1+x)x(1+x)ln2subscript21𝑥𝑥1𝑥2\log_{2}(1+x)-\frac{x}{(1+x)\ln 2}roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_x ) - divide start_ARG italic_x end_ARG start_ARG ( 1 + italic_x ) roman_ln 2 end_ARG at x=0𝑥0x=0italic_x = 0 equals 00. From the above Results “(i)” and “(ii)”, we obtain (iii) [log2(1+ψn(pn,α,β))ψn(pn,α,β)(1+ψn(pn,α,β))ln2]delimited-[]subscript21subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽1subscript𝜓𝑛subscript𝑝𝑛𝛼conditional𝛽2\left[\log_{2}\big{(}1+\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$% \bigstar$})\big{)}-\frac{\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$% \bigstar$})}{(1+\psi_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$}))% \ln 2}\right][ roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ) - divide start_ARG italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_ARG start_ARG ( 1 + italic_ψ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ) roman_ln 2 end_ARG ] is positive and decreasing in pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.

We also have (iv) the function log2(1+x)xsubscript21𝑥𝑥\frac{\log_{2}(1+x)}{x}divide start_ARG roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_x ) end_ARG start_ARG italic_x end_ARG is decreasing for x>0𝑥0x>0italic_x > 0 since the derivative 1x2[x(1+x)ln2log2(1+x)]1superscript𝑥2delimited-[]𝑥1𝑥2subscript21𝑥\frac{1}{x^{2}}[\frac{x}{(1+x)\ln 2}-\log_{2}(1+x)]divide start_ARG 1 end_ARG start_ARG italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG [ divide start_ARG italic_x end_ARG start_ARG ( 1 + italic_x ) roman_ln 2 end_ARG - roman_log start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ( 1 + italic_x ) ] is negative due to Result “(ii)” above. From the above Results “(i)” and “(iv)”, we obtain (v) r¯n(pn,α,β)subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) defined in (78) is increasing in pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. Since the utility function Un(rn,sn)subscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛U_{n}(r_{n},s_{n})italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is concave and non-decreasing in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT, Un(rn,sn)rnsubscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝑟𝑛\frac{\partial U_{n}(r_{n},s_{n})}{\partial r_{n}}divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG is non-negative and non-increasing in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. Then (vi) Un(rn,sn)rn+yce2znrn3νn2+ζnsnμnΛnrn2νnsubscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝑟𝑛𝑦subscript𝑐e2subscript𝑧𝑛superscriptsubscript𝑟𝑛3superscriptsubscript𝜈𝑛2subscript𝜁𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛superscriptsubscript𝑟𝑛2subscript𝜈𝑛\frac{\partial U_{n}(r_{n},s_{n})}{\partial r_{n}}+\frac{yc_{\hskip 0.5pt% \textnormal{e}}}{2z_{n}{r_{n}}^{3}{{\nu_{n}}^{2}}}+\frac{\zeta_{n}s_{n}{\color% [rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}}}{{r_{n}}^{2}{\nu_{n}}}divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG + divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG + divide start_ARG italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG is positive and non-increasing in rnsubscript𝑟𝑛r_{n}italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT. From the above Results “(v)” and “(vi)”, we obtain (vii) (Un(rn,sn)rn)|rn=r¯n(pn,α,β)+yce2zn[r¯n(pn,α,β)]3νn2+ζnsnμnΛn[r¯n(pn,α,β)]2νnevaluated-atsubscript𝑈𝑛subscript𝑟𝑛subscript𝑠𝑛subscript𝑟𝑛subscript𝑟𝑛subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽𝑦subscript𝑐e2subscript𝑧𝑛superscriptdelimited-[]subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽3superscriptsubscript𝜈𝑛2subscript𝜁𝑛subscript𝑠𝑛subscript𝜇𝑛subscriptΛ𝑛superscriptdelimited-[]subscript¯𝑟𝑛subscript𝑝𝑛𝛼conditional𝛽2subscript𝜈𝑛\big{(}\frac{\partial U_{n}(r_{n},s_{n})}{\partial r_{n}}\big{)}|_{r_{n}=% \overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})}+\frac{% yc_{\hskip 0.5pt\textnormal{e}}}{2z_{n}\cdot[\overline{r}_{n}(p_{n},\alpha,% \beta\mid\textnormal{\small$\bigstar$})]^{3}{\color[rgb]{0,0,0}{\nu_{n}}^{2}}}% +\frac{\zeta_{n}s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{0,0,0}\Lambda_{n}% }}{[\overline{r}_{n}(p_{n},\alpha,\beta\mid\textnormal{\small$\bigstar$})]^{2}% {\color[rgb]{0,0,0}\nu_{n}}}( divide start_ARG ∂ italic_U start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) end_ARG start_ARG ∂ italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG ) | start_POSTSUBSCRIPT italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) end_POSTSUBSCRIPT + divide start_ARG italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT end_ARG start_ARG 2 italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ [ over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ] start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG + divide start_ARG italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG [ over¯ start_ARG italic_r end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_α , italic_β ∣ ★ ) ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG is positive and non-increasing in pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.

From the above Results “(iii)” and “(vii)”, the left hand side of (82) is decreasing as pnsubscript𝑝𝑛p_{n}italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases. ∎

-D Further explanations of the step-by-step analysis in (54) on Page 54 for Problem 5(𝐳,y,𝐬)subscript5𝐳𝑦𝐬\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ), which will be useful for Appendices -E-F, and -H

In this part, we provide further explanations of the step-by-step analysis in (54) on Page 54 for Problem 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ), which will be useful to prove the results in Appendices -E-F, and -H later.

We recall Problem 5(𝒛,y,𝒔)subscript5𝒛𝑦𝒔\mathbb{P}_{5}(\bm{z},y,\bm{s})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( bold_italic_z , italic_y , bold_italic_s ) (i.e., 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ )) from (16):

5():max𝒃,𝒑,𝒇MS,𝒇VU,T:subscript5subscript𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\displaystyle\textnormal{$\mathbb{P}_{5}(\textnormal{\small$\bigstar$})$}:\max% \limits_{\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},T}blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) : roman_max start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT F(𝒃,𝒑,𝒇MS,𝒇VU,T𝒔,y)𝐹𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝒔𝑦\displaystyle F(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}% },T\mid\bm{s},y)italic_F ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ bold_italic_s , italic_y )
ycen𝒩{[(pn+pncir)snμnΛn]2zn\displaystyle-yc_{\hskip 0.5pt\textnormal{e}}\cdot\sum_{n\in\mathcal{N}}\big{% \{}[(p_{n}+p_{n}^{\textnormal{cir}})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[% rgb]{0,0,0}\Lambda_{n}}]^{2}z_{n}- italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT { [ ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
+14(rn(bn,pn)νn)2zn}\displaystyle+\frac{1}{4(r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}\nu_{n}})^{2}z_{% n}}\big{\}}+ divide start_ARG 1 end_ARG start_ARG 4 ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG }
s.t. (7a): n𝒩bnbmax,(7a): subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max\displaystyle\textnormal{(\ref{constraintbn}): }\sum_{n\in\mathcal{N}}b_{n}% \leq b_{\textnormal{max}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ,
(7b): n𝒩pnpmax,(7b): subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max\displaystyle\textnormal{(\ref{constraintpn}): }\sum_{n\in\mathcal{N}}p_{n}% \leq p_{\textnormal{max}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ,
(7d): n𝒩fnMSfmaxMS,(7d): subscript𝑛𝒩superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓maxMS\displaystyle\textnormal{(\ref{constraintfMS}): }\sum_{n\in\mathcal{N}}f_{n}^{% \textnormal{MS}}\leq f_{\textnormal{max}}^{\textnormal{MS}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ,
(7e): fnVUfn,maxVU,n𝒩,formulae-sequence(7e): superscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVUfor-all𝑛𝒩\displaystyle\textnormal{(\ref{constraintfn}): }f_{n}^{\textnormal{VU}}\leq f_% {n,\textnormal{max}}^{\textnormal{VU}},~{}\forall n\in\mathcal{N},( ): italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , ∀ italic_n ∈ caligraphic_N ,
(11a): tn(bn,pn,sn,fnMS,fnVU)T,n𝒩.formulae-sequence(11a): subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇for-all𝑛𝒩\displaystyle\textnormal{(\ref{constraintTtau}): }t_{n}(b_{n},p_{n},s_{n},f_{n% }^{\textnormal{MS}},f_{n}^{\textnormal{VU}})\leq T,~{}\forall n\in\mathcal{N}.( ): italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ≤ italic_T , ∀ italic_n ∈ caligraphic_N .

As shown at the beginning of Section VI on Page VI, 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) belongs to convex optimization, and α,β,γ,𝜹,𝜻𝛼𝛽𝛾𝜹𝜻\alpha,\beta,\gamma,\bm{\delta},\bm{\zeta}italic_α , italic_β , italic_γ , bold_italic_δ , bold_italic_ζ denote the Lagrange multipliers for (7a), (7b), (7d), (7e), and (11a), respectively.

Suppose we already know 𝜻𝜻\bm{\zeta}bold_italic_ζ. We move 𝜻𝜻\bm{\zeta}bold_italic_ζ and (11a) to the objective function, and construct the following problem (recall that for an optimization problem isubscript𝑖\mathbb{P}_{i}blackboard_P start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT, we use Hisubscript𝐻subscript𝑖H_{\mathbb{P}_{i}}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT end_POSTSUBSCRIPT to denote its objective function):

7(,𝜻):min𝒃,𝒑,𝒇MS,𝒇VU,T:subscript7𝜻subscript𝒃𝒑superscript𝒇MSsuperscript𝒇VU𝑇\displaystyle\textnormal{$\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{% \zeta})$}:\min\limits_{\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{% \textnormal{VU}},T}blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) : roman_min start_POSTSUBSCRIPT bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T end_POSTSUBSCRIPT H5(𝒃,𝒑,𝒇MS,𝒇VU,T)subscript𝐻subscript5𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇\displaystyle-H_{\mathbb{P}_{5}}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}% ^{\textnormal{VU}},T\mid\textnormal{\small$\bigstar$})- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ ★ )
+n𝒩[ζn(tn(bn,pn,sn,fnMS,fnVU)T)]subscript𝑛𝒩delimited-[]subscript𝜁𝑛subscript𝑡𝑛subscript𝑏𝑛subscript𝑝𝑛subscript𝑠𝑛superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓𝑛VU𝑇\displaystyle+\sum_{n\in\mathcal{N}}\big{[}\zeta_{n}\cdot(t_{n}(b_{n},p_{n},s_% {n},f_{n}^{\textnormal{MS}},f_{n}^{\textnormal{VU}})-T)\big{]}+ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT [ italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ ( italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) - italic_T ) ]
s.t. (7a): n𝒩bnbmax,(7a): subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max\displaystyle\textnormal{(\ref{constraintbn}): }\sum_{n\in\mathcal{N}}b_{n}% \leq b_{\textnormal{max}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ,
(7b): n𝒩pnpmax,(7b): subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max\displaystyle\textnormal{(\ref{constraintpn}): }\sum_{n\in\mathcal{N}}p_{n}% \leq p_{\textnormal{max}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ≤ italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ,
(7d): n𝒩fnMSfmaxMS,(7d): subscript𝑛𝒩superscriptsubscript𝑓𝑛MSsuperscriptsubscript𝑓maxMS\displaystyle\textnormal{(\ref{constraintfMS}): }\sum_{n\in\mathcal{N}}f_{n}^{% \textnormal{MS}}\leq f_{\textnormal{max}}^{\textnormal{MS}},( ): ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ,
(7e): fnVUfn,maxVU,n𝒩.formulae-sequence(7e): superscriptsubscript𝑓𝑛VUsuperscriptsubscript𝑓𝑛maxVUfor-all𝑛𝒩\displaystyle\textnormal{(\ref{constraintfn}): }f_{n}^{\textnormal{VU}}\leq f_% {n,\textnormal{max}}^{\textnormal{VU}},~{}\forall n\in\mathcal{N}.( ): italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ≤ italic_f start_POSTSUBSCRIPT italic_n , max end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , ∀ italic_n ∈ caligraphic_N .

We define

  • Statement 𝒱5subscript𝒱subscript5\mathcal{V}_{\mathbb{P}_{5}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {[𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),α#(),β#(),γ#(),𝜹#(),𝜻#()]is a solution to the KKT conditions 𝒮KKT in (43)for Problem 5().}\left\{\begin{array}[]{l}[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{% \#}(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$% \bigstar$}),\\ T^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(\textnormal{\small$\bigstar$% }),\beta^{\#}(\textnormal{\small$\bigstar$}),\gamma^{\#}(\textnormal{\small$% \bigstar$}),\bm{\delta}^{\#}(\textnormal{\small$\bigstar$}),\bm{\zeta}^{\#}(% \textnormal{\small$\bigstar$})]\\ \textnormal{is a solution to the KKT conditions $\mathcal{S}_{KKT}$ in (\ref{% KKTP5})}\\ \textnormal{for Problem $\mathbb{P}_{5}(\textnormal{\small$\bigstar$})$.}\end{% array}\right\}{ start_ARRAY start_ROW start_CELL [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL is a solution to the KKT conditions caligraphic_S start_POSTSUBSCRIPT italic_K italic_K italic_T end_POSTSUBSCRIPT in ( ) end_CELL end_ROW start_ROW start_CELL for Problem blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) . end_CELL end_ROW end_ARRAY }, and

  • Statement 𝒱7subscript𝒱subscript7\mathcal{V}_{\mathbb{P}_{7}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {[𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),α#(),β#(),γ#(),𝜹#()]is a solution to the KKT conditions ofProblem 7(,𝜻#()).}\left\{\begin{array}[]{l}[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{% \#}(\textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$% \bigstar$}),\\ T^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(\textnormal{\small$\bigstar$% }),\beta^{\#}(\textnormal{\small$\bigstar$}),\gamma^{\#}(\textnormal{\small$% \bigstar$}),\bm{\delta}^{\#}(\textnormal{\small$\bigstar$})]\\ \textnormal{is a solution to the KKT conditions of}\\ \textnormal{Problem $\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta}^{% \#}(\textnormal{\small$\bigstar$}))$.}\end{array}\right\}{ start_ARRAY start_ROW start_CELL [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL is a solution to the KKT conditions of end_CELL end_ROW start_ROW start_CELL Problem blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) . end_CELL end_ROW end_ARRAY }.

By checking the KKT conditions of 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) and 7(,𝜻#())subscript7superscript𝜻#\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$}))blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ), we build the following relationship between 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) and 7(,𝜻)subscript7𝜻\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ):

Statement 𝒱5subscript𝒱subscript5\mathcal{V}_{\mathbb{P}_{5}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT {Statement 𝒱7 holds,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.}.absentStatement 𝒱7 holds,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.\displaystyle\Leftrightarrow\left\{\begin{array}[]{l}\textnormal{Statement $% \mathcal{V}_{\mathbb{P}_{7}}$ holds,}\\ \text{and $[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$% \bigstar$}),$}\\ \text{$(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),T^{\#}(% \textnormal{\small$\bigstar$}),\bm{\zeta}^{\#}(\textnormal{\small$\bigstar$})]% $ satisfies}\\ \text{$\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}:=\big{\{}\textnormal{(\ref{% partialLpartialT}), (\ref{Complementarytime}), (\ref{constraintTtau}), (\ref{% Dualfeasibility}e)}\big{\}}$.}\end{array}\right\}.⇔ { start_ARRAY start_ROW start_CELL Statement caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT end_POSTSUBSCRIPT holds, end_CELL end_ROW start_ROW start_CELL and [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT := { ( ), ( ), ( ), ( e) } . end_CELL end_ROW end_ARRAY } . (118doeb)

In 7(,𝜻)subscript7𝜻\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ), the optimizations of [𝒃,𝒑]𝒃𝒑[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ], [𝒇MS,𝒇VU]superscript𝒇MSsuperscript𝒇VU[\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ] and T𝑇Titalic_T are independent and thus separable. This independence holds because 𝜻𝜻\bm{\zeta}bold_italic_ζ is already given for 7(,𝜻)subscript7𝜻\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ). We do not have such independence in optimizing 5()subscript5\mathbb{P}_{5}(\textnormal{\small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT ( ★ ) where 𝜻𝜻\bm{\zeta}bold_italic_ζ is not decided yet. Hence, 7(,𝜻)subscript7𝜻\mathbb{P}_{7}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 7 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) is equivalent to the combination of 8(,𝜻)subscript8𝜻\mathbb{P}_{8}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ), 9(,𝜻)subscript9𝜻\mathbb{P}_{9}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ), and 10(,𝜻)subscript10𝜻\mathbb{P}_{10}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) defined below:

Problem 8(,𝜻):minTyctTTn𝒩ζn:Problem 8(,𝜻)subscript𝑇𝑦subscript𝑐t𝑇𝑇subscript𝑛𝒩subscript𝜁𝑛\displaystyle\textnormal{Problem $\mathbb{P}_{8}(\textnormal{\small$\bigstar$}% ,\bm{\zeta})$}:\min_{T}\quad yc_{\hskip 0.8pt\textnormal{t}}T-T\sum_{n\in% \mathcal{N}}\zeta_{n}Problem blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) : roman_min start_POSTSUBSCRIPT italic_T end_POSTSUBSCRIPT italic_y italic_c start_POSTSUBSCRIPT t end_POSTSUBSCRIPT italic_T - italic_T ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
Problem 9(,𝜻):min𝒃,𝒑{𝒰(𝒃,𝒑,𝒔)+ycen𝒩{[(pn+pncir)snμnΛn]2zn+14(rn(bn,pn)νn)2zn}+n𝒩(ζntnTx(bn,pn,sn))}\displaystyle\textnormal{Problem $\mathbb{P}_{9}(\textnormal{\small$\bigstar$}% ,\bm{\zeta})$}:\min_{\bm{b},\bm{p}}\left\{\begin{array}[]{l}-\mathcal{U}(\bm{b% },\bm{p},\bm{s})\\ +yc_{\hskip 0.5pt\textnormal{e}}\cdot\sum\limits_{n\in\mathcal{N}}\big{\{}[(p_% {n}+p_{n}^{\textnormal{cir}})s_{n}{\color[rgb]{0,0,0}\mu_{n}}{\color[rgb]{% 0,0,0}\Lambda_{n}}]^{2}z_{n}\\ +\frac{1}{4(r_{n}(b_{n},p_{n}){\color[rgb]{0,0,0}\nu_{n}})^{2}z_{n}}\big{\}}\\ +\sum\limits_{n\in\mathcal{N}}(\zeta_{n}\cdot t_{n}^{\textnormal{Tx}}(b_{n},p_% {n},s_{n}))\end{array}\right\}Problem blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) : roman_min start_POSTSUBSCRIPT bold_italic_b , bold_italic_p end_POSTSUBSCRIPT { start_ARRAY start_ROW start_CELL - caligraphic_U ( bold_italic_b , bold_italic_p , bold_italic_s ) end_CELL end_ROW start_ROW start_CELL + italic_y italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT { [ ( italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT + italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT cir end_POSTSUPERSCRIPT ) italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT italic_μ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT roman_Λ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_CELL end_ROW start_ROW start_CELL + divide start_ARG 1 end_ARG start_ARG 4 ( italic_r start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) italic_ν start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_z start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG } end_CELL end_ROW start_ROW start_CELL + ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ) end_CELL end_ROW end_ARRAY } (118doeg)
s.t.(7a),(7b),s.t.(7a)(7b)\displaystyle~{}~{}~{}~{}~{}~{}\textrm{s.t.}\quad\textnormal{(\ref{% constraintbn})},\textnormal{(\ref{constraintpn})},s.t. ( ) , ( ) ,
Problem 10(,𝜻):min𝒇MS,𝒇VU{y[ce(n𝒩EnMS:Pro(sn,fnMS)+n𝒩EnVU:Pro(sn,fnVU))]+n𝒩(ζn[tnMS:Pro(sn,fnMS)+tnVU:Pro(sn,fnVU)]}\displaystyle\textnormal{Problem $\mathbb{P}_{10}(\textnormal{\small$\bigstar$% },\bm{\zeta})$}:\min_{\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}}\left% \{\begin{array}[]{l}y\cdot[c_{\hskip 0.5pt\textnormal{e}}\cdot(\sum_{n\in% \mathcal{N}}E_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{% MS}})\\ +\sum_{n\in\mathcal{N}}E_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{% \textnormal{VU}}))]\\ +\sum_{n\in\mathcal{N}}(\zeta_{n}\cdot[t_{n}^{\textnormal{MS}:\textnormal{Pro}% }(s_{n},f_{n}^{\textnormal{MS}})\\ +t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},f_{n}^{\textnormal{VU}})]\end{% array}\right\}Problem blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) : roman_min start_POSTSUBSCRIPT bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT end_POSTSUBSCRIPT { start_ARRAY start_ROW start_CELL italic_y ⋅ [ italic_c start_POSTSUBSCRIPT e end_POSTSUBSCRIPT ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) end_CELL end_ROW start_ROW start_CELL + ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_E start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ) ] end_CELL end_ROW start_ROW start_CELL + ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ⋅ [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) end_CELL end_ROW start_ROW start_CELL + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , italic_f start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) ] end_CELL end_ROW end_ARRAY } (118doel)
s.t.(7d),(7e),s.t.(7d)(7e)\displaystyle~{}~{}~{}~{}~{}~{}\textrm{s.t.}\quad\textnormal{(\ref{% constraintfMS})},\textnormal{(\ref{constraintfn})},s.t. ( ) , ( ) ,

Then after defining

  • Statement 𝒱8subscript𝒱subscript8\mathcal{V}_{\mathbb{P}_{8}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {T#() is a solution to Problem 8(,𝜻#()).}T#() is a solution to Problem 8(,𝜻#()).\left\{\begin{array}[]{l}\textnormal{$T^{\#}(\textnormal{\small$\bigstar$})$ % is a solution to Problem $\mathbb{P}_{8}(\textnormal{\small$\bigstar$},\bm{% \zeta}^{\#}(\textnormal{\small$\bigstar$}))$.}\end{array}\right\}{ start_ARRAY start_ROW start_CELL italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) is a solution to Problem blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) . end_CELL end_ROW end_ARRAY },

  • Statement 𝒱9subscript𝒱subscript9\mathcal{V}_{\mathbb{P}_{9}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {[𝒃#(),𝒑#(),α#(),β#()]is a solution to the KKT conditions ofProblem 9(,𝜻#()).}superscript𝒃#superscript𝒑#superscript𝛼#superscript𝛽#is a solution to the KKT conditions ofProblem 9(,𝜻#()).\left\{\begin{array}[]{l}\textnormal{$[\bm{b}^{\#}(\textnormal{\small$\bigstar% $}),\bm{p}^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(\textnormal{\small$% \bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$})]$}\\ \textnormal{is a solution to the KKT conditions of}\\ \textnormal{Problem $\mathbb{P}_{9}(\textnormal{\small$\bigstar$},\bm{\zeta}^{% \#}(\textnormal{\small$\bigstar$}))$.}\end{array}\right\}{ start_ARRAY start_ROW start_CELL [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL is a solution to the KKT conditions of end_CELL end_ROW start_ROW start_CELL Problem blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) . end_CELL end_ROW end_ARRAY }, and

  • Statement 𝒱10subscript𝒱subscript10\mathcal{V}_{\mathbb{P}_{10}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {(𝒇MS)#(),(𝒇VU)#(),γ#(),𝜹#()]is a solution to the KKT conditions ofProblem 10(,𝜻#()).}\left\{\begin{array}[]{l}\textnormal{$(\bm{f}^{\textnormal{MS}})^{\#}(% \textnormal{\small$\bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{% \small$\bigstar$}),\gamma^{\#}(\textnormal{\small$\bigstar$}),\bm{\delta}^{\#}% (\textnormal{\small$\bigstar$})]$}\\ \textnormal{is a solution to the KKT conditions of}\\ \textnormal{Problem $\mathbb{P}_{10}(\textnormal{\small$\bigstar$},\bm{\zeta}^% {\#}(\textnormal{\small$\bigstar$}))$.}\end{array}\right\}{ start_ARRAY start_ROW start_CELL ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_γ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_δ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL is a solution to the KKT conditions of end_CELL end_ROW start_ROW start_CELL Problem blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) . end_CELL end_ROW end_ARRAY }

we obtain

Statement 𝒱5subscript𝒱subscript5\mathcal{V}_{\mathbb{P}_{5}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT end_POSTSUBSCRIPT
{Statements 𝒱8𝒱9, and 𝒱10 hold,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.},absentStatements 𝒱8𝒱9, and 𝒱10 hold,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.\displaystyle\Leftrightarrow\left\{\begin{array}[]{l}\textnormal{Statements $% \mathcal{V}_{\mathbb{P}_{8}}$, $\mathcal{V}_{\mathbb{P}_{9}}$, and $\mathcal{V% }_{\mathbb{P}_{10}}$ hold,}\\ \text{and $[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),$}% \\ \text{$T^{\#}(\textnormal{\small$\bigstar$}),\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$})]$ satisfies}\\ \text{$\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}:=\big{\{}\textnormal{(\ref{% partialLpartialT}), (\ref{Complementarytime}), (\ref{constraintTtau}), (\ref{% Dualfeasibility}e)}\big{\}}$.}\end{array}\right\},⇔ { start_ARRAY start_ROW start_CELL Statements caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT end_POSTSUBSCRIPT , caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT , and caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT hold, end_CELL end_ROW start_ROW start_CELL and [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT := { ( ), ( ), ( ), ( e) } . end_CELL end_ROW end_ARRAY } , (118doex)
{Statements 𝒱9 and 𝒱10 hold,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.}absentStatements 𝒱9 and 𝒱10 hold,and [𝒃#(),𝒑#(),(𝒇MS)#(),(𝒇VU)#(),T#(),𝜻#()] satisfies𝒮2.1𝒮2.2:={(24), (29), (11a), (33e)}.\displaystyle\Leftrightarrow\left\{\begin{array}[]{l}\textnormal{Statements $% \mathcal{V}_{\mathbb{P}_{9}}$ and $\mathcal{V}_{\mathbb{P}_{10}}$ hold,}\\ \text{and $[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal% {\small$\bigstar$}),(\bm{f}^{\textnormal{MS}})^{\#}(\textnormal{\small$% \bigstar$}),(\bm{f}^{\textnormal{VU}})^{\#}(\textnormal{\small$\bigstar$}),$}% \\ \text{$T^{\#}(\textnormal{\small$\bigstar$}),\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$})]$ satisfies}\\ \text{$\mathcal{S}_{2.1}\cup\mathcal{S}_{2.2}:=\big{\{}\textnormal{(\ref{% partialLpartialT}), (\ref{Complementarytime}), (\ref{constraintTtau}), (\ref{% Dualfeasibility}e)}\big{\}}$.}\end{array}\right\}⇔ { start_ARRAY start_ROW start_CELL Statements caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT and caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT hold, end_CELL end_ROW start_ROW start_CELL and [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , ( bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ) start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , end_CELL end_ROW start_ROW start_CELL italic_T start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 2.2 end_POSTSUBSCRIPT := { ( ), ( ), ( ), ( e) } . end_CELL end_ROW end_ARRAY } (118dofc)

where the last step means 8(,𝜻)subscript8𝜻\mathbb{P}_{8}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) can be neglected since (24) induces the objective function of 8(,𝜻)subscript8𝜻\mathbb{P}_{8}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 8 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) to be always 00.

Now we analyze Problem 9(,𝜻)subscript9𝜻\mathbb{P}_{9}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ). Note that β𝛽\betaitalic_β is the Lagrange multiplier for (7b). Suppose we already know β𝛽\betaitalic_β. We move β𝛽\betaitalic_β and (7b) to the objective function, and construct the following problem:

Problem 11(,𝜻,β)::Problem 11(,𝜻,β)absent\displaystyle\textnormal{Problem $\mathbb{P}_{11}(\textnormal{\small$\bigstar$% },\bm{\zeta},\beta)$}:Problem blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β ) :
min𝒃,𝒑{H9(𝒃,𝒑,𝜻)+β(n𝒩pnpmax)}subscript𝒃𝒑subscript𝐻subscript9𝒃conditional𝒑𝜻𝛽subscript𝑛𝒩subscript𝑝𝑛subscript𝑝max\displaystyle\min_{\bm{b},\bm{p}}\begin{array}[]{l}\left\{H_{\mathbb{P}_{9}}(% \bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta})+\beta\cdot\big{(}% \sum_{n\in\mathcal{N}}p_{n}-p_{\textnormal{max}}\big{)}\right\}\end{array}roman_min start_POSTSUBSCRIPT bold_italic_b , bold_italic_p end_POSTSUBSCRIPT start_ARRAY start_ROW start_CELL { italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ ) + italic_β ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) } end_CELL end_ROW end_ARRAY (118dofe)
s.t.(7a),s.t.(7a)\displaystyle~{}~{}~{}~{}~{}~{}~{}~{}\textrm{s.t.}\quad\textnormal{(\ref{% constraintbn})},s.t. ( ) , (118doff)

where H9(𝒃,𝒑,𝜻)subscript𝐻subscript9𝒃conditional𝒑𝜻H_{\mathbb{P}_{9}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ ) denotes the objective function of Problem 9subscript9\mathbb{P}_{9}blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT. Then after defining

  • Statement 𝒱11subscript𝒱subscript11\mathcal{V}_{\mathbb{P}_{11}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • {[𝒃#(),𝒑#(),α#()]is a solution to the KKT conditions ofProblem 11(,𝜻#(),β#()).}superscript𝒃#superscript𝒑#superscript𝛼#is a solution to the KKT conditions ofProblem 11(,𝜻#(),β#()).\left\{\begin{array}[]{l}\textnormal{$[\bm{b}^{\#}(\textnormal{\small$\bigstar% $}),\bm{p}^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(\textnormal{\small$% \bigstar$})]$}\\ \textnormal{is a solution to the KKT conditions of}\\ \textnormal{Problem $\mathbb{P}_{11}(\textnormal{\small$\bigstar$},\bm{\zeta}^% {\#}(\textnormal{\small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$}))% $.}\end{array}\right\}{ start_ARRAY start_ROW start_CELL [ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] end_CELL end_ROW start_ROW start_CELL is a solution to the KKT conditions of end_CELL end_ROW start_ROW start_CELL Problem blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) . end_CELL end_ROW end_ARRAY }

and checking the KKT conditions of 9(,𝜻#()\mathbb{P}_{9}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$})blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) and 11(,𝜻#(),β#())subscript11superscript𝜻#superscript𝛽#\mathbb{P}_{11}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$}))blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ), we have

Statement 𝒱9subscript𝒱subscript9\mathcal{V}_{\mathbb{P}_{9}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT {Statement 𝒱11 holds,and [β#(),𝒑#()] satisfies𝒮1.2.2.2:={(26),(7b),(33b)}.}absentStatement 𝒱11 holds,and [β#(),𝒑#()] satisfies𝒮1.2.2.2:={(26),(7b),(33b)}.\displaystyle\Leftrightarrow\left\{\begin{array}[]{l}\textnormal{Statement $% \mathcal{V}_{\mathbb{P}_{11}}$ holds,}\\ \text{and $[\beta^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{% \small$\bigstar$})]$ satisfies}\\ \text{$\mathcal{S}_{1.2.2.2}:=\big{\{}\textnormal{(\ref{Complementarybeta})},% \textnormal{(\ref{constraintpn})},\textnormal{(\ref{Dualfeasibility}b)}\big{\}% }$.}\end{array}\right\}⇔ { start_ARRAY start_ROW start_CELL Statement caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT holds, end_CELL end_ROW start_ROW start_CELL and [ italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT := { ( ) , ( ) , ( b) } . end_CELL end_ROW end_ARRAY } (118dofm)

Now we analyze Problem 11(,𝜻,β)subscript11𝜻𝛽\mathbb{P}_{11}(\textnormal{\small$\bigstar$},\bm{\zeta},\beta)blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β ). Note that α𝛼\alphaitalic_α is the Lagrange multiplier for (7a). Suppose we already know α𝛼\alphaitalic_α. We move α𝛼\alphaitalic_α and (7a) to the objective function, and construct the following problem:

Problem 12(,𝜻,β,α)::Problem 12(,𝜻,β,α)absent\displaystyle\textnormal{Problem $\mathbb{P}_{12}(\textnormal{\small$\bigstar$% },\bm{\zeta},\beta,\alpha)$}:Problem blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β , italic_α ) :
min𝒃,𝒑{H11(𝒃,𝒑,𝜻,β)+α(n𝒩bnbmax)},subscript𝒃𝒑subscript𝐻subscript11𝒃conditional𝒑𝜻𝛽𝛼subscript𝑛𝒩subscript𝑏𝑛subscript𝑏max\displaystyle\min_{\bm{b},\bm{p}}\left\{\begin{array}[]{l}H_{\mathbb{P}_{11}}(% \bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta)+\alpha\cdot% \big{(}\sum_{n\in\mathcal{N}}b_{n}-b_{\textnormal{max}}\big{)}\end{array}% \right\},roman_min start_POSTSUBSCRIPT bold_italic_b , bold_italic_p end_POSTSUBSCRIPT { start_ARRAY start_ROW start_CELL italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β ) + italic_α ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) end_CELL end_ROW end_ARRAY } , (118dofo)

where H11(𝒃,𝒑,𝜻,β)subscript𝐻subscript11𝒃conditional𝒑𝜻𝛽H_{\mathbb{P}_{11}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta)italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β ) denotes the objective function of Problem 11subscript11\mathbb{P}_{11}blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT. Then after defining

  • Statement 𝒱12subscript𝒱subscript12\mathcal{V}_{\mathbb{P}_{12}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT:

  • [𝒃#(),𝒑#()]superscript𝒃#superscript𝒑#[\bm{b}^{\#}(\textnormal{\small$\bigstar$}),\bm{p}^{\#}(\textnormal{\small$% \bigstar$})][ bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_p start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] is a globally optimal solution to Problem 12(,𝜻#(),β#(),α#())subscript12superscript𝜻#superscript𝛽#superscript𝛼#\mathbb{P}_{12}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(% \textnormal{\small$\bigstar$}))blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ),

and checking the KKT conditions of 11(,𝜻#(),β#())subscript11superscript𝜻#superscript𝛽#\mathbb{P}_{11}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$}))blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ) and 12(,𝜻#(),β#(),α#())subscript12superscript𝜻#superscript𝛽#superscript𝛼#\mathbb{P}_{12}(\textnormal{\small$\bigstar$},\bm{\zeta}^{\#}(\textnormal{% \small$\bigstar$}),\beta^{\#}(\textnormal{\small$\bigstar$}),\alpha^{\#}(% \textnormal{\small$\bigstar$}))blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_β start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ), we get

Statement 𝒱11subscript𝒱subscript11\mathcal{V}_{\mathbb{P}_{11}}caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT {Statement 𝒱12 holds,and [α#(),𝒃#()] satisfies 𝒮1.2.2.1:={(34), (35)}.}absentStatement 𝒱12 holds,and [α#(),𝒃#()] satisfies 𝒮1.2.2.1:={(34), (35)}.\displaystyle\Leftrightarrow\left\{\begin{array}[]{l}\textnormal{Statement $% \mathcal{V}_{\mathbb{P}_{12}}$ holds,}\\ \text{and $[\alpha^{\#}(\textnormal{\small$\bigstar$}),\bm{b}^{\#}(\textnormal% {\small$\bigstar$})]$ satisfies }\\ \text{$\mathcal{S}_{1.2.2.1}:=\big{\{}\textnormal{(\ref{Stationaritypn3alpha})% , (\ref{Complementaryalpha2})}\big{\}}$.}\end{array}\right\}⇔ { start_ARRAY start_ROW start_CELL Statement caligraphic_V start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT holds, end_CELL end_ROW start_ROW start_CELL and [ italic_α start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) , bold_italic_b start_POSTSUPERSCRIPT # end_POSTSUPERSCRIPT ( ★ ) ] satisfies end_CELL end_ROW start_ROW start_CELL caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT := { ( ), ( ) } . end_CELL end_ROW end_ARRAY } (118dofs)

-E Proving that the left-hand side of (86) is non-increasing with respect to β𝛽\betaitalic_β

From the conditions of Proposition 1.2.1 and Proposition 1.2.2.1, setting [𝒃,𝒑,α]𝒃𝒑𝛼[\bm{b},\bm{p},\alpha][ bold_italic_b , bold_italic_p , italic_α ] as [𝒃~(α˘(β,𝜻),β,𝜻),𝒑~(α˘(β,𝜻),β,𝜻),α˘(β,𝜻)]~𝒃˘𝛼𝛽conditional𝜻𝛽conditional𝜻~𝒑˘𝛼𝛽conditional𝜻𝛽conditional𝜻˘𝛼𝛽conditional𝜻[\widetilde{\bm{b}}(\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{% p}}(\breve{\alpha}(\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\breve{\alpha}(\beta,\bm{\zeta}% \mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) , over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) ] satisfies 𝒮1.2.1𝒮1.2.2.1={(20), (21), (34), (35)}subscript𝒮1.2.1subscript𝒮1.2.2.1(20), (21), (34), (35)\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}=\big{\{}\textnormal{(\ref{% Stationaritybn}), (\ref{Stationaritypn}), (\ref{Stationaritypn3alpha}), (\ref{Complementaryalpha% 2})}\big{\}}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT = { ( ), ( ), ( ), ( ) }; i.e., the KKT conditions of convex optimization 11(,𝜻,β)subscript11𝜻𝛽\mathbb{P}_{11}(\textnormal{\small$\bigstar$},\bm{\zeta},\beta)blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β ). Hence,

[𝒃~(α˘(β,𝜻),β,𝜻),𝒑~(α˘(β,𝜻),β,𝜻)]is a globally optimal solution to 11(,𝜻,β).~𝒃˘𝛼𝛽conditional𝜻𝛽conditional𝜻~𝒑˘𝛼𝛽conditional𝜻𝛽conditional𝜻is a globally optimal solution to 11(,𝜻,β).\displaystyle\begin{array}[]{l}\text{$[\widetilde{\bm{b}}(\breve{\alpha}(\beta% ,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid\textnormal{% \small$\bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar% $})]$}\\ \text{is a globally optimal solution to $\mathbb{P}_{11}(\textnormal{\small$% \bigstar$},\bm{\zeta},\beta)$.}\end{array}start_ARRAY start_ROW start_CELL [ over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ) ] end_CELL end_ROW start_ROW start_CELL is a globally optimal solution to blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β ) . end_CELL end_ROW end_ARRAY (118dofv)

To prove the desired result, we consider the case where β𝛽\betaitalic_β equals β1subscript𝛽1\beta_{1}italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT, and the case where β𝛽\betaitalic_β equals β2subscript𝛽2\beta_{2}italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT, respectively, for arbitrarily chosen β1subscript𝛽1\beta_{1}italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT and β2subscript𝛽2\beta_{2}italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT. Due to Result (118dofv) above, for H11(𝒃,𝒑,𝜻,β)subscript𝐻subscript11𝒃conditional𝒑𝜻𝛽H_{\mathbb{P}_{11}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta)italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β ) denoting the objective function of Problem 11subscript11\mathbb{P}_{11}blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT, we obtain

H11(𝒃~(α˘(β1,𝜻),β1,𝜻),𝒑~(α˘(β1,𝜻),β1,𝜻,𝜻,β1))subscript𝐻subscript11~𝒃˘𝛼subscript𝛽1conditional𝜻subscript𝛽1conditional𝜻~𝒑˘𝛼subscript𝛽1conditional𝜻subscript𝛽1𝜻delimited-∣∣𝜻subscript𝛽1\displaystyle H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{1},% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\beta_{1},\bm% {\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{% \small$\bigstar$}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta_{1}))italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) )
\displaystyle\leq
H11(𝒃~(α˘(β2,𝜻),β2,𝜻),𝒑~(α˘(β2,𝜻),β2,𝜻,𝜻,β1),\displaystyle H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{2},% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2},\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\beta_{2},\bm% {\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{% \small$\bigstar$}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta_{1}),italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) , (118dofw)

and

H11(𝒃~(α˘(β2,𝜻),β2,𝜻),𝒑~(α˘(β2,𝜻),β2,𝜻,𝜻,β2)\displaystyle H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{2},% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2},\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\beta_{2},\bm% {\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{% \small$\bigstar$}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta_{2})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT )
\displaystyle\leq
H11(𝒃~(α˘(β1,𝜻),β1,𝜻),𝒑~(α˘(β1,𝜻),β1,𝜻,𝜻,β2).\displaystyle H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{1},% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\breve{\alpha}(\beta_{1},\bm% {\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{% \small$\bigstar$}\mid\textnormal{\small$\bigstar$},\bm{\zeta},\beta_{2}).italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) . (118dofx)

From (118dofw) and (118dofx), it follows that

[H11(𝒃~(α˘(β1,𝜻),β1,𝜻),𝒑~(α˘(β1,𝜻),β1,𝜻,𝜻,β1))H11(𝒃~(α˘(β1,𝜻),β1,𝜻),𝒑~(α˘(β1,𝜻),β1,𝜻,𝜻,β2))]\displaystyle\left[\begin{array}[]{l}H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(% \breve{\alpha}(\beta_{1},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1% },\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\\ \widetilde{\bm{p}}(\breve{\alpha}(\beta_{1},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{\small$\bigstar$}\mid% \textnormal{\small$\bigstar$},\bm{\zeta},\beta_{1}))\\ -H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{1},\bm{\zeta}% \mid\textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\\ \widetilde{\bm{p}}(\breve{\alpha}(\beta_{1},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{\small$\bigstar$}\mid% \textnormal{\small$\bigstar$},\bm{\zeta},\beta_{2}))\end{array}\right][ start_ARRAY start_ROW start_CELL italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ) end_CELL end_ROW start_ROW start_CELL - italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ) end_CELL end_ROW end_ARRAY ] (118dogc)
+[H11(𝒃~(α˘(β2,𝜻),β2,𝜻),𝒑~(α˘(β2,𝜻),β2,𝜻,𝜻,β2))H11(𝒃~(α˘(β2,𝜻),β2,𝜻),𝒑~(α˘(β2,𝜻),β2,𝜻,𝜻,β1)]0.\displaystyle+\left[\begin{array}[]{l}H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(% \breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2% },\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\\ \widetilde{\bm{p}}(\breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$}\mid% \textnormal{\small$\bigstar$},\bm{\zeta},\beta_{2}))\\ -H_{\mathbb{P}_{11}}(\widetilde{\bm{b}}(\breve{\alpha}(\beta_{2},\bm{\zeta}% \mid\textnormal{\small$\bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\\ \widetilde{\bm{p}}(\breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$}\mid% \textnormal{\small$\bigstar$},\bm{\zeta},\beta_{1})\end{array}\right]\leq 0.+ [ start_ARRAY start_ROW start_CELL italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ) end_CELL end_ROW start_ROW start_CELL - italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , end_CELL end_ROW start_ROW start_CELL over~ start_ARG bold_italic_p end_ARG ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ∣ ★ , bold_italic_ζ , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) end_CELL end_ROW end_ARRAY ] ≤ 0 . (118dogh)

Since H11(𝒃,𝒑,𝒇MS,𝒇VU,Tβ,𝜻,𝒛,y,𝒔)subscript𝐻subscript11𝒃𝒑superscript𝒇MSsuperscript𝒇VUconditional𝑇𝛽𝜻𝒛𝑦𝒔H_{\mathbb{P}_{11}}(\bm{b},\bm{p},\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal% {VU}},T\mid\beta,\bm{\zeta},\bm{z},y,\bm{s})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p , bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_T ∣ italic_β , bold_italic_ζ , bold_italic_z , italic_y , bold_italic_s ) equals H9(𝒃,𝒑,𝜻)+β(n𝒩pnpmax)subscript𝐻subscript9𝒃conditional𝒑𝜻𝛽subscript𝑛𝒩subscript𝑝𝑛subscript𝑝maxH_{\mathbb{P}_{9}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta})+% \beta\cdot\big{(}\sum_{n\in\mathcal{N}}p_{n}-p_{\textnormal{max}}\big{)}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ ) + italic_β ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) from (118doff), the term inside the first “[]delimited-[][\cdot][ ⋅ ]” of (118dogh) equals (β1β2)(n𝒩p~n(α˘(β1,𝜻),β1,𝜻)pmax)subscript𝛽1subscript𝛽2subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽1conditional𝜻subscript𝛽1conditional𝜻subscript𝑝max(\beta_{1}-\beta_{2})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(% \breve{\alpha}(\beta_{1},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1% },\bm{\zeta}\mid\textnormal{\small$\bigstar$})-p_{\textnormal{max}}\big{)}( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ), and the term inside the second “[]delimited-[][\cdot][ ⋅ ]” of (118dogh) equals (β2β1)(n𝒩p~n(α˘(β2,𝜻),β2,𝜻)pmax)subscript𝛽2subscript𝛽1subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽2conditional𝜻subscript𝛽2conditional𝜻subscript𝑝max(\beta_{2}-\beta_{1})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(% \breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2% },\bm{\zeta}\mid\textnormal{\small$\bigstar$})-p_{\textnormal{max}}\big{)}( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT - italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ). Then we obtain

{(β1β2)(n𝒩p~n(α˘(β1,𝜻),β1,𝜻)pmax)+(β2β1)(n𝒩p~n(α˘(β2,𝜻),β2,𝜻)pmax)}subscript𝛽1subscript𝛽2subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽1conditional𝜻subscript𝛽1conditional𝜻subscript𝑝maxsubscript𝛽2subscript𝛽1subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽2conditional𝜻subscript𝛽2conditional𝜻subscript𝑝max\displaystyle\left\{\begin{array}[]{l}(\beta_{1}-\beta_{2})\cdot\big{(}\sum_{n% \in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(\beta_{1},\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\beta_{1},\bm{\zeta}\mid\textnormal{\small$% \bigstar$})-p_{\textnormal{max}}\big{)}\\ +(\beta_{2}-\beta_{1})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(% \breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{2% },\bm{\zeta}\mid\textnormal{\small$\bigstar$})-p_{\textnormal{max}}\big{)}\end% {array}\right\}{ start_ARRAY start_ROW start_CELL ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) end_CELL end_ROW start_ROW start_CELL + ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT - italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) - italic_p start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) end_CELL end_ROW end_ARRAY } (118dogk)
0;absent0\displaystyle\leq 0;≤ 0 ; (118dogl)

i.e., (β1β2)(n𝒩p~n(α˘(β1,𝜻),β1,𝜻)n𝒩p~n(α˘(β2,𝜻),β2,𝜻))0subscript𝛽1subscript𝛽2subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽1conditional𝜻subscript𝛽1conditional𝜻subscript𝑛𝒩subscript~𝑝𝑛˘𝛼subscript𝛽2conditional𝜻subscript𝛽2conditional𝜻0(\beta_{1}-\beta_{2})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(% \breve{\alpha}(\beta_{1},\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\beta_{1% },\bm{\zeta}\mid\textnormal{\small$\bigstar$})-\sum_{n\in\mathcal{N}}% \widetilde{p}_{n}(\breve{\alpha}(\beta_{2},\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\beta_{2},\bm{\zeta}\mid\textnormal{\small$\bigstar$})\big{)}\leq 0( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) - ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) , italic_β start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , bold_italic_ζ ∣ ★ ) ) ≤ 0. Hence, n𝒩p~n(α˘(β,𝜻),β,𝜻)subscript𝑛𝒩subscript~𝑝𝑛˘𝛼𝛽conditional𝜻𝛽conditional𝜻\sum_{n\in\mathcal{N}}\widetilde{p}_{n}(\breve{\alpha}(\beta,\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar% $})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over˘ start_ARG italic_α end_ARG ( italic_β , bold_italic_ζ ∣ ★ ) , italic_β , bold_italic_ζ ∣ ★ ), i.e., the left-hand side of (86), is non-increasing as β𝛽\betaitalic_β increases. ∎

-F Proving that the left-hand side of (84) is non-increasing with respect to α𝛼\alphaitalic_α

From Proposition 1.2.1’s condition, setting [𝒃,𝒑]𝒃𝒑[\bm{b},\bm{p}][ bold_italic_b , bold_italic_p ] as [𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)]~𝒃𝛼𝛽conditional𝜻~𝒑𝛼𝛽conditional𝜻[\widetilde{\bm{b}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}),% \widetilde{\bm{p}}(\alpha,\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] satisfies 𝒮1.2.1={(20), (21)}subscript𝒮1.2.1(20), (21)\mathcal{S}_{1.2.1}=\big{\{}\textnormal{(\ref{Stationaritybn}), (\ref{Stationaritypn})}\big{\}}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT = { ( ), ( ) }; i.e., the KKT conditions of convex optimization 12(,𝜻,β,α)subscript12𝜻𝛽𝛼\mathbb{P}_{12}(\textnormal{\small$\bigstar$},\bm{\zeta},\beta,\alpha)blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β , italic_α ). Hence,

[𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)] is a globally optimal solution to 12(,𝜻,β,α).[𝒃~(α,β,𝜻),𝒑~(α,β,𝜻)] is a globally optimal solution to 12(,𝜻,β,α).\displaystyle\begin{array}[]{l}\text{$[\widetilde{\bm{b}}(\alpha,\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha,\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$})]$ is a globally optimal solution }\\ \text{to $\mathbb{P}_{12}(\textnormal{\small$\bigstar$},\bm{\zeta},\beta,% \alpha)$.}\end{array}start_ARRAY start_ROW start_CELL [ over~ start_ARG bold_italic_b end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α , italic_β , bold_italic_ζ ∣ ★ ) ] is a globally optimal solution end_CELL end_ROW start_ROW start_CELL to blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ , italic_β , italic_α ) . end_CELL end_ROW end_ARRAY (118dogo)

To prove the desired result, we consider the case where α𝛼\alphaitalic_α equals α1subscript𝛼1\alpha_{1}italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT, and the case where α𝛼\alphaitalic_α equals α2subscript𝛼2\alpha_{2}italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT, respectively, for arbitrarily chosen α1subscript𝛼1\alpha_{1}italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT and α2subscript𝛼2\alpha_{2}italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT. Due to Result (118dogo) above, for H12(𝒃,𝒑,𝜻,β,α)subscript𝐻subscript12𝒃conditional𝒑𝜻𝛽𝛼H_{\mathbb{P}_{12}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},% \beta,\alpha)italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β , italic_α ) denoting the objective function of Problem 12subscript12\mathbb{P}_{12}blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT, we obtain

H12(𝒃~(α1,β,𝜻),𝒑~(α1,β,𝜻),𝜻,β,α1)subscript𝐻subscript12~𝒃subscript𝛼1𝛽conditional𝜻conditional~𝒑subscript𝛼1𝛽conditional𝜻𝜻𝛽subscript𝛼1absent\displaystyle H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{1},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{1},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{1})\leqitalic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ≤
H12(𝒃~(α2,β,𝜻),𝒑~(α2,β,𝜻),𝜻,β,α1),subscript𝐻subscript12~𝒃subscript𝛼2𝛽conditional𝜻conditional~𝒑subscript𝛼2𝛽conditional𝜻𝜻𝛽subscript𝛼1\displaystyle H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{2},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{2},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{1}),italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) , (118dogp)

and

H12(𝒃~(α2,β,𝜻),𝒑~(α2,β,𝜻),𝜻,β,α2)subscript𝐻subscript12~𝒃subscript𝛼2𝛽conditional𝜻conditional~𝒑subscript𝛼2𝛽conditional𝜻𝜻𝛽subscript𝛼2absent\displaystyle H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{2},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{2},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{2})\leqitalic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ≤
H12(𝒃~(α1,β,𝜻),𝒑~(α1,β,𝜻),𝜻,β,α2).subscript𝐻subscript12~𝒃subscript𝛼1𝛽conditional𝜻conditional~𝒑subscript𝛼1𝛽conditional𝜻𝜻𝛽subscript𝛼2\displaystyle H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{1},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{1},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{2}).italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) . (118dogq)

From (118dogp) and (118dogq), it follows that

[H12(𝒃~(α1,β,𝜻),𝒑~(α1,β,𝜻),𝜻,β,α1)\displaystyle[H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{1},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{1},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{1})[ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT )
H12(𝒃~(α1,β,𝜻),𝒑~(α1,β,𝜻),𝜻,β,α2)]\displaystyle-H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{1},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{1},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{2})]- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ]
+[H12(𝒃~(α2,β,𝜻),𝒑~(α2,β,𝜻),𝜻,β,α2)\displaystyle+[H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{2},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{2},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{2})+ [ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT )
H12(𝒃~(α2,β,𝜻),𝒑~(α2,β,𝜻),𝜻,β,α1)]\displaystyle-H_{\mathbb{P}_{12}}(\widetilde{\bm{b}}(\alpha_{2},\beta,\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\widetilde{\bm{p}}(\alpha_{2},\beta,% \bm{\zeta}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},% \bm{\zeta},\beta,\alpha_{1})]- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over~ start_ARG bold_italic_b end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) , over~ start_ARG bold_italic_p end_ARG ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ∣ ★ , bold_italic_ζ , italic_β , italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ]
0.absent0\displaystyle\leq 0.≤ 0 . (118dogr)

Since H12(𝒃,𝒑,𝜻,β,α)subscript𝐻subscript12𝒃conditional𝒑𝜻𝛽𝛼H_{\mathbb{P}_{12}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},% \beta,\alpha)italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 12 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β , italic_α ) equals H11(𝒃,𝒑,𝜻,β)+α(n𝒩bnbmax)subscript𝐻subscript11𝒃conditional𝒑𝜻𝛽𝛼subscript𝑛𝒩subscript𝑏𝑛subscript𝑏maxH_{\mathbb{P}_{11}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta},% \beta)+\alpha\cdot\big{(}\sum_{n\in\mathcal{N}}b_{n}-b_{\textnormal{max}}\big{)}italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 11 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ , italic_β ) + italic_α ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT italic_b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) from (118dofo), the term inside the first “[]delimited-[][\cdot][ ⋅ ]” of (118dogr) equals (α1α2)(n𝒩b~n(α1,β,𝜻)bmax)subscript𝛼1subscript𝛼2subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼1𝛽conditional𝜻subscript𝑏max(\alpha_{1}-\alpha_{2})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{b}_{n}(% \alpha_{1},\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})-b_{\textnormal{% max}}\big{)}( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ), and the term inside the second “[]delimited-[][\cdot][ ⋅ ]” of (118dogr) equals (α2α1)(n𝒩b~n(α2,β,𝜻)bmax)subscript𝛼2subscript𝛼1subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼2𝛽conditional𝜻subscript𝑏max(\alpha_{2}-\alpha_{1})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{b}_{n}(% \alpha_{2},\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})-b_{\textnormal{% max}}\big{)}( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT - italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ). Then we obtain

(α1α2)(n𝒩b~n(α1,β,𝜻)bmax)subscript𝛼1subscript𝛼2subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼1𝛽conditional𝜻subscript𝑏max\displaystyle(\alpha_{1}-\alpha_{2})\cdot\big{(}\sum_{n\in\mathcal{N}}% \widetilde{b}_{n}(\alpha_{1},\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}% )-b_{\textnormal{max}}\big{)}( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT )
+\displaystyle++ (α2α1)(n𝒩b~n(α2,β,𝜻)bmax)0;subscript𝛼2subscript𝛼1subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼2𝛽conditional𝜻subscript𝑏max0\displaystyle(\alpha_{2}-\alpha_{1})\cdot\big{(}\sum_{n\in\mathcal{N}}% \widetilde{b}_{n}(\alpha_{2},\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$}% )-b_{\textnormal{max}}\big{)}\leq 0;( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT - italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) - italic_b start_POSTSUBSCRIPT max end_POSTSUBSCRIPT ) ≤ 0 ; (118dogs)

i.e., (α1α2)(n𝒩b~n(α1,β,𝜻)n𝒩b~n(α2,β,𝜻))0subscript𝛼1subscript𝛼2subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼1𝛽conditional𝜻subscript𝑛𝒩subscript~𝑏𝑛subscript𝛼2𝛽conditional𝜻0(\alpha_{1}-\alpha_{2})\cdot\big{(}\sum_{n\in\mathcal{N}}\widetilde{b}_{n}(% \alpha_{1},\beta,\bm{\zeta}\mid\textnormal{\small$\bigstar$})-\sum_{n\in% \mathcal{N}}\widetilde{b}_{n}(\alpha_{2},\beta,\bm{\zeta}\mid\textnormal{% \small$\bigstar$})\big{)}\leq 0( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT - italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ) ⋅ ( ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) - ∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , italic_β , bold_italic_ζ ∣ ★ ) ) ≤ 0. Hence, n𝒩b~n(α,β,𝜻)subscript𝑛𝒩subscript~𝑏𝑛𝛼𝛽conditional𝜻\sum_{n\in\mathcal{N}}\widetilde{b}_{n}(\alpha,\beta,\bm{\zeta}\mid\textnormal% {\small$\bigstar$})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over~ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_α , italic_β , bold_italic_ζ ∣ ★ ), i.e., the left-hand side of (84), is non-increasing as α𝛼\alphaitalic_α increases. ∎

-G Proving Page 2’s Lemma 2

From Lemma 3 to be presented in Appendix -I, tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),f´nVU(𝜻))subscript𝑡𝑛subscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n}^{\textnormal% {MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{% VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases. For hn(𝜻T)subscript𝑛conditional𝜻𝑇h_{n}(\bm{\zeta}\mid T)italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) defined in (89), given [ζ1,,ζn1,ζn+1,ζN]subscript𝜁1subscript𝜁𝑛1subscript𝜁𝑛1subscript𝜁𝑁[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n+1}\ldots,\zeta_{N}][ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] and T𝑇Titalic_T, we either have (89a) or (89b). In either case, “tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),f´nVU(𝜻))Tsubscript𝑡𝑛subscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript´𝑓𝑛VUconditional𝜻𝑇t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n}^{\textnormal% {MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{% VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}))-Titalic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) - italic_T” or “ζnsubscript𝜁𝑛-\zeta_{n}- italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT” defined for hn(𝜻T)subscript𝑛conditional𝜻𝑇h_{n}(\bm{\zeta}\mid T)italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases. Hence, hn(𝜻T)subscript𝑛conditional𝜻𝑇h_{n}(\bm{\zeta}\mid T)italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases, given [ζ1,,ζn1,ζn+1,ζN]subscript𝜁1subscript𝜁𝑛1subscript𝜁𝑛1subscript𝜁𝑁[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n+1}\ldots,\zeta_{N}][ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] and T𝑇Titalic_T. ∎

-H Proving that the left-hand side of (108) is non-increasing with respect to T𝑇Titalic_T

We recall from (90) and (91) that

setting 𝜻𝜻\bm{\zeta}bold_italic_ζ as 𝜻`(T)`𝜻conditional𝑇\grave{\bm{\zeta}}(T\mid\textnormal{\small$\bigstar$})over` start_ARG bold_italic_ζ end_ARG ( italic_T ∣ ★ ) ensures hn(𝜻T)=0subscript𝑛conditional𝜻𝑇0h_{n}(\bm{\zeta}\mid T)=0italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) = 0 for any n𝒩𝑛𝒩n\in\mathcal{N}italic_n ∈ caligraphic_N, (118dogt)

where hn(𝜻T)=0subscript𝑛conditional𝜻𝑇0h_{n}(\bm{\zeta}\mid T)=0italic_h start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ italic_T ) = 0 is defined in (89).

From Lemma 3 to be presented in Appendix -I below, we can prove that n𝒩ζ`n(T)subscript𝑛𝒩subscript`𝜁𝑛conditional𝑇\sum_{n\in\mathcal{N}}\grave{\zeta}_{n}(T\mid\textnormal{\small$\bigstar$})∑ start_POSTSUBSCRIPT italic_n ∈ caligraphic_N end_POSTSUBSCRIPT over` start_ARG italic_ζ end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_T ∣ ★ ); i.e., the left-hand side of (108) is non-increasing with respect to T𝑇Titalic_T. The proof is similar to those in Appendices -E and -F. ∎

-I Lemma 3 and its proof

Lemma 3.

Given “normal-★\bigstar” (i.e., [𝐳,y,𝐬]𝐳𝑦𝐬[\bm{z},y,\bm{s}][ bold_italic_z , italic_y , bold_italic_s ]) and [ζ1,,ζn1,ζn+1,ζN]subscript𝜁1normal-…subscript𝜁𝑛1subscript𝜁𝑛1normal-…subscript𝜁𝑁[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n+1}\ldots,\zeta_{N}][ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ], we have:

&given [ζ1,,ζn1,ζn+1,ζN]subscript𝜁1normal-…subscript𝜁𝑛1subscript𝜁𝑛1normal-…subscript𝜁𝑁[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n+1}\ldots,\zeta_{N}][ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ], and “normal-★\bigstar” (i.e., “𝐳,y,𝐬𝐳𝑦𝐬\bm{z},y,\bm{s}bold_italic_z , italic_y , bold_italic_s”), then as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases,

  • i)

    tnTx(b´n(𝜻),p´n(𝜻),sn)superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛t_{n}^{\textnormal{Tx}}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n})italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is non-increasing;

  • ii)

    tnMS:Pro(sn,f´nMS(𝜻))+tnVU:Pro(sn,f´nVU(𝜻))superscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS}}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}))+t_{n}^{\textnormal{VU}:% \textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) is non-increasing; and

  • iii)

    tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),f´nVU(𝜻))subscript𝑡𝑛subscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n}^{\textnormal% {MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{% VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) is non-increasing.

Proof of Lemma 3:

Below we prove Results “i)”, “ii)”, and “iii)”, respectively.

Proving Lemma 3’s Result “i)”:

From Proposition 1.2’s condition, setting [𝒃,𝒑,α,β]𝒃𝒑𝛼𝛽[\bm{b},\bm{p},\alpha,\beta][ bold_italic_b , bold_italic_p , italic_α , italic_β ] as [𝒃´(𝜻),𝒑´(𝜻),α´(𝜻),β´(𝜻)]´𝒃conditional𝜻´𝒑conditional𝜻´𝛼conditional𝜻´𝛽conditional𝜻[\acute{\bm{b}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{p}}(% \bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\alpha}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\beta}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$})][ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_α end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_β end_ARG ( bold_italic_ζ ∣ ★ ) ] satisfies 𝒮1.2.1𝒮1.2.2.1𝒮1.2.2.2={(20), (21), (26), (7b), (33b), (34), (35)}subscript𝒮1.2.1subscript𝒮1.2.2.1subscript𝒮1.2.2.2(20), (21), (26), (7b), (33b), (34), (35)\mathcal{S}_{1.2.1}\cup\mathcal{S}_{1.2.2.1}\cup\mathcal{S}_{1.2.2.2}=\big{\{}% \textnormal{(\ref{Stationaritybn}), (\ref{Stationaritypn}), (\ref{% Complementarybeta}), {(\ref{constraintpn})}, (\ref{Dualfeasibility}b), (\ref{% Stationaritypn3alpha}), (\ref{Complementaryalpha2})}\big{\}}caligraphic_S start_POSTSUBSCRIPT 1.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.1 end_POSTSUBSCRIPT ∪ caligraphic_S start_POSTSUBSCRIPT 1.2.2.2 end_POSTSUBSCRIPT = { ( ), ( ), ( ), ( ), ( b), ( ), ( ) }; i.e., the KKT conditions of convex optimization 9(,𝜻)subscript9𝜻\mathbb{P}_{9}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ). Hence,

[𝒃´(𝜻),𝒑´(𝜻)] is a globally optimal solution to 9(,𝜻).[𝒃´(𝜻),𝒑´(𝜻)] is a globally optimal solution to 9(,𝜻).\displaystyle\begin{array}[]{l}\text{$[\acute{\bm{b}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}\mid\textnormal{\small% $\bigstar$})]$ is a globally optimal solution to $\mathbb{P}_{9}(\textnormal{% \small$\bigstar$},\bm{\zeta})$.}\end{array}start_ARRAY start_ROW start_CELL [ over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ ∣ ★ ) ] is a globally optimal solution to blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) . end_CELL end_ROW end_ARRAY (118dogv)

To prove the desired result, we consider the case where ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT equals ζn(1)superscriptsubscript𝜁𝑛1\zeta_{n}^{(1)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, and the case where ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT equals ζn(2)superscriptsubscript𝜁𝑛2\zeta_{n}^{(2)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT, respectively, for arbitrarily chosen ζn(1)superscriptsubscript𝜁𝑛1\zeta_{n}^{(1)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT and ζn(2)superscriptsubscript𝜁𝑛2\zeta_{n}^{(2)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT. Due to Result (118dogv) above, after defining

𝜻(n,1)superscript𝜻𝑛1\displaystyle\bm{\zeta}^{(n,1)}bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT :=[ζ1,,ζn1,ζn(1),ζn+1,,ζN],assignabsentsubscript𝜁1subscript𝜁𝑛1superscriptsubscript𝜁𝑛1subscript𝜁𝑛1subscript𝜁𝑁\displaystyle:=[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n}^{(1)},\zeta_{n+1},% \ldots,\zeta_{N}],:= [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ,
𝜻(n,2)superscript𝜻𝑛2\displaystyle\bm{\zeta}^{(n,2)}bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT :=[ζ1,,ζn1,ζn(2),ζn+1,,ζN],assignabsentsubscript𝜁1subscript𝜁𝑛1superscriptsubscript𝜁𝑛2subscript𝜁𝑛1subscript𝜁𝑁\displaystyle:=[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n}^{(2)},\zeta_{n+1},% \ldots,\zeta_{N}],:= [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ,

then with H9(𝒃,𝒑,𝜻)subscript𝐻subscript9𝒃conditional𝒑𝜻H_{\mathbb{P}_{9}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ ) denoting the objective function of Problem 9subscript9\mathbb{P}_{9}blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT, we obtain

H9(𝒃´(𝜻(n,1)),𝒑´(𝜻(n,1)),𝜻(n,1))subscript𝐻subscript9´𝒃conditionalsuperscript𝜻𝑛1conditional´𝒑conditionalsuperscript𝜻𝑛1superscript𝜻𝑛1\displaystyle H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,1)})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT )
H9(𝒃´(𝜻(n,1)),𝒑´(𝜻(n,1)),𝜻(n,2)),absentsubscript𝐻subscript9´𝒃conditionalsuperscript𝜻𝑛1conditional´𝒑conditionalsuperscript𝜻𝑛1superscript𝜻𝑛2\displaystyle\leq H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,2)}),≤ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ) , (118dogw)

and

H9(𝒃´(𝜻(n,2)),𝒑´(𝜻(n,2)),𝜻(n,2))subscript𝐻subscript9´𝒃conditionalsuperscript𝜻𝑛2conditional´𝒑conditionalsuperscript𝜻𝑛2superscript𝜻𝑛2\displaystyle H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,2)})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT )
H9(𝒃´(𝜻(n,2)),𝒑´(𝜻(n,2)),𝜻(n,1)).absentsubscript𝐻subscript9´𝒃conditionalsuperscript𝜻𝑛2conditional´𝒑conditionalsuperscript𝜻𝑛2superscript𝜻𝑛1\displaystyle\leq H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,1)}).≤ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ) . (118dogx)

From (118dogw) and (118dogx), it follows that

[H9(𝒃´(𝜻(n,1)),𝒑´(𝜻(n,1)),𝜻(n,1))\displaystyle\big{[}H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,1)})[ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT )
H9(𝒃´(𝜻(n,1)),𝒑´(𝜻(n,1)),𝜻(n,2))]\displaystyle-H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,1)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,2)})\big{]}- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ) ]
+[H9(𝒃´(𝜻(n,2)),𝒑´(𝜻(n,2)),𝜻(n,2))\displaystyle+\big{[}H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,2)})+ [ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT )
H9(𝒃´(𝜻(n,2)),𝒑´(𝜻(n,2)),𝜻(n,1))]\displaystyle-H_{\mathbb{P}_{9}}(\acute{\bm{b}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$}),\acute{\bm{p}}(\bm{\zeta}^{(n,2)}\mid% \textnormal{\small$\bigstar$})\mid\textnormal{\small$\bigstar$},\bm{\zeta}^{(n% ,1)})\big{]}- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_b end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_p end_ARG ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ) ]
0.absent0\displaystyle\leq 0.≤ 0 . (118dogy)

Note that H9(𝒃,𝒑,𝜻)subscript𝐻subscript9𝒃conditional𝒑𝜻H_{\mathbb{P}_{9}}(\bm{b},\bm{p}\mid\textnormal{\small$\bigstar$},\bm{\zeta})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 9 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_b , bold_italic_p ∣ ★ , bold_italic_ζ ) is given by (118doeg). Then the term inside the first “[]delimited-[][\cdot][ ⋅ ]” of (118dogy) equals (ζn(1)ζn(2))tnTx(b´n(𝜻(n,1)),p´n(𝜻(n,1)),sn)superscriptsubscript𝜁𝑛1superscriptsubscript𝜁𝑛2superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛1subscript´𝑝𝑛conditionalsuperscript𝜻𝑛1subscript𝑠𝑛(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot t_{n}^{\textnormal{Tx}}(\acute{b}_{n}(% \bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}(\bm{\zeta}^% {(n,1)}\mid\textnormal{\small$\bigstar$}),s_{n})( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ), and the term inside the second “[]delimited-[][\cdot][ ⋅ ]” of (118dogy) equals (ζn(2)ζn(1))tnTx(b´n(𝜻(n,2)),p´n(𝜻(n,2)),sn)superscriptsubscript𝜁𝑛2superscriptsubscript𝜁𝑛1superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛2subscript´𝑝𝑛conditionalsuperscript𝜻𝑛2subscript𝑠𝑛(\zeta_{n}^{(2)}-\zeta_{n}^{(1)})\cdot t_{n}^{\textnormal{Tx}}(\acute{b}_{n}(% \bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}(\bm{\zeta}^% {(n,2)}\mid\textnormal{\small$\bigstar$}),s_{n})( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) ⋅ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ). Then we obtain

(ζn(1)ζn(2))tnTx(b´n(𝜻(n,1)),p´n(𝜻(n,1)),sn)superscriptsubscript𝜁𝑛1superscriptsubscript𝜁𝑛2superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛1subscript´𝑝𝑛conditionalsuperscript𝜻𝑛1subscript𝑠𝑛\displaystyle(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot t_{n}^{\textnormal{Tx}}(% \acute{b}_{n}(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{p}_{% n}(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),s_{n})( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT )
+\displaystyle++ (ζn(2)ζn(1))tnTx(b´n(𝜻(n,2)),p´n(𝜻(n,2)),sn)0;superscriptsubscript𝜁𝑛2superscriptsubscript𝜁𝑛1superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛2subscript´𝑝𝑛conditionalsuperscript𝜻𝑛2subscript𝑠𝑛0\displaystyle(\zeta_{n}^{(2)}-\zeta_{n}^{(1)})\cdot t_{n}^{\textnormal{Tx}}(% \acute{b}_{n}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{p}_{% n}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),s_{n})\leq 0;( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) ⋅ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ≤ 0 ; (118dogz)

i.e., (ζn(1)ζn(2))(tnTx(b´n(𝜻(n,1)),p´n(𝜻(n,1)),sn)tnTx(b´n(𝜻(n,2)),p´n(𝜻(n,2)),sn))0superscriptsubscript𝜁𝑛1superscriptsubscript𝜁𝑛2superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛1subscript´𝑝𝑛conditionalsuperscript𝜻𝑛1subscript𝑠𝑛superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditionalsuperscript𝜻𝑛2subscript´𝑝𝑛conditionalsuperscript𝜻𝑛2subscript𝑠𝑛0(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot\big{(}t_{n}^{\textnormal{Tx}}(\acute{b}% _{n}(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}(\bm{% \zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),s_{n})-t_{n}^{\textnormal{Tx}% }(\acute{b}_{n}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{p}% _{n}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),s_{n})\big{)}\leq 0( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ ( italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) - italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) ) ≤ 0. Hence, tnTx(b´n(𝜻),p´n(𝜻),sn)superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛t_{n}^{\textnormal{Tx}}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n})italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases.

Proving Lemma 3’s Result “ii)”:

From Proposition 1.1’s condition, setting [𝒇MS,𝒇VU,γ,𝜹]superscript𝒇MSsuperscript𝒇VU𝛾𝜹[\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}},\gamma,\bm{\delta}][ bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT , italic_γ , bold_italic_δ ] as [𝒇´MS(𝜻),𝒇´VU(𝜻),γ´(𝜻),𝜹´(𝜻)]superscript´𝒇MSconditional𝜻superscript´𝒇VUconditional𝜻´𝛾conditional𝜻´𝜹conditional𝜻[\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\bm{f}}^{\textnormal{VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})% ,\acute{\gamma}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{\delta% }}(\bm{\zeta}\mid\textnormal{\small$\bigstar$})][ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_γ end_ARG ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_δ end_ARG ( bold_italic_ζ ∣ ★ ) ] satisfies 𝒮1.1:={(22), (23), (27), (28), (7d), (7e), (33c), (33d)}assignsubscript𝒮1.1(22), (23), (27), (28), (7d), (7e), (33c), (33d)\mathcal{S}_{1.1}:=\big{\{}\textnormal{(\ref{partialLpartialfMS}), (\ref{% partialLpartialfVU}), (\ref{Complementarygamma}), (\ref{Complementarydelta}), % {(\ref{constraintfMS})}, {(\ref{constraintfn})}, (\ref{Dualfeasibility}c), (% \ref{Dualfeasibility}d)}\big{\}}caligraphic_S start_POSTSUBSCRIPT 1.1 end_POSTSUBSCRIPT := { ( ), ( ), ( ), ( ), ( ), ( ), ( c), ( d) }; i.e., the KKT conditions of convex optimization 10(,𝜻)subscript10𝜻\mathbb{P}_{10}(\textnormal{\small$\bigstar$},\bm{\zeta})blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ). Hence,

[𝒇´MS(𝜻),𝒇´VU(𝜻)] is a globally optimal solutionto 10(,𝜻).[𝒇´MS(𝜻),𝒇´VU(𝜻)] is a globally optimal solutionto 10(,𝜻).\displaystyle\begin{array}[]{l}\text{$[\acute{\bm{f}}^{\textnormal{MS}}(\bm{% \zeta}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm{% \zeta}\mid\textnormal{\small$\bigstar$})]$ is a globally optimal solution}\\ \textnormal{to $\mathbb{P}_{10}(\textnormal{\small$\bigstar$},\bm{\zeta})$.}% \end{array}start_ARRAY start_ROW start_CELL [ over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ] is a globally optimal solution end_CELL end_ROW start_ROW start_CELL to blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT ( ★ , bold_italic_ζ ) . end_CELL end_ROW end_ARRAY (118dohc)

To prove the desired result, we consider the case where ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT equals ζn(1)superscriptsubscript𝜁𝑛1\zeta_{n}^{(1)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT, and the case where ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT equals ζn(2)superscriptsubscript𝜁𝑛2\zeta_{n}^{(2)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT, respectively, for arbitrarily chosen ζn(1)superscriptsubscript𝜁𝑛1\zeta_{n}^{(1)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT and ζn(2)superscriptsubscript𝜁𝑛2\zeta_{n}^{(2)}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT. Due to Result (118dohc) above, after defining

𝜻(n,1)superscript𝜻𝑛1\displaystyle\bm{\zeta}^{(n,1)}bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT :=[ζ1,,ζn1,ζn(1),ζn+1,,ζN],assignabsentsubscript𝜁1subscript𝜁𝑛1superscriptsubscript𝜁𝑛1subscript𝜁𝑛1subscript𝜁𝑁\displaystyle:=[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n}^{(1)},\zeta_{n+1},% \ldots,\zeta_{N}],:= [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ,
𝜻(n,2)superscript𝜻𝑛2\displaystyle\bm{\zeta}^{(n,2)}bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT :=[ζ1,,ζn1,ζn(2),ζn+1,,ζN],assignabsentsubscript𝜁1subscript𝜁𝑛1superscriptsubscript𝜁𝑛2subscript𝜁𝑛1subscript𝜁𝑁\displaystyle:=[\zeta_{1},\ldots,\zeta_{n-1},\zeta_{n}^{(2)},\zeta_{n+1},% \ldots,\zeta_{N}],:= [ italic_ζ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT , italic_ζ start_POSTSUBSCRIPT italic_n + 1 end_POSTSUBSCRIPT , … , italic_ζ start_POSTSUBSCRIPT italic_N end_POSTSUBSCRIPT ] ,

then with H10(𝒇MS,𝒇VU,𝜻)subscript𝐻subscript10superscript𝒇MSconditionalsuperscript𝒇VU𝜻H_{\mathbb{P}_{10}}(\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}\mid% \textnormal{\small$\bigstar$},\bm{\zeta})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ∣ ★ , bold_italic_ζ ) denoting the objective function of Problem 10subscript10\mathbb{P}_{10}blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT, we obtain

H10(𝒇´MS(𝜻(n,1)),𝒇´VU(𝜻(n,1)),𝜻(n,1))subscript𝐻subscript10superscript´𝒇MSconditionalsuperscript𝜻𝑛1conditionalsuperscript´𝒇VUconditionalsuperscript𝜻𝑛1superscript𝜻𝑛1absent\displaystyle H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,1)})\leqitalic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ) ≤
H10(𝒇´MS(𝜻(n,1)),𝒇´VU(𝜻(n,1)),𝜻(n,2)),subscript𝐻subscript10superscript´𝒇MSconditionalsuperscript𝜻𝑛1conditionalsuperscript´𝒇VUconditionalsuperscript𝜻𝑛1superscript𝜻𝑛2\displaystyle H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,2)}),italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ) , (118dohd)

and

H10(𝒇´MS(𝜻(n,2)),𝒇´VU(𝜻(n,2)),𝜻(n,2))subscript𝐻subscript10superscript´𝒇MSconditionalsuperscript𝜻𝑛2conditionalsuperscript´𝒇VUconditionalsuperscript𝜻𝑛2superscript𝜻𝑛2absent\displaystyle H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,2)})\leqitalic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ) ≤
H10(𝒇´MS(𝜻(n,2)),𝒇´VU(𝜻(n,2)),𝜻(n,1)).subscript𝐻subscript10superscript´𝒇MSconditionalsuperscript𝜻𝑛2conditionalsuperscript´𝒇VUconditionalsuperscript𝜻𝑛2superscript𝜻𝑛1\displaystyle H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,1)}).italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ) . (118dohe)

From (118dohd) and (118dohe), it follows that

[H10(𝒇´MS(𝜻(n,1)),𝒇´VU(𝜻(n,1)),𝜻(n,1))\displaystyle\big{[}H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{% \zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{% VU}}(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$},\bm{\zeta}^{(n,1)})[ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT )
H10(𝒇´MS(𝜻(n,1)),𝒇´VU(𝜻(n,1)),𝜻(n,2))]\displaystyle-H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,1)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,2)})\big{]}- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ) ]
+[H10(𝒇´MS(𝜻(n,2)),𝒇´VU(𝜻(n,2)),𝜻(n,2))\displaystyle+\big{[}H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{% \zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{% VU}}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{% \small$\bigstar$},\bm{\zeta}^{(n,2)})+ [ italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT )
H10(𝒇´MS(𝜻(n,2)),𝒇´VU(𝜻(n,2)),𝜻(n,1))]\displaystyle-H_{\mathbb{P}_{10}}(\acute{\bm{f}}^{\textnormal{MS}}(\bm{\zeta}^% {(n,2)}\mid\textnormal{\small$\bigstar$}),\acute{\bm{f}}^{\textnormal{VU}}(\bm% {\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$})\mid\textnormal{\small$% \bigstar$},\bm{\zeta}^{(n,1)})\big{]}- italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) , over´ start_ARG bold_italic_f end_ARG start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ∣ ★ , bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ) ]
0.absent0\displaystyle\leq 0.≤ 0 . (118dohf)

Note that H10(𝒇MS,𝒇VU,𝜻)subscript𝐻subscript10superscript𝒇MSconditionalsuperscript𝒇VU𝜻H_{\mathbb{P}_{10}}(\bm{f}^{\textnormal{MS}},\bm{f}^{\textnormal{VU}}\mid% \textnormal{\small$\bigstar$},\bm{\zeta})italic_H start_POSTSUBSCRIPT blackboard_P start_POSTSUBSCRIPT 10 end_POSTSUBSCRIPT end_POSTSUBSCRIPT ( bold_italic_f start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT , bold_italic_f start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ∣ ★ , bold_italic_ζ ) is given by (118doel). Then the term inside the first “[]delimited-[][\cdot][ ⋅ ]” of (118dohf) equals (ζn(1)ζn(2))[tnMS:Pro(sn,f´nMS(𝜻(n,1)))+tnVU:Pro(sn,f´nVU(𝜻(n,1)))]superscriptsubscript𝜁𝑛1superscriptsubscript𝜁𝑛2delimited-[]superscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditionalsuperscript𝜻𝑛1superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛VUconditionalsuperscript𝜻𝑛1(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot[t_{n}^{\textnormal{MS}:\textnormal{Pro}% }(s_{n},\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}^{(n,1)}\mid\textnormal{% \small$\bigstar$}))+t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{% n}^{\textnormal{VU}}(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}))]( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ], and the term inside the second “[]delimited-[][\cdot][ ⋅ ]” of (118dohf) equals (ζn(2)ζn(1))[tnMS:Pro(sn,f´nMS(𝜻(n,2)))+tnVU:Pro(sn,f´nVU(𝜻(n,2)))]superscriptsubscript𝜁𝑛2superscriptsubscript𝜁𝑛1delimited-[]superscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditionalsuperscript𝜻𝑛2superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛VUconditionalsuperscript𝜻𝑛2(\zeta_{n}^{(2)}-\zeta_{n}^{(1)})\cdot[t_{n}^{\textnormal{MS}:\textnormal{Pro}% }(s_{n},\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}^{(n,2)}\mid\textnormal{% \small$\bigstar$}))+t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{% n}^{\textnormal{VU}}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}))]( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) ⋅ [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ]. Then we obtain

{(ζn(1)ζn(2))[tnMS:Pro(sn,f´nMS(𝜻(n,1)))+tnVU:Pro(sn,f´nVU(𝜻(n,1)))]+(ζn(2)ζn(1))[tnMS:Pro(sn,f´nMS(𝜻(n,2)))+tnVU:Pro(sn,f´nVU(𝜻(n,2)))]}0;\displaystyle\left\{\begin{array}[]{l}(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot[t% _{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS}}(% \bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}))\\ +t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}% }(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}))]\\ +(\zeta_{n}^{(2)}-\zeta_{n}^{(1)})\cdot[t_{n}^{\textnormal{MS}:\textnormal{Pro% }}(s_{n},\acute{f}_{n}^{\textnormal{MS}}(\bm{\zeta}^{(n,2)}\mid\textnormal{% \small$\bigstar$}))\\ +t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}% }(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}))]\end{array}\right\}% \leq 0;{ start_ARRAY start_ROW start_CELL ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) end_CELL end_ROW start_ROW start_CELL + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ] end_CELL end_ROW start_ROW start_CELL + ( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT ) ⋅ [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) end_CELL end_ROW start_ROW start_CELL + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ] end_CELL end_ROW end_ARRAY } ≤ 0 ; (118dohk)

namely, (ζn(1)ζn(2)){[tnMS:Pro(sn,f´nMS(𝜻(n,1)))+tnVU:Pro(sn,f´nVU(𝜻(n,1)))][tnMS:Pro(sn,f´nMS(𝜻(n,2)))+tnVU:Pro(sn,f´nVU(𝜻(n,2)))]}0(\zeta_{n}^{(1)}-\zeta_{n}^{(2)})\cdot\left\{\begin{array}[]{l}[t_{n}^{% \textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS}}(\bm{% \zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}))\\ +t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}% }(\bm{\zeta}^{(n,1)}\mid\textnormal{\small$\bigstar$}))]\\ -[t_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS% }}(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}))\\ +t_{n}^{\textnormal{VU}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}% }(\bm{\zeta}^{(n,2)}\mid\textnormal{\small$\bigstar$}))]\end{array}\right\}\leq 0( italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 1 ) end_POSTSUPERSCRIPT - italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( 2 ) end_POSTSUPERSCRIPT ) ⋅ { start_ARRAY start_ROW start_CELL [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) end_CELL end_ROW start_ROW start_CELL + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 1 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ] end_CELL end_ROW start_ROW start_CELL - [ italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) end_CELL end_ROW start_ROW start_CELL + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ start_POSTSUPERSCRIPT ( italic_n , 2 ) end_POSTSUPERSCRIPT ∣ ★ ) ) ] end_CELL end_ROW end_ARRAY } ≤ 0. Therefore, tnMS:Pro(sn,f´nMS(𝜻))+tnVU:Pro(sn,f´nVU(𝜻))superscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS}}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}))+t_{n}^{\textnormal{VU}:% \textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) is non-increasing as ζnsubscript𝜁𝑛\zeta_{n}italic_ζ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT increases.

Proving Lemma 3’s Result “iii)”: From (3), tn(b´n(𝜻),p´n(𝜻),sn,f´nMS(𝜻),f´nVU(𝜻))subscript𝑡𝑛subscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{p}_{n}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n},\acute{f}_{n}^{\textnormal% {MS}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),\acute{f}_{n}^{\textnormal{% VU}}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) is the sum of tnTx(b´n(𝜻),p´n(𝜻),sn)superscriptsubscript𝑡𝑛Txsubscript´𝑏𝑛conditional𝜻subscript´𝑝𝑛conditional𝜻subscript𝑠𝑛t_{n}^{\textnormal{Tx}}(\acute{b}_{n}(\bm{\zeta}\mid\textnormal{\small$% \bigstar$}),\acute{p}_{n}(\bm{\zeta}\mid\textnormal{\small$\bigstar$}),s_{n})italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT Tx end_POSTSUPERSCRIPT ( over´ start_ARG italic_b end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , over´ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( bold_italic_ζ ∣ ★ ) , italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ) and tnMS:Pro(sn,f´nMS(𝜻))+tnVU:Pro(sn,f´nVU(𝜻))superscriptsubscript𝑡𝑛:MSProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛MSconditional𝜻superscriptsubscript𝑡𝑛:VUProsubscript𝑠𝑛superscriptsubscript´𝑓𝑛VUconditional𝜻t_{n}^{\textnormal{MS}:\textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{MS}}% (\bm{\zeta}\mid\textnormal{\small$\bigstar$}))+t_{n}^{\textnormal{VU}:% \textnormal{Pro}}(s_{n},\acute{f}_{n}^{\textnormal{VU}}(\bm{\zeta}\mid% \textnormal{\small$\bigstar$}))italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT MS end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ) + italic_t start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU : Pro end_POSTSUPERSCRIPT ( italic_s start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , over´ start_ARG italic_f end_ARG start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT start_POSTSUPERSCRIPT VU end_POSTSUPERSCRIPT ( bold_italic_ζ ∣ ★ ) ). Then the desired result clearly follows from Lemma 3’s Results “i)” and “ii)”. ∎