This paper studies the multiple timescale behavior that is induced by dynamic coupling between continuous-time and discrete-time systems, and that arises naturally in distributed networked systems. An order reduction method is proposed that establishes a mathematically rigorous separation principle between the fast evolution of the continuous-time dynamics and the slow updates of the discrete-time dynamics. Quantitative conditions on the discrete update rate are then derived that ensure the stability of the coupled dynamics based on the behavior of the isolated systems. The results are illustrated for a distributed network of satellites whose attitudes evolve continuously while communicating intermittently over the network.

Introduction

In multi-agent systems, distributed graph-based protocols between agents are often coupled to dynamic weight evolution and tracking of the agents' own nonlinear dynamics. One approach to analyzing these types of complex systems is to assume that the agents' network communication occurs very quickly, leading to a set of coupled, continuous-time dynamics [1]. These purely continuous-time dynamics can then be collectively designed to achieve desirable behavior [2,3]. However, this approach can break down as the time between communication updates becomes too large, leading to instability [4,5]. An alternative approach is to view the updates over the network as occurring only intermittently. This produces an inherently hybrid-time character in the coupled dynamics, as shown in Fig. 1. Intuitively, if the agents move quickly relative to the slow discrete updates over the network, then they will reach their immediate goal, and the network dynamics will evolve as if the agents are always at their state-dependent equilibrium trajectory. This implies that, depending on the rate of updates, a decoupling is possible between the fast, continuous-time agent dynamics and the slow, discrete-time network dynamics that is based on the different characteristic timescales over which the subsystems evolve. Such a separation between the subsystem dynamics is useful because it has the potential to decrease the complexity of analyzing the coupled hybrid-time system, permitting the networked decision dynamics to be designed separately from the agents' dynamics. The question, then, is under what conditions is this separation valid?

Fig. 1
Evolution of the coupled discrete-time network states x and continuous-time agent states y as the agents evolve toward their state-dependent equilibrium h(x, t) over each interval
Fig. 1
Evolution of the coupled discrete-time network states x and continuous-time agent states y as the agents evolve toward their state-dependent equilibrium h(x, t) over each interval
Close modal

Concepts from singular perturbation theory provide an effective approach for understanding such multiple timescale systems [6]. For purely continuous-time systems, singular perturbation theory describes how slow and fast behaviors are induced when a small parameter multiplies the time derivatives of a subset of the system states. The Tikhonov–Levinson theorem then gives conditions under which such a purely continuous-time system can be analyzed based on the properties of its isolated slow and fast dynamics [6,7]. Application of these conditions to networked dynamical systems, for example, has yielded graph-topological stability bounds for the consensus-tracking and state-dependent graph problems [8]. The success of the Tikhonov–Levinson conditions for simplified analysis of continuous-time systems with slow and fast behaviors has led to several extensions in the literature for different classes of systems. These include: (1) discrete-time systems [9], (2) differential inclusions [10], (3) impulsive differential equations [11,12], and (4) hybrid systems where the fast dynamics are constrained to evolve on a compact set [13,14]. However, by focusing on the role of a small parameter in inducing slow and fast behaviors, these extensions do not consider how the update rate can affect the behavior of coupled hybrid-time dynamics and allow their analysis to be simplified.

This paper addresses the described research gap. In particular, this work studies the role of the discrete update period on the properties of coupled continuous-time and discrete-time dynamics. The paper makes two main contributions. The first is a novel reduced-order modeling technique, based on concepts of perturbation and asymptotic theory, that provides mathematical rigor to the intuitive notion of a separation principle in such hybrid-time systems as the time between discrete updates grows. In particular, conditions are derived under which the design of the discrete-time dynamics can be separated from the behavior of the continuous-time dynamics, and asymptotic bounds on the error that this decoupled design introduces are explicitly computed in terms of the update period. In the context of networked systems, these conditions give insight into when a designer can choose the network-based update algorithm independently from the behavior of the individual agents. The second contribution is a set of quantitative conditions that give a lower bound on the update rate under which the coupled hybrid-time system is guaranteed to be stable, and which are based on stability properties of the decoupled systems. These techniques can be practically applied to understand the effects of implemented communication rates on the behavior of networked dynamical systems.

The structure of the paper is as follows: In Sec. 2, the hybrid-time system under study is defined. Section 3 then develops reduced-order models for the hybrid-time system and proves their efficacy under appropriate conditions. Next, Sec. 4 presents the method for finding quantitative stability bounds for the coupled hybrid-time dynamics. An application to a distributed network of satellites is illustrated in Sec. 5, and conclusions are presented in Sec. 6.

Problem Formulation

Consider the class of systems defined by
x(tk+)=f(x(tk),y(tk),k;μ),x(t0)=x0(μ)ẏ(t)=g(x(tk+),y(t),t;μ),y(t0)=y0(μ)
(1)

where the vector of discrete-time states is xDxnx, the vector of continuous-time states is yDyny, updates of the discrete-time system occur at distinct times t1, t2,…, differences between these distinct times are lower-bounded by tktk1τ>0 for k{1,2,}, and μ = 1/τ measures the corresponding fastest update rate. In the context of networked dynamical systems, for example, y describes the agent states while x encodes the network states that update at time tk. Here, the dependence on μ in the last argument of f and g captures possible changes in the vector fields due to a change in the update rate. Similarly, the dependence of x0 and y0 on μ is included to capture possible changes in the initial conditions due to a different update rate being used. Of course, g, f, x0, and y0 may not change with the update rate in a particular system, but including this potential dependency on the update rate allows the ensuing results to be applied to a wider class of systems. To pose a well-defined problem, assume that:

Assumption 1. The functions g, f, x0, and y0 areO(1)as τ → ∞ in the domains Dy and Dx.

Assumption 2. The function g is continuously differentiable in all its arguments and the functions f, x0, and y0 are Lipschitz in their arguments over the domains Dy and Dx.

Reduced-Order Modeling

In this section, two reduced-order models are formulated for the hybrid-time system (1). The validity of these models in approximating the behavior of Eq. (1) is then rigorously proven, justifying the separate design of the continuous-time agent dynamics from the discrete-time network decision dynamics. The reduced-order models are characterized as follows:

Decision System. Define the equilibrium trajectory of the isolated continuous-time agent dynamics as a known function h:Dx×+Dy, which satisfies ḣ(p,t)=g(p,h(p,t),t;0) for pDx and tR+. The decision system is then defined as
x¯(tk+)=f(x¯(tk),h(x¯(tk),tk),k;0)
(2)

subject to x¯(t0)=x0(0).

Interval Correction System. Define the kth time interval between discrete-time updates as Ik{t|tkt<tk+1} and the elapsed time within this interval as ηttk. The interval correction system is then defined separately for each interval Ik as
ŷ̇k(η)=g(x¯(tk+),ŷk(η)+h(x¯(tk+),η+tk),η+tk;0)h(x¯(tk+),η+tk)t
(3)

subject to ŷ0(0)=y0(0)h(x¯(t0),t0) for the first interval and ŷk(0)=h(x¯(tk),tk)h(x¯(tk+),tk) otherwise, and where x¯ is the state vector of the decision system defined in Eq. (2).

Remark 1. The decision system (2) describes the reduced-order behavior of the isolated discrete-time network dynamics with the continuous-time agent dynamics always at their state-dependent equilibrium. Note that the system is purely discrete.

Remark 2. The interval correction system (3) describes the evolution of the isolated continuous agent dynamics toward the equilibrium trajectory between each set of consecutive discrete updates. The initial conditions are based on the state vector x¯ of the decision system alone. They are independent of the state of the interval correction system on any previous intervals. Note that the interval correction system describes purely continuous-time dynamics. The new time variable η is introduced here to make clear that solutions of Eq. (3) are dependent on the elapsed time and are defined only for a particular interval Ik.

Remark 3. The last argument of the vector fields f and g is set to zero in Eqs. (2) and (3) because the reduced-order models describe the dynamics in the limit of τ growing very large so that the discrete network updates always occur with the agents at their state-dependent equilibrium.

Remark 4. While the original dynamics (1) are fully coupled, the reduced-order models (2) and (3) obtain their triangular structure by exploiting the equilibrium trajectory h(x¯,t).

With the reduced-order models defined in Eqs. (2) and (3), the next logical question is under what conditions these models provide an accurate description of the original coupled dynamics (1). To this end, the following lemma first provides conditions to ensure that the approximation provided by the reduced-order continuous-time interval dynamics remains close to the true continuous-time dynamics over the time interval Ik, given that the initial conditions of Eq. (3) and the state vector x¯ of the decision system (2) are both close to the true values of Eq. (1) at the start of the interval.

Lemma 1. For the dynamics (1) under Assumptions 1 and 2, further assume that the interval correction system (3) is uniformly asymptotically stable for all pointsx¯Dxand the corresponding known trajectoriesh(x¯(tk+),t). Then, ify(tk)ŷk(0)h(x¯(tk+),tk)=o(1)andx(tk+)x¯(tk+)=o(1)in the limit τ → ∞, τ can be chosen large enough that
y(t)ŷk(ttk)h(x¯(tk+),t)=o(1)
for all t in the time intervalIk={t|tkt<tk+1}. Further, there is a tj with tk < tj ≤ tk+1 such that
y(t)h(x¯(tk+),t)=o(1)

holds for all t[tj, tk+1).

Proof. The proof of the lemma follows three steps:

  1. (1)

    Formulate the dynamics of the continuous-state approximation error over an interval as a perturbed version of the interval correction dynamics.

  2. (2)

    Use the stability of the interval correction system and a converse Lyapunov theorem to obtain a Lyapunov function with certain desirable bounding properties for the interval correction dynamics.

  3. (3)

    Use the interval correction dynamics' Lyapunov function as well as the form of the perturbation in dynamics of the continuous-state approximation error to obtain bounds on the norm of this approximation error.

The steps are detailed as follows:

Step 1. In the following, all instances of x(tk+) will be written as x and all instances of x¯(tk+) as x¯ for conciseness since both x(tk+) and x¯(tk+) are constant over the interval Ik where the analysis is performed.

Define the error in the approximation over the interval Ik as v(η)y(η+tk)h(x¯,η+tk)ŷk(η). The error dynamics within the interval are then written as
dvdη=ddη[y(η+tk)h(x¯,η+tk)ŷk(η)]=ẏ(η+tk)h(x¯,η+tk)tŷ̇k(η)
Now, with ẏ defined in Eq. (1) and ŷ̇k defined in Eq. (3), the error dynamics are
dvdη=g(x,y(η+tk),η+tk;μ)h(x¯,η+tk)t{g(x¯,ŷk(η)+h(x¯,η+tk),η+tk;0)h(x¯,η+tk)t}=g(x,y,η+tk;μ)g(x¯,ŷk+h(x¯,η+tk),η+tk;0)+{g(x¯,y,η+tk;μ)g(x¯,y,η+tk;μ)}+{g(x¯,y,η+tk;0)g(x¯,y,η+tk;0)}+{g(x¯,v+h(x¯,η+tk),η+tk;0)g(x¯,v+h(x¯,η+tk),η+tk;0)}+{g(x¯,h(x¯,η+tk),η+tk;0)h(x¯,η+tk)t}=g(x¯,v+h(x¯,η+tk),η+tk;0)h(x¯,η+tk)t+{g(x¯,v+ŷk+h(x¯,η+tk),η+tk;0)g(x¯,v+h(x¯,η+tk),η+tk;0)g(x¯,ŷk+h(x¯,η+tk),η+tk;0)+g(x¯,h(x¯,η+tk),η+tk;0)}Δ1+{g(x¯,y,η+tk;μ)g(x¯,y,η+tk;0)}Δ2+{g(x,y,η+tk;μ)g(x¯,y,η+tk;μ)}Δ3
using y(η+tk)=v(η)+h(x¯,η+tk)+ŷk(η) by definition of the approximation error, and g(p,h(p,η+tk),η+tk;0)h(p,η+tk)/t=0 for pDx by definition of the equilibrium trajectory. That is, the error dynamics may be written as
dvdη=g(x¯,v+h(x¯,η+tk),η+tk;0)h(x¯,η+tk)t+ΔG
(4)
a perturbed version of the interval correction dynamics (3), where the perturbation is ΔG = Δ1 + Δ2 + Δ3. Now, the first component of the perturbation satisfies
Δ1=g(x¯,v+ŷk+h(x¯,η+tk),η+tk;0)g(x¯,v+h(x¯,η+tk),η+tk;0)g(x¯,ŷk+h(x¯,η+tk),η+tk;0)+g(x¯,h(x¯,η+tk),η+tk;0)=h(x¯,η+tk)ŷk+h(x¯,η+tk)(g(x¯,s+v,η;0)yg(x¯,s,η;0)y)dsh(x¯,η+tk)ŷk+h(x¯,η+tk)MvdsMvŷk
over the domain for some M ≥ 0 since g is continuously differentiable. The second component has the bound
Δ2=g(x¯,y,η+tk;μ)g(x¯,y,η+tk;0)μL4
over the domain for some L4 ≥ 0 since g is Lipschitz in its last argument. The third component is then similarly bounded by
Δ3=g(x,y,η+tk;μ)g(x¯,y,η+tk;μ)L1xx¯
over the domain for some L1 ≥ 0 since g is Lipschitz in its first argument. Therefore, the overall perturbation bounds
ΔG(Mŷk)v+{L1xx¯+μL4}
(5)

hold over the domain.

Step 2. By assumption, the interval correction system (3) is uniformly asymptotically stable for each x¯Dx. Therefore, by the converse Lyapunov theorem [7, Theorem 4.16], there exists a Lyapunov function V over some domain DV={vn|v2<r} for the dynamics that satisfies the inequalities α1(v)V(η,v)α2(v)
Vη+Vv{g(x¯,v+h(x¯,η+tk),η+tk;0)h(x¯,η+tk)t}α3(v)

and V/vα4(v) for class K functions αi defined on [0, r].

Step 3. In Eq. (5), the perturbation ΔG in the error dynamics (4) has been shown to satisfy
ΔGγ(η)v+d
with γ(η)=(Mŷk)v and d=L1xx¯+μL4. Due to the asymptotic stability of the interval correction dynamics
ŷkβ1(ŷk(0),η),0η<tk+1tk
(6)
for some class KL function β1. Now, γ(η)=Mβ1(ŷk(0),η) and d are both non-negative, continuous, and bounded for all 0 ≤ η ≤ tk+1tk. Since xx¯=o(1) and v(0)=o(1), μ can be chosen, dependent on r (the same r that defines DV) and for 0 ≤ η ≤ tk+1tk, small enough that
γ(η)v+d=Mβ1(ŷk(0),η)v+L1xx¯+μL4δ<θα3(α21(α1(r)))/α4(r)
with v<r,δ+, and 0 < θ < 1. Therefore, by Ref. [7, Lemma 9.3], for all v(0)<α21(α1(r)), trajectories of the approximation error system (4) satisfy
v(η)β2(v(0),η),0η<η¯
and
v(η)α5(δ),η¯ηtk+1tk
for some class KL function β2, some finite η¯, and α5 the class κ function defined by
α5(δ)=α11(α2(α31(δα4(r)θ)))

This gives the bound on y(t)h(x¯,t)ŷk(ttk) for all tk ≤ t < tk+1. Since Eq. (6) gives an asymptotically decaying bound on ŷk, τ can be chosen large enough that there exists a tj with tk < tj ≤ tk+1 such that ŷk(ttk)=o(1) for t ≥ tj and thus y(t)h(x¯,t)=o(1) holds for all t ∈ [tj, tk+1).

In Lemma 1, the Landau “little-Oh” o(1) bounds on the approximation error of the continuous agent state over an interval can be interpreted as saying that this error decreases asymptotically as τ grows large even though the reduced-order model is not quite the same as the full model and the approximation starts from different initial conditions than the true dynamics. This is a result of the assumption of uniform asymptotic stability for Eq. (3), which allows the continuous dynamics to eventually evolve to a known trajectory when x¯ is known. As described by the following lemma, tighter bounds on this approximation error can be found under the more restrictive assumption of exponential stability for Eq. (3).

Lemma 2. Under the conditions of Lemma 1, if instead the errors in initial conditions areO(τ1)and the interval correction system (3) is exponentially stable for all pointsx¯Dxand their corresponding known trajectoriesh(x¯(tk+),t), then the o(1) bounds on the approximation in Lemma 1 are replaced byO(τ1)bounds.

Proof. The proof adopts the same three-step structure as the proof of Lemma 1, with the following changes:

Step 1. Follows identically.

Step 2. By Ref. [7, Theorem 4.14], the conditions on the converse Lyapunov function V are satisfied with αi(v)=civ2 for i = 1, 2, 3 and α4(v)=c4v for positive constants c1c4.

Step 3. Since exponential stability holds, then the bound on ŷk in Eq. (6) is of the form β1(ŷk(0),η)=kŷk(0)eaη. Further, 0ηγ(τ)dτ0·η+ω for some non-negative constant ω. Define a=1/2c3/c2>0 and p=exp(c4ω/2c1)1, where the ci comes from the bounds converse Lyapunov function V, and choose τ large enough that v(0)=y(tk)ŷk(0)h(x¯(tk+),tk)=O(τ1) satisfies v(0)<r/p/c1/c2 and small enough that d<2c1ar/c4p. By Ref. [7, Lemma 9.4], trajectories of the approximation error system (4) therefore satisfy the norm bound
v(η)c2c1pv(0)eαη+c4p2c1d0ηea(ητ)dτ

whose first term is of O(τ1) for all η ≥ 0 if v(0)=O(τ1), and whose second term is of O(τ1) because d is and since the integral is bounded for all η ≥ 0. This gives the bound on yh(x¯,t)ŷk(ttk) for all tk ≤ t < tk+1. Since ŷk has an exponentially decaying bound in η, τ can be chosen large enough that there exists a tj with tk < tj ≤ tk+1 such that ŷk(ttk)=O(τ1), giving the desired bound on y(t)h(x¯,t).

Under the more stringent condition of exponential stability for the interval correction system (3), the corresponding Landau “big-Oh” O(τ1) bounds in Lemma 2 give a stricter statement of the rate of the approximation error's decrease as τ grows large. This is possible because exponential stability gives concrete time bounds for the evolution of y toward h(x¯,t) in step 3 of the lemma.

With Lemmas 1 and 2 in place, the validity of approximating the coupled hybrid-time system (1) by dynamics of the reduced-order models (2) and (3) can now be determined.

Theorem 1. For the dynamics (1) under Assumptions 1 and 2, further assume that the interval correction system (3) is uniformly asymptotically stable for all pointsx¯Dxand the corresponding known trajectoriesh(x¯(tk+),t). Then, for the reduced-order modelsx¯andŷ, respectively, characterized in Eqs.(2)and(3), and any tf ≥ t0, there exists a τ0, 0 < τ0 < ∞, such that for all τ ≥ τ0 the approximations
x(tk+)=x¯(tk+)+o(1)y(t)=h(x¯(tk+),t)+ŷk(ttk)+o(1)
are valid for all t[t0, tf]. Further, for each intervalIkbetween discrete updates with tk < tf, there is a tj with tk < tj ≤ tk+1 such that the approximation
y=h(x¯(tk+),t)+o(1)

holds for all t[tj, tk+1).

Proof. The proof uses induction to follow the error in the approximation for x over discrete updates, with the error in the y approximation bounded over the continuous-time intervals using Lemma (1).

Define u(tk+;μ)=x(tk+;μ)x¯(tk+). Suppose for some k that x(tk)x¯(tk)=o(1) and y(tkτ)h(x¯(tk),tkτ)=o(1). Then, under the assumption of uniform asymptotic stability of Eq. (3), τ can be always be chosen large enough that y(tk)h(x¯(tk),tk)=o(1) by Lemma 1. Further, after the transition
u(tk+;μ)=f(x(tk),y(tk),k;μ)f(x¯(tk),h(x¯(tk),tk),k;0)P1x(tk)x¯(tk)+P2y(tk)h(x¯(tk),tk)+P4μ=o(1)
using the Lipschitz property of f so that x(tk+)x¯(tk+)=o(1). From the initial conditions and the assumption that x0 and y0 are O(1) and Lipschitz, x(t1)x¯(t1)=x(t0+)x¯(t0+)=x0(μ)x0(0)=O(μ) and y(t0)ŷ0(0)h(x¯(t0+),t0)=y0(μ)y0(0)=O(μ), and are thus both o(1). Therefore, τ can be chosen large enough that the approximations
x(tk+)=x¯(tk+)+o(1)y(t)=h(x¯(tk+),t)+ŷ(ttk)+o(1)

hold by induction for any finite number of discrete updates, and thus are valid for all t ∈ [t0, tf]. The bound on y for t ∈ [tj, tk+1) then comes from application of Lemma 1.

Again, stricter bounds on the approximation errors may be found by assuming exponential stability of the interval correction system.

Corollary 1. Under the conditions of Theorem 1, if the interval correction system (3) is instead exponentially stable for all pointsx¯Dxand their corresponding known trajectoriesh(x¯(tk+),t), then the o(1) bounds on the approximation in Theorem 1 are replaced byO(τ1)bounds.

Proof. The desired results follow identically to the proof of Theorem 1 by noting that (1) both x0(μ)x0(0)=O(τ1) and y0(μ)y0(0)=O(τ1) hold since x0 and y0 are Lipschitz, (2) the continuous-interval bounds given by Lemma 2 may be used instead of the bounds given by Lemma 1 since the stricter requirement of Eq. (3) being exponentially stable is met here.

Theorem 1 provides a certificate that Eqs. (2) and (3) are good approximations of Eq. (1) as τ grows large, with the trajectories of the reduced-order approximations remaining asymptotically close to the trajectories of the full system. Intuitively, the error bounds grow smaller as the update period grows because the continuous-time agent dynamics have more time to reach their equilibrium trajectory, making the reduced-order models more accurate. Corollary 1 then provides stricter bounds on the approximation error by assuming exponential stability instead of asymptotic stability, as in Lemma 2. These results give mathematical rigor to the notion of a separation principle between the continuous-time and discrete-time dynamics, as desired.

Stability Bounds on Communication Rate

For the purpose of implementation, quantitative bounds on τ are desirable that guarantee stability of the hybrid-time system (1). If the reduced-order discrete-time decision system (2) is designed assuming that the continuous-time dynamics are always at their state-dependent equilibrium, then too-frequent updates may lead to instability of the coupled dynamics (1). This is because at the time of the next update, the continuous-time states would not have had a chance to reach their new equilibrium and may in fact have initially moved away from this equilibrium due to nonminimum phase behavior [6, Chap. 6]. This section therefore details an approach to find sufficient lower bounds on τ above which the hybrid-time system is guaranteed to be stable under given conditions and using the stability properties of the individual reduced-order models.

To begin, define the trajectory tracking error ỹ as the difference between the continuous agent state vector and its state-dependent equilibrium trajectory, ỹ(t)=y(t)h(x(tk+),t). After a discrete jump, the equilibrium trajectory changes due to the updated value of the discrete network state vector, and ỹ is thus correspondingly updated as
ỹ(tk+)=y(tk)h(x(tk+),tk)={ỹ(tk)+h(x(tk),tk)}h(x(tk+),tk)=ỹ(tk)+h(x(tk),tk)h(f(x(tk),ỹ(tk)+h(x(tk),tk),tk;μ),tk)
The hybrid-time system (1) can therefore be rewritten in terms of ỹ as
x(tk+)=f(x(tk),ỹ(tk)+h(x(tk),tk;μ)ỹ(tk+)=ỹ(tk)+h(x(tk),tk)h(f(x(tk),ỹ(tk)+h(x(tk),tk),tk;μ),tk)ỹ̇(t)=g(x(tk+),ỹ(t)+h(x(tk+),t),t;μ)h(x(tk+),t)t
(7)

subject to ỹ(t0)=y(t0)h(x(t0),t0) and valid for all time t ≥ t0. This collection of states will be denoted in the following by z[xT,ỹT]T.

In order to derive explicit numerical conditions that guarantee stability of Eq. (7), it will be further assumed that

Assumption 3. The vector field f can be written asf(x,ỹ+h(x,t),tk;μ)=Kx+f̃(x,ỹ,tk;μ), whereKnx×nxandf̃is bounded over Dx and Dy as
f̃2zT[J11J12J12TJ13]z+μzT[E11E12E12TE13]zzTJ1z+μzTE1z

withJ11,E11nx×nx,J12,E12nx×ny, andJ13,E13ny×ny

Assumption 4. The vector field g can be written asg(x,ỹ+h(x,t),t;μ)h(x,t)/t=Aỹ+g̃(x,ỹ,t,μ), whereAny×nyandg̃is bounded over Dx and Dy as
g̃(x,ỹ,t,μ)2ỹTRỹ+μzT[E21E22E22TE23]zỹTRỹ+μzTE2z

withE21nx×nx,E22nx×ny, andR,E23ny×ny

Assumption 5. The jump in theỹstates after a discrete update,Δhh(x(tk),tk)h(f(x(tk),ỹ(tk)+h(x(tk),t),k;μ),tk), is bounded over Dx and Dy as
Δh2zT[J21J22J22TJ23]zzTJ2z

withJ21nx×nx,J22nx×ny, and J23ny×ny.

Assumption 3 implies that the discrete x dynamics have a zero equilibrium when ỹ=0 and μ = 0. This is reasonable as equilibrium of interest can be relocated to zero by a simple coordinate shift [7]. Assumption 4 allows ỹ to have a stable zero equilibrium when μ = 0, while Assumption 5 provides state-dependent bounds on the change in the continuous agent dynamics' state-dependent equilibrium trajectory due to a discrete update. Nonlinearities of these types are standard in the interconnected systems literature and cover a wide class of practical systems including the attitude dynamics of precision-pointing spacecraft [15, Chap. 6] and multimachine power systems [16,17].

With these assumptions in place, the following theorem now gives sufficient conditions under which the error dynamics (7) are stable about the origin. The approach uses the well-known theory of vector Lyapunov functions [18, Chap. 2], which allows stability properties of the isolated subsystems to be leveraged in the analysis by loosening the restrictions on scalar Lyapunov functions for hybrid systems [19].

Theorem 2. For the dynamics (7) under Assumptions 3–5, if for someτ=1/μthere are matrices P1, P2 > 0 and positive scalars dij, β, γi, κi such that the linear matrix inequalities (LMIs)
Φ0,Ω0,Ψ0
hold with
Φ[(d11P1+KTP1K+γ1J11+γ1μE11)γ1J12+γ1μE12KTP1*γ1J13+γ1μE13d12P20**γ1+P1]Ω[κ1P1+μβE21μβE220*(κ2P2+P2A+ATP2+βR+μβE23)P2**βI]
and
Ψ[d21P1+γ2J21γ2J220*d22P2+P2+γ2J23P2**γ2I+P2]
and such that
ρ([d11+d12κ1κ2(1eκ2τ)d12eκ2τd21+d22κ1κ2(1eκ2τ)d22eκ2τ])1

where ρ() denotes the spectral radius of a matrix; then the error dynamics (7) are stable about zero for all τ ≥ τ.

Proof. The proof follows by construction of a vector Lyapunov function and analysis of the corresponding comparison system. To begin, assume the vector Lyapunov function U(t)=[V1(t),V2(t)]T (see Ref. [18, Chap. 2], for example) with V1=xTP1x and V2=ỹTP2ỹ and Pi > 0. Further assume that the LMIs are satisfied for some μLMI. Since μ comes into the LMIs through a positive semidefinite matrix, the LMIs are also satisfied for all μμLMI, or equivalently all τ1/μLMI=τLMI.

For V1, calculating the derivative for tIk yields
V̇1=2xTP1ẋ=0
since x only changes at the discrete jumps. Over jumps
V1(tk+)=f(x,ỹ+h,k;μ)TP1f(x,ỹ+h,k;μ)=(Kx+f̃)TP1(Kx+f̃)=[xf̃]T[KI]TP1[KI][xf̃][xf̃]T[KI]TP1[KI][xf̃]+γ1[zTJ1z+μzTE1zf̃2]
where γ1 ≥ 0, since 0γ1[zTJ1z+μzTE1zf̃2]. Adding and subtracting d11V1 and d12V2, where each d1j ≥ 0, this can be further arranged as
V1(tk+)[zf̃]TΦ[zf̃]+d11V1+d12V2

Since Φ ≤ 0, the inequality V1(tk+)d11V1(tk)+d12V2(tk) therefore holds.

For V2, the derivative along trajectories for tIk satisfy
V̇2=2ỹTP2ỹ̇2ỹTP2(Aỹ+g̃(x,ỹ,t,μ))+β(ỹTRỹ+μzTE2zg̃2)+(κ1V1κ2V2)(κ1V1κ2V2)
This can be rearranged as
V̇2[zg̃]TΩ[zg̃]+κ1V1κ2V2
and therefore V̇2κ1V1κ2V2 holds since Ω ≤ 0. Over jumps, similarly to the V1(tk+) case
V2(tk+)={ỹ+Δh}TP2{ỹ+Δh}=[ỹΔh]T[II]TP2[II][ỹΔh][ỹΔh]T[II]TP2[II][ỹΔh]+γ2[zTJ2zΔh2]=[zΔh]TΨ[zΔh]+d21V1+d22V2

Thus, V2(tk+)d21V1(tk)+d22V2(tk) holds since Ψ ≤ 0.

The vector Lyapunov function U(t) has been shown to satisfy
U̇[00κ1κ2]BU
and
U(tk+)[d11d12d21d22]DU(tk)
where vu implies vi ≤ ui for all i. A comparison system for the dynamics is therefore
u(tk+)=Du(tk)u̇=Bu
(8)
subject to u(t0) = U(t0). It follows from Ref. [18, Theorem 2.11] that the stability properties of the zero solution of Eq. (8) imply the corresponding stability properties of the error dynamics (7).
To analyze stability of Eq. (8), construct the state evolution of u at tIk as
u(t)=eB(ttk)i=1kDeB(titi1)u(t0)=eB(ttk)i=1kD̃(titi1)u(t0)
where D̃ is explicitly calculated as
D̃(titi1)=[d11+d12κ1κ2(1eκ2(titi1))d12eκ2(titi1)d21+d22κ1κ2(1eκ2(titi1))d22eκ2(titi1)]
Now, u(t) is bounded if each D̃ has spectral radius of at most one. Noting that as τ
limτλ(D̃(τ))=d11+d12κ1κ2,0

the condition is feasible if d11 + d12(κ1/κ2) ≤ 1. Therefore, choosing ττLMI such that max|λ(D̃(τ))|1, and noting that max|λ(D̃(τ))| is monotonic in τ, the original system (1) is stable for all ττ.

The results of Theorem 2 yield stability bounds for the hybrid-time system. The matrices in the LMIs are slack matrices that allow a simpler comparison system to be analyzed in the proof instead of the original dynamics. This comparison system is based on Lyapunov functions for the individual continuous-time and discrete-time dynamics. Of course, the acquired bounds may be conservative since they are based on particular Lyapunov functions. However, the outlined approach can be adapted if more information, such as more appropriate Lyapunov functions, are known for the reduced-order models.

Application

This section presents an application of the paper's main results to the analysis of a distributed network of satellites. Using the approach detailed in Sec. 3, reduced-order models are derived that decouple the satellites' discrete-time leader–follower consensus protocol from their individual continuous-time attitude tracking dynamics when the update rate is slow. A bound on the update rate is then found that guarantees stability for the coupled hybrid-time system using the method of Sec. 4, and it is shown how update rates faster than this bound can cause instability.

Consider a group of satellites communicating intermittently over a network to distributively reach consensus on their attitude as illustrated in Fig. 2, where the ith satellite's attitude is represented by the modified Rodrigues parameters (MRPs) σi3. Further assume that one satellite, the leader, has knowledge of the desired attitude σdesired for the group. A distributed protocol for the ith satellite's reference attitude is then provided by the discrete leader–follower dynamics

Fig. 2
Distributed attitude consensus for a network of satellites with intermittent communication: (a) the set of reference attitudes updates distributively at time tk over a barbell graph and (b) each satellite's attitude evolves toward its reference attitude between discrete updates
Fig. 2
Distributed attitude consensus for a network of satellites with intermittent communication: (a) the set of reference attitudes updates distributively at time tk over a barbell graph and (b) each satellite's attitude evolves toward its reference attitude between discrete updates
Close modal
σref,i(tk+)={σdesired,i=1σi(tk)+ΔjN(i)(σi(tk)σj(tk)),i1
where Δ is a (fixed) step size, and jN(i) if there is an edge from agent j to agent i in the satellites' undirected communication graph, G [20]. Under appropriate closed-loop control [21, Chap. 8], the ith satellite's attitude error kinematics are described by
ddt[σ̂iσ̇i]=[0I3ci,1I3ci,2I3][σ̂iσ̇i]+[0g̃i(σ̂i,σ̇i,t)]

where σ̂i=σiσref,i, and where g̃i accounts for the nonlinear effects of imperfect actuation in the control. This is a tracking controller that stabilizes to hi(x,t)=[σref,iT,01×3]T when σref,i is fixed.

The discrete evolution of the satellites' reference attitudes, x=[σref,1Tσref,nT]T, and continuous evolution of their true states, y=[σ1T,,σnT,σ̇1T,,σ̇nT]T, can be equivalently written as the coupled system
x(tk+)=[K03n×3n]y(tk)+[σdesired03(n1)×1]ẏ(t)=A(y(t)[x(tk+)03n×1])+g̃(x(tk+),y(t),t)
(9)
where
K[01×n[InΔL(G)]2:n,1:n]I3A[03n×3nI3nInc1I3Inc2I3],andg̃(x,y,t)[0g̃1(σ̂1,σ̇1,t)g̃n(σ̂n,σ̇n,t)]
Here, ⊗ represents the Kronecker product, cj=[cj,1cj,n]T,[InL(G)]2:n,1:n are the last n–1 rows of the matrix difference, and L(G) is the satellite communication network's graph Laplacian L(G). The dynamics (9) are of the form Eq. (1) and they satisfy the conditions of Theorem 1. Therefore, as shown in Fig. 3, the corresponding reduced-order models
Fig. 3
Comparison of reduced-order models and true evolution of one satellite's state as τ increases: (a) continuous evolution of the first MRP within a normalized interval and (b) discrete evolution of the first MRP reference commands
Fig. 3
Comparison of reduced-order models and true evolution of one satellite's state as τ increases: (a) continuous evolution of the first MRP within a normalized interval and (b) discrete evolution of the first MRP reference commands
Close modal
x¯(tk+)=[K03n×3n]x¯(tk)+[σdesired03(n1)×1]
and
ŷ̇k(η)=Aŷk(η)+g̃(x¯(tk+),ŷk(η)+x¯(tk+),η+tk)

given by Eqs. (2) and (3), respectively, become good approximations of the true dynamics as the minimum time τ between discrete updates increases. Here, the reduced-order decision dynamics for x¯ describe discrete-time leader–follower dynamics whose behavior is linked to the communication graph's topology.

To find a bound on τ that guarantees stability, first rewrite the dynamics (9) in terms of the error states x̃=x1σdesired and ỹ=y[(x̃+1σdesired)T,0]T. Using L(G)1=0 (see Ref. [20], for example), the error dynamics are then
x̃(tk+)=Kx̃(tk)+[K0]ỹ(tk)ỹ(tk+)=ỹ(tk)+[(IK)x̃(tk)[K0]ỹ(tk)0]ỹ̇(t)=Aỹ(t)+g̃(x̃(tk+)+1σdesiredỹ(t)+g̃(Mỹ(t)+[x̃(tk+)+1σdesired0],t)
(10)

which is of the form Eq. (7). Now, for the satellite and network parameters defined in Table 1, Assumptions 1 and 3 of Theorem 2 are satisfied with

Table 1

Simulation parameters

ParameterValue
c10.4⋅ 1
c21
Δ0.4
GBarbell graph on 8 nodes
ParameterValue
c10.4⋅ 1
c21
Δ0.4
GBarbell graph on 8 nodes
J1=[0000KTK0000],E1=0
and
J2=[(I3nK)T(I3nK)(I3nK)TK0KT(I3nK)KTK0000]

while Assumption 2 holds by assuming that R(0.01)2I. The LMIs and spectral radius inequality in Theorem 2 are then satisfied using the constants defined in Table 2, providing the bound τ=33 s. As expected, Fig. 4(a) shows that the hybrid-time system is stable when τ = 33 s. However, the bound given by any particular combination of parameters that satisfy Theorem 2 may be conservative. For these particular initial conditions, Fig. 4(b) demonstrates that the satellites exhibit unstable oscillations in their attitudes when τ = 10 s. In this particular case, the instability is due to a resonance phenomenon where the distributed decisions on new reference attitudes are made when satellites have overshot their previous reference attitudes. For large enough τ, however, the satellites' attitudes settle closer to their individual references, which allows the discrete leader–follower consensus protocol to evolve in a stable fashion as designed. This example illustrates the potential danger of too-frequent communication updates even for systems where the discrete network dynamics and continuous agent dynamics are stable when isolated.

Fig. 4
Evolution of all 8 satellites' attitudes, showing instability for small τ: (a) τ=33  s=τ⋆ and (b) τ=10  s<τ⋆
Fig. 4
Evolution of all 8 satellites' attitudes, showing instability for small τ: (a) τ=33  s=τ⋆ and (b) τ=10  s<τ⋆
Close modal
Table 2

Values of constants that satisfy Theorem 2

ParameterValue
P1I
P2Solution to P2A + AP2 + I = 0
d110.9750
d1228.5469
d2116.1391
d2210.0091
Β310.9920
γ143.5036
γ23.7445
κ14.0752 × 10−9
κ20.3016
τ33 s
ParameterValue
P1I
P2Solution to P2A + AP2 + I = 0
d110.9750
d1228.5469
d2116.1391
d2210.0091
Β310.9920
γ143.5036
γ23.7445
κ14.0752 × 10−9
κ20.3016
τ33 s

Conclusion

This paper examined the interactions between continuous-time and discrete-time dynamics often found in networked systems. First, a separation principle between the continuous-time agent dynamics and the discrete-time network dynamics was proven as the period between updates of the discrete system grows. Different asymptotic error bounds for the resulting reduced-order models were found based on the stability properties of the isolated continuous-time agent dynamics. Intuitively, these bounds grow tighter for a slower communication rate because the continuous-time system can evolve closer to its state-dependent equilibrium, yielding a more accurate trajectory in the reduced-order models. In the context of networked dynamical systems, this separation principle rigorously justifies the isolated design of discrete-time network dynamics and continuous-time agent dynamics. Next, a method was described for establishing quantitative upper bounds on the update rate below which the coupled hybrid-time system is guaranteed to be stable. The approach uses separate Lyapunov functions for the continuous-time agent dynamics and the discrete-time network dynamics to form a simpler comparison system that establishes stability of the coupled hybrid-time system when the bound is satisfied. When updates occur faster than this bound, however, the system can become unstable even if the decoupled network and agent dynamics are individually stable. This is because the agents no longer have adequate time to approach their reference trajectories before the next update, and may in fact initially diverge from their reference trajectories due to non-minimum phase behavior. An application where satellites intermittently communicate over a network to establish consensus on their attitudes illustrated these results.

Funding Data

  • National Science Foundation (CAREER Award No. 155229).

Nomenclature

Times and Rates
tk =

time at the kth update of the discrete-time system, s

tk+ =

time immediately following the kth update of the discrete-time system, s

tk =

time immediately preceding the kth update of the discrete-time system, s

t0 =

initial time, s

μ =

fastest update rate of the discrete-time system, 1/τ, Hz

μ =

sufficient upper bound on the update rate to guarantee stability of the coupled system, 1/τ, Hz

τ =

lower-bound on time between updates of the discrete-time system, s

τ =

sufficient lower-bound on τ to guarantee stability of the coupled system, s

Full Model Symbols
Dx =

domain of the discrete-time state vector x

Dy =

domain of the continuous-time state vector y

f =

vector field of the discrete-time dynamics, mapping Dx×Dy××+Dx

g =

vector field of the continuous-time dynamics, mapping Dx×Dy×+×+Dy

nx =

dimension of the discrete-time state vector x

ny =

dimension of the continuous-time state vector y

x =

discrete-time state vector of the dynamics

x(tk+) =

value of the discrete-time state vector x at time tk+

x(tk) =

value of the discrete-time state vector x at time tk

x0(μ) =

initial conditions of the discrete-time state vector x, a function of the update rate μ

y =

continuous-time state vector of the dynamics

ỹ(t) =

error between the true continuous-time state vector y(t) and the state-dependent equilibrium trajectory h(x(tk+),t), defined for all t ≥ t0

y(tk) =

the value of the true continuous-state vector y at the discrete-update at time tk. Note that y(tk)=y(tk+)=y(tk)

ỹ(tk+) =

value of the error between the true continuous-time state vector y and the state-dependent equilibrium trajectory h(x(tk+),t) at time tk+

ỹ(tk) =

value of the error between the true continuous-time state vector y and the state-dependent equilibrium trajectory h(x(tk),t) at time tk

y0(μ) =

initial conditions of the continuous-time state vector y, a function of the update rate μ

z =

collection of the state vectors x and ỹ

Reduced Model Symbols
h(p, t) =

equilibrium trajectory of the isolated continuous-time dynamics, mapping (p,t)Dx×+Dy

Ik =

time interval between tk (inclusive) and tk+1 (exclusive)

x¯ =

state vector of the reduced-order discrete-time decision system

x¯(tk+) =

value of the reduced-order discrete-time decision system state vector x¯ at time tk+

x¯(tk) =

value of the reduced-order decision system state vector x¯ at time tk

ŷk =

state vector of the reduced-order continuous-time interval correction system defined on the interval Ik, a function of the elapsed time η within the interval

ŷk(0) =

value of the state vector ŷk of the kth interval correction system at η = 0

η =

elapsed time within the time interval Ik,ttk

References

1.
Sedghi
,
B.
,
2003
, “
Control Design of Hybrid Systems Via Dehybridization
,”
Ph.D. thesis
, Ecole Polytechnique Federale De Lausanne, Lausanne, Switzerland.https://infoscience.epfl.ch/record/28440/files/fulltext.pdf
2.
Chung
,
S.-J.
,
Ahsun
,
U.
, and
Slotine
,
J.-J. E.
,
2009
, “
Application of Synchronization to Formation Flying Spacecraft: Lagrangian Approach
,”
J. Guid., Control, Dyn.
,
32
(
2
), pp.
512
526
.
3.
Li
,
Z.
,
Ren
,
W.
,
Liu
,
X.
, and
Fu
,
M.
,
2013
, “
Consensus of Multi-Agent Systems With General Linear and Lipschitz Nonlinear Dynamics Using Distributed Adaptive Protocols
,”
IEEE Trans. Autom. Control
,
58
(
7
), pp.
1786
1791
.
4.
Naghshtabrizi
,
P.
,
Hespanha
,
J. P.
, and
Teel
,
A. R.
,
2006
, “
On the Robust Stability and Stabilization of Sampled-Data Systems: A Hybrid System Approach
,”
45th IEEE Conference on Decision and Control
(
CDC
), San Diego, CA, Dec. 13–15, pp.
4873
4878
.
5.
Jentzen
,
A.
,
Leber
,
F.
,
Schneisgen
,
D.
,
Berger
,
A.
, and
Siegmund
,
S.
,
2010
, “
An Improved Maximum Allowable Transfer Interval for Lp-Stability of Networked Control Systems
,”
IEEE Trans. Autom. Control
,
55
(
1
), pp.
179
184
.
6.
Narang-Siddarth
,
A.
, and
Valasek
,
J.
,
2014
,
Nonlinear Time Scale Systems in Standard and Nonstandard Forms
,
SIAM
, Philadelphia, PA.
7.
Khalil
,
H. K.
,
2001
,
Nonlinear Systems
, 3rd ed.,
Prentice Hall
, Upper Saddle River, NJ.
8.
Awad
,
A.
,
Chapman
,
A.
,
Schoof
,
E.
,
Narang-Siddarth
,
A.
, and
Mesbahi
,
M.
,
2015
, “
Time-Scale Separation on Networks: Consensus, Tracking, and State-Dependent Interactions
,”
54th IEEE Conference on Decision and Control
(
CDC
), Osaka, Japan, Dec. 15–18, pp. 6172–6177.
9.
Bouyekhf
,
R.
, and
El Moudni
,
A.
,
1997
, “
On Analysis of Discrete Singularly Perturbed Non-Linear Systems: Application to the Study of Stability Properties
,”
J. Franklin Inst.
,
334
(
2
), pp.
199
212
.
10.
Veliov
,
V.
,
1997
, “
A Generalization of the Tikhonov Theorem for Singularly Perturbed Differential Inclusions
,”
J. Dyn. Control Syst.
,
3
(
3
), pp.
291
319
.
11.
Bainov
,
D.
, and
Covachev
,
V.
,
1994
,
Impulsive Differential Equations With a Small Parameter
,
World Scientific Publishing
, Singapore.
12.
Chen
,
W. H.
,
Yuan
,
G.
, and
Zheng
,
W. X.
,
2013
, “
Robust Stability of Singularly Perturbed Impulsive Systems Under Nonlinear Perturbation
,”
IEEE Trans. Autom. Control
,
58
(
1
), pp.
168
174
.
13.
Sanfelice
,
R. G.
, and
Teel
,
A. R.
,
2011
, “
On Singular Perturbations Due to Fast Actuators in Hybrid Control Systems
,”
Automatica
,
47
(
4
), pp.
692
701
.
14.
Wang
,
W.
,
Teel
,
A. R.
, and
Nešić
,
D.
,
2012
, “
Analysis for a Class of Singularly Perturbed Hybrid Systems Via Averaging
,”
Automatica
,
48
(
6
), pp.
1057
1068
.
15.
Siljak
,
D. D.
,
1978
,
Large-Scale Dynamical Systems
,
Elsevier
, New York.
16.
Zečević
,
A. I.
, and
Šiljak
,
D. D.
,
2008
, “
Control Design With Arbitrary Information Structure Constraints
,”
Automatica
,
44
(
10
), pp. 2642–2647.
17.
Sghaier Tlili
,
A.
,
2017
, “
Linear Matrix Inequality Robust Tracking Control Conditions for Nonlinear Disturbed Interconnected Systems
,”
ASME J. Dyn. Syst., Meas., Control
,
139
(
6
), p. 061002.
18.
Haddad
,
W. M.
,
Chellaboina
,
V. S.
, and
Nersesov
,
S. G.
,
2014
,
Impulsive and Hybrid Dynamical Systems: Stability, Dissipativity, and Control
,
Princeton University Press
, Princeton, NJ.
19.
Goebel
,
R.
,
Sanfelice
,
R. G.
, and
Teel
,
A. R.
,
2009
, “
Hybrid Dynamical Systems
,”
IEEE Control Syst.
,
29
(
2
), pp.
28
93
.
20.
Mesbahi
,
M.
, and
Egerstedt
,
M.
,
2010
,
Graph Theoretic Methods in Multiagent Networks
,
Princeton University Press
, Princeton, NJ.
21.
Schaub
,
H.
, and
Junkins
,
J. L.
,
2003
,
Analytical Mechanics of Space Systems
,
AIAA
,
Reston, VA
.