Entropy-Regularized Optimal Transport
for Time-Varying Multi-Agent Coverage Control
Abstract
This paper addresses time-varying coverage control for multi-agent systems, formulated as the tracking of an evolving target density via entropy-regularized semi-discrete optimal transport. Unlike the hard Laguerre partition of the unregularized formulation, entropic regularization assigns fractions of the mass at each point to all agents, simplifying the design and numerical implementation of the control law. We derive a feedback-feedforward controller that tracks the evolving first-order optimality conditions with exponential convergence, and we investigate the role of the regularization parameter, which, above a critical threshold, renders the fully collapsed configuration locally optimal. Numerical experiments validate the theory: for moderate regularization, the proposed approach has performance comparable to the unregularized formulation and outperforms the corresponding Voronoi-based coverage baseline.
Index Terms:
Agents-based systems, Cooperative control, Coverage control, Density control, Entropic regularization, Optimal transport, Swarm robotics, Wasserstein distanceI Introduction
Coordinating mobile agents toward a desired spatial configuration is a fundamental problem in the control of multi-agent systems. In many applications, however, prescribing individual target positions is unnecessarily restrictive: the objective is instead specified at the collective or probabilistic level through a desired spatial distribution [1, 2]. This motivates a distributional formulation in which the agents are represented by their empirical measure and are steered toward a possibly time-varying target density, without prescribing an individual target position for each agent.
Optimal transport (OT) provides a natural framework for this problem, as the Wasserstein distance incorporates the geometry of the physical domain and allows discrete agent distributions to be compared directly with the continuous target densities [3]. While several approaches to density control rely on mean-field or continuum descriptions [4, 5, 6], here we retain the finite-dimensional nature of the multi-agent dynamics and formulate the resulting discrete-to-continuous problem through semi-discrete OT [7]. This provides a direct connection between individual agent positions and collective objectives in probability space. This perspective is also related to coverage control, where spatial densities encode the relative importance of different regions and classical formulations lead to Voronoi-based deployments [8, 9, 2]. Recent works have connected coverage objectives with semi-discrete OT and Laguerre partitions [10, 11, 12]. Building on this interpretation, our previous work [13] formulated time-varying coverage as an unregularized semi-discrete OT problem, in which agent positions and Kantorovich dual variables evolve jointly to track the first-order optimality conditions associated with a time-varying density. Such a formulation, however, inherits the hard partition induced by Laguerre cells, so that transport assignments change through moving cell boundaries. This lack of smoothness may be undesirable in a continuously evolving feedback problem, as moving cell boundaries complicate sensitivities, require geometric regularity assumptions, and lead to nonsmooth closed-loop analysis.
In this work, we introduce entropic regularization into the time-varying semi-discrete optimal transport formulation we first proposed in its unregularized form in [13]. Entropic OT replaces hard cell-based assignments with smooth transport weights, thereby regularizing the dependence of the transport problem on both the agent positions and the dual variables [3, 7]. It has also been employed for model predictive control in the discrete-discrete setting [14]. In contrast to these existing uses, the present work employs entropy not merely as a computational tool, as is common in OT [15], but as a control-oriented regularization that facilitates the design of smooth continuous-time feedback laws. The regularization parameter provides a natural trade-off between fidelity to the original Wasserstein problem and smoothness of the induced transport allocation. More broadly, the resulting formulation provides a framework for time-varying multi-agent density tracking and formation control in probability space. Unlike continuum approaches, it acts directly on a finite collection of agents, while allowing the target density to encode time-varying formations without prescribing individual agent assignments. In this Letter, we focus on the centralized setting. Our contributions are threefold: (i) we formulate time-varying density tracking for finite-agent systems as an entropy-regularized semi-discrete OT problem; (ii) we derive the associated regularized optimality conditions and continuous-time dynamics for the agent positions and dual variables, replacing the nonsmooth Laguerre partition with smooth transport weights; and (iii) we investigate the influence of the entropic regularization parameter.
II Mathematical Preliminaries
Scalars are lowercase (), vectors bold lowercase (), and matrices bold uppercase (), with maximum eigenvalue . The operator stacks vectors, e.g., . The -dimensional identity matrix is denoted by . Matrices of zeros and ones are denoted by and , respectively. When , they are and . The Kronecker product is , while is the Kronecker delta. The set of Borel probability measures on with finite second moment is , and denotes the -Wasserstein distance. As in [10], is the transport value associated with the half-squared Euclidean cost .
II-A Semi-Discrete Optimal Transport
OT compares probability measures by minimizing the cost of mass redistribution. Its Kantorovich formulation yields the Wasserstein distance [16]. In the semi-discrete setting, continuous and discrete measures are compared and, under mild assumptions, strong duality holds. The optimal map partitions domains into Laguerre cells, which generalize Voronoi cells through additive weights [17].
II-B Entropic Regularization
Entropy is commonly used as a regularizer in optimization problems over probability measures. In OT, entropic regularization is particularly convenient as it smooths the transport problem and typically reduces the computational burden associated with classical OT [15, 3, 7]. In the semi-discrete setting, the regularized problem becomes
where is the Kullback-Leibler divergence between measures and , is the vector of soft Laguerre assignments and is the coupling they induce. The assignments satisfy
The regularized dual objective is
| (3) |
where the cost of the discrete atom is . The hard Laguerre assignment is thereby replaced by a softmax distribution: each is fractionally assigned to all discrete atoms of rather than belonging to a single Laguerre cell. The -regularized assignment associated with atom is
| (4) |
As , the hard Laguerre partition is recovered whenever the limiting Laguerre assignment is unique almost everywhere and its cells have positive mass [3].
II-C Coverage Control
Coverage control positions mobile agents according to a target density by minimizing a coverage cost [8], classically via Voronoi tessellations [8, 9] and, more recently, via semi-discrete OT [18, 11, 12, 10]. Unlike Voronoi partitions, which depend only on agent positions, Laguerre partitions incorporate the dual variables to enforce equal-mass constraints, so that agents concentrate in high-density areas and the finite-agent approximation error is reduced [13, 10]. Building on [10], our previous work [13] tracked the unregularized first-order optimality conditions and , for a time-varying , of the optimization problem minimizing the semi-discrete 2-Wasserstein distance squared. That construction, however, requires sensitivities of integrals over moving Laguerre cells: these contain facet integrals and change expression whenever the Laguerre adjacency graph changes, so the analysis needs nondegenerate cells, moving-boundary formulas, and a nonsmooth solution concept, which the entropic framework proposed here avoids.
III Modeling and Problem Statement
Building upon [13], our aim is to control an ensemble of finite agents to approximate a continuous, possibly time-varying distribution by minimizing the instantaneous entropic semi-discrete transport cost.
Consider a convex compact domain , and let denote a (possibly time-varying) target density function with unitary mass. The absolutely continuous target measure is induced by .
Assumption 1
is and Lipschitz in time.
This guarantees that is sufficiently regular and exists. The -th controlled agent is located at position at time , and we collect the positions of all agents in . Each agent evolves according to:
| (5) |
where is the control input driving the -th agent. The empirical measure of the agents at time , denoted by , is defined as the normalized sum of Dirac delta measures centered at the agent positions:
| (6) |
Assuming that the agents have access to and its time derivative , the objective is to design a control law that computes for , so that, at each time , the positions of the agents minimize the mismatch between the target measure and the empirical measure (6), i.e.,
| (7) |
for the entropy regularization parameter , with given by (3). Note that the instantaneous Wasserstein minimization is fundamentally different from dynamic OT in the Benamou-Brenier formulation [19].
IV Entropic Coverage Control
For every and every , the soft assignment (4) satisfies . We define the regularized masses and barycenters as
| (8a) | ||||
| (8b) | ||||
Thus, and every is well defined, without requiring an additional nonempty-cell assumption. Here and , and we collect them as and . These converge to their unregularized counterparts, the mass and barycenter of the Laguerre cell (2), as [3]. Direct differentiation yields
| (9) |
Setting (9) to zero, the regularized first-order conditions are
| (10a) | ||||
| (10b) | ||||
We will then design dynamics for to achieve the above conditions. To do so, we first differentiate (8) in time, obtaining
where is given, while
Exploiting the softmax properties, we have
Therefore, we define the sensitivity matrix , with block entries
| (11a) | |||
| the matrix with block entries | |||
| (11b) | |||
| the matrix with block entries | |||
| (11c) | |||
| and the matrix with scalar entries | |||
| (11d) | |||
This construction allows us to compactly write
with
| (12a) | ||||
| (12b) | ||||
We now exploit this structure to design primal and dual dynamics that track the time-varying first-order optimality conditions (10) by directly imposing the desired error dynamics. Since the dual variables are defined up to an additive constant, we remove one decision variable to resolve this ambiguity and, without loss of generality, set . The inner objective is concave and becomes strictly concave once this gauge is fixed; the outer minimization, however, is nonconvex, as is standard for this class of problems [10, 13, 8]. We therefore target stationary points.
Theorem 1 (Tracking solution)
Suppose Assumption 1 hold. Let , impose with , and define
| (13) |
where , , , and are defined in (11). Suppose further that is well defined11 1 This assumption is typically made in the related literature on time-varying coverage control, where analogous invertibility conditions arise and are discussed, e.g., in [9]. Then, the control inputs in (5) defined by the continuous-time dynamics
| (14) |
with gains and feedforward terms , given by (12), achieve exponential tracking of the first-order optimality conditions (10) of Problem (7). In particular, the tracking errors and converge exponentially to zero with rates and , respectively.
Proof:
The first block row of (14) gives
| (15) |
Since
| (16) |
subtracting (16) from (15), we obtain , leading to exponential convergence of the agent positions to (10a) with rate . The second block row gives
Using
we obtain
Thus, the first components of satisfy the desired exponential dynamics. Moreover, since the soft assignments sum to one, , so that
and the -th component satisfies the same equation. Hence , leading to exponential convergence of the mass error to zero, thus leading the dual variable to satisfy (10b). Finally, since and each is a -weighted average of , the positions remain bounded, so that the closed loop is forward complete, i.e., no finite escape occurs and its solutions exist for all . ∎
The main theoretical advantage over the unregularized formulation of [13, Theorem 1] is the removal of several geometric regularity assumptions. Since for every , the soft masses, barycenters, and their sensitivities are continuously differentiable at every primal-dual configuration: distinct agents, nondegenerate cells, and locally finite topological transitions of the Laguerre tessellation need no longer be assumed, the closed loop admits classical solutions, and the identities above hold at every time instant rather than almost everywhere. The implementation simplifies accordingly, as all sensitivities are smooth integrals over , evaluated by vectorizable quadrature and softmax operations, with no Laguerre cells to construct, neighbors to identify, or facet integrals to evaluate. The price is the loss of the topology-induced sparsity that enables distributed approximations in the unregularized setting: is generally dense, although approximate sparsity may be recovered by truncating negligible weights.
We now characterize the role of . Section V shows that small values yield solutions comparable to their unregularized counterparts, so that the above advantages are obtained at a controlled approximation bias. Larger values make the bias more pronounced, observing reduced agent dispersion and, for sufficiently large , collapse of the ensemble onto the global barycenter of the target density. Although coincident positions remain admissible in the regularized formulation, such behavior is undesirable when inter-agent collisions must be avoided.
Proposition 1 (Sub-optimality gap)
Let and be the unregularized and -regularized transport costs between empirical and target measures at time for the given agents . Then, for every ,
Proof:
Since the KL divergence is nonnegative, the value of the regularized problem is no smaller than that of the unregularized one. Conversely, an optimal coupling of the unregularized problem can be chosen deterministic, with for measurable sets satisfying , also when some agents coincide. This coupling is feasible for the regularized problem and . Hence,
∎The bound holds uniformly in and .
Proposition 2 (Collapsed stationary configuration)
Define the moments of the target distribution
For every , the configuration
| (17) |
is a stationary point with Hessian
| (18) |
where
| (19) |
Therefore, the collapsed point (17) is a strict local minimum if , and a saddle point if .
Proof:
At the collapsed point (17),
therefore, it is a stationary point. We then compute the Hessian
Substituting (17) into the sensitivity matrices concerning yields
for defined in (19). Since vanishes, the total derivative , and substitution into the Hessian leads to (18). The matrix has eigenvalue zero along the consensus direction and eigenvalue one along the disagreement directions. Hence, the Hessian has eigenvalue with multiplicity , along the consensus directions, and eigenvalues , each with multiplicity , along the disagreement directions associated with the th eigenvalue of , proving the classification. ∎
Remark 1
By Proposition 2, should be chosen strictly below for all . The threshold, however, governs only full collapse: partial clustering of subsets of agents can occur below it, as in Fig. 2(b). As in the unregularized case, collision-free trajectories are never guaranteed. Characterizing such partial collapses, and enforcing collision constraints, is left for future work.
V Numerical Validation
In all experiments, the integrals in (11) are evaluated by tensor-product quadrature on a uniform grid of points per dimension in the 2D experiment and points in the 1D experiment, (14) is integrated with forward Euler with , the gains are , , and . We first validate the proposed approach in a representative two-dimensional example. We consider agents tasked with covering an evolving density and set . The initial density is Gaussian and evolves according to the advection-diffusion equation
| (20) |
complemented with no-flux boundary conditions. We consider a uniform drift and a diffusion coefficient . This setting may represent, for instance, a contaminant plume transported by a uniform fluid current while diffusing [20, 2]. The agents must therefore continuously redistribute to monitor the evolving concentration field. Figure 1a–c shows snapshots at the initial, intermediate, and final times, with computed directly from (20). Starting from random initial positions uniform in , the agents redistribute to cover the density while tracking its drift, and progressively spread out as it diffuses, adapting to the varying target density. The mass and positions error also exponentially decay to zero (their evolutions are omitted here for the sake of brevity). The Wasserstein distance decreases rapidly during the initial transient and then grows linearly, as diffusion increases the variance of the target density and hence the finite-agent quantization error (Fig. 1d).
Next, we investigate the effect of in a one-dimensional domain. We consider agents covering a Gaussian density with a time-varying mean, namely, , where and , over a time horizon . Figures 2(a)–2(c) show the final agent configurations for different values of . For , the agents effectively cover the density while maintaining distinct positions: three agents are closely spaced near the peak of the Gaussian, whereas the remaining two lie farther away toward its tails. For the intermediate value , the three central agents collapse to the same position, while the two outer agents remain distinct. Finally, for , all agents collapse to a single point corresponding to the global barycenter of the target density, consistently with Proposition 2. Figure 2(d) further confirms these theoretical findings, where we vary . For small values of , the standard deviation of the agent positions, normalized by its value in the unregularized case, remains close to one, indicating that the ensemble spreads similarly to the baseline configuration. As increases, the normalized standard deviation decreases and becomes zero near the theoretical critical threshold, remaining zero for all values exceeding the variance of the target density. Accordingly, the normalized Wasserstein distance remains close to one for small and increases to approximately 3 when all agents collapse.
Finally, we compare the proposed solution with the Voronoi-based approach [9], obtained in the unregularized case by setting for all . Since the Voronoi partition does not enforce equal cell masses, the agents concentrate less around the Gaussian peak than under the unregularized OT solution, resulting in a larger final approximation error. Moreover, the entropic controller remains more accurate for all tested values , as reported in Table I for four representative values of . Finally, the suboptimality gap consistently remains below the upper bound established in Proposition 1. Notice that at a collapsed configuration, all agents coincide and the regularized optimal coupling has zero KL divergence, consequently, .
VI Conclusion
This paper introduced an entropy-regularized optimal transport framework for time-varying coverage control, with application to multi-agent density tracking. The smooth assignment induced by entropic regularization enabled a control law that exponentially tracks the evolving first-order optimality conditions, together with an explicit threshold above which the collapsed configuration becomes locally optimal. Numerical experiments confirmed the theory and, for moderate regularization, have comparable performance with our unregularized approach [13], while outperforming Voronoi-based coverage [9]. Future work will focus on distributed implementations, adaptive selection of , extensions to constrained dynamics and collision avoidance, and a theoretical characterization of the conditions ensuring the invertibility of .
References
- [1] (2014) Probabilistic swarm guidance using optimal transport. In IEEE Conference on Control Applications, pp. 498–505. Cited by: §I.
- [2] (2025) Heterogeneous collaborative pursuit via coverage control driven by Fokker-Planck equations. IEEE Transactions on Robotics 41, pp. 3649–3668. Cited by: §I, §I, §V.
- [3] (2019) Computational optimal transport: with applications to data science. Foundations and Trends in Machine Learning 11 (5-6), pp. 355–607. Cited by: §I, §I, §II-A, §II-B, §II-B, §IV.
- [4] (2021) Optimal transport in systems and control. Annual Review of Control, Robotics, and Autonomous Systems 4 (1), pp. 89–113. Cited by: §I.
- [5] (2023) Continuum swarm tracking control: a geometric perspective in Wasserstein space. In 62nd IEEE Conference on Decision and Control (CDC), pp. 1367–1374. Cited by: §I.
- [6] (2025) Leader–follower density control of spatial dynamics in large-scale multiagent systems. IEEE Transactions on Automatic Control 70 (10), pp. 6783–6798. Cited by: §I.
- [7] (2023) Semi-discrete optimal transport: hardness, regularization and numerical solution. Mathematical Programming 199 (1), pp. 1033–1106. Cited by: §I, §I, §II-B.
- [8] (2004) Coverage control for mobile sensing networks. IEEE Transactions on Robotics and Automation 20 (2), pp. 243–255. Cited by: §I, §II-C, §IV.
- [9] (2015) Multirobot control using time-varying density functions. IEEE Transactions on Robotics 31 (2), pp. 489–493. Cited by: §I, §II-C, TABLE I, TABLE I, §V, §VI, footnote 1.
- [10] (2021) Optimal transport-based coverage control for swarm robot systems: generalization of the Voronoi tessellation-based method. IEEE Control Systems Letters 5 (4), pp. 1483–1488. Cited by: §I, §II-C, §II, §IV.
- [11] (2022) A multiscale analysis of multi-agent coverage control algorithms. Automatica 145, pp. 110516. Cited by: §I, §II-C.
- [12] (2024) Distributed online optimization for multi-agent optimal transport. Automatica 170, pp. 111880. Cited by: §I, §II-C.
- [13] (2026) Optimal transport for time-varying multi-agent coverage control. arXiv:2601.21753. Cited by: §I, §I, §II-C, §III, §IV, §IV, TABLE I, TABLE I, §VI.
- [14] (2023) Entropic model predictive optimal transport over dynamical systems. Automatica 152, pp. 110980. Cited by: §I.
- [15] (2013) Sinkhorn distances: lightspeed computation of optimal transport. Advances in neural information processing systems 26. Cited by: §I, §II-B.
- [16] (2009) Optimal transport: old and new. Vol. 338, Springer. Cited by: §II-A, §II-A.
- [17] (1987) Power diagrams: properties, algorithms and applications. SIAM Journal on Computing 16 (1), pp. 78–96. Cited by: §II-A.
- [18] (2024) Multi-agent coverage control: from discrete assignments to continuous multi-agent distribution matching. arXiv:2407.13890. Cited by: §II-C.
- [19] (2000) A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numerische Mathematik 84 (3), pp. 375–393. Cited by: §III.
- [20] (2013) Oil spill cleaning up using swarm of robots. In Proceedings of the Second International Conference on Advances in Computing and Information Technology, pp. 215–224. Cited by: §V.