arXiv is now an independent nonprofit! Learn more
License: arXiv.org perpetual non-exclusive license
arXiv:2608.19599v1 [stat.ME] 20 Aug 2026

Efficient Poisson Subsampling for the Partially Linear Additive Cox Model

Dongxiao HanNITFID, LPMC and KLMDASR, School of Statistics and Data Science, Nankai UniversityLiuquan SunSKLMS, Academy of Mathematics and Systems Science, Chinese Academy of Sciences,and School of Mathematical Sciences, University of Chinese Academy of SciencesChunjie WangSchool of Mathematics and Statistics, Changchun University of TechnologyDehui WangSchool of Mathematics and Statistics, Liaoning UniversityHaiYing WangDepartment of Statistics, University of Connecticut    Haixiang ZhangSchool of Mathematics and KL-AAGDM, Tianjin University
Abstract

To address the computational and storage challenges often encountered in large-scale survival data analysis, we propose an efficient Poisson subsampling method for the partially linear additive Cox model. This model provides a flexible yet interpretable framework by incorporating linear covariate effects, additive nonparametric components for nonlinear covariates, and a nonparametric baseline hazard function. The proposed method adopts B-spline basis functions to approximate the nonparametric components and employs the decorrelated score technique to construct a Poisson subsampling-based estimation equation, based on which we establish the asymptotic normality of the resulting estimator and derive the optimal subsampling probabilities according to the L-optimality criterion. Furthermore, we design a two-step adaptive algorithm for practical implementation. The proposed approach enables computationally efficient statistical inference for large-scale survival analysis without processing the full dataset. We validate the performance of the proposed method through extensive simulation studies and a real-world application to a lymphoma cancer dataset, demonstrating its efficiency and accuracy in large-scale settings.

11footnotetext: †\daggerAuthors are listed in alphabetical order.22footnotetext: ∗*Corresponding author: haixiang.zhang@tju.edu.cn

Keywords: Massive data; Optimal subsampling; Partially linear additive Cox model; Survival data.

1 Introduction

With the rapid growth of data volume in modern application scenarios, traditional statistical methods frequently face computationally infeasible challenges, particularly in resource-constrained environments. Subsampling has emerged as a powerful and widely adopted technique in statistical and computational research. By carefully selecting a representative subset from the full dataset, subsampling allows for parameter estimation with reduced resource consumption while preserving the statistical validity of the resulting estimates. This makes it a practical solution for modern large-scale data challenges.

Extensive research efforts have been devoted to the development of subsampling strategies for various statistical models. Specifically, 11 and 10 introduced L-optimality based methods for logistic and quantile regression, respectively; 15 studied the softmax regression via Poisson subsampling; 7 investigated A-optimality methods for the functional generalized linear model; Shao et al. (9) studied the partially linear model by constructing an unbiased Neyman-orthogonal score function; 20, Zuo et al. (24); 16 proposed optimal subsample selection approaches in distributed computing environments, and 18 developed an online strategy for the streaming multinomial logistic model. In high-dimensional settings, 21 provided a cross-validation procedure for selecting optimal subsamples. Comprehensive reviews of this field can be found in 14 (14) and Yu et al. (17) and the references therein.

Survival data arise frequently in many fields, such as biomedicine 2, engineering 13, and social sciences (Lee et al., 5). Although recent years have seen the development of subsampling methods for such data, these methods are limited to settings where covariates have parametric effects. For instance, Zuo et al. (23) investigated the additive hazards model 6, and Zhang et al. (22) and Shao et al. (8) studied the Cox model 1, with all these studies employing L-optimality subsampling; In distributed settings, Zhang et al. (19) further proposed a divide-and-conquer based subsampling approach for the Cox model. The partially linear additive Cox (PLA-Cox; 4, 4) model, which includes the Cox model as a special case, integrates both parametric and nonparametric covariate effects. Given its wide applicability, there is an urgent need for subsampling methods to alleviate the computational burden of fitting this model to large-scale data.

In this article, we propose an efficient Poisson subsampling method tailored for the PLA-Cox model. Our approach approximates nonparametric components using B-spline basis functions, constructs Poisson subsampling-based estimation equations via the decorrelated score technique, and derives the optimal subsampling probabilities based on the L-optimality criterion. For practical implementation, we design a two-stage adaptive algorithm. In the first stage, a pilot subsample is drawn via uniform Poisson subsampling to obtain pilot estimators. These estimators are then used to determine the optimal subsampling probabilities for selecting the final subsample and estimating the target parameters in the second stage. The differences between our work and prior studies on subsampling in survival analysis are as follows: First, as mentioned above, existing subsampling methods are designed for models with fully parametric covariate effects (e.g., the additive hazards model and the Cox model), whereas our method targets the PLA-Cox model, which includes both parametric and nonparametric covariate effects. Second, we develop an efficient Poisson subsampling scheme for the PLA-Cox model, which implements sampling without replacement (thus avoiding duplicate observations), distinguishing it from existing with-replacement subsampling strategies. Third, to address the nonparametric components of covariate effects, we adopt B-spline basis functions for approximation and employ the decorrelated score technique to eliminate the confounding influence of nuisance parameters. This distinguishes our estimation strategy from existing subsampling methods. Moreover, the introduction of this nonparametric component substantially complicates the theoretical development, as it necessitates validating the B-spline approximation and adjusting for the decorrelation procedure.

The remainder of this paper is outlined as follows: In Section 2, we develop a Poisson subsampling method for the PLA-Cox model, along with the asymptotic normality of the corresponding estimator. In Section 3, we focus on determining the optimal subsampling probabilities, and propose a two-stage algorithm that enables the adaptive implementation of the optimal subsampling method. In Section 4, we conduct simulation studies to examine the finite-sample performance of the proposed method. An application to a real dataset is provided in Section 5. Concluding remarks are presented in Section 6. All proofs are deferred to the Supplementary Material.

2 Poisson Subsampling-Based Estimation

Let TT and CC be the failure time and censoring time, respectively. Denote 𝑿=(X1,…,Xp)′∈ℝp\bm{X}=(X_{1},\ldots,X_{p})^{\prime}\in\mathbb{R}^{p} as the covariate vector for the parametric components, and 𝒁=(Z1,…,Zq)′∈ℝq\bm{Z}=(Z_{1},\ldots,Z_{q})^{\prime}\in\mathbb{R}^{q} as the covariates for the nonparametric components. Conditional on 𝐗\mathbf{X} and 𝐙\mathbf{Z}, we assume that TT and CC are independent. The observed time is defined as Y=min⁡(T,C)Y=\min(T,C), with event indicator Δ=I⁡(T≤C)\Delta=I(T\leq C), where I⁡(⋅)I(\cdot) denotes the indicator function. The full dataset consists of nn independent and identically distributed observations from the population, denoted as 𝒟n={(𝐗i,𝐙i,Δi,Yi):i=1,…,n}\mathcal{D}_{n}=\left\{\left(\mathbf{X}_{i},\mathbf{Z}_{i},\Delta_{i},Y_{i}\right):i=1,\dots,n\right\}. The PLA-Cox model assumes

λ⁡(t∣𝑿,𝒁)=λ0​(t)​exp⁡{𝜷0′​𝑿+g⁡(𝒁)},\displaystyle\lambda(t\mid\bm{X},\bm{Z})=\lambda_{0}(t)\exp\{\bm{\beta}_{0}^{\prime}\bm{X}+g(\bm{Z})\}, (1)

where λ⁡(t∣𝑿,𝒁)\lambda(t\mid\bm{X},\bm{Z}) is the conditional hazard function given 𝐗\mathbf{X} and 𝐙\mathbf{Z}, λ0​(t)\lambda_{0}(t) is an unspecified baseline hazard function, 𝜷0\bm{\beta}_{0} is a pp-dimensional regression parameter vector, and the nonparametric components g⁡(𝐙)=∑j=1qgj​(Zj)g(\mathbf{Z})=\sum_{j=1}^{q}g_{j}(Z_{j}) consists of smooth functions of ZjZ_{j}, the jjth component of 𝐙\mathbf{Z}, satisfying E⁡{gj​(Zj)}=0{E}\{g_{j}(Z_{j})\}=0 for j=1,…,qj=1,\ldots,q.

We approximate each gj​(⋅)g_{j}(\cdot) by using B-spline basis functions. Suppose that each ZjZ_{j} takes values in [a,b][a,b], where aa and bb are finite numbers. Define 𝒮ϱ\mathcal{S}_{\varrho} as the space of polynomial splines of degree ϱ≥1\varrho\geq 1. Consider a knot sequence with JJ interior knots

a=t−ϱ=…=t−1=t0<t1<…<tJ=tJ+1=…=tJ+ϱ+1=b,a=t_{-\varrho}=\ldots=t_{-1}=t_{0}<t_{1}<\ldots<t_{J}=t_{J+1}=\ldots=t_{J+\varrho+1}=b,

where JJ may increase with sample size nn. For each j=1,…,qj=1,\ldots,q, we approximate gj​(Zj)g_{j}(Z_{j}) by a linear combination of B-spline basis functions {Bs,j​(Zj)}s=−ϱJ\{B_{s,j}(Z_{j})\}_{s=-\varrho}^{J} of order ϱ+1\varrho+1. The nonparametric components in model (1) can be approximated as 𝜶′​𝑩​(𝒁)\bm{\alpha}^{\prime}\bm{B}(\bm{Z}), where 𝐁⁡(𝐙)={Bs,j​(Zj),s=−ϱ,…,J;j=1,…,q}′\mathbf{B}(\mathbf{Z})=\{B_{s,j}(Z_{j}),s=-\varrho,\ldots,J;j=1,\ldots,q\}^{\prime} is the B-spline basis vector, and 𝜶={αs,j,s=−ϱ,…,J;j=1,…,q}′\bm{\alpha}=\{\alpha_{s,j},s=-\varrho,\ldots,J;j=1,\ldots,q\}^{\prime} is the corresponding coefficient vector.

The negative log pseudo-partial likelihood function for the full data is

ℓ⁡(𝜽)\displaystyle\ell(\bm{\theta}) =−1n∑i=1n∫0τ[𝜷′𝐗i+𝜶′𝐁(𝐙i)−log{n−1∑j=1nI(Yj≥t)exp{𝜷′𝐗j+𝜶′𝐁(𝐙j)}}]dNi(t),\displaystyle=-\frac{1}{n}\sum_{i=1}^{n}\int_{0}^{\tau}\left[\bm{\beta}^{\prime}\mathbf{X}_{i}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}_{i})-\log\left\{n^{-1}\sum_{j=1}^{n}I(Y_{j}\geq t)\exp\{\bm{\beta}^{\prime}\mathbf{X}_{j}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}_{j})\}\right\}\right]dN_{i}(t),

where 𝜽=(𝜷′,𝜶′)′\bm{\theta}=(\bm{\beta}^{\prime},\bm{\alpha}^{\prime})^{\prime}, τ\tau is a prespecified positive constant, and Ni​(t)=I⁡(Δi=1,Yi≤t)N_{i}(t)=I(\Delta_{i}=1,Y_{i}\leq t) is a counting process, i=1,…,ni=1,\ldots,n. However, when the full dataset is large, minimizing ℓ⁡(𝜽)\ell(\bm{\theta}) brings an enormous computational burden, severely limiting the practical application of the PLA-Cox model in massive data scenarios. We employ the Possion subsampling method to address this challenge. Specifically, the iith observation is assigned a sampling probability πi\pi_{i} satisfying 0<πi≤r−10<\pi_{i}\leq r^{-1} with ∑i=1nπi=1\sum_{i=1}^{n}\pi_{i}=1, where rr represents the expected subsample size. Let u1,…,unu_{1},\ldots,u_{n} be independent uniform random variables on (0,1)(0,1) that are independent of the observed data. For each individual ii, we include the tuple (𝐗i,𝐙i,Δi,Yi)(\mathbf{X}_{i},\mathbf{Z}_{i},\Delta_{i},Y_{i}) in the subsample if ui≤r​πiu_{i}\leq r\pi_{i}. This yields the subsampled dataset 𝒟r∗={(𝐗i∗,𝐙i∗,Δi∗,Yi∗,πi∗)}i=1r∗\mathcal{D}_{r^{*}}=\{(\mathbf{X}_{i}^{*},\mathbf{Z}_{i}^{*},\Delta_{i}^{*},Y_{i}^{*},\pi_{i}^{*})\}_{i=1}^{r^{*}}, where for each observation ii, 𝐗i∗\mathbf{X}_{i}^{*} are the linear-effect covariates, 𝐙i∗\mathbf{Z}_{i}^{*} are the nonparametric confounders, Δi∗\Delta_{i}^{*} is the event indicator, 𝐘i∗\mathbf{Y}_{i}^{*} is the response variable, and πi∗\pi_{i}^{*} is the sampling probability. The realized subsample size r∗r^{*} satisfies 𝔼⁡(r∗)=r\mathbb{E}(r^{*})=r. Based on 𝒟r∗\mathcal{D}_{r^{*}}, a negative weighted log pseudo-partial likelihood is given as follows:

ℓ∗​(𝜽)\displaystyle\ell^{*}(\bm{\theta}) =\displaystyle= −1n∑i=1r∗1r​πi∗∫0τ[𝜷′𝐗i∗+𝜶′𝐁(𝐙i∗)\displaystyle-\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{1}{r\pi_{i}^{*}}\int_{0}^{\tau}\Big[\bm{\beta}^{\prime}\mathbf{X}^{*}_{i}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}^{*}_{i})
−log{n−1∑j=1r∗(rπj∗)−1I(Yj∗≥t)exp{𝜷′𝐗j∗+𝜶′𝐁(𝐙j∗)}}]dNi∗(t),\displaystyle-\log\Big\{n^{-1}\sum_{j=1}^{r^{*}}(r\pi_{j}^{*})^{-1}I(Y^{*}_{j}\geq t)\exp\{\bm{\beta}^{\prime}\mathbf{X}^{*}_{j}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}^{*}_{j})\}\Big\}\Big]dN_{i}^{*}(t),

where Ni∗​(t)=I⁡(Δi∗=1,Yi∗≤t)N_{i}^{*}(t)=I(\Delta_{i}^{*}=1,Y^{*}_{i}\leq t), i=1,…,r∗i=1,\ldots,r^{*}.

In the PLA-Cox model, 𝜷\bm{\beta} is the target parameter requiring rigorous inference, whereas 𝜶\bm{\alpha} is nuisance parameter which merely capture nonparametric confounding effects. As a result, we adopt the decorrelated score technique to eliminate the influence of 𝜶\bm{\alpha} on 𝜷\bm{\beta}. Let

∇𝜷ℓ∗​(𝜷,𝜶)=∂ℓ∗​(𝜷,𝜶)/∂𝜷,∇𝜶ℓ∗​(𝜷,𝜶)=∂ℓ∗​(𝜷,𝜶)/∂𝜶,\displaystyle\nabla_{\bm{\beta}}\ell^{*}(\bm{\beta},\bm{\alpha})={\partial\ell^{*}(\bm{\beta},\bm{\alpha})}/{\partial\bm{\beta}},~~\nabla_{\bm{\alpha}}\ell^{*}(\bm{\beta},\bm{\alpha})={\partial\ell^{*}(\bm{\beta},\bm{\alpha})}/{\partial\bm{\alpha}},
∇𝜷​𝜶ℓ∗​(𝜷,𝜶)=∂2ℓ∗​(𝜷,𝜶)/∂𝜷​∂𝜶′,∇𝜶​𝜶ℓ∗​(𝜷,𝜶)=∂2ℓ∗​(𝜷,𝜶)/∂𝜶​∂𝜶′,\displaystyle\nabla_{\bm{\beta}\bm{\alpha}}\ell^{*}(\bm{\beta},\bm{\alpha})={\partial^{2}\ell^{*}(\bm{\beta},\bm{\alpha})}/{\partial\bm{\beta}\partial\bm{\alpha}^{\prime}},~~\nabla_{\bm{\alpha}\bm{\alpha}}\ell^{*}(\bm{\beta},\bm{\alpha})={\partial^{2}\ell^{*}(\bm{\beta},\bm{\alpha})}/{\partial\bm{\alpha}\partial\bm{\alpha}^{\prime}},

and

𝜽^F=(𝜷^F′,𝜶^F′)′=arg⁡min𝜽⁡ℓ⁡(𝜽).\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}=(\hat{\bm{\beta}}_{\mbox{\tiny\rm F}}^{\prime},\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}}^{\prime})^{\prime}=\arg\min\limits_{\bm{\theta}}\ell(\bm{\theta}).

If 𝜽^F\hat{\bm{\theta}}_{\mbox{\tiny\rm F}} is available, we propose the following decorrelated score function

U∗​(𝜷,𝜶^F,𝐖^F)=∇𝜷ℓ∗​(𝜷,𝜶^F)−𝐖^F​∇𝜶ℓ∗​(𝜷,𝜶^F),\displaystyle U^{*}(\bm{\beta};\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}},\hat{\mathbf{W}}_{\mbox{\tiny\rm F}})=\nabla_{\bm{\beta}}{\ell^{*}(\bm{\beta},{\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}}})}-\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}\nabla_{\bm{\alpha}}{\ell^{*}(\bm{\beta},{\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}}})},

where 𝐖^F=∇𝜷​𝜶2​ℓ​(𝜽^F)​{∇𝜶​𝜶2​ℓ​(𝜽^F)}−1\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}=\nabla^{2}_{\bm{\beta}\bm{\alpha}}\ell(\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\{{\nabla_{\bm{\alpha}\bm{\alpha}}^{2}\ell(\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}\}^{-1} is the projection matrix of ∇𝜷ℓ∗​(𝜷^F,𝜶^F)\nabla_{\bm{\beta}}{\ell^{*}(\hat{\bm{\beta}}_{\mbox{\tiny\rm F}},{\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}}})} onto ∇𝜶ℓ∗​(𝜷^F,𝜶^F)\nabla_{\bm{\alpha}}{\ell^{*}(\hat{\bm{\beta}}_{\mbox{\tiny\rm F}},{\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}}})}. Nevertheless, since 𝜶^F\hat{\bm{\alpha}}_{\mbox{\tiny\rm F}} and 𝐖^F\hat{\mathbf{W}}_{\mbox{\tiny\rm F}} are unavailable, we replace them with pilot estimators obtained from a pilot subsample. Given the expected pilot subsample size r0r_{0}, we draw a pilot subsample 𝒟r0∗={(𝐗i0∗,𝐙i0∗,Δi0∗,Yi0∗,πi0∗)}i=1r0∗\mathcal{D}_{r_{0}^{*}}=\left\{(\mathbf{X}_{i}^{0*},\mathbf{Z}_{i}^{0*},\Delta_{i}^{0*},Y_{i}^{0*},\pi_{i}^{0*})\right\}_{i=1}^{r_{0}^{*}} via uniform Poisson subsampling with πi0∗=1/n\pi_{i}^{0*}=1/n, i=1,…,r0∗i=1,\ldots,r_{0}^{*}. Based on this subsample, we compute (𝜷0~,𝜶~0)=argminℓ0∗(𝜷,𝜶)(\tilde{\bm{\beta}_{0}},\tilde{\bm{\alpha}}_{0})=\arg\min\ell^{0*}(\bm{\beta},\bm{\alpha}) and 𝐖~0=∇𝜷​𝜶2ℓ0∗(𝜷~0,𝜶~0){∇𝜶​𝜶2ℓ0∗(𝜷~0,𝜶~0)}−1\tilde{\mathbf{W}}_{0}=\nabla^{2}_{\bm{\beta}\bm{\alpha}}\ell^{0*}(\tilde{\bm{\beta}}_{0},\tilde{\bm{\alpha}}_{0})\big\{\nabla_{\bm{\alpha}\bm{\alpha}}^{2}\ell^{0*}(\tilde{\bm{\beta}}_{0},\tilde{\bm{\alpha}}_{0})\big\}^{-1}, where

ℓ0∗(𝜷,𝜶)\displaystyle\ell^{0*}(\bm{\beta},\bm{\alpha}) =\displaystyle= −∑i=1r0∗1r0∫0τ[𝜷′𝐗i0∗+𝜶′𝐁(𝐙i0∗)\displaystyle-\sum_{i=1}^{r_{0}^{*}}\frac{1}{r_{0}}\int_{0}^{\tau}\Big[\bm{\beta}^{\prime}\mathbf{X}^{0*}_{i}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}^{0*}_{i})
−log{∑j=1r0∗(r0)−1I(Yj0∗≥t)exp{𝜷′𝐗j0∗+𝜶′𝐁(𝐙j0∗)}}]dNi0∗(t),\displaystyle-\log\Big\{\sum_{j=1}^{r_{0}^{*}}(r_{0})^{-1}I(Y^{0*}_{j}\geq t)\exp\{\bm{\beta}^{\prime}\mathbf{X}^{0*}_{j}+\bm{\alpha}^{\prime}{\mathbf{B}}(\mathbf{Z}^{0*}_{j})\}\Big\}\Big]dN_{i}^{0*}(t),

and Ni0∗(t)=I(Δi0∗=1,Yi0∗≤t)N_{i}^{0*}(t)=I(\Delta_{i}^{0*}=1,Y^{0*}_{i}\leq t), i=1,…,ni=1,\ldots,n. Finally, we obtain the subsampling estimator 𝜷~\tilde{\bm{\beta}} by solving U∗​(𝜷,𝜶~0,𝐖~0)=0U^{*}(\bm{\beta};\tilde{\bm{\alpha}}_{0},\tilde{\mathbf{W}}_{0})=0.

Our method inherits two core statistical advantages. First, from the computational perspective, the proposed method significantly reduces the computational burden by only utilizing a small fraction of the full dataset, avoiding the high computational cost of full-data optimization. Second, in terms of statistical inference, the orthogonality between the decorrelated score function and the gradient vector of the nuisance parameter 𝜶\bm{\alpha} eliminates the interference of 𝜶\bm{\alpha} on 𝜷~\tilde{\bm{\beta}}, ensuring valid inference for the target parameter 𝜷0\bm{\beta}_{0} in the presence of nonparametric covariate effects. Our approach differs from existing subsampling methods in survival analysis, which are designed exclusively for models with fully parametric covariate effects and thus cannot be directly extended to our setting involving both parametric and nonparametric covariate components.

For any vector 𝐮\mathbf{u}, define 𝐮⊗0=1\mathbf{u}^{\otimes 0}=1, 𝐮⊗1=𝐮\mathbf{u}^{\otimes 1}=\mathbf{u} and 𝐮⊗2=𝐮𝐮′\mathbf{u}^{\otimes 2}=\mathbf{u}\mathbf{u}^{\prime}. Let

S(k)​(t,𝜽)\displaystyle S^{(k)}(t,\bm{\theta}) =1n​∑i=1nI⁡(Yi≥t)​𝐕i⊗k​exp⁡(𝜽′​𝐕i),\displaystyle=\frac{1}{n}\sum_{i=1}^{n}I(Y_{i}\geq t)\mathbf{V}_{i}^{\otimes k}\exp(\bm{\theta}^{\prime}\mathbf{V}_{i}),
SX(k)​(t,𝜽)\displaystyle S_{X}^{(k)}(t,\bm{\theta}) =1n​∑i=1nI⁡(Yi≥t)​𝐗i⊗k​exp⁡(𝜽′​𝐕i),\displaystyle=\frac{1}{n}\sum_{i=1}^{n}I(Y_{i}\geq t)\mathbf{X}^{\otimes k}_{i}\exp(\bm{\theta}^{\prime}\mathbf{V}_{i}),
SZ(k)​(t,𝜽)\displaystyle S_{Z}^{(k)}(t,\bm{\theta}) =1n​∑i=1nI⁡(Yi≥t)​𝐁⊗k​(𝐙i)​exp⁡(𝜽′​𝐕i),\displaystyle=\frac{1}{n}\sum_{i=1}^{n}I(Y_{i}\geq t)\mathbf{B}^{\otimes k}(\mathbf{Z}_{i})\exp(\bm{\theta}^{\prime}\mathbf{V}_{i}),
SW(k)​(t,𝐖^F,𝜽)\displaystyle S_{W}^{(k)}(t,\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\bm{\theta}) =1n​∑i=1nI⁡(Yi≥t)​{𝐗i−𝐖^F​𝐁​(𝐙i)}​(𝐗i⊗k)′​exp⁡(𝜽′​𝐕i),\displaystyle=\frac{1}{n}\sum_{i=1}^{n}I(Y_{i}\geq t)\{\mathbf{X}_{i}-\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}\mathbf{B}(\mathbf{Z}_{i})\}(\mathbf{X}^{\otimes k}_{i})^{\prime}\exp(\bm{\theta}^{\prime}\mathbf{V}_{i}),
and
𝚿\displaystyle\mathbf{\Psi} =1n​∑i=1n∫0τ[SW(1)​(t,𝐖^F,𝜽^F)S(0)​(t,𝜽^F)−SX(1)​(t,𝜽^F)​SW(0)​(t,𝐖^F,𝜽^F)′{S(0)​(t,𝜽^F)}2]​d​Ni​(t),\displaystyle=\frac{1}{n}\sum_{i=1}^{n}\int_{0}^{\tau}\left[\frac{S_{W}^{(1)}(t,\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}-\frac{S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})S_{W}^{(0)}(t,\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})^{\prime}}{\{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\}^{2}}\right]dN_{i}(t),

where 𝐕i=(𝐗i′,𝐁​(𝐙i)′)′\mathbf{V}_{i}=(\mathbf{X}_{i}^{\prime},\mathbf{B}(\mathbf{Z}_{i})^{\prime})^{\prime}, i=1,…,ni=1,\ldots,n and kk = 0, 1. The following conditions are required for establishing the asymptotic properties of 𝜷~\tilde{\bm{\beta}}.

  • (C1)

    ∫0τλ0​(t)​𝑑t<∞\int_{0}^{\tau}\lambda_{0}(t)dt<\infty, and P⁡(T≥τ)>0P(T\geq\tau)>0.

  • (C2)

    The covariate vector 𝐗\mathbf{X} is bounded.

  • (C3)

    The limit of 𝚿\mathbf{\Psi} is nonsingular.

  • (C4)

    max1≤i≤n⁡(n​πi)−1=OP​(1)\max_{1\leq i\leq n}(n\pi_{i})^{-1}=O_{P}(1), r0=o⁡(n)r_{0}=o(n) and r=o⁡(n)r=o(n).

Condition (C1) is a regularity assumption in survival analysis. Condition (C2) is a boundedness constraint on 𝐗\mathbf{X}, which is a conventional requirement in the literature 3. This assumption maintains practical relevance for biomedical survival data, where typical covariates, such as treatment indicators, blood pressure measurements, age, and gender, are naturally bounded. Condition (C3) is imposed to guarantee the invertibility of the matrix 𝚿\mathbf{\Psi}. Condition (C4) specifies that the minimal subsampling probability scales at order 1/n, which is consistent with Assumption 5 in Wang et al. (12). Moreover, r0=o⁡(n)r_{0}=o(n) and r=o⁡(n)r=o(n) ensure that the subsample sizes are much smaller than the full data size, a natural requirement to alleviate the computational burden. Theorem 1 below develops the asymptotic normality of 𝜷~\tilde{\bm{\beta}}.

Theorem 1

Under conditions (C1)-(C4), conditional on 𝒟n\mathcal{D}_{n} in probability, we have

𝚺−1/2(𝜷~−𝜷^F)⟶d𝒩(𝟎,𝐈),\displaystyle\bm{\Sigma}^{-1/2}(\tilde{\bm{\beta}}-\hat{\bm{\beta}}_{\mbox{\tiny\rm F}})\stackrel{{\scriptstyle d}}{{\longrightarrow}}\mathcal{N}(\mathbf{0},\mathbf{I}),

where ⟶d\stackrel{{\scriptstyle d}}{{\longrightarrow}} denotes convergence in distribution, and 𝚺=𝚿−1​𝚪​𝚿−1\bm{\Sigma}=\mathbf{\Psi}^{-1}\mathbf{\Gamma}\mathbf{\Psi}^{-1} with

𝚪\displaystyle\mathbf{\Gamma} =1n2​∑i=1n1r​πi​[∫0τ{𝐗i−SX(1)​(t,𝜽^F)S(0)​(t,𝜽^F)−𝐖^F​[𝐁⁡(𝐙i)−SZ(1)​(t,𝜽^F)S(0)​(t,𝜽^F)]}​d​Mi​(t,𝜽^F)]⊗2,\displaystyle=\frac{1}{n^{2}}\sum_{i=1}^{n}\frac{1}{r\pi_{i}}\left[\int_{0}^{\tau}\left\{\mathbf{X}_{i}-\frac{S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}-\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}\left[\mathbf{B}(\mathbf{Z}_{i})-\frac{S_{Z}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}\right]\right\}dM_{i}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\right]^{\otimes 2},

and Mi​(t,𝛉)=Ni​(t)−∫0tI⁡(Yi≥u)​exp⁡(𝛉′​𝐕i)​λ0​(u)​𝑑uM_{i}(t,\bm{\theta})=N_{i}(t)-\int_{0}^{t}I(Y_{i}\geq u)\exp(\bm{\theta}^{\prime}\mathbf{V}_{i})\lambda_{0}(u)du, i=1,…,ni=1,\ldots,n.

Next, we aim to find the optimal probabilities that minimize the covariance matrix in Theorem 1. Because 𝚿−1​𝚪1​𝚿−1⪯𝚿−1​𝚪2​𝚿−1\bm{\Psi}^{-1}\bm{\Gamma}_{1}\bm{\Psi}^{-1}\preceq\bm{\Psi}^{-1}\bm{\Gamma}_{2}\bm{\Psi}^{-1} is equivalent to 𝚪1⪯𝚪2\bm{\Gamma}_{1}\preceq\bm{\Gamma}_{2} in the Loewner ordering, this objective reduces to minimizing 𝚪\bm{\Gamma}. However, since two positive definite matrices are not necessarily comparable, we instead minimize tr⁡(𝚪)\operatorname{tr}(\mathbf{\Gamma}), a criterion justified by the fact that 𝚪1⪯𝚪2\mathbf{\Gamma}_{1}\preceq\mathbf{\Gamma}_{2} implies tr⁡(𝚪1)≤tr⁡(𝚪2)\operatorname{tr}(\mathbf{\Gamma}_{1})\leq\operatorname{tr}(\mathbf{\Gamma}_{2}). This strategy is known as the L-optimality criterion, which has been widely adopted in the field of subsampling 10. We denote these optimal probabilities as {πiLopt}i=1n\{\pi_{i}^{\text{Lopt}}\}_{i=1}^{n}, and their closed-form expressions are presented in Theorem 2.

Theorem 2

Suppose that conditions (C1)-(C4) are satisfied. If the subsampling probabilities are chosen as

πiLopt=‖𝚪i​(𝐖^F,𝜽^F)‖∧H∑j=1n{‖𝚪j​(𝐖^F,𝜽^F)‖∧H},i=1,…,n,\displaystyle\pi_{i}^{\rm Lopt}=\frac{\|\bm{\Gamma}_{i}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\|\wedge H}{\sum_{j=1}^{n}\{\|\bm{\Gamma}_{j}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\|\wedge H\}},~\ \textrm{$i=1,\ldots,n$}, (2)

then t​r​(𝚪)tr(\mathbf{\Gamma}) attains its minimum, where a∧b=min⁡(a,b)a\wedge b=\min(a,b),

𝚪i​(𝐖^F,𝜽^F)\displaystyle\bm{\Gamma}_{i}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}) =\displaystyle= ‖∫0τ{𝐗i−SX(1)​(t,𝜽^F)S(0)​(t,𝜽^F)−𝐖^F​[𝐁⁡(𝐙i)−SZ(1)​(t,𝜽^F)S(0)​(t,𝜽^F)]}​d​Mi​(t,𝜽^F)‖,\displaystyle\|\int_{0}^{\tau}\left\{\mathbf{X}_{i}-\frac{S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}-\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}\left[\mathbf{B}(\mathbf{Z}_{i})-\frac{S_{Z}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}\right]\right\}dM_{i}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\|,
H\displaystyle H =\displaystyle= ∑i=1n−s𝚪(i)​(𝐖^F,𝜽^F)r−s,\displaystyle\frac{\sum_{i=1}^{n-s}\bm{\Gamma}_{(i)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{r-s},

𝚪(1)​(𝐖^F,𝜽^F)≤…≤𝚪(n)​(𝐖^F,𝜽^F)\bm{\Gamma}_{(1)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\leq\ldots\leq\bm{\Gamma}_{(n)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}) are the order statistics of 𝚪1​(𝐖^F,𝛉^F)\bm{\Gamma}_{1}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), …\ldots, 𝚪n​(𝐖^F,𝛉^F)\bm{\Gamma}_{n}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), and ss is an integer such that

𝚪(n−s)​(𝐖^F,𝜽^F)∑i=1n−s𝚪(i)​(𝐖^F,𝜽^F)<1r−s,\displaystyle\frac{\bm{\Gamma}_{(n-s)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{\sum_{i=1}^{n-s}\bm{\Gamma}_{(i)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}<\frac{1}{r-s},

and

𝚪(n−s+1)​(𝐖^F,𝜽^F)∑i=1n−s+1𝚪(i)​(𝐖^F,𝜽^F)<1r−s+1,\displaystyle\frac{\bm{\Gamma}_{(n-s+1)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{\sum_{i=1}^{n-s+1}\bm{\Gamma}_{(i)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}<\frac{1}{r-s+1},

with 𝚪(n+1)​(𝐖^F,𝛉^F)=∞\bm{\Gamma}_{(n+1)}(\hat{\mathbf{W}}_{\mbox{\tiny\rm F}},\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})=\infty.

Remark 1

As shown by Wang et al. (12), we can practically use H=∞H=\infty, and the performance of the estimator with H=∞H=\infty is comparable to that obtained with the optimal sampling probabilities. This strategy has also been adopted in other Poisson subsampling-based methods (Wang et al. 12; 16 16; Yao et al. 15) and can improve computational efficiency.

3 Two-Step Subsampling Algorithm

As shown in Section 2, the L-optimal subsampling probabilities depend on several unobservable quantities: the full data estimator 𝜽^F\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}, the projection matrix 𝐖^F\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}, Λ0​(t)=∫0tλ0​(s)​𝑑s\Lambda_{0}(t)=\int_{0}^{t}\lambda_{0}(s)ds, SX(1)​(t,𝜽^F)S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), SZ(1)​(t,𝜽^F)S_{Z}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), and S(0)​(t,𝜽^F)S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}). To overcome the unavailability of these quantities in advance, we propose the following two-step subsampling algorithm.

Step 1: Pilot Subsampling and Hybrid Probability Calculation. A pilot subsample 𝒟r0∗\mathcal{D}_{r_{0}^{*}} of expected size r0≪nr_{0}\ll n is drawn from 𝒟n\mathcal{D}_{n} via uniform Poisson subsampling. Based on this pilot subsample, we compute pilot estimators 𝜽~0=(𝜷0~,𝜶~0)\tilde{\bm{\theta}}_{0}=(\tilde{\bm{\beta}_{0}},\tilde{\bm{\alpha}}_{0}) and 𝐖~0\tilde{\mathbf{W}}_{0}. We estimate the cumulative baseline hazard Λ0​(t)\Lambda_{0}(t) by the following Breslow estimator computed on the pilot subsample,

Λ^0UNIF​(t,𝜽~0)=∑i=1r0∗∫0tdNi0∗(u)∑j=1r0∗I(Yj0∗≥u)exp(𝜽~0′𝐕j0∗),\hat{\Lambda}_{0}^{\text{UNIF}}(t,\tilde{\bm{\theta}}_{0})=\sum_{i=1}^{r_{0}^{*}}\int_{0}^{t}\frac{dN_{i}^{0*}(u)}{\sum_{j=1}^{r_{0}^{*}}I(Y_{j}^{0*}\geq u)\exp(\tilde{\bm{\theta}}_{0}^{\prime}\mathbf{V}_{j}^{0*})},

where 𝐕i0∗=(𝐗i0∗′,𝐁(𝐙i0∗)′)′\mathbf{V}_{i}^{0*}=(\mathbf{X}_{i}^{0*\prime},\mathbf{B}(\mathbf{Z}_{i}^{0*})^{\prime})^{\prime}, i=1,…,ni=1,\ldots,n. In addition, we replace SX(1)​(t,𝜽^F)S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), SZ(1)​(t,𝜽^F)S_{Z}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}), and S(0)​(t,𝜽^F)S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}}) with their pilot subsample counterparts:

SX0∗(1)​(t,𝜽~0)\displaystyle S_{X}^{0*(1)}(t,\tilde{\bm{\theta}}_{0}) =1r0∗∑i=1r0∗I(Yi0∗≥t)𝐗i0∗exp(𝜽~0′𝐕i0∗),\displaystyle=\frac{1}{r_{0}^{*}}\sum_{i=1}^{r_{0}^{*}}I(Y_{i}^{0*}\geq t)\mathbf{X}_{i}^{0*}\exp(\tilde{\bm{\theta}}_{0}^{\prime}\mathbf{V}_{i}^{0*}),
SZ0∗(1)​(t,𝜽~0)\displaystyle S_{Z}^{0*(1)}(t,\tilde{\bm{\theta}}_{0}) =1r0∗∑i=1r0∗I(Yi0∗≥t)𝐁(𝐙i0∗)exp(𝜽~0′𝐕i0∗),\displaystyle=\frac{1}{r_{0}^{*}}\sum_{i=1}^{r_{0}^{*}}I(Y_{i}^{0*}\geq t)\mathbf{B}(\mathbf{Z}_{i}^{0*})\exp(\tilde{\bm{\theta}}_{0}^{\prime}\mathbf{V}_{i}^{0*}),
and
S0∗(0)​(t,𝜽~0)\displaystyle S^{0*(0)}(t,\tilde{\bm{\theta}}_{0}) =1r0∗∑i=1r0∗I(Yi0∗≥t)exp(𝜽~0′𝐕i0∗),\displaystyle=\frac{1}{r_{0}^{*}}\sum_{i=1}^{r_{0}^{*}}I(Y_{i}^{0*}\geq t)\exp(\tilde{\bm{\theta}}_{0}^{\prime}\mathbf{V}_{i}^{0*}),

which are computed by using the pilot subsample. Apply these substitutions to (2), yielding the implementable optimal subsampling probabilities,

πiapp=‖𝚪i​(𝐖~0,𝜽~0)‖∑j=1n‖𝚪j​(𝐖~0,𝜽~0)‖,i=1,…,n,\displaystyle\pi_{i}^{\text{app}}=\frac{\|\bm{\Gamma}_{i}(\tilde{\mathbf{W}}_{0},\tilde{\bm{\theta}}_{0})\|}{\sum_{j=1}^{n}\|\bm{\Gamma}_{j}(\tilde{\mathbf{W}}_{0},\tilde{\bm{\theta}}_{0})\|},~\ \textrm{$i=1,\ldots,n$},

where

𝚪i​(𝐖~0,𝜽~0)\displaystyle\bm{\Gamma}_{i}(\tilde{\mathbf{W}}_{0},\tilde{\bm{\theta}}_{0}) =\displaystyle= ∫0τ{𝐗i−SX0∗(1)​(t,𝜽~0)S0∗(0)​(t,𝜽~0)−𝐖~0[𝐁(𝐙i0∗)−SZ0∗(1)​(t,𝜽~0)S0∗(0)​(t,𝜽~0)]}dM^i(t,𝜽~0),\displaystyle\int_{0}^{\tau}\left\{\mathbf{X}_{i}-\frac{S_{X}^{0*(1)}(t,\tilde{\bm{\theta}}_{0})}{S^{0*(0)}(t,\tilde{\bm{\theta}}_{0})}-\tilde{\mathbf{W}}_{0}\left[\mathbf{B}(\mathbf{Z}_{i}^{0*})-\frac{S_{Z}^{0*(1)}(t,\tilde{\bm{\theta}}_{0})}{S^{0*(0)}(t,\tilde{\bm{\theta}}_{0})}\right]\right\}d\hat{M}_{i}(t,\tilde{\bm{\theta}}_{0}),

with M^i​(t,𝜽~0)=Ni​(t)−∫0tI⁡(Yi≥u)​exp⁡(𝜽~0′​𝐕i)​d​Λ^0UNIF​(u,𝜽~0)\hat{M}_{i}(t,\tilde{\bm{\theta}}_{0})=N_{i}(t)-\int_{0}^{t}I(Y_{i}\geq u)\exp(\tilde{\bm{\theta}}_{0}^{\prime}\mathbf{V}_{i})d\hat{\Lambda}_{0}^{\mbox{\tiny\rm UNIF}}(u,\tilde{\bm{\theta}}_{0}), i=1,…,ni=1,\ldots,n.

To address numerical instability caused by near-zero πiapp\pi_{i}^{\text{app}}, we introduce a hybrid subsampling scheme: πδ​iapp=(1−δ)​πiapp+δ/n\pi_{\delta i}^{\text{app}}=(1-\delta)\pi_{i}^{\text{app}}+{\delta}/{n}, where δ∈(0,1)\delta\in(0,1) (e.g., δ=0.1\delta=0.1) controls the proportion of mixture. This scheme balances optimality and stability, where the term (1−δ)​πiapp(1-\delta)\pi_{i}^{\text{app}} retains the optimal subsampling feature (selecting informative observations) and δ/n{\delta}/{n} guarantees a non-zero subsampling probability for all observations.

Step 2: Final Subsampling and Estimator Computation. We generate independent uniform random variables ui∼U⁡(0,1)u_{i}\sim U(0,1) for each observation ii in 𝒟n\mathcal{D}_{n}, and include observation ii in the final subsample 𝒟r∗\mathcal{D}_{r^{*}} if ui≤r​πδ​iappu_{i}\leq r\pi_{\delta i}^{\text{app}}, where rr is the expected final subsample size. The two-step Poisson subsampling estimator 𝜷^\hat{\bm{\beta}} is then computed by solving the decorrelated score equation

Uδ∗​(𝜷,𝜶~0,𝐖~0)=∂ℓδ∗​(𝜷,𝜶~0)∂𝜷−𝐖~0​∂ℓδ∗​(𝜷,𝜶~0)∂𝜶=0,\displaystyle U_{\delta}^{*}(\bm{\beta};\tilde{\bm{\alpha}}_{0},\tilde{\mathbf{W}}_{0})=\frac{\partial\ell_{\delta}^{*}(\bm{\beta},\tilde{\bm{\alpha}}_{0})}{\partial\bm{\beta}}-\tilde{\mathbf{W}}_{0}\frac{\partial\ell_{\delta}^{*}(\bm{\beta},\tilde{\bm{\alpha}}_{0})}{\partial\bm{\alpha}}=0,

where ℓδ∗​(𝜷,𝜶)\ell_{\delta}^{*}(\bm{\beta},\bm{\alpha}) has the same expression as ℓ∗​(𝜷,𝜶)\ell^{*}(\bm{\beta},\bm{\alpha}) except that r​πi∗r\pi_{i}^{*} is replaced with {(rπδ​iapp∗)∧1}\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}. Our proposed two-step subsampling method is summarized in the following Algorithm 1.

Algorithm 1 Poisson Subsampling Estimation

Input: The full data 𝒟n={(𝐗i,𝐙i,Δi,Yi)}i=1n\mathcal{D}_{n}=\{(\mathbf{X}_{i},\mathbf{Z}_{i},\Delta_{i},Y_{i})\}_{i=1}^{n}; the expected pilot subsample size r0r_{0}; the expected final subsample size rr; the proportion of mixture δ\delta.

Step 1: Pilot Subsampling and Hybrid Probability Calculation

  1. 1.

    Draw a uniform pilot subsample: 𝒟r0∗={(𝐗i0∗,𝐙i0∗,Δi0∗,Yi0∗,πi0∗)}i=1r0∗\mathcal{D}_{r_{0}^{*}}=\left\{(\mathbf{X}_{i}^{0*},\mathbf{Z}_{i}^{0*},\Delta_{i}^{0*},Y_{i}^{0*},\pi_{i}^{0*})\right\}_{i=1}^{r_{0}^{*}}, where r0∗r_{0}^{*} is the actual pilot subsample size.

  2. 2.

    Compute 𝜽~0\tilde{\bm{\theta}}_{0}, 𝐖~0\tilde{\mathbf{W}}_{0} and πiapp\pi_{i}^{\text{app}}.

  3. 3.

    Calculate hybrid subsampling probabilities:

    πδ​iapp=(1−δ)​πiapp+δn.\pi_{\delta i}^{\text{app}}=(1-\delta)\pi_{i}^{\text{app}}+\frac{\delta}{n}.

Step 2: Final Subsampling and Estimator Computation

  1. 1.

    For each i=1,…,ni=1,\dots,n:

    • •

      Generate ui∼U⁡(0,1)u_{i}\sim U(0,1);

    • •

      If ui≤r​πδ​iappu_{i}\leq r\pi_{\delta i}^{\text{app}}, we include (𝐗i,𝐙i,Δi,Yi)(\mathbf{X}_{i},\mathbf{Z}_{i},\Delta_{i},Y_{i}) in the subsample.

  2. 2.

    By solving the estimating equation Uδ∗​(𝜷,𝜶~0,𝐖~0)=0U_{\delta}^{*}(\bm{\beta};\tilde{\bm{\alpha}}_{0},\tilde{\mathbf{W}}_{0})=0, we obtain the estimator 𝜷^\hat{\bm{\beta}}.

We establish the asymptotic normality of 𝜷^\hat{\bm{\beta}} in the next Theorem 3.

Theorem 3

Assume conditions  (C1)-(C4) hold. Conditional on 𝒟n\mathcal{D}_{n} and 𝛉~0\tilde{\bm{\theta}}_{0}, the two-step Poisson subsampling estimator 𝛃^\hat{\bm{\beta}} satisfies

𝚺δ−1/2(𝜷^−𝜷^F)⟶d𝒩(0,𝐈),\displaystyle\bm{\Sigma}_{\delta}^{-1/2}(\hat{\bm{\beta}}-\hat{\bm{\beta}}_{\mbox{\tiny\rm F}})\stackrel{{\scriptstyle d}}{{\longrightarrow}}\mathcal{N}(0,\mathbf{I}),

where 𝚺δ=𝚿−1​𝚪δ​𝚿−1\bm{\Sigma}_{\delta}=\mathbf{\Psi}^{-1}\mathbf{\Gamma}_{\delta}\mathbf{\Psi}^{-1} and

𝚪δ\displaystyle\mathbf{\Gamma}_{\delta} =1n2​∑i=1n1{(r​πδ​iapp)∧1}​[∫0τ{𝐗i−SX(1)​(t,𝜽^F)S(0)​(t,𝜽^F)−𝐖^F​[𝐁⁡(𝐙i)−SZ(1)​(t,𝜽^F)S(0)​(t,𝜽^F)]}​d​Mi​(t,𝜽^F)]⊗2.\displaystyle=\frac{1}{n^{2}}\sum_{i=1}^{n}\frac{1}{\{(r\pi_{\delta i}^{\text{app}})\wedge 1\}}\left[\int_{0}^{\tau}\left\{\mathbf{X}_{i}-\frac{S_{X}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}-\hat{\mathbf{W}}_{\mbox{\tiny\rm F}}\left[\mathbf{B}(\mathbf{Z}_{i})-\frac{S_{Z}^{(1)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}{S^{(0)}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})}\right]\right\}dM_{i}(t,\hat{\bm{\theta}}_{\mbox{\tiny\rm F}})\right]^{\otimes 2}.

For the purposes of conducting statistical inference, we estimate the covariance matrix of 𝜷^\hat{\bm{\beta}} by

𝛀^=𝚿^−1​𝚪^​𝚿^−1,\displaystyle\hat{\mathbf{\Omega}}=\hat{\mathbf{\Psi}}^{-1}\hat{\mathbf{\Gamma}}\hat{\mathbf{\Psi}}^{-1},

where

𝚿^=1n​∑i=1r∗Δi∗{(rπδ​iapp∗)∧1}​[SW∗(1)​(t,𝐖~0,𝜽^)S∗(0)​(t,𝜽^)−SW∗(0)​(t,𝐖~0,𝜽^)​SX∗(1)​(t,𝜽^){S∗(0)​(t,𝜽^)}2],\displaystyle\hat{\mathbf{\Psi}}=\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{\Delta_{i}^{*}}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}}\left[\frac{S_{W}^{*(1)}(t,\tilde{\mathbf{W}}_{0},\hat{\bm{\theta}})}{S^{*(0)}(t,\hat{\bm{\theta}})}-\frac{S_{W}^{*(0)}(t,\tilde{\mathbf{W}}_{0},\hat{\bm{\theta}})S_{X}^{*(1)}(t,\hat{\bm{\theta}})}{\{S^{*(0)}(t,\hat{\bm{\theta}})\}^{2}}\right],

and

𝚪^\displaystyle\hat{\mathbf{\Gamma}} =1n2​∑i=1r∗1{(rπδ​iapp∗)∧1}2​[∫0τ{𝐗i∗−SX∗(1)​(t,𝜽^)S∗(0)​(t,𝜽^)−𝐖~0​[𝐁⁡(𝐙i∗)−SZ∗(1)​(t,𝜽^)S∗(0)​(t,𝜽^)]}​d​M^i∗​(t,𝜽^)]⊗2,\displaystyle=\frac{1}{n^{2}}\sum_{i=1}^{r^{*}}\frac{1}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}^{2}}\left[\int_{0}^{\tau}\left\{\mathbf{X}^{*}_{i}-\frac{S_{X}^{*(1)}(t,\hat{\bm{\theta}})}{S^{*(0)}(t,\hat{\bm{\theta}})}-\tilde{\mathbf{W}}_{0}\left[\mathbf{B}(\mathbf{Z}^{*}_{i})-\frac{S_{Z}^{*(1)}(t,\hat{\bm{\theta}})}{S^{*(0)}(t,\hat{\bm{\theta}})}\right]\right\}d\hat{M}^{*}_{i}(t,\hat{\bm{\theta}})\right]^{\otimes 2},

together with 𝜽^=(𝜷^′,𝜶~0′)′\hat{\bm{\theta}}=(\hat{\bm{\beta}}^{\prime},\tilde{\bm{\alpha}}_{0}^{\prime})^{\prime}, d​M^i∗​(t,𝜽)=d​Ni∗​(t)−I⁡(Yi∗≥t)​exp⁡(𝜽′​𝐕i∗)​d​Λ^0UNIF​(t,𝜽)d\hat{M}^{*}_{i}(t,\bm{\theta})=dN_{i}^{*}(t)-I(Y^{*}_{i}\geq t)\exp(\bm{\theta}^{\prime}\mathbf{V}^{*}_{i})d\hat{\Lambda}_{0}^{\mbox{\tiny\rm UNIF}}(t,\bm{\theta}),

SX∗(1)​(t,𝜽)\displaystyle S_{X}^{*(1)}(t,\bm{\theta}) =1n​∑i=1r∗1{(rπδ​iapp∗)∧1}​I​(Yi∗≥t)​𝐗i∗​exp⁡(𝜽′​𝐕i∗),\displaystyle=\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{1}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}}I(Y^{*}_{i}\geq t)\mathbf{X}^{*}_{i}\exp(\bm{\theta}^{\prime}\mathbf{V}^{*}_{i}),
SZ∗(1)​(t,𝜽)\displaystyle S_{Z}^{*(1)}(t,\bm{\theta}) =1n​∑i=1r∗1{(rπδ​iapp∗)∧1}​I​(Yi∗≥t)​𝐁​(𝐙i∗)​exp⁡(𝜽′​𝐕i∗),\displaystyle=\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{1}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}}I(Y^{*}_{i}\geq t)\mathbf{B}(\mathbf{Z}^{*}_{i})\exp(\bm{\theta}^{\prime}\mathbf{V}^{*}_{i}),
S∗(0)​(t,𝜽)\displaystyle S^{*(0)}(t,\bm{\theta}) =1n​∑i=1r∗1{(rπδ​iapp∗)∧1}​I​(Yi∗≥t)​exp⁡(𝜽′​𝐕i∗),\displaystyle=\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{1}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}}I(Y^{*}_{i}\geq t)\exp(\bm{\theta}^{\prime}\mathbf{V}^{*}_{i}),
and
SW∗(k)​(t,𝐖,𝜽)\displaystyle S_{W}^{*(k)}(t,\mathbf{W},\bm{\theta}) =1n∑i=1r∗1{(rπδ​iapp∗)∧1}I(Yi∗≥t){𝐗i∗−𝐖𝐁(𝐙i∗)}(𝐗i∗⊗k)′exp(𝜽′𝐕i∗),\displaystyle=\frac{1}{n}\sum_{i=1}^{r^{*}}\frac{1}{\{(r\pi_{\delta i}^{\text{app}*})\wedge 1\}}I(Y^{*}_{i}\geq t)\{\mathbf{X}^{*}_{i}-\mathbf{W}\mathbf{B}(\mathbf{Z}^{*}_{i})\}(\mathbf{X}^{*\otimes k}_{i})^{\prime}\exp(\bm{\theta}^{\prime}\mathbf{V}^{*}_{i}),

k=0,1k=0,1.

The proposed two-step subsampling algorithm enables data-dependent sampling probabilities and adapts to the intrinsic features of complex large-scale survival datasets. Notably, the covariance estimator 𝛀^\hat{\mathbf{\Omega}} is merely constructed from the final subsample, which effectively alleviates computational burden while providing reliable uncertainty quantification for 𝜷^\hat{\bm{\beta}} to support statistical inference.

4 Numerical Simulations

In this section, simulation studies were conducted to evaluate the estimation accuracy and computational efficiency of the proposed Poisson subsampling estimator. Let λ0​(t)=0.5​t\lambda_{0}(t)=0.5t, 𝜷0=(−1,−0.5,0,0.5,1)′\bm{\beta}_{0}=(-1,-0.5,0,0.5,1)^{\prime} and n=106n=10^{6}. We considered two distinct data-generating processes for covariate 𝐗\mathbf{X}:

  • Case I: 𝐗\mathbf{X} followed a multivariate normal distribution 𝒩⁡(𝟎,𝚼)\mathcal{N}(\mathbf{0},\bm{\Upsilon}), where Υj​s\Upsilon_{js} denotes the (j,s)(j,s) entry of 𝚼\bm{\Upsilon}, with Υj​s=1\Upsilon_{js}=1 if j=sj=s and Υj​s=0.3\Upsilon_{js}=0.3 if j≠sj\neq s.

  • Case II: 𝐗\mathbf{X} followed a mixed multivariate normal distribution 0.5​𝒩​(−𝟏,𝚼~)+0.5​𝒩​(𝟏,𝚼~)0.5\mathcal{N}(-\mathbf{1},\tilde{\bm{\Upsilon}})+0.5\mathcal{N}(\mathbf{1},\tilde{\bm{\Upsilon}}), where Υ~j​s=0.5|j−s|\tilde{\Upsilon}_{js}=0.5^{|j-s|}.

Let 𝐙=(Z1,Z2)′\mathbf{Z}=(Z_{1},Z_{2})^{\prime}, with Z1Z_{1} and Z2Z_{2} independently drawn from a uniform distribution on (0,1)(0,1). The nonparametric functions were specified as g1​(z)=sin⁡(2​π​z)g_{1}(z)=\sin(2\pi z) and g2​(z)=5​z4+3​z2−2g_{2}(z)=5z^{4}+3z^{2}-2. The interior knots were {0.2,0.3,0.5,0.6,0.8}\{0.2,0.3,0.5,0.6,0.8\}. The censoring time CC was simulated from a uniform distribution on (0,c0)(0,c_{0}), where c0c_{0} was selected to give a certain censoring rate (CR). We set CR at 20%20\% and 60%60\%, respectively. All the simulation results presented below are based on 1000 replications.

4.1 Target 1: Sensitivity to the Pilot Subsample Size r0r_{0}

We began by examining the effect of the pilot subsample size r0r_{0} under δ=0.1\delta=0.1 and ϱ=3\varrho=3. Define E​S​EjESE_{j} as the empirical standard error of estimator β^j\hat{\beta}_{j} computed over 1000 simulation repetitions, where β^j\hat{\beta}_{j} is the jjth component of 𝜷^\hat{\bm{\beta}}, j=1,⋯,pj=1,\cdots,p. The average standard error (ASE) was then given by A​S​E=∑j=1pE​S​Ej/pASE=\sum_{j=1}^{p}ESE_{j}/p. Table 1 displays ASE for the subsampling estimator across pilot subsample sizes r0∈{500,600,700}r_{0}\in\{500,600,700\} and final subsample sizes r∈{600,800,1000}r\in\{600,800,1000\}. From Table 1, the ASE shows minimal fluctuations as r0r_{0} increases from 500 to 700. For example, in Case I with CR=20% and the final subsample size r=1000r=1000, the ASE is 0.05380.0538 when r0=500r_{0}=500, and decreases only slightly to 0.05350.0535 for r0=600r_{0}=600 and r0=700r_{0}=700, corresponding to a maximum reduction of just 0.56%0.56\%. This indicates that r0=500r_{0}=500 is sufficient to generate stable pilot estimators, as further increasing r0r_{0} does not meaningfully improve the precision of 𝜷^\hat{\bm{\beta}}. In addition, as expected, the ASE consistently decreases with the increase of the subsample size rr, while the higher censoring rate (CR=60%) generally leads to a larger ASE compared to the lower censoring rate (CR=20%).

Table 1: The ASE of the subsampling estimator with different pilot subsample size r0r_{0}.
CR=20%20\% CR=60%60\%
r0r_{0} r=600r=600 r=800r=800 r=1000r=1000 r=600r=600 r=800r=800 r=1000r=1000
Case I 500 0.0733 0.0616 0.0538 0.0883 0.0748 0.0658
600 0.0720 0.0607 0.0535 0.0865 0.0740 0.0651
700 0.0714 0.0603 0.0535 0.0858 0.0729 0.0646
Case II 500 0.0725 0.0619 0.0543 0.1117 0.0815 0.0696
600 0.0715 0.0611 0.0538 0.0871 0.0730 0.0645
700 0.0708 0.0603 0.0528 0.0858 0.0721 0.0633

4.2 Target 2: Sensitivity to the Mixing Parameter δ\delta

We analyzed how ASE values vary with δ\delta under r0=500r_{0}=500 and ϱ=3\varrho=3. The approximate sampling distribution 𝝅δapp\bm{\pi}_{\delta}^{\mathrm{app}} exhibits two boundary behaviors: it converges to the optimal subsampling distribution as δ\delta approaches 0, and approaches the uniform subsampling distribution when δ\delta approaches 1. Table  2 shows that δ=0.1\delta=0.1 achieves the lowest ASE across all scenarios, striking the optimal balance between optimality and stability. For example, in Case I with a 20% censoring rate and r=1000r=1000, its ASE of 0.0538 is about 1.5% lower than that of δ=0\delta=0 and 1.3% lower than that of δ=0.3\delta=0.3. Thus, δ=0.1\delta=0.1 eliminates the numerical instability caused by near zero probabilities without sacrificing efficiency. As δ\delta increases to 0.3 or 0.5, the ASE generally rises, reflecting a loss of optimality as the sampling distribution becomes too uniform. The advantage of δ=0.1\delta=0.1 is greater under challenging conditions such as a high censoring rate of 60% or asymmetric covariates as in Case II, where stability is critical. We therefore recommend δ=0.1\delta=0.1 for practical implementation of our method.

Table 2: The ASE of the subsampling estimator with different mixing rate δ\delta.
CR=20%20\% CR=60%60\%
rr δ=0\delta=0 δ=0.1\delta=0.1 δ=0.3\delta=0.3 δ=0.5\delta=0.5 δ=0\delta=0 δ=0.1\delta=0.1 δ=0.3\delta=0.3 δ=0.5\delta=0.5
Case I 600 0.0740 0.0713 0.0718 0.0723 0.0907 0.0883 0.0887 0.0939
800 0.0629 0.0616 0.0609 0.0624 0.0768 0.0748 0.0758 0.0787
1000 0.0546 0.0538 0.0545 0.0556 0.0682 0.0658 0.0669 0.0698
Case II 600 0.0729 0.0725 0.0722 0.0734 0.1139 0.1017 0.1002 0.1066
800 0.0620 0.0619 0.0609 0.0621 0.0996 0.0815 0.0811 0.0845
1000 0.0550 0.0543 0.0547 0.0549 0.0861 0.0696 0.0727 0.0755

4.3 Target 3: Sensitivity to the Spline Degree ϱ\varrho

Following the preceding investigation, we assessed the sensitivity of the proposed estimator to the spline degree ϱ\varrho under δ=0.1\delta=0.1 and r0=500r_{0}=500. The spline degree controls the flexibility of the B-spline basis used to approximate the nonparametric component g⁡(Z)g(Z). A lower degree, such as ϱ=3\varrho=3 for a cubic spline, is computationally efficient but may underfit complex nonparametric relationships. A higher degree, such as ϱ=5\varrho=5 for a quintic spline, can capture more intricate patterns but risks overfitting and higher computational cost. Table  3 shows that the ASE values for ϱ\varrho=3,4 and 5 are nearly identical, with maximum differences of less than 5%, showing that the spline degree has minimal impact on the estimation accuracy of 𝜷^\hat{\bm{\beta}}. For example, in Case I with a 20% censoring rate and r=1000, the ASE value for ϱ\varrho =3 is 0.0538, which is only 3.4% lower than the value of 0.0558 for ϱ\varrho =5. Given the minimal differences in ASE across ϱ\varrho values, the robustness of the estimator to the spline degree, and the computational efficiency of lower degrees, ϱ\varrho=3 is the optimal choice.

Table 3: The ASE of the subsampling estimator with different spline degree ϱ\varrho.
CR=20%20\% CR=60%60\%
rr ϱ=3\varrho=3 ϱ=4\varrho=4 ϱ=5\varrho=5 ϱ=3\varrho=3 ϱ=4\varrho=4 ϱ=5\varrho=5
Case I 600 0.0733 0.0741 0.0753 0.0883 0.0915 0.1252
800 0.0616 0.0625 0.0631 0.0748 0.0777 0.0952
1000 0.0538 0.0556 0.0558 0.0658 0.0687 0.0833
Case II 600 0.0725 0.0736 0.0738 0.0892 0.0913 0.0996
800 0.0619 0.0620 0.0627 0.0815 0.0786 0.0877
1000 0.0543 0.0548 0.0553 0.0696 0.0735 0.0838

4.4 Target 4: Performance Comparison of Subsampling Methods

To assess the performance advantage of our L-optimality criterion-based subsampling approach (Lopt), we compared it with uniform subsampling (UNIF) and the method of 22 (denoted as “Oracle”). We set r0=500r_{0}=500, δ=0.1\delta=0.1 and ϱ=3\varrho=3. Under the UNIF scheme, each observation receives equal subsampling probability πi=1/n\pi_{i}=1/n for i=1,…,ni=1,\dots,n. The Oracle method assumes prior knowledge of the nonparametric functions g1​(z)g_{1}(z) and g2​(z)g_{2}(z). Performance evaluation employs four metrics: estimated bias (BIAS) computed as the sample mean of the estimates minus the full data estimator, empirical standard error (SE), mean estimated standard error (ESE), and empirical 95% coverage probability (CP) based on normal approximation.

Table 4: Simulation results on 𝜷^1\hat{\bm{\beta}}_{1} with Case I and CR=20%20\%.
Subsample Size Methods BIAS SE ESE CP
r=600r=600 Lopt -0.0008 0.0755 0.0778 0.958
UNIF -0.0250 0.0858 0.0960 0.964
Oracle -0.0010 0.0765 0.0737 0.952
r=800r=800 Lopt -0.0045 0.0619 0.0662 0.962
UNIF -0.0167 0.0719 0.0827 0.974
Oracle 0.0024 0.0653 0.0629 0.942
r=1000r=1000 Lopt -0.0030 0.0549 0.0587 0.978
UNIF -0.0177 0.0638 0.0740 0.966
Oracle 0.0001 0.0559 0.0558 0.940
Table 5: Simulation results on 𝜷^1\hat{\bm{\beta}}_{1} with Case I and CR=60%60\%.
Subsample Size Methods BIAS SE ESE CP
r=600r=600 Lopt 0.0054 0.0910 0.0938 0.958
UNIF -0.0329 0.1323 0.1429 0.958
Oracle 0.0096 0.0911 0.0904 0.944
r=800r=800 Lopt 0.0025 0.0773 0.0800 0.946
UNIF -0.0023 0.1134 0.1225 0.960
Oracle 0.0094 0.0785 0.0770 0.954
r=1000r=1000 Lopt 0.0038 0.0696 0.0710 0.950
UNIF -0.0228 0.0997 0.1093 0.952
Oracle 0.0075 0.0685 0.0684 0.938

Tables 4-7 show that all three methods produce near-zero BIAS values, implying the unbiasedness of the subsampling estimator for 𝜷1{\bm{\beta}}_{1}. The results for the other components of 𝜷{\bm{\beta}} are similar and omitted. For Lopt, the ESE closely matches the corresponding SE, demonstrating that the proposed covariance estimator 𝛀^\hat{\mathbf{\Omega}} is reliable. For instance, at r=1000r=1000, SE = 0.0549 and ESE = 0.0587, a relative difference of only 6.9%. In contrast, UNIF shows a larger discrepancy, as seen at r=1000r=1000 where SE = 0.0638 and ESE = 0.0740, a relative difference of 16.0%. This is because uniform sampling ignores the information of observations, leading to less accurate standard error estimation. This advantage of Lopt grows with the subsample size rr, as more high-information observations are retained.

Table 6: Simulation results on 𝜷^1\hat{\bm{\beta}}_{1} with Case II and CR=20%20\%.
Subsample Size Methods BIAS SE ESE CP
r=600r=600 Lopt -0.0117 0.0727 0.0745 0.960
UNIF -0.0257 0.0865 0.0924 0.956
Oracle -0.0034 0.0740 0.0722 0.948
r=800r=800 Lopt -0.0090 0.0631 0.0634 0.944
UNIF -0.0188 0.0761 0.0794 0.956
Oracle -0.0001 0.0634 0.0617 0.942
r=1000r=1000 Lopt -0.0005 0.0565 0.0563 0.946
UNIF -0.0159 0.0672 0.0709 0.950
Oracle -0.0008 0.0530 0.0548 0.954
Table 7: Simulation results on 𝜷^1\hat{\bm{\beta}}_{1} with Case II and CR=60%60\%†.
Subsample Size Methods BIAS SE ESE CP
r=600r=600 Lopt -0.0066 0.0932 0.0915 0.958
UNIF -0.0337 0.1287 0.1384 0.962
Oracle 0.0088 0.0891 0.0891 0.958
r=800r=800 Lopt -0.0026 0.0791 0.0766 0.950
UNIF -0.0241 0.1103 0.1181 0.960
Oracle 0.0108 0.0738 0.0760 0.958
r=1000r=1000 Lopt -0.0027 0.0693 0.0678 0.958
UNIF -0.0165 0.0998 0.1053 0.962
Oracle 0.0098 0.0659 0.0674 0.960

Figure 1 visualizes the ASE comparisons across all scenarios, further validating the superiority of Lopt. In all four subfigures, the ASE of Lopt is substantially lower than that of UNIF, and nearly identical to that of Oracle, especially when rr is large. For example, in Case I with CR=20%, the ASE of Lopt at r=1000r=1000 is almost indistinguishable from Oracle, while UNIF’s ASE is significantly higher. This demonstrates that Lopt achieves near-optimal estimation accuracy without requiring prior knowledge of nonparametric functions.

Refer to caption
(a) Case I with CR=20%20\%.
Refer to caption
(b) Case I with CR=60%60\%.
Refer to caption
(c) Case II with CR=20%20\%.
Refer to caption
(d) Case II with CR=60%60\%.
Figure 1: The ASEs for different subsampling methods.

4.5 Target 5: Computational Efficiency Evaluation

We conducted additional simulations to evaluate the computational efficiency of our proposed method. Data generation followed the Case I specification with covariates 𝐗\mathbf{X} constructed as previously described, except that the regression coefficient vector was 𝜷=(0.5,…,0.5)′\bm{\beta}=(0.5,\ldots,0.5)^{\prime} with dimensions p=5p=5 and p=50p=50. We set r0=500r_{0}=500, r=1000r=1000, δ=0.1\delta=0.1 and ϱ=3\varrho=3. All computations were performed in R on a laptop with 32GB RAM. We report in Table 8 the CPU times (in seconds) for computing 𝜷^\hat{\bm{\beta}}, averaged over 100 repetitions (excluding data generation time). From Table 8 we see that both Lopt and UNIF achieve substantial computational savings compared to full data analysis. For example, when p=5p=5 and n=107n=10^{7}, the CPU time of Lopt is 7.459 seconds, which is only 4.2% of that of full data analysis at 178.67 seconds. This implies that subsampling effectively reduces the computational burden by focusing on a small subset of informative observations, rather than processing the entire large dataset. UNIF is slightly faster than Lopt in all scenarios, which is attributed to the fact that UNIF does not require calculating optimal subsampling probabilities or allocation sizes. While UNIF offers faster computation, it suffers from a larger SE. In contrast, Lopt balances computational efficiency and statistical performance. The computational difference between subsampling methods and full data analysis widens with increasing pp. This is because full data analysis requires processing all nn observations with pp covariates, leading to an increase in computational cost as pp grows, while subsampling methods only process a small subset of all observations, making the impact of pp on CPU time much smaller.

Table 8: The CPU times of subsampling methods.
Method n=106n=10^{6} n=5×106n=5\times 10^{6} 10710^{7}
pp=5 Lopt 1.538 4.363 7.459
UNIF 0.982 1.259 1.494
Full data 15.25 79.73 178.67
pp=50 Lopt 12.906 28.844 44.644
UNIF 9.197 10.922 37.068
Full data 58.95 292.14 628.01

5 A Real Data Example

We illustrated the practical performance of the proposed two-step Poisson subsampling method by using a large-scale lymphoma cancer dataset from the Surveillance, Epidemiology, and End Results (SEER) program. The SEER is a authoritative and widely used source for population-level cancer survival research in the United States. The dataset included complete records of N=111,283N=111,283 lymphoma patients diagnosed between 1975 and 2007. In this survival analysis, the follow-up time was censored at 60 months (5 years) after diagnosis. Within the cohort, 46,067 individuals experienced the event of interest, leading to an empirical censoring rate of 58.6%58.6\%, which was consistent with the moderate-to-high censoring settings considered in our simulation studies. The parametric covariate XX was biological sex (coded as 11 for male and 00 for female), and the nonparametric nuisance covariate ZZ was age at diagnosis (centered and standardized). The full data estimator using all observations was β^=0.1956\hat{\beta}=0.1956, which served as the gold-standard benchmark for evaluating the subsampling estimator.

We set r0=500r_{0}=500, δ=0.1\delta=0.1, ϱ=3\varrho=3 and used interior knots at {0.2,0.3,0.5,0.6,0.8}\{0.2,0.3,0.5,0.6,0.8\}. We generated 10001000 independent subsamples at four incremental sizes: r=600,800,1000,1200r=600,800,1000,1200. For each subsample size, we obtained both Lopt and UNIF estimators, and reported the point estimate, SE, ESE based on 1000 replications. The results were summarized in Table 9.

Table 9: The results in the lymphoma cancer data.
Method Estimate SE ESE
r=600r=600 Lopt 0.18310 0.11297 0.10990
UNIF 0.18983 0.12164 0.13277
r=800r=800 Lopt 0.18353 0.09584 0.09434
UNIF 0.18848 0.10632 0.11429
r=1000r=1000 Lopt 0.18548 0.08281 0.08395
UNIF 0.18905 0.09645 0.10204
r=1200r=1200 Lopt 0.18684 0.07391 0.07648
UNIF 0.19012 0.08991 0.09302

Both Lopt and UNIF produce point estimates close to the full data estimator β^=0.1956\hat{\beta}=0.1956, confirming that subsampling-based inference is reliable for large-scale survival data. Notably, the Lopt estimates are systematically closer to the full data estimator than UNIF across all subsample sizes. As rr increases from 600 to 1200, the Lopt estimates improve steadily from 0.183100.18310 to 0.186840.18684, gradually converging toward 0.19560.1956. In contrast, the UNIF estimates remain relatively unstable and deviate more noticeably from the benchmark. The Lopt method achieves consistently smaller SE than UNIF at every subsample size. For instance, at r=1000r=1000, SE of Lopt is 0.082810.08281, which is 14.1%14.1\% lower than SE of UNIF (0.096450.09645). At r=1200r=1200, the efficiency gain increases to 17.8%17.8\%. This indicates that the L-optimal subsampling strategy effectively prioritizes informative observations, leading to more precise estimation than uniform sampling.

Moreover, ESE closely matches the SE for Lopt across all subsample sizes, with relative differences below 4%4\%. In contrast, ESE of UNIF noticeably overstates uncertainty and deviates from SE, especially at small subsample sizes. This validates that the proposed covariance estimator is reliable for practical applications. Moreover, as the subsample size rr increases, both methods improve in precision, with SE and ESE decreasing monotonically. The Lopt method maintains its efficiency advantage across all levels of rr, demonstrating its stability and practical usefulness even with relatively small subsamples.

6 Concluding Remarks

In this article, we proposed an efficient Poisson subsampling method for the PLA-Cox model to address the computational and storage challenges of large-scale survival data analysis. The proposed method uses B-spline basis functions to approximate the additive nonparametric components and adopts the decorrelated score technique to construct a subsampling-based estimation equation. We established the asymptotic distribution of the resulting estimator and derived optimal subsampling probabilities under the L-optimality criterion. A two-step adaptive algorithm was developed for practical implementation. Extensive simulation studies and a real-world application to a lymphoma cancer dataset were conducted to validate the performance of the proposed method.

This research has several limitations that provide directions for future work. First, the hybrid subsampling scheme introduces a tuning parameter δ\delta, whose selection is currently based on empirical experience (e.g., δ=0.1\delta=0.1). Developing a data-driven method to select δ\delta adaptively would further improve the method’s robustness. Second, our framework focuses on independent and identically distributed datasets. Extending the Poisson subsampling framework to dependent survival data (e.g., clustered survival data or longitudinal survival data) is a valuable direction for future research. Third, the current method uses B-spline approximations for the nonparametric component g⁡(𝒁)g(\bm{Z}). Exploring alternative nonparametric approximations (e.g., neural networks) may enhance the flexibility in capturing complex nonlinear relationships.

AI Use Statement During the preparation of this work, the authors use Deepseek-V2 exclusively for English language editing and readability improvement.
Disclosure Statement The authors report that there are no competing interests to declare.

SUPPLEMENTARY MATERIAL

The supplementary material contains proofs of all the theoretical results.

Acknowledgments

Dongxiao Han’s research was partly supported by the National Natural Science Foundation of China (12471259 and 12231011), and Academy for Advanced Interdisciplinary Studies of Nankai University, and Tianjin Municipal Natural Science Foundation (23JCYBJC01270). Liuquan Sun’s research was partially supported by the National Natural Science Foundation of China (12571299). Chunjie Wang’s research was partly supported by the National Natural Science Foundation of China (12271060), and the Outstanding Youth Fund Project of Jilin Provincial Natural Science Foundation (20250101011JJ). Dehui Wang’s research was partly supported by the National Natural Science Foundation of China (12271231, 1247012719).

References

  • Cox (1972) D. R. Cox Regression models and life-tables (with discussions). Journal of the Royal Statistical Society, Series B (Statistical Methodology) 34, pp. 187–220. Cited by: §1.
  • Fan et al. (2024) S. Fan, R. Xu, Q. Dong, Y. He, C. Chang, and P. Cu Stable cox regression for survival analysis under distribution shifts. Nature Machine Intelligence 6, pp. 1525–1541. Cited by: §1.
  • Huang et al. (2013) J. Huang, T. Sun, Z. Ying, Y. Yu, and C. Zhang Oracle inequalities for the lasso in the cox model. The Annals of Statistics 41, pp. 1142–1165. External Links: Document Cited by: §2.
  • Huang (1999) J. Huang Efficient estimation of the partly linear additive cox model. The Annals of Statistics 27, pp. 1536–1563. Cited by: §1.
  • Lee et al. (2025) S. Lee, K. Lee, and K. Lee Discrete-time survival analysis incorporating time structure in developmental research. Structural Equation Modeling: A Multidisciplinary Journal 32, pp. 929–940. Cited by: §1.
  • Lin and Ying (1994) D. Y. Lin and Z. Ying Semiparametric analysis of the additive risk model. Biometrika 81, pp. 61–71. Cited by: §1.
  • Liu et al. (2023) H. Liu, J. You, and J. Cao Functional L-optimality subsampling for functional generalized linear models with massive data. Journal of Machine Learning Research 24, pp. 1–41. Cited by: §1.
  • Shao et al. (2025a) Y. Shao, Z. Hou, L. Wang, and H. Lian Optimal decorrelated score subsampling for Cox regression with massive survival data. Neurocomputing 638, pp. 1–8. Cited by: §1.
  • Shao et al. (2025b) Y. Shao, L. Wang, H. Lian, and H. Wang Optimal subsampling for high-dimensional partially linear models via machine learning methods. Journal of Machine Learning Research 26, pp. 1–70. Cited by: §1.
  • Wang and Ma (2021) H. Wang and Y. Ma Optimal subsampling for quantile regression in big data. Biometrika 108, pp. 99–112. Cited by: §1, §2.
  • Wang et al. (2018) H. Wang, R. Zhu, and P. Ma Optimal subsampling for large sample logistic regression. Journal of the American Statistical Association 113, pp. 829–844. Cited by: §1.
  • Wang et al. (2022) J. Wang, J. Zou, and H. Wang Sampling with replacement vs poisson sampling: a comparative study in optimal subsampling. IEEE Transactions on Information Theory 68, pp. 6605–6630. Cited by: §2, Remark 1.
  • Wijethilake et al. (2021) N. Wijethilake, D. Meedeniya, C. Chitraranjan, I. Perera, M. Islam, and H. Ren Glioma survival analysis empowered with data engineering—a survey. IEEE Access 9, pp. 43168–43191. Cited by: §1.
  • Yao and Wang (2021) Y. Yao and H. Wang A review on optimal subsampling methods for massive datasets. Journal of Data Science 19, pp. 151–172. Cited by: §1.
  • Yao et al. (2023) Y. Yao, J. Zou, and H. Wang Optimal poisson subsampling for softmax regression. Journal of Systems Science and Complexity 36, pp. 1609–1625. Cited by: §1, Remark 1.
  • Yu et al. (2022) J. Yu, H. Wang, M. Ai, and H. Zhang Optimal distributed subsampling for maximum quasi-likelihood estimators with massive data. Journal of the American Statistical Association 117, pp. 265–276. Cited by: §1, Remark 1.
  • Yu et al. (2024) J. Yu, M. Ai, and Z. Ye A review on design inspired subsampling for big data. Statistical Papers 65, pp. 467–510. Cited by: §1.
  • Yu et al. (2025) J. Yu, Z. Ye, M. Ai, and P. Ma Optimal subsampling for data streams with measurement constrained categorical responses. Journal of Computational and Graphical Statistics 34, pp. 994–1004. Cited by: §1.
  • Zhang et al. (2025) H. Zhang, Y. Li, and H. Wang DsubCox: a fast subsampling algorithm for Cox model with distributed and massive survival data. International Journal of Biostatistics 21, pp. 53–65. Cited by: §1.
  • Zhang and Wang (2021) H. Zhang and H. Wang Distributed subdata selection for big data via sampling-based approach. Computational Statistics and Data Analysis 153, pp. 107072. External Links: Document Cited by: §1.
  • Zhang and Wang (2026) H. Zhang and H. Wang Refitted cross-validation estimation for high-dimensional subsamples from low-dimension full data. Computational Statistics 41, pp. 1–15. Cited by: §1.
  • Zhang et al. (2024) H. Zhang, L. Zuo, H. Wang, and L. Sun Approximating partial likelihood estimators via optimal subsampling. Journal of Computational and Graphical Statistics 33, pp. 276–288. Cited by: §1, §4.4.
  • Zuo et al. (2021a) L. Zuo, H. Zhang, H. Wang, and L. Liu Sampling-based estimation for massive survival data with additive hazards model. Statistics in Medicine 40, pp. 441–450. Cited by: §1.
  • Zuo et al. (2021b) L. Zuo, H. Zhang, H. Wang, and L. Sun Optimal subsample selection for massive logistic regression with distributed data. Computational Statistics 36, pp. 2535–2562. Cited by: §1.