Decision tree with PSA (Jenks 2016)

Tegaderm CHG IV Securement Dressing

Andrew J. Sims

July 2020

Introduction

This vignette is an example of modelling a decision tree using the rdecision package, with probabilistic sensitivity analysis (PSA). It is based on the model reported by Jenks et al1 in which a transparent dressing used to secure vascular catheters (Tegaderm CHG) was compared with a standard dressing.

Model variables

Source variables

Eleven source variables were used in the model. The choice of variables, their distributions and their parameters are taken from Table 4 of Jenks et al1, with the following additional information:

The model variables were constructed as follows:

# baseline risk
r.CRBSI <- GammaModVar$new(
  "Baseline CRBSI rate",  "/1000 catheter days",
  shape = (1.48 ^ 2L) / (0.12 ^ 2L),
  scale = (0.12 ^ 2L) / 1.48
)
r.LSI <- GammaModVar$new(
  "Baseline LSI rate", "/1000 catheter days",
  shape = (0.14 ^ 2L) / (0.5 ^ 2L),
  scale = (0.5 ^ 2L) / 0.14
)
r.Dermatitis <- BetaModVar$new(
  "Baseline dermatitis risk", "/catheter", alpha = 1L, beta = 475L
)
# relative effectiveness
hr.CRBSI <- LogNormModVar$new(
  "Tegaderm CRBSI HR", "HR",
  p1 = 0.402, p2 = (0.868 - 0.186) / (2L * 1.96), param = "LN7"
)
hr.LSI <- LogNormModVar$new(
  "Tegaderm LSI HR", "HR",
  p1 = 0.402, p2 = (0.868 - 0.186) / (2L * 1.96), param = "LN7"
)
rr.Dermatitis <- LogNormModVar$new(
  "Tegaderm Dermatitis RR", "RR", p1 = 1.0, p2 = 0.5, param = "LN7"
)
# cost variables
c.CRBSI <- GammaModVar$new(
  "CRBSI cost", "GBP",
  shape = (9900.0 ^ 2L) / (3000.0 ^ 2L),
  scale = (3000.0 ^ 2L) / 9900.0
)
c.LSI <- GammaModVar$new(
  "LSI cost", "GBP",
  shape = (100.0 ^ 2L) / (30.0 ^ 2L),
  scale = (30.0 ^ 2L) / 100.0
)
c.Dermatitis <- GammaModVar$new(
  "Dermatitis cost", "GBP",
  shape = (6.0 ^ 2L) / (3.0 ^ 2L),
  scale = (3.0 ^ 2L) / 6.0
)
# number of dressings and days with catheter
n.dressings <- GammaModVar$new(
  "No. dressings", "dressings",
  shape = (3.0 ^ 2L) / (2.0 ^ 2L),
  scale = (2.0 ^ 2L) / 3.0
)
n.cathdays <- GammaModVar$new(
  "No. days with catheter", "days",
  shape = (10.0 ^ 2L) / (5.0 ^ 2L),
  scale = (5.0 ^ 2L) / 10.0
)

Model variable expressions

Variables in the model may be included in the decision tree via mathematical expressions, which involve model variables and are themselves model variables. Forms of expression involving R functions and multiple model variables are supported, provided they conform to R syntax. The following code creates the model variable expressions to be used as values in the decision tree edges. For probabilities, the convention \(q = 1 - p\) is used to ensure that the sum of probabilities leaving each chance node is one.

p.CRBSI.S <- ExprModVar$new(
  "P(CRBSI | standard dressing)", "P",
  rlang::quo(r.CRBSI * n.cathdays / 1000.0)
)
q.CRBSI.S <- ExprModVar$new(
  "Q(CRBSI | standard dressing)", "1 - P",  rlang::quo(1.0 - p.CRBSI.S)
)
p.CRBSI.T <- ExprModVar$new(
  "P(CRBSI|Tegaderm)", "P",
  rlang::quo(p.CRBSI.S * hr.CRBSI)
)
q.CRBSI.T <- ExprModVar$new(
  "Q(CRBSI | Tegaderm)", "1 - P", rlang::quo(1.0 - p.CRBSI.T)
)
p.LSI.S <- ExprModVar$new(
  "P(LSI | Standard)", "/patient",
  rlang::quo(r.LSI * n.cathdays / 1000.0)
)
q.LSI.S <- ExprModVar$new(
  "Q(LSI | Standard)", "1 - P", rlang::quo(1.0 - p.LSI.S)
)
p.LSI.T <- ExprModVar$new(
  "P(LSI | Tegaderm)", "P", rlang::quo(p.LSI.S * hr.LSI)
)
q.LSI.T <- ExprModVar$new(
  "Q(LSI | Tegaderm)", "1 - P", rlang::quo(1.0 - p.LSI.T)
)
p.Dermatitis.S <- ExprModVar$new(
  "P(dermatitis | standard dressing)", "P",
  rlang::quo(r.Dermatitis)
)
q.Dermatitis.S <- ExprModVar$new(
  "Q(dermatitis | standard dressing)", "1 - P",
  rlang::quo(1.0 - p.Dermatitis.S)
)
p.Dermatitis.T <- ExprModVar$new(
  "P(dermatitis | Tegaderm)", "P",
  rlang::quo(p.Dermatitis.S * rr.Dermatitis)
)
q.Dermatitis.T <- ExprModVar$new(
  "Q(dermatitis | Tegaderm)", "1 - P",
  rlang::quo(1.0 - p.Dermatitis.T)
)
c.Tegaderm <- ExprModVar$new(
  "Tegaderm CHG cost", "GBP", rlang::quo(6.26 * n.dressings)
)
c.Standard <- ExprModVar$new(
  "Standard dressing cost", "GBP", rlang::quo(1.54 * n.dressings)
)

The decision tree

Constructing the tree

The following code constructs the decision tree based on Figure 2 of Jenks et al1. In the formulation used by rdecision, the decision tree is constructed from sets of decision, chance and leaf nodes and from edges (actions and reactions). Leaf nodes are synonymous with pathways in Briggs’ terminology2. The time horizon is not stated explicitly in the model, and is assumed to be 7 days. It was implied that the time horizon was ICU stay plus some follow-up, and the costs reflect those incurred in that period, so the assumption of 7 days does not affect the rdecision implementation of the model.

The tree is somewhat more complex than Figure 2 of Jenks et al because it allows for patients to have more than one adverse event (AE) during their stay (whereas their Figure 2 implies that only one event per patient is possible). The rates of AE were estimated independently, and allow for multiple events, (figure 1).

# create decision tree
th <- as.difftime(7L, units = "days")
# standard dressing
t01 <- LeafNode$new("t01", interval = th)
t02 <- LeafNode$new("t02", interval = th)
c01 <- ChanceNode$new()
e01 <- Reaction$new(
  c01, t01, p = p.Dermatitis.S, cost = c.Dermatitis, label = "Dermatitis"
)
e02 <- Reaction$new(
  c01, t02, p = q.Dermatitis.S, cost = 0.0, label = "No dermatitis"
)
t03 <- LeafNode$new("t03", interval = th)
t04 <- LeafNode$new("t04", interval = th)
c02 <- ChanceNode$new()
e03 <- Reaction$new(
  c02, t03, p = p.Dermatitis.S, cost = c.Dermatitis, label = "Dermatitis"
)
e04 <- Reaction$new(
  c02, t04, p = q.Dermatitis.S, cost = 0.0, label = "No dermatitis"
)
c03 <- ChanceNode$new()
e05 <- Reaction$new(c03, c01, p = p.LSI.S, cost = c.LSI, label = "LSI")
e06 <- Reaction$new(c03, c02, p = q.LSI.S, cost = 0.0, label = "No LSI")
t11 <- LeafNode$new("t11", interval = th)
t12 <- LeafNode$new("t12", interval = th)
c11 <- ChanceNode$new()
e11 <- Reaction$new(
  c11, t11, p = p.Dermatitis.S, cost = c.Dermatitis, label = "Dermatitis"
)
e12 <- Reaction$new(
  c11, t12, p = q.Dermatitis.S, cost = 0.0, label = "No Dermatitis"
)
t13 <- LeafNode$new("t13", interval = th)
t14 <- LeafNode$new("t14", interval = th)
c12 <- ChanceNode$new()
e13 <- Reaction$new(
  c12, t13, p = p.Dermatitis.S, cost = c.Dermatitis, label = "Dermatitis"
)
e14 <- Reaction$new(
  c12, t14, p = q.Dermatitis.S, cost = 0.0, label = "No dermatitis"
)
c13 <- ChanceNode$new()
e15 <- Reaction$new(c13, c11, p = p.LSI.S, cost = c.LSI, label = "LSI")
e16 <- Reaction$new(c13, c12, p = q.LSI.S, cost = 0.0, label = "No LSI")
c23 <- ChanceNode$new()
e21 <- Reaction$new(c23, c03, p = p.CRBSI.S, cost = c.CRBSI, label = "CRBSI")
e22 <- Reaction$new(c23, c13, p = q.CRBSI.S, cost = 0.0, label = "No CRBSI")

# Tegaderm branch
t31 <- LeafNode$new("t31", interval = th)
t32 <- LeafNode$new("t32", interval = th)
c31 <- ChanceNode$new()
e31 <- Reaction$new(
  c31, t31, p = p.Dermatitis.T, cost = c.Dermatitis, label = "Dermatitis"
)
e32 <- Reaction$new(
  c31, t32, p = q.Dermatitis.T, cost = 0.0, label = "no dermatitis"
)
t33 <- LeafNode$new("t33", interval = th)
t34 <- LeafNode$new("t34", interval = th)
c32 <- ChanceNode$new()
e33 <- Reaction$new(
  c32, t33, p = p.Dermatitis.T, cost = c.Dermatitis, label = "Dermatitis"
)
e34 <- Reaction$new(
  c32, t34, p = q.Dermatitis.T, cost = 0.0, label = "No dermatitis"
)
c33 <- ChanceNode$new()
e35 <- Reaction$new(c33, c31, p = p.LSI.T, cost = c.LSI, label = "LSI")
e36 <- Reaction$new(c33, c32, p = q.LSI.T, cost = 0.0, label = "No LSI")
t41 <- LeafNode$new("t41", interval = th)
t42 <- LeafNode$new("t42", interval = th)
c41 <- ChanceNode$new()
e41 <- Reaction$new(
  c41, t41, p = p.Dermatitis.T, cost = c.Dermatitis, label = "Dermatitis"
)
e42 <- Reaction$new(
  c41, t42, p = q.Dermatitis.T, cost = 0.0, label = "No dermatitis"
)
t43 <- LeafNode$new("t43", interval = th)
t44 <- LeafNode$new("t44", interval = th)
c42 <- ChanceNode$new()
e43 <- Reaction$new(
  c42, t43, p = p.Dermatitis.T, cost = c.Dermatitis, label = "Dermatitis"
)
e44 <- Reaction$new(
  c42, t44, p = q.Dermatitis.T, cost = 0.0, label = "No dermatitis"
)
c43 <- ChanceNode$new()
e45 <- Reaction$new(c43, c41, p = p.LSI.T, cost = c.LSI, label = "LSI")
e46 <- Reaction$new(c43, c42, p = q.LSI.T, cost = 0.0, label = "No LSI")
c53 <- ChanceNode$new()
e51 <- Reaction$new(c53, c43, p = p.CRBSI.T, cost = c.CRBSI, label = "CRBSI")
e52 <- Reaction$new(c53, c33, p = q.CRBSI.T, cost = 0.0, label = "no CRBSI")

# decision node
d1 <- DecisionNode$new("d1")
e9 <- Action$new(d1, c23, label = "Standard", cost = c.Standard)
e10 <- Action$new(d1, c53, label = "Tegaderm", cost = c.Tegaderm)

# create decision tree
V <- list(
  d1,
  c01, c02, c03, c11, c12, c13, c23, c31, c32, c33, c41, c42, c43, c53,
  t01, t02, t03, t04, t11, t12, t13, t14, t31, t32, t33, t34,
  t41, t42, t43, t44
)
E <- list(
  e01, e02, e03, e04, e05, e06, e11, e12, e13, e14, e15, e16, e21, e22,
  e31, e32, e33, e34, e35, e36, e41, e42, e43, e44, e45, e46, e51, e52,
  e9, e10
)
DT <- DecisionTree$new(V, E)

Tree diagram

The draw method of a DecisionTree object creates a graphical representation of the tree, as follows.

DT$draw(border = TRUE)
Figure 1. Decision tree for the Tegaderm model

Figure 1. Decision tree for the Tegaderm model

In the company’s model, the uncertainties in the probabilities associated with the polytomous chance nodes were modelled as independent variables. This is not recommended because there is a chance that a particular run of the PSA will yield probabilities that are outside the range [0,1].

Summary of model variables in the tree

The model variables which will be associated with actions, reactions and leaf nodes can be tabulated using the method modvar_table. This returns a data frame describing each variable, its description, units and uncertainty distribution. Variables inheriting from type ModVar will be included in the tabulation unless explicitly excluded, regular numeric values will not be listed. In the Tegaderm model, the input model variables are in the following table, with expression model variables excluded.

Description Distribution
Dermatitis cost Ga(4,1.5)
Baseline dermatitis risk Be(1,475)
Tegaderm Dermatitis RR LN(-0.112,0.472)
LSI cost Ga(11.111,9)
Baseline LSI rate Ga(0.078,1.786)
No. days with catheter Ga(4,2.5)
Tegaderm LSI HR LN(-0.997,0.414)
No. dressings Ga(2.25,1.333)
CRBSI cost Ga(10.89,909.091)
Baseline CRBSI rate Ga(152.111,0.01)
Tegaderm CRBSI HR LN(-0.997,0.414)

Point estimates and distributions of model variables

The point estimates, units and distributional properties are obtained from the same call, in the remaining columns.

Variable Mean Q2.5 Q97.5
Dermatitis cost, GBP 6 1.63 13.2
Baseline dermatitis risk, /catheter 0.0021 5.33e-05 0.00774
Tegaderm Dermatitis RR, RR 1 0.354 2.26
LSI cost, GBP 100 50.1 167
Baseline LSI rate, /1000 catheter days 0.14 3.92e-21 1.47
No. days with catheter, days 10 2.72 21.9
Tegaderm LSI HR, HR 0.402 0.164 0.831
No. dressings, dressings 3 0.433 8
CRBSI cost, GBP 9900 4922 16589
Baseline CRBSI rate, /1000 catheter days 1.48 1.25 1.72
Tegaderm CRBSI HR, HR 0.402 0.164 0.831

Running the model

Base case

The following code runs a single model scenario, using the evaluate method of a decision node to evaluate each pathway from the decision node, shown in the table. This model did not consider utility, and the columns associated with utility are removed.

RES <- DT$evaluate()
Run d1 Cost
1 Standard 151.3
1 Tegaderm 77.75

Univariate sensitivity analysis

The sensitivity of the decision tree results to each source model variable, varied independently of the others, is demonstrated by a tornado diagram. The method tornado can be used to generate such a plot (and also provides a tabulated version of the values used in the plot). Source variables are varied over their 95% confidence limits (figure 2).

to <- DT$tornado(
  index = list(e10), ref = list(e9), draw = TRUE
)
Figure 2. Tornado diagram for the Tegaderm model

Figure 2. Tornado diagram for the Tegaderm model

The object returned from method tornado (to) is a data frame which includes the values of the cost difference when each model variable is univariately at the limits of its 95% confidence interval, as follows:

Variable LL UL outcome.min outcome.max
No. days with catheter, days 2.72 21.92 9.74 178.1
CRBSI cost, GBP 4922 16589 29.48 132.7
Tegaderm CRBSI HR, HR 0.16 0.83 108.5 10.67
No. dressings, dressings 0.43 8 85.66 49.95
Baseline CRBSI rate, /1000 catheter days 1.25 1.72 60.17 88
Baseline LSI rate, /1000 catheter days 0 1.47 73.46 74.34
LSI cost, GBP 50.12 166.8 73.5 73.6
Tegaderm LSI HR, HR 0.16 0.83 73.58 73.48
Tegaderm Dermatitis RR, RR 0.35 2.26 73.55 73.53
Dermatitis cost, GBP 1.63 13.15 73.54 73.54
Baseline dermatitis risk, /catheter 0 0.01 73.54 73.54

Probabilistic sensitivity analysis

Multivariate probabilistic sensitivity analysis is supported through the use of sampling model variables. The same call, with extra parameters, is used to run the PSA and save the results in a data frame. Additionally, the cost difference is computed for each run of the model, as follows:

N <- 1000L
psa <- DT$evaluate(setvars = "random", by = "run", N = N)
psa$Difference <- psa$Cost.Standard - psa$Cost.Tegaderm

The first few runs of PSA are as follows; the by = "run" option reshapes the table to give one row per simulation, rather than one row per run, per strategy.

Run Cost.Tegaderm Cost.Standard Difference
1 29.39 65.6 36.21
2 32.55 68.74 36.19
3 75.77 203.9 128.2
4 56.05 234.6 178.5
5 47.04 145 97.95
6 62.17 89.72 27.55
7 128.5 275.8 147.4
8 19.31 36.48 17.17
9 100.5 155.8 55.3
10 59.39 63.04 3.65

From PSA (1000 runs), the mean cost of treatment with Tegaderm was 74.74 GBP, the mean cost of treatment with standard dressings was 141.92 GBP and the mean cost saving was 67.19 GBP. The 95% confidence interval for cost saving was -13.57 GBP to 213.91 GBP; the standard deviation of the cost saving was 58.50 GBP. Overall, 92.5% of runs found that Tegaderm was cost saving. These results replicate those reported by Jenks et al (saving of 72.90 GBP, 97.8% cases cost saving; mean cost of standard dressing 151.29 GBP, mean cost of Tegaderm 77.75 GBP).

Scenario - low baseline rate of CRBSI

Jenks et al modelled an additional scenario, in which the baseline rate of CRBSI was 0.3 per 1000 catheter days (modelled as a Gamma distribution fitted to a sample mean of 0.3 and a sample 95% confidence interval of 0.2 to 0.6). A way to achieve this in rdecision is to replace the model variable for the baseline rate of CRBSI, and any other model variables that depend on it via expressions, and then reconstruct the model, as follows.

r.CRBSI <- GammaModVar$new(
  "Baseline CRBSI rate",  "/1000 catheter days",
  shape = (0.30 ^ 2L) / (0.102 ^ 2L),
  scale = (0.102 ^ 2L) / 0.30
)
p.CRBSI.S <- ExprModVar$new(
  "P(CRBSI | standard dressing)", "P",
  rlang::quo(r.CRBSI * n.cathdays / 1000.0)
)
q.CRBSI.S <- ExprModVar$new(
  "Q(CRBSI | standard dressing)", "1 - P",  rlang::quo(1.0 - p.CRBSI.S)
)
p.CRBSI.T <- ExprModVar$new(
  "P(CRBSI|Tegaderm)", "P",
  rlang::quo(p.CRBSI.S * hr.CRBSI)
)
q.CRBSI.T <- ExprModVar$new(
  "Q(CRBSI | Tegaderm)", "1 - P", rlang::quo(1.0 - p.CRBSI.T)
)
e21 <- Reaction$new(c23, c03, p = p.CRBSI.S, cost = c.CRBSI, label = "CRBSI")
e22 <- Reaction$new(c23, c13, p = q.CRBSI.S, cost = 0.0, label = "No CRBSI")
e51 <- Reaction$new(c53, c43, p = p.CRBSI.T, cost = c.CRBSI, label = "CRBSI")
e52 <- Reaction$new(c53, c33, p = q.CRBSI.T, cost = 0.0, label = "no CRBSI")
E <- list(
  e01, e02, e03, e04, e05, e06, e11, e12, e13, e14, e15, e16, e21, e22,
  e31, e32, e33, e34, e35, e36, e41, e42, e43, e44, e45, e46, e51, e52,
  e9, e10
)
DT <- DecisionTree$new(V, E)

The model for this scenario was run under PSA, as for the base case:

N <- 1000L
psa <- DT$evaluate(setvars = "random", by = "run", N = N)
psa$Difference <- psa$Cost.Standard - psa$Cost.Tegaderm

From PSA (1000 runs), the mean cost of treatment with Tegaderm was 30.84 GBP, the mean cost of treatment with standard dressings was 33.45 GBP and the mean cost saving was 2.61 GBP. The 95% confidence interval for cost saving was -26.73 GBP to 38.10 GBP; the standard deviation of the cost saving was 16.68 GBP. Overall, 55.1% of runs found that Tegaderm was cost saving. These results replicate those reported by Jenks et al (saving of 3.56 GBP, 57.9% cases cost saving; mean cost of standard dressing 34.47 GBP, mean cost of Tegaderm 30.79 GBP).

Two threshold analyses were reported for this scenario. This can be achieved in rdecision by using the threshold method of the decision tree. Firstly, the threshold hazard ratio of a CRBSI with Tegaderm versus a CRBSI with a standard dressing was varied in the range 0.1 to 0.9, as follows:

hr_threshold <- DT$threshold(
  index = list(e10),
  ref = list(e9),
  outcome = "saving",
  mvd = "Tegaderm CRBSI HR",
  a <- 0.1,
  b <- 0.9,
  tol = 0.01
)

This gave a threshold value of 0.53, above which Tegaderm became cost incurring (the reported threshold was 0.53). Secondly, the cost of each CRBSI was varied between 0 GBP and 9900 GBP to find the threshold of cost saving, as follows:

c_crbsi_threshold <- DT$threshold(
  index = list(e10),
  ref = list(e9),
  outcome = "saving",
  mvd = "CRBSI cost",
  a <- 0.0,
  b <- 9900.0,
  tol = 10.0
)

This gave a threshold value of 7,840.72 GBP, below which Tegaderm became cost incurring (the reported threshold was 8000 GBP).

References

1.
Jenks, M., Craig, J., Green, W., Hewitt, N., Arber, M. & Sims, A. J. Tegaderm CHG IV securement dressing for central venous and arterial catheter insertion sites: A NICE medical technology guidance. Applied Health Economics and Health Policy 14, 135–149 (2016).
2.
Briggs, A., Claxton, K. & Sculpher, M. Decision modelling for health economic evaluation. (Oxford University Press, 2006).