Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-23T10:34:59.492Z Has data issue: false hasContentIssue false

Quantification of systemic-to-pulmonary collateral flow in univentricular physiology with 4D flow MRI

Published online by Cambridge University Press:  19 September 2022

Floris-Jan S. Ridderbos*
Affiliation:
Department of Radiology, Stanford University Medical Center, Stanford University, Stanford, USA Department of Pediatric Cardiology, Center for Congenital Heart Diseases, Beatrix Children’s Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
Frandics P. Chan
Affiliation:
Department of Radiology, Stanford University Medical Center, Stanford University, Stanford, USA
Joost P. van Melle
Affiliation:
Department of Cardiology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
Tjark Ebels
Affiliation:
Department of Cardiothoracic Surgery, Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands Department of Cardiothoracic Surgery, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
Jeffrey A. Feinstein
Affiliation:
Department of Pediatrics (Cardiology), Stanford University Medical Center / Lucile Packard Children’s Hospital, Stanford University, Stanford, USA
Rolf M.F. Berger
Affiliation:
Department of Pediatric Cardiology, Center for Congenital Heart Diseases, Beatrix Children’s Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
Tineke P. Willems
Affiliation:
Department of Radiology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
*
Author for correspondence: Floris-Jan S. Ridderbos, MD, Department of Pediatric Cardiology, Center for Congenital Heart Diseases, Beatrix Children’s Hospital, University Medical Center Groningen, P.O. Box 30.001, Internal Zip Code CA41, 9700 RB Groningen, the Netherlands. Tel: +31503612800. Fax: +31503614235. E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Purpose:

Systemic-to-pulmonary collateral flow is a well-recognised phenomenon in patients with single ventricle physiology, but remains difficult to quantify. The aim was to compare the reported formula’s that have been used for calculation of systemic-to-pulmonary-collateral flow to assess their consistency and to quantify systemic-to-pulmonary collateral flow in patients with a Glenn and/or Fontan circulation using four-dimensional flow MRI (4D flow MR).

Methods:

Retrospective case–control study of Glenn and Fontan patients who had a 4D flow MR study. Flows were measured at the ascending aorta, left and right pulmonary arteries, left and right pulmonary veins, and both caval veins. Systemic-to-pulmonary collateral flow was calculated using two formulas: 1) pulmonary veins – pulmonary arteries and 2) ascending aorta – caval veins. Anatomical identification of collaterals was performed using the 4D MR image set.

Results:

Fourteen patients (n = 11 Fontan, n = 3 Glenn) were included (age 26 [22–30] years). Systemic-to-pulmonary collateral flow was significantly higher in the patients than the controls (n = 10, age 31.2 [15.1–38.4] years) with both formulas: 0.28 [0.09–0.5] versus 0.04 [−0.66–0.21] l/min/m2 (p = 0.036, formula 1) and 0.67 [0.24–0.88] versus -0.07 [−0.16–0.08] l/min/m2 (p < 0.001, formula 2). In patients, systemic-to-pulmonary collateral flow differed significantly between formulas 1 and 2 (13% versus 26% of aortic flow, p = 0.038). In seven patients, veno-venous collaterals were detected and no aortopulmonary collaterals were visualised.

Conclusion:

4D flow MR is able to detect increased systemic-to-pulmonary collateral flow and visualise collaterals vessels in Glenn and Fontan patients. However, the amount of systemic-to-pulmonary collateral flow varies with the formula employed. Therefore, further research is necessary before it could be applied in clinical care.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press

The presence of systemic-to-pulmonary collateral flow is common and felt, in some cases, to be of clinical significance in univentricular patients with a partial cavopulmonary connection (Glenn-anastomosis) or a Fontan circulation. Reference Mcelhinney, Reddy, Tworetzky, Petrossian, Hanley and Moore1,Reference Triedman, Bridges, Mayer and Lock2 The most common collaterals are systemic arterial-to-pulmonary arterial collaterals (i.e. aorta-to-pulmonary collaterals) and systemic venous-to-pulmonary venous collaterals (i.e. veno-venous collaterals), see Figure 1. Blood flow via these different types of collaterals will have variable haemodynamic consequences including increased pulmonary flow and volume loading of the systemic ventricle (aorta-to-pulmonary collaterals; left-right shunt) and cyanosis (veno-venous collaterals; right-left shunt). There is currently no consensus whether these collaterals are supportive or detrimental to the Fontan circulation and its clinical outcome. Cyanosis due to veno-venous collaterals is always unfavourable. However, the effect of volume loading due to systemic-to-pulmonary collateral flow can be favourable when there is decreased preload or unfavourable when the ventricle is overloaded. Consequently, there is also no consensus if aorta-to-pulmonary collaterals and veno-venous collaterals should be closed or left intact in patients with a Fontan circulation.

Quantification of these collateral flows and its haemodynamic consequences might be helpful in this discussion. Qualitative assessment of systemic-to-pulmonary collateral flow has been done using angiography, Reference Mcelhinney, Reddy, Tworetzky, Petrossian, Hanley and Moore1Reference Banka, Sleeper and Atz3 during cardiopulmonary bypass, Reference Ichikawa, Yagihara and Kishimoto4,Reference Bradley, McCall, Sistino and Radtke5 or using lung scintigraphy. Reference Inuzuka, Aotsuka and Nakajima6 However, true quantification of systemic-to-pulmonary collateral flow in order to assess its haemodynamic significance is shown to be hazardously difficult. Several reports have proposed two-dimensional phase contrast MRI for quantification of systemic-to-pulmonary collateral flow, using different formulas resulting in a wide range of systemic-to-pulmonary collateral flow, varying between 0.78 and 1.65 l/min/m2 for Glenn patients and 0.3–1.03 l/min/m2 for Fontan patients. Reference Odenwald, Quail and Giardini7,Reference Whitehead, Harris and Glatz8,Reference Wang, Liang, Huang, Liu, Deng and Yang17Reference Whitehead, Gillespie, Harris, Fogel and Rome20,Reference Latus, Gummel and Diederichs9Reference Whitehead, Sundareswaran, Parks, Harris, Yoganathan and Fogel16 As a consequence of the heterogeneous methodology for calculation of systemic-to-pulmonary collateral flow, it is difficult to interpret the true amount of systemic-to-pulmonary collateral flow based on these previous studies. Moreover, it is important to note that it has not been possible to discriminate between aorta-to-pulmonary collaterals and veno-venous collaterals using these formulas. Four-dimensional (4D) flow MR has the potential for comprehensive haemodynamic assessment including quantification of S systemic-to-pulmonary collateral flow. Reference Valverde, Nordmeyer and Uribe21 We aimed to compare the reported formula’s that have been used for the calculation of systemic-to-pulmonary collateral flow to assess their consistency and to quantify systemic-to-pulmonary collateral flow in patients with a Glenn and/or Fontan circulation using 4D flow MR.

Figure 1. Schematical overview of the Fontan circulation including different types of collateral flow.

Legend: Colour coding: red; highly oxygenated blood, purple; transition between oxygenated and deoxygenated blood, blue: deoxygenated blood. The black box represents collateral blood flow measured using the pulmonary and systemic estimator. The black bars represent the location of the performed 4D flow MR measurements.

Materials and methods

Study population

Adult patients status-post a Glenn or Fontan procedure who had undergone 4D Flow MR acquisition at the Stanford University Medical Center between January 2011 and February 2016 were retrospectively selected from the institutional 4D MR database. All studies had been obtained as part of the patients’ routine clinical care. Ten additional control subjects without any structural or functional cardiovascular abnormalities who had undergone 4D flow MR scan, as screening of cardiac abnormalities (e.g. patent foramen ovale) were included. Clinical medical records were used to collect clinical variables. Exclusion criteria included significant artefacts in the MR data prohibiting suitable analysis, and fat-suppressed MR data making background phase correction and the flow data unreliable. The study was approved by the institutional review board from Stanford University Medical Center and was carried out with Health Insurance Portability and Accountability Act (HIPAA) compliance and in accordance with the principles of the Declaration of Helsinki.

4D flow MR acquisition and data processing

The 4D flow scanning sequence was performed at the end of a clinical scan using a 1.5T MR scanner (GE Health Care, Waukesha Wisconsin, USA). A clinical scan included a standard 2D steady-state free precession cine sequence (FIESTA) for cardiac examination (short-axis, long-axis, four-chamber, inlet-outlet views). Magnetic resonance angiography was thereafter performed by standard first-pass contrast-enhanced magnetic resonance angiography technique using gadofosveset (Ablavar, Lantheus Medical, Billerica, Massachusetts, USA) at a dose of 0.03 mmol/kg. Finally, the 4D flow scanning sequence was performed because its signal strength benefits from residual contrast after the magnetic resonance angiography. Phase-contrast images were acquired with a ECG-gated, respiratory compensated, 3D phase-contrast sequence with velocity encoding in all directions. The imaging volume covered the thorax. The scan parameters included: flip angle 15°, repetition time 3.65–4.72 ms (range), echo time 1.32–2.28 ms (range), acquired spatial resolution of 1.09–1.82 x 1.46–2.19 x 2.6–3.0 mm (range). One velocity encoding range (VENC) was used for each acquisition and was typically 150–300 cm/s (range), which has been shown to be reliable for both venous and arterial flows. Reference Tariq, Hsiao, Alley, Zhang, Lustig and Vasanawala22 Using segmented k-space technique, 4–6 phase-encoding lines were collected per heartbeat, depending on heart rate. This yields a temporal resolution of 60–110 ms. Data acquisition was accelerated in the spatial domain using compressed SENSE technique. Acceleration factor, ranging from 1.7 to 10, was adjusted to achieve a 10-minute scan. Raw MR data were transferred to a cloud-based 4D flow MR application (Arterys Inc., San Francisco, CA, USA) for post-processing, as has been described elsewhere. Reference Chelu, van den Bosch and van Kranenburg23,Reference Chelu, Wanambiro and Hsiao24 Post-processing included correction for Maxwell phase effects and encoding errors related to gradient field distortions. Background phase correction was executed by manual segmenting of the stationary voxels in the volumetric data after which the software automatically corrected the phase off-set caused by Eddy currents.

Flow measurements

In patients, blood flow was measured in the following locations: Ascending aorta at the level of the left pulmonary artery junction, right superior caval vein (below the entrance of the azygos vein if present), left superior caval vein (if present), inferior caval vein (between hepatic vein confluence and right atrium/conduit), Fontan conduit (distal and proximal to fenestration, if present), right pulmonary artery (if not possible the upper and interlobar branch were measured separately), left pulmonary artery (between the cavopulmonary shunt and the first left pulmonary artery branch), all left and right pulmonary veins before the confluence to the left atrium (Fig 2). In the control group, the aorta, pulmonary, and caval veins were assessed on the same locations as described above. The pulmonary arteries were measured between the pulmonary bifurcation and the first side branch. A dynamic cross-sectional plane perpendicularly on each vessel of interest was manually chosen using the three-dimensional magnitude data and the flow vector arrows across the cardiac cycle. Flow was quantified by manually segmenting the cross-sectional area of the vessel based on the anatomical magnitude data for each temporal frame throughout the cardiac cycle (Fig 3). All flow measurements were performed by one investigator (FR). In addition, to assess inter-observer variability, flow measurements were also performed by a second investigator (TW) in 10 control and 10 Fontan subjects. Cardiac index was defined as aortic ascending flow divided by body surface area. Pulmonary arterial flow was the sum of left and right pulmonary artery. Pulmonary venous flow was the sum of left and right pulmonary venous flow. Caval flow was the sum of superior and inferior caval venous flow (below the fenestration). Total venous return to the left atrium in control patients was defined as pulmonary venous flow and in Fontan patients as the sum of pulmonary venous flow and fenestration flow if present. Fenestration flow was measured as the difference between flow superior and inferior of the fenestration in the Fontan tunnel. Total venous return to the left atrium and aortic ascending flow should be equal in normal physiology and was used as a measure of internal consistency in the control group. Pulmonary to systemic flow ratios were calculated using pulmonary artery/aortic flow (Qpulmonary artery/Qsystemic) and pulmonary venous/aortic flow (Qpulmonary venous/Qsystemic). Left/right pulmonary venous and arterial flow distribution (e.g. left pulmonary/total pulmonary venous flow, right pulmonary/total pulmonary venous flow and left pulmonary artery/total pulmonary artery flow, and right pulmonary/total pulmonary artery flow) were expressed as percentages. All flows (Q) were indexed for body surface area (L/min/m2). Reference Haycock, Schwartz and Wisotsky25

Figure 2. 4D flow MR overview of flow measurements in a Fontan patient.

Legend: Overview of all performed flow measurements in a Fontan patient. Ao; ascending aorta, IVC; inferior vena cava, LPA; left pulmonary artery, LPV; left pulmonary vein, RPA; right pulmonary artery, RPV; right pulmonary vein, SVC; superior vena cava.

Figure 3. Example of single 4D flow measurement.

Legend: Right pulmonary artery measurement in a Fontan patient. Panel A: coronal view. Panel B; cross-sectional (perpendicular) view of RPA measurement location. Panel C; longitudinal view of the RPA measurement location. Panel D; cross-sectional phase-contrast view of the RPA measurement. Ao: aorta, AoD: descending aorta, LA: left atrium, RPA; right pulmonary artery, RPV: right pulmonary vein, SVC; superior vena cava.

Calculation of SPCF

Systemic-to-pulmonary collateral flow was calculated using two different formulas that have been previously reported. Reference Whitehead, Harris and Glatz8,Reference Latus, Gummel and Diederichs9,Reference Fogel, Li and Wilson26,Reference Grosse-Wortmann, Al-Otay and Yoo10,Reference Glatz, Rome and Small11,Reference Grosse-Wortmann, Drolet and Dragulescu14Reference Glatz, Harrison and Small19 Formula 1‘the pulmonary estimator’; systemic-to-pulmonary collateral flow[pulmonary estimator] = pulmonary venous – pulmonary artery flow. Formula 2); ‘The systemic estimator’; flow[systemic estimator] = ascending aortic - (superior and inferior caval venous) flow. systemic-to-pulmonary collateral flow values were normalised to body surface area. Reference Haycock, Schwartz and Wisotsky25 Systemic-to-pulmonary collateral flow values were also expressed as percentage of cardiac index and total pulmonary flow. To discriminate between aorta-to-pulmonary collaterals and veno-venous collaterals qualitatively, the anatomical 4D image set was used to screen for visible aorta-to-pulmonary collaterals and veno-venous collaterals.

Statistical analysis

Data are presented as median and interquartile ranges [25th–75th percentiles]. Categorical variables are expressed as a frequency distribution and percentages. Flows are expressed as l/min/m2 unless mentioned otherwise. The Mann–Whitney U test was performed for comparison of the continuous variables between the groups. The Wilcoxon signed-rank test was used to assess differences for repeated measurements within patients. Spearman rank correlation was calculated to assess the strength of relationship between quantitative variables. Bland–Altman analysis was performed to assess internal consistency between the flow measurements and to assess inter-observer variability, presented as mean difference (with 95% limits of agreement). Intra-class correlation analysis was performed to assess inter-observer variability, additionally the coefficient of variation was calculated. A p-value < 0.05 was considered to be significant. Statistical analysis was done using IBM SPSS Statistics 24.0 (IBM Corp.).

Results

Baseline characteristics

Thirty-eight adult patients with a Glenn-anastomosis or Fontan circulation were identified in the institutional 4D flow MR database. Twenty-four patients were excluded because of limiting susceptibility artefacts (n = 9) due to implanted metal material (n = 5 embolic coils, n = 1 stent in Fontan conduit, n = 3 due to sternal wires and/or metal clips) or unsuitable MR acquisition datasets (due to a fat-suppression technique making phase-contrast data unreliable) (n = 15). Fourteen adult patients were included (11 Fontan patients and 3 Glenn patients). The baseline characteristics of the patient group (n = 14) are shown in Table 1. Ten additional control subjects (age 31.2 [15.1–38.4] years) were included from the 4D MR flow database with confirmed absence of any structural or functional cardiovascular abnormalities. There were no significant differences in age and body surface area between the control and patient group.

Table 1. Patient group baseline characteristics (n = 14)

All data are expressed as frequency (%) or median [25th -75th percentiles]. AVSD; atrioventricular septum defect, ccTGA/PA; congenital corrected transposition of the great arteries with pulmonary artresia, DILV; double inlet left ventricle, DIRV/PA; Double inlet right ventricle with pulmonary atresia, DORV/PS; double outlet right ventricle with pulmonary stenosis, HLHS; hypoplastic left heart syndrome, MR; magnetic resonance, NYHA-FC; New York Heart Association-Functional Class, PA/IVS; pulmonary atresia with intact ventricular septum, SpO2; systemic peripheral oxygen saturation, TA; tricuspid atresia,.

MR-derived flow and systemic-to-pulmonary collateral flow results

Table 2 summarises the flow measurements for both groups. Cardiac index was significantly lower in the patient group, 2.57 [2.14–2.93] l/min/m2 versus 2.97 [2.72–3.56] l/min/m2 in the controls (p = 0.019). Essentially all measured flows were different between the patients and controls. Table 3 summarises the systemic-to-pulmonary collateral flow measurements. Systemic-to-pulmonary collateral flow[pulmonary estimator] was significantly higher in the patient group compared to the control group, both in absolute volume and relative percentage of either pulmonary venous or aortic flow (0.28 [0.09–0.5] versus 0.04 [−0.06-0.21] l/min/m2 (p = 0.036), 16% versus 1% of pulmonary venous flow (p = 0.007), 13% versus 1% of aortic flow (p = 0.022)). Similarly, SPCFSE was higher in the patient group compared to the control group (0.67 [0.24–0.88] versus −0.07 [−0.16-0.08] l/min/m2 (p < 0.001), 31% versus −2% of pulmonary venous flow (p < 0.001), 26% versus −2% of aortic flow (p < 0.001)).

In the control group, there was no significant difference between systemic-to-pulmonary collateral flow[systemic estimator] and systemic-to-pulmonary collateral flow[pulmonary estimator] calculations (p = 0.139). Systemic-to-pulmonary collateral flow was however, significantly higher in the patient group (p = 0.038) using systemic-to-pulmonary collateral flow[systemic estimator] (0.67 l/min/m2) when compared to systemic-to-pulmonary collateral flow[pulmonary estimator] (0.28 l/min/m2).

Table 2. Flow measurements results

All data are expressed as median [25th–75th percentiles]. *; considered statistically significant.

BSA; body surface area, IVC; inferior vena cava, LPA; left pulmonary artery, LPV; left pulmonary vein, MR; magnetic resonance, PCPC; partial cavopulmonary connection, Qpa; pulmonary arterial flow, Qpv; pulmonary venous flow, Qs; aortic flow, RPA; right pulmonary artery, RPV; right pulmonary vein, SVC; superior vena cava.

Table 3. Systemic-to-pulmonary collateral flow (SPCF) results

All data are expressed as median [25th -75th percentiles]. AoA; aortic ascending, PCPC; partial cavopulmonary connection, PV: pulmonary venous, SPCF; systemic-to-pulmonary collateral flow, PE; pulmonary estimator (=PV-PA), SE; systemic estimator (=AoA-[SVC + IVC]).

The mean difference between systemic-to-pulmonary collateral flow[systemic estimator] and systemic-to-pulmonary collateral flow[pulmonary estimator] was 0.32 (−0.56-1.19) l/min/m2 for the patient group. Mean difference between aortic ascending flow and total venous return to the left atrium was 0.35 (−0.32-1.01) l/min/m2 for the Fontan group. Between the Glenn (n = 3) and Fontan (n = 11) subgroups, no statistically significant differences were found in systemic-to-pulmonary collateral flow, regardless of calculation method ([pulmonary estimator] versus [systemic estimator]). In Fontan patients, when systemic-to-pulmonary collateral flow was included in the Qpulmonary venous this resulted in a significant higher Qpulmonary/Qsystemic ratio expressed as the difference between the ratios of Qpulmonary artery/Qsystemic (Qpulmonary without systemic-to-pulmonary collateral flow) and Qpulmonary venous/Qsystemic (Qpulmonary with systemic-to-pulmonary collateral flow): 0.70 [0.66–0.77] versus 0.85 [0.73–0.90]; p = 0.003. Regardless of systemic-to-pulmonary collateral flow, both Qpulmonary venous/Qsystemic and Qpulmonary artery/Qsystemic ratios were significantly lower in patients compared to controls (Qpulmonary venous/Qsystemic; 0.82 versus 0.97; p < 0.01 and Qpulmonary artery/Qsystemic; 0.71 versus 0.94; p < 0.001). In the control and Glenn groups, no statistical significant differences between Qpulmonary artery/Qsystemic and Qpulmonary venous/Qsystemic were found. None of the two systemic-to-pulmonary collateral flow formulas correlated with oxygen saturation at rest in the Fontan group. The left/right pulmonary arterial flow distribution in the control group was not different from that in the patient group (48%/52% versus 44%/56%; p = 0.403). Similarly, the left/right pulmonary venous flow distribution did not differ between controls and patients (49%/51% versus 46%/54%; p = 0.154). In the patient group, left/right systemic-to-pulmonary collateral flow distribution was 54%/46%.

Internal consistency and reproducibility

Mean difference between aortic ascending flow and total venous return to the left atrium was 0.08 (−0.45-0.6) l/min/m2 for the control group. Inter-observer agreement was good for all measurements as shown in Table 4.

Table 4. Inter-observer variability

AoA; Aortic ascending, CI; confidence interval, IVC; inferior vena cava, LoA; level of agreement, LPA; left pulmonary artery, LPV; left pulmonary vein, RPA; right pulmonary artery, RPV; right pulmonary vein, SVC; superior vena cava.

Qualitative assessment of systemic-to-pulmonary collateral flow

No evidence of aorta-to-pulmonary collaterals in our patient group was found but visible veno-venous collaterals were detected in seven Fontan patients. These veno-venous collaterals originated from both the lower and upper mediastinum (the innominate vein and superior vena cava) and they drained to either the inferior and/or superior pulmonary veins on either sides or drained directly into the left atrium, see Figure 4 for illustration. A sub-analysis between two subgroups based on the presence/absence of visible veno-venous collaterals did not show any significant differences in systemic-to-pulmonary collateral flow.

Figure 4. 4D flow MR images of systemic-to-pulmonary collateral vessels.

Legend: Examples of 4D flow MR images illustrating systemic-venous-to-pulmonary venous collaterals (i.e. veno-venous collateral, VVC) in two different Fontan patients. Anterior-to-posterior view. Panel A) VVC with infra-diaphragmatic origin with a tortuous course draining directly into the left atrium. Panel B) VVC originating from the upper mediastinum draining into the left pulmonary vein. Ao; aorta, AoD; descending aorta, L; left, LA; left atrium, LPA; left pulmonary artery, LPV; left pulmonary vein, R; right, RPV; right pulmonary vein, SV; single ventricle, SVC: superior vena cava. The arrows indicate a VVC.

Discussion

In this study, we quantified systemic-to-pulmonary collateral flow with 4D flow MR in Glenn and Fontan patients and showed that systemic-to-pulmonary collateral flow is significantly higher in this population compared to control subjects. Visible veno-venous collaterals were found in seven Fontan patients and no aorta-to-pulmonary collaterals were detected. The type of formula used for systemic-to-pulmonary collateral flow calculation did not change the amount of systemic-to-pulmonary collateral flow in the control group, however in the patient group systemic-to-pulmonary collateral flow did vary significantly depending on the formula used. The Glenn subgroup did not have significantly higher systemic-to-pulmonary collateral flow as compared to the Fontan subgroup in contrast to previous studies in children (Table S1). This might be attributed to the older age of the Glenn subgroup and the additional antegrade pulmonary flow that most of these patients still had. With 4D flow MR, it is possible to measure flow through multiple vessels of interest off-line, which is especially suited in patients with complex congenital cardiovascular anatomy for a comprehensive flow analysis. We showed that multiple 4D flow MR measurements are reproducible with good inter-observer agreement. This technique is of added value because in patients with complex congenital cardiovascular anatomy it is known that especially multiple pulmonary arterial and venous flow measurements are cumbersome using conventional MR phase-contrast imaging. Based on the current spatial resolution and phase-contrast signal-to-noise ratio in smaller collateral vessels, we did not deem it feasible to measure flow through these vessels directly, although this certainly could become possible in the near-future when the technology improves and would become an advantage of 4D flow MRI.

Currently, different formulas have been proposed for the calculation of systemic-to-pulmonary collateral flow with heterogeneous results as shown in Table S1. The systemic-to-pulmonary collateral flow[systemic estimator] formula has the advantage that only three measurements are necessary in large vessels which usually can be measured without much difficulty. This method has been used most frequently (Table S1). The systemic-to-pulmonary collateral flow[pulmonary estimator] formula has the advantage that systemic-to-pulmonary collateral flow can be expressed for each lung. The disadvantage is that all the pulmonary veins and both pulmonary artery branches need to be measured, especially measuring the right pulmonary artery in Fontan patients can be difficult with 2D phase-contrast MR. Reference Robbers-Visser, Helderman and Strengers27 We have shown that different approaches to quantify systemic-to-pulmonary collateral flow are consistent in the control group, however in the patient group there was a discrepancy among the two formulas used. Only three studies have described an agreement between the systemic-to-pulmonary collateral flow[systemic estimator] and systemic-to-pulmonary collateral flow[pulmonary estimator] formulas. Reference Odenwald, Quail and Giardini7,Reference Whitehead, Harris and Glatz8,Reference Valverde, Nordmeyer and Uribe21 Odenwald et al. showed frequent differences of 0.5–1.0 l/m/m2 between the pulmonary estimator and systemic estimator formulas. Reference Odenwald, Quail and Giardini7 Whitehead et al. reported a mean difference of 0.02 ( −0.6 – 0.6) l/min/m2 and Valverde et al. reported a mean difference of 0.01 (−1.52 to 1.54) min/m2). Reference Whitehead, Harris and Glatz8,Reference Valverde, Nordmeyer and Uribe21 In comparison, our results show a mean difference of 0.32 (−0.56 to1.19) l/min/m2 in the patient group.

There are a few explanations for our higher systemic-to-pulmonary collateral flow[systemic estimator] results compared to the systemic-to-pulmonary collateral flow[pulmonary estimator] formula. A potential limitation of the systemic-to-pulmonary collateral flow[pulmonary estimator] approach is that when veno-venous collaterals drain directly in the left atrium they are not included in the calculation (as in Fig 4A), which will lead to underestimation of systemic-to-pulmonary collateral flow[pulmonary estimator]. This could also explain the measured difference between total venous return to left atrium and ascending aortic flow in the Fontan group. Especially in older Fontan patients veno-venous collaterals are known to be more prevalent and this may explain the higher difference between systemic-to-pulmonary collateral flow[systemic estimator] and systemic-to-pulmonary collateral flow[pulmonary estimator] because our cohort was older compared to the three described studies which included more young Glenn patients (Table S1). Reference Odenwald, Quail and Giardini7,Reference Whitehead, Harris and Glatz8,Reference Valverde, Nordmeyer and Uribe21 Despite the possibility of not measuring veno-venous collaterals adequately with the systemic-to-pulmonary collateral flow[pulmonary estimator] formula, measurements of the pulmonary arteries and pulmonary veins are useful to appreciate the distribution of pulmonary flow better. Potential limitations of systemic-to-pulmonary collateral flow[pulmonary estimator] include underestimation of inferior vena cava flow, sometimes due to the inability to perform optimal segmentation or the presence of a suboptimal flow signal. This is likely to be related to anatomical variations in hepatic venous drainage, surgical variations in the conduit anastomosis, and the presence of a dilated inferior vena cava in older patients with an atriopulmonary connection. Finally, technical differences in the used MR acquisitions, post-processing, and differences in selection bias and sample sizes could account in part for these differences. We did not compare the 4D flow measurements directly with 2D phase-contrast measurements which can be considered a limitation. Technical limitations inherent to 4D flow MRI (such as the use of single velocity-encoded value [VENC]) could also have contributed to measurement errors. In our opinion, both the systemic-to-pulmonary collateral flow[pulmonary estimator] and systemic-to-pulmonary collateral flow[systemic estimator] formulas have their added value and we propose that both should be used in tandem as there is currently no consensus for a gold standard. When significant differences between systemic-to-pulmonary collateral flow[systemic estimator] and systemic-to-pulmonary collateral flow[pulmonary estimator] are found, the described limitations should be considered.

It is important to note that systemic-to-pulmonary collateral flow quantification using the described methods potentially includes multiple types of collateral flow: aorta-to-pulmonary collaterals, veno-venous collaterals, and systemic arterial-to-pulmonary venous shunts, see Figure 1. Intra-pulmonary arterial-to-pulmonary venous malformations (PAVM) can also be present; however, these cannot be measured separately using MR due to their intrapulmonary peripheral location.

Aorta-to-pulmonary collaterals form a left-to-right shunt, increase pulmonary blood flow, and may lead to volume loading of the heart. Potential beneficial effects include the promotion of pulmonary vascular growth, and pulsatility from aorta-to-pulmonary collaterals have been suggested to have positive effects on the endothelial-dependent vaso-relaxation response in the pulmonary vascular bed. Reference Zongtao, Zengwei, Hongyu, Renfu, Huishan and Xinmin28Reference Kurotobi, Sano and Kogaki31 Furthermore, increase in pulmonary blood flow leads to increase of the ventricular preload that is assumed to be relatively reduced in the Fontan circulation. Unfavourable effects of aorta-to-pulmonary collaterals occur when the systemic-to-pulmonary collateral flow is haemodynamically significant and include chronic ventricular volume overloading which may result in ventricular failure and reduction of ‘effective cardiac output’ to the systemic circulation. Reference Ait Ali, Cadoni, Rossi, Keilberg, Passino and Festa15 Also, pulsatile aorta-to-pulmonary collateral flow in proximal pulmonary arteries may result in competitive flow with power loss in the cavopulmonary flow. Reference Ascuitto and Ross-Ascuitto32

Veno-venous collaterals bypass the pulmonary capillary bed and therefore cause right-to-left shunting resulting in systemic desaturation. Increased systemic venous pressure due to conduit obstruction or increased pulmonary vascular resistance may lead to development of veno-venous collaterals as a compensatory mechanism in attempt to relieve systemic venous pressure, and to maintain sufficient systemic venous return to the heart and thus cardiac output (‘natural fenestration’), however at the cost of oxygenation.

Currently, there are no clinical guidelines available regarding the management of systemic-to-pulmonary collateral vessels for patients with a partial cavo-pulmonary connection or Fontan circulation, resulting in heterogeneity of the used indications for catheter closure between centres. Reference Banka, Sleeper and Atz3 Considering aorta-to-pulmonary collaterals, the centres that do perform aorta-to-pulmonary collateral catheter occlusion have been using qualitative invasive criteria to grade the severity of aorta-to-pulmonary collaterals such as the size of aorta-to-pulmonary collaterals, oxygen step-ups in the pulmonary arteries and angiographic filling defects. These methods however cannot identify peripheral collaterals and are not quantitative. There is currently little evidence available if aorta-to-pulmonary collateral closure leads to improved outcome in the long-term, and while beneficial short-term effects of closure have been reported, Reference Dori, Glatz and Hanna33 this may be only a temporary solution, Reference Brown, Gauvreau and Powell34 or do not have a significant effect at all on systemic-to-pulmonary collateral flow. Reference Odenwald, Quail and Giardini7,Reference Prakash, Rathod, Powell, McElhinney, Banka and Geva13

Considering veno-venous collaterals, there is limited retrospective data available on the incidence and the effects of closure and there is no prospective outcome data. Reference Sugiyama, Yoo, Williams and Benson35Reference Poterucha, Johnson and Taggart37 Decreased survival has been described in Fontan patients after a veno-venous collateral embolisation. Especially patients with heterotaxy, atriopulmonary connection, and a Fontan pressure above 18 mmHg had a high mortality and might had taken advantage from the natural fenestration that veno-venous collaterals provide. Reference Poterucha, Johnson and Taggart37 With comprehensive non-invasive 4D flow cardiac MR quantification, it is possible to assess more precisely for each patient whether systemic-to-pulmonary collateral flow is haemodynamic relevant, and in combination with clinical variables may aid in the selection and management of patients who may benefit from aorta-to-pulmonary collateral or veno-venous collateral closure.

Limitations

This study has limitations inherent to the use of MR which include a non-physiological imaging situation (supine position) and the exclusion of patients with implanted pacemaker devices. The 4D flow MR measurements were not compared directly to traditional 2D phase-contrast MRI measurements. This can be considered a limitation as 2D phase-contrast MR is still considered the gold standard for MR-derived flow measurements. The use of a single velocity-encoded value for both arterial and venous flows is a limitation that could affect precision of flow measurements. The acquired temporal resolution was generally higher than the consensus value which is a limitation and could influence the accuracy of flow measurements; however, the 4D flow data was interpolated to a temporal resolution of 40 ms or less which is sufficient for flow measurements, while the double integration with the 4D flow velocity field reduces the effects of high frequency events. There are limitations inherent to the retrospective cohort study design which includes a possible referral and selection bias and the impossibility to detect casual relationships. A significant amount of patients had to be excluded due to imaging artefacts (mainly metallic artefacts) or due to unsuitable MR acquisition data sets (due to a fat-suppression technique making phase-contrast data unreliable). Although these reasons for exclusion are predominantly of technical nature, a potential selection bias cannot be excluded. The small sample size limits the possibility to assess risk factors for systemic-to-pulmonary collateral flow or correlations with systemic-to-pulmonary collateral flow and clinical outcome parameters.

Conclusions

Increased systemic-to-pulmonary collateral flow can be detected and collateral vessels can be visualised with 4D flow MR in Glenn and Fontan patients. However, the amount of measured systemic-to-pulmonary collateral flow in Glenn and Fontan patients varies with the formula employed. Currently, none can be considered the gold standard for clinical application. Therefore, further research is necessary before it may support clinical decision-making to guide the management of systemic-to-pulmonary collaterals in these patients.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S1047951122002840

Acknowledgements

None.

Financial support

FR received personal travel grants for this work from the Scholtes-Cordes Foundation, the Netherlands, from the Ministry of Education, Culture and Science, the Netherlands, and from the Graduate School of Medical Sciences, University of Groningen, the Netherlands. The other authors have no funding to report.

Conflicts of interest

None.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national guidelines on human experimentation (Health Insurance Portability and Accountability Act [HIPAA]) and with the Helsinki Declaration of 1975, as revised in 2013, and has been approved by the institutional committee (the institutional review board from Stanford University Medical Center).

References

Mcelhinney, DB, Reddy, VM, Tworetzky, W, Petrossian, E, Hanley, FL, Moore, P. Incidence and implications of systemic to cavopulmonary anastomosis. Ann Thorac Surg 2000; 69: 1222–8.10.1016/S0003-4975(99)01088-7CrossRefGoogle ScholarPubMed
Triedman, JK, Bridges, ND, Mayer, JE, Lock, JE. Prevalence and risk factors for aortopulmonary collateral vessels after Fontan and bidirectional Glenn procedures. J Am Coll Cardiol. 1993; 22: 207215.10.1016/0735-1097(93)90836-PCrossRefGoogle ScholarPubMed
Banka, P, Sleeper, LA, Atz, AM, et al. Practice variability and outcomes of coil embolization of aortopulmonary collaterals before Fontan completion: a report from the Pediatric Heart Network Fontan Cross-Sectional Study. Am Heart J. 2011; 162: 125130.10.1016/j.ahj.2011.03.021CrossRefGoogle ScholarPubMed
Ichikawa, H, Yagihara, T, Kishimoto, H, et al. Extent of aortopulmonary collateral blood flow as a risk factor for Fontan operations. Ann Thorac Surg. 1995; 59: 433437.10.1016/0003-4975(94)00120-VCrossRefGoogle ScholarPubMed
Bradley, SM, McCall, MM, Sistino, JJ, Radtke, WA. Aortopulmonary collateral flow in the Fontan patient: does it matter? Ann Thorac Surg. 2001; 72: 408415.10.1016/S0003-4975(01)02813-2CrossRefGoogle ScholarPubMed
Inuzuka, R, Aotsuka, H, Nakajima, H, et al. Quantification of collateral aortopulmonary flow in patients subsequent to construction of bidirectional cavopulmonary shunts. Cardiol Young. 2008; 18: 485493.10.1017/S104795110800259XCrossRefGoogle ScholarPubMed
Odenwald, T, Quail, MA, Giardini, A, et al. Systemic to pulmonary collateral blood flow influences early outcomes following the total cavopulmonary connection. Heart. 2012; 98: 934940.10.1136/heartjnl-2011-301599CrossRefGoogle ScholarPubMed
Whitehead, KK, Harris, MA, Glatz, AC, et al. Status of systemic to pulmonary arterial collateral flow after the Fontan procedure. Am J Cardiol March 2015; 115: 1739–45.10.1016/j.amjcard.2015.03.022CrossRefGoogle ScholarPubMed
Latus, H, Gummel, K, Diederichs, T, et al. Aortopulmonary collateral flow is related to pulmonary artery size and affects ventricular dimensions in patients after the fontan procedure. PLoS One 2013; 8: e81684.10.1371/journal.pone.0081684CrossRefGoogle ScholarPubMed
Grosse-Wortmann, L, Al-Otay, A, Yoo, S-J. Aortopulmonary collaterals after bidirectional cavopulmonary connection or Fontan completion: quantification with MRI. Circ Cardiovasc Imaging. 2009; 2: 219225.10.1161/CIRCIMAGING.108.834192CrossRefGoogle ScholarPubMed
Glatz, AC, Rome, JJ, Small, AJ, et al. Systemic-to-pulmonary collateral flow, as measured by cardiac magnetic resonance imaging, is associated with acute post-Fontan clinical outcomes. Circ Cardiovasc Imaging. 2012; 5: 218225.10.1161/CIRCIMAGING.111.966986CrossRefGoogle ScholarPubMed
Schmitt, B, Steendijk, P, Ovroutski, S, et al. Pulmonary vascular resistance, collateral flow, and ventricular function in patients with a Fontan circulation at rest and during dobutamine stress. Circ Cardiovasc Imaging. 2010; 3: 623631.10.1161/CIRCIMAGING.109.931592CrossRefGoogle ScholarPubMed
Prakash, A, Rathod, RH, Powell, AJ, McElhinney, DB, Banka, P, Geva, T. Relation of systemic-to-pulmonary artery collateral flow in single ventricle physiology to palliative stage and clinical status. Am J Cardiol. 2012; 109: 10381045.10.1016/j.amjcard.2011.11.040CrossRefGoogle ScholarPubMed
Grosse-Wortmann, L, Drolet, C, Dragulescu, A, et al. Aortopulmonary collateral flow volume affects early postoperative outcome after Fontan completion: a multimodality study. J Thorac Cardiovasc Surg. 2012; 144: 13291336.10.1016/j.jtcvs.2012.03.032CrossRefGoogle ScholarPubMed
Ait Ali, L, Cadoni, A, Rossi, G, Keilberg, P, Passino, C, Festa, P. Effective cardiac index and systemic-pulmonary collaterals evaluated by cardiac magnetic resonance late after Fontan palliation. Am J Cardiol. 2017; 119: 20692072.10.1016/j.amjcard.2017.03.040CrossRefGoogle ScholarPubMed
Whitehead, KK, Sundareswaran, KS, Parks, WJ, Harris, MA, Yoganathan, AP, Fogel, MA. Blood flow distribution in a large series of patients having the Fontan operation: a cardiac magnetic resonance velocity mapping study. J Thorac Cardiovasc Surg. 2009; 138: 96102.10.1016/j.jtcvs.2008.11.062CrossRefGoogle Scholar
Wang, R-P, Liang, C-H, Huang, M-P, Liu, H, Deng, Q-P, Yang, M-F. Assessment of aortopulmonary collateral flow and pulmonary vascular growth using a 3.0 T magnetic resonance imaging system in patients who underwent bidirectional Glenn shunting. Eur J Cardiothorac Surg 2012; 41: e146e153.10.1093/ejcts/ezs189CrossRefGoogle ScholarPubMed
Pushparajah, K, Wong, JK, Bellsham-Revell, HR, et al. Magnetic resonance imaging catheter stress haemodynamics post-Fontan in hypoplastic left heart syndrome. Eur Heart J Cardiovasc Imaging 2015, 644651.Google ScholarPubMed
Glatz, AC, Harrison, N, Small, AJ, et al. Factors associated with systemic to pulmonary arterial collateral flow in single ventricle patients with superior cavopulmonary connections. Heart. 2015; 101: 18131818.10.1136/heartjnl-2015-307703CrossRefGoogle ScholarPubMed
Whitehead, KK, Gillespie, MJ, Harris, MA, Fogel, MA, Rome, JJ. Noninvasive quantification of systemic-to-pulmonary collateral flow: a major source of inefficiency in patients with superior cavopulmonary connections. Circ Cardiovasc Imaging. 2009; 2: 405411.10.1161/CIRCIMAGING.108.832113CrossRefGoogle Scholar
Valverde, I, Nordmeyer, S, Uribe, S, et al. Systemic-to-pulmonary collateral flow in patients with palliated univentricular heart physiology: measurement using cardiovascular magnetic resonance 4D velocity acquisition. J Cardiovasc Magn Reson 2012; 14: 25.10.1186/1532-429X-14-25CrossRefGoogle ScholarPubMed
Tariq, U, Hsiao, A, Alley, M, Zhang, T, Lustig, M, Vasanawala, SS. Venous and arterial flow quantification are equally accurate and precise with parallel imaging compressed sensing 4D phase contrast MRI. J Magn Reson Imaging. 2013; 37: 14191426.10.1002/jmri.23936CrossRefGoogle ScholarPubMed
Chelu, RG, van den Bosch, AE, van Kranenburg, M, et al. Qualitative grading of aortic regurgitation: a pilot study comparing CMR 4D flow and echocardiography. Int J Cardiovasc Imaging. 2016; 32: 301307.10.1007/s10554-015-0779-7CrossRefGoogle ScholarPubMed
Chelu, RG, Wanambiro, KW, Hsiao, A, et al. Cloud-processed 4D CMR flow imaging for pulmonary flow quantification. Eur J Radiol. 2016; 85: 18491856.10.1016/j.ejrad.2016.07.018CrossRefGoogle ScholarPubMed
Haycock, GB, Schwartz, GJ, Wisotsky, DH. Geometric method for measuring body surface area: a height-weight formula validated in infants, children, and adults. J Pediatr. 1978; 93: 6266.10.1016/S0022-3476(78)80601-5CrossRefGoogle ScholarPubMed
Fogel, MA, Li, C, Wilson, F, et al. Relationship of cerebral blood flow to aortic-to-pulmonary collateral/shunt flow in single ventricles. Heart. 2015 June; 101: 17.10.1136/heartjnl-2014-307311CrossRefGoogle ScholarPubMed
Robbers-Visser, D, Helderman, F, Strengers, JL, et al. Pulmonary artery size and function after Fontan operation at a young age. J Magn Reson Imaging. 2008; 28: 11011107.10.1002/jmri.21544CrossRefGoogle ScholarPubMed
Zongtao, Y, Zengwei, W, Hongyu, Z, Renfu, Z, Huishan, W, Xinmin, L. Experimental study of effect of Fontan circuit on pulmonary microcirculation. Asian Cardiovasc Thorac Ann. 2006; 14: 183188.Google Scholar
Zongtao, Y, Huishan, W, Zengwei, W, et al. Experimental study of nonpulsatile flow perfusion and structural remodeling of pulmonary microcirculation vessels. Thorac Cardiovasc Surg. 2010; 58: 468472.10.1055/s-0030-1250124CrossRefGoogle ScholarPubMed
Brandes, H, Albes, JM, Conzelmann, A, Wehrmann, M, Ziemer, G. Comparison of pulsatile and nonpulsatile perfusion of the lung in an extracorporeal large animal model. Eur Surg Res 2002; 34: 321329.10.1159/000063067CrossRefGoogle Scholar
Kurotobi, S, Sano, T, Kogaki, S, et al. Bidirectional cavopulmonary shunt with right ventricular outflow patency: the impact of pulsatility on pulmonary endothelial function. J Thorac Cardiovasc Surg. 2001; 121: 11611168.10.1067/mtc.2001.113024CrossRefGoogle ScholarPubMed
Ascuitto, RJ, Ross-Ascuitto, NT. Systematic-to-pulmonary collaterals: a source of flow energy loss in Fontan physiology. Pediatr Cardiol. 2004; 25: 472481.10.1007/s00246-004-0580-1CrossRefGoogle ScholarPubMed
Dori, Y, Glatz, AC, Hanna, BD, et al. Acute effects of embolizing systemic-to-pulmonary arterial collaterals on blood flow in patients with superior cavopulmonary connections: a pilot study. Circ Cardiovasc Interv. 2013; 6: 101106.10.1161/CIRCINTERVENTIONS.112.972265CrossRefGoogle ScholarPubMed
Brown, DW, Gauvreau, K, Powell, AJ, et al. Cardiac magnetic resonance versus routine cardiac catheterization before bidirectional Glenn anastomosis: Long-term follow-up of a prospective randomized trial. J Thorac Cardiovasc Surg. 2013; 146: 11721178.10.1016/j.jtcvs.2012.12.079CrossRefGoogle ScholarPubMed
Sugiyama, H, Yoo, S-J, Williams, W, Benson, LN. Characterization and treatment of systemic venous to pulmonary venous collaterals seen after the fontan operation. Cardiol Young. 2003; 13: 424430.10.1017/S1047951103000908CrossRefGoogle ScholarPubMed
Lluri, G, Levi, DS, Aboulhosn, J. Systemic to pulmonary venous collaterals in adults with single ventricle physiology after cavopulmonary palliation. Int J Cardiol. 2015; 189: 159163.10.1016/j.ijcard.2015.04.065CrossRefGoogle ScholarPubMed
Poterucha, JT, Johnson, JN, Taggart, NW, et al. Embolization of veno-venous collaterals after the Fontan operation is associated with decreased survival. Congenit Heart Dis 2015; 10: E2306.10.1111/chd.12276CrossRefGoogle ScholarPubMed
Figure 0

Figure 1. Schematical overview of the Fontan circulation including different types of collateral flow.Legend: Colour coding: red; highly oxygenated blood, purple; transition between oxygenated and deoxygenated blood, blue: deoxygenated blood. The black box represents collateral blood flow measured using the pulmonary and systemic estimator. The black bars represent the location of the performed 4D flow MR measurements.

Figure 1

Figure 2. 4D flow MR overview of flow measurements in a Fontan patient.Legend: Overview of all performed flow measurements in a Fontan patient. Ao; ascending aorta, IVC; inferior vena cava, LPA; left pulmonary artery, LPV; left pulmonary vein, RPA; right pulmonary artery, RPV; right pulmonary vein, SVC; superior vena cava.

Figure 2

Figure 3. Example of single 4D flow measurement.Legend: Right pulmonary artery measurement in a Fontan patient. Panel A: coronal view. Panel B; cross-sectional (perpendicular) view of RPA measurement location. Panel C; longitudinal view of the RPA measurement location. Panel D; cross-sectional phase-contrast view of the RPA measurement. Ao: aorta, AoD: descending aorta, LA: left atrium, RPA; right pulmonary artery, RPV: right pulmonary vein, SVC; superior vena cava.

Figure 3

Table 1. Patient group baseline characteristics (n = 14)

Figure 4

Table 2. Flow measurements results

Figure 5

Table 3. Systemic-to-pulmonary collateral flow (SPCF) results

Figure 6

Table 4. Inter-observer variability

Figure 7

Figure 4. 4D flow MR images of systemic-to-pulmonary collateral vessels.Legend: Examples of 4D flow MR images illustrating systemic-venous-to-pulmonary venous collaterals (i.e. veno-venous collateral, VVC) in two different Fontan patients. Anterior-to-posterior view. Panel A) VVC with infra-diaphragmatic origin with a tortuous course draining directly into the left atrium. Panel B) VVC originating from the upper mediastinum draining into the left pulmonary vein. Ao; aorta, AoD; descending aorta, L; left, LA; left atrium, LPA; left pulmonary artery, LPV; left pulmonary vein, R; right, RPV; right pulmonary vein, SV; single ventricle, SVC: superior vena cava. The arrows indicate a VVC.

Supplementary material: File

Ridderbos et al. supplementary material

Table S1

Download Ridderbos et al. supplementary material(File)
File 35.5 KB
Supplementary material: File

Ridderbos et al. supplementary material

Table S2

Download Ridderbos et al. supplementary material(File)
File 20.4 KB