I thank the authors of the article [1] for their interest in
our journal club discussing the same [2]. The points raised by
the authors are based on selective interpretation of their own
data [1] and selected quotes from the Evidence-based viewpoint
[2]. Hence, none of the points change anything in the critical
appraisal commentary [2]. Responses to specific points in the
correspondence are as follows:
(i)
‘Study hypothesis’ is not synonymous with ‘Research
question’. Besides the fact that the latter includes five
elements of the PICOT frame-work, it starts from a position of
clinical equipoise (i.e. the investigators do not
pre-assume that the intervention will be beneficial). Thus the
‘Research question’ sets the tone for the methods used in a
study, and is a touchstone for readers/appraisers to judge its
validity. It has been previously pointed out that the “science
of evidence-based medicine hinges on the art” of framing
appropriate questions [3].
(ii)
It has already been emphasized [2] that a cluster RCT is
the ideal design when either the intervention or outcomes or
both, are expected to spill over into/onto those who are not
randomized (but are present in the cluster). In this study [1],
it is difficult to judge a priori whether the
intervention (microfinance scheme support to individual women in
certain households in a cluster) or outcome (nutritional
parameters in their offspring) could have a spill-over effect on
mothers (who did not receive the financial support) or their
offspring, in which case an individually randomized trial would
be more appropriate.
(iii)
The study [1] mentioned that “tolas of similar
size were paired” and those “in each pair were randomly
assigned”. For instance, if tolas ‘A’ and ‘X’ were paired
and one of these was randomly assigned to a group, it follows
that the other member of the pair would have to be assigned to
the other group. This precludes any scope for allocation
concealment. Thus one member of the pair would have a 50% chance
of being assigned to either group, whereas the second member
would have a 100% chance of being assigned to the other group.
This is akin to using a coin-toss to randomize a pair of
participants.
(iv)
In this study [1], not all children who were present at
baseline were available for follow-up at 18 months; and not all
children whose 18 month data were collected, had data collected
at baseline. Thus, children whose data were collected at 18
months of age (presented in table 2 of the article) [1],
comprised an unknown proportion of those who were present at
baseline, plus an unknown proportion of those who were not
present at baseline.
(v)
The authors [1] found that children in the comparison
group fared worse than children in the intervention group.
Notwithstanding the methodological limitations compromising
validity, they assumed this to mean that under natural
circumstances, nutritional status of children would decline, and
the intervention partially mitigated this. But they have not
provided any data from any study, anywhere in the world, that
can support this view. This suggests that the explanation
offered for the unusual finding in this study [1] is erroneous.
This view is strengthened by the other points mentioned in the
commentary [2].
(vi)
Figure 3 in the study [1] shows that only about 12% of
the loans were for ‘food and supplies’ and the total amounted to
less than Rs. 10,000 across the tolas. In the face of
food insecurity (i.e., starvation), one would expect
people to take loans to purchase food (to tide over the
immediate scarcity) rather than invest in capital for
agriculture or medical supplies (that have no short-term impact
on starvation).
(vii)
The table of baseline characteristics in the study [1] showed
statistically significant differences in three anthropometric
parameters between the intervention and comparison groups. Two
of these were better in the intervention group viz HAZ (Z
score -2.00 vs -2.14) and proportion with MUAC <12.5 cm
(13% vs 16%). In contrast, the proportion with wasting
was higher in the intervention group (20% vs 15%). These
data suggest that children in the intervention group had
(statistically) better HAZ. Since height Z score is an
indicator of longer-term nutritional status and does not decline
immediately in acute malnutrition (unlike wasting or MUAC), it
suggests that children in the interventional group had a
statistically superior indicator of longer-term nutritional
status (at baseline).
(viii)
Since only one-third of the mothers in the intervention group
actually received the intervention, it is difficult to believe
that the comparable outcomes in offspring of those who did (and
did not) receive the intervention was based on a spillover
effect. The authors have not demonstrated how/why financial
empowerment of a limited number of women in the community could
create a spillover effect to other mothers and families.
In summary, methodological limitations compromise
the validity of the trial [1], and the authors’ recent comments
do not change the viewpoint that this trial is insufficient to
support further similar studies or launch a community-wide
intervention with the specific microfinance scheme described
(for the purpose of improving nutritional status of children).
Whether the scheme could have any other positive social or
cultural or health-related impact, is outside the scope of
discussion.
REFERENCES
1. Ojha S,
Szatkowski L, Sinha R, Yaron G, Fogarty A, Allen SJ, et al.
Rojiroti microfinance and child nutrition: a cluster randomised
trial. Arch Dis Child. 2020;105:229-35.
2. Mathew JL.
Cluster randomized trial evaluating impact of a community-based
microfinance scheme on childhood nutritional status:
Evidence-based medicine viewpoint. Indian Pediatr.
2020;57:459-63.
3. Mathew JL, Singh M. Evidence based child health:
Fly but with feet on the ground! Indian Pediatr. 2008;45:95-8.