January 2019 - 14

TIP FROM THE TRENCHES
The scientific triad of proper research
To meet the standards of the scientific method,
research must be compliant in three extremely
crucial areas:
* Validity. The degree to which a study accurately
reflects or assesses the specific concept the
researchers are attempting to measure. Does it
When the amount of change is said to be " significant, " it
means the amount of change was most likely due to the
testing protocol over mere chance.
� p-value. This is the metric researchers use to determine
significance. A p-value of 0.05 indicates there's less than a
5-percent probability that the resulting change or difference
between groups was simply chance. More clearly stated, it
shows there is more than a 95-percent probability that the
amount of change or difference between the groups was a
result of the implemented protocol.
� Case study. This is an in-depth review of one
individual that must be taken in context, as the results
cannot be extrapolated to the general public.
� Experimental study. In this format, subjects are
assigned to either a control group or the experimental
group. The experimental group is placed under the
protocol being studied; the control group is not.
� Crossover study. In this type of study, the subjects
of both experimental and control groups are place under
each other's protocol or treatment.
For example, one group would be under Protocol A
followed by Protocol B, while the other group implements
Protocol B followed by Protocol A. After the designated
period for the first protocol is complete, a " washout "
period is inserted before beginning the second protocol.
Doing this reduces the chances of a residual effect of the
first protocol on the second protocol.
� Survey. Most notably in questionnaire and interview
formats, quantifiable information is collected from a
population or subset of a population. The U.S. Census is
a well-known example. Obviously, you are counting on the
honesty and integrity of the survey population for valid data.
� Cross-sectional study. This is an observation of
a population or a subset of a population at one crosssection
or specific juncture. For example, measuring the
body composition of a football team or offensive linemen
(subset) during the preseason.
� Longitudinal study. Basically, the researchers are
doing much the same as in a cross-sectional study. It just
takes place over a longer period of time. For instance, the
aforementioned body composition measurements might be
taken preseason, midseason and at season's end.
� Position stands. These are written by a panel of
experts, usually within a specific organization. The positon
stand is based upon available research on a targeted topic.
It presents a set of recommendations, guidelines and best
14 JANUARY 2019
truly measure/test the research topic in question?
* Reliability. Is the research repeatable? In other
words, if the research is repeated and the results are
consistent, we can tag it as being reliable.
* Credibility. Is the research trustworthy and
believable? The researchers' conclusions must be
supported by the research findings.
practices procured from those research results.
� Literature review. This is an exhaustive compilation
and analysis of high-quality studies performed in a specific
area. To be credible, it must include all relevant studies on
the topic, not just handpicked reports that run parallel with
the personal philosophies or preferred methodologies of
researchers.
� Meta-analysis. More commonly seen than ever before,
this is the pooling of numerous studies that investigated
the same topic into one large study. Doing so enlarges
the population base and can provide a wider scope of
evidence-based findings on the particular subject. As with
a literature review, the meta-analysis should not exclude
studies that run contrary to the beliefs of the researchers.
Final rep
Here are a few more points for consideration and
possible contention when examining a study.
� Peer review. It's paramount for meeting the standards
of the scientific method that the research manuscript is
published in a scholarly, peer-reviewed publication. If so,
you can be relatively assured that it was put to the fire of a
rigorous, impartial review process.
� Proper design. The gold standard for design in
clinical research is:
* Randomized: Random subject assignment to groups.
* Double-blind: Researchers and subjects are unaware
as to which group is receiving which specific protocol
treatment
* Placebo-controlled: One group receives the
protocol/treatment to be studied, and the control group
receives a placebo or alternate protocol.
* True cause and effect. Correlation does not imply
causation. It could merely be a coincidence, or pure
chance. The best method for showing causality is by
adhering to the principles and guidelines of a
randomized, double-blind, placebo-controlled study.
Ken Mannie is the head strength/conditioning coach at
Michigan State University. To contact him about this topic or
anything else you've read in Powerline, send him an email at
mannie@ath.msu.edu.
Reference
Brzycki, M., A Practical Approach to Strength and
Conditioning, 5th Ed., Wish Publishing, 2018.
January 2019

Table of Contents for the Digital Edition of January 2019
