Blocking (statistics)

In thestatisticaltheory of thedesign of experiments,blockingis the arranging ofexperimental unitsthat are similar to one another in groups (blocks) based on one or more variables. These variables are chosen carefully to minimize the impact of their variability on the observed outcomes. There are different ways that blocking can be implemented, resulting in different confounding effects. However, the different methods share the same purpose: to control variability introduced by specific factors that could influence the outcome of an experiment. The roots of blocking originated from the statistician,Ronald Fisher,following his development ofANOVA.

History

The use of blocking in experimental design has an evolving history that spans multiple disciplines. The foundational concepts of blocking date back to the early 20th century with statisticians likeRonald A. Fisher.His work in developinganalysis of variance(ANOVA) set the groundwork for grouping experimental units to control for extraneous variables. Blocking evolved over the years, leading to the formalization of randomized block designs andLatin squaredesigns.Today, blocking still plays a pivotal role in experimental design, and in recent years, advancements in statistical software and computational capabilities have allowed researchers to explore more intricate blocking designs.

Use

Blocking reduces unexplained variability. Its principle lies in the fact that variability which cannot be overcome (e.g. needing two batches of raw material to produce 1 container of a chemical) isconfoundedor aliased with a(n) (higher/highest order) interaction to eliminate its influence on the end product.High orderinteractionsare usually of the least importance (think of the fact that temperature of a reactor or the batch of raw materials is more important than the combination of the two – this is especially true when more (3, 4,...) factors are present); thus it is preferable to confound this variability with the higher interaction.

Examples

• Male and female:An experiment is designed to test a new drug on patients. There are two levels of the treatment,drug,andplacebo,administered tomaleandfemalepatients in adouble blindtrial. The sex of the patient is ablockingfactor accounting for treatment variability betweenmalesandfemales.This reduces sources of variability and thus leads to greater precision.
• Elevation:An experiment is designed to test the effects of a new pesticide on a specific patch of grass. The grass area contains a major elevation change and thus consists of two distinct regions – 'high elevation' and 'low elevation'. A treatment group (the new pesticide) and a placebo group are applied to both the high elevation and low elevation areas of grass. In this instance the researcher is blocking the elevation factor which may account for variability in the pesticide's application.
• Intervention:Suppose a process is invented that intends to make the soles of shoes last longer, and a plan is formed to conduct a field trial. Given a group ofnvolunteers, one possible design would be to given/2 of them shoes with the new soles andn/2 of them shoes with the ordinary soles,randomizingthe assignment of the two kinds of soles. This type of experiment is acompletely randomized design.Both groups are then asked to use their shoes for a period of time, and then measure the degree of wear of the soles. This is a workable experimental design, but purely from the point of view of statistical accuracy (ignoring any other factors), a better design would be to give each person one regular sole and one new sole, randomly assigning the two types to the left and right shoe of each volunteer. Such a design is called a "randomized completeblock design."This design will be more sensitive than the first, because each person is acting as his/her own control and thus thecontrol groupis more closely matched to thetreatment groupblock design

Nuisance variables

Nuisance variable effect on response variable

Nuisance variable (sex) effect on response variable (weight loss)

In the examples listed above, a nuisance variable is a variable that is not the primary focus of the study but can affect the outcomes of the experiment.They are considered potential sources of variability that, if not controlled or accounted for, may confound the interpretation between theindependent and dependent variables.

To address nuisance variables, researchers can employ different methods such as blocking or randomization. Blocking involves grouping experimental units based on levels of the nuisance variable to control for its influence.Randomizationhelps distribute the effects of nuisance variables evenly across treatment groups.

By using one of these methods to account for nuisance variables, researchers can enhance the internal validity of their experiments, ensuring that the effects observed are more likely attributable to the manipulated variables rather than extraneous influences.

In the first example provided above, the sex of the patient would be a nuisance variable. For example, consider if the drug was a diet pill and the researchers wanted to test the effect of the diet pills on weight loss. The explanatory variable is the diet pill and the response variable is the amount of weight loss. Although the sex of the patient is not the main focus of the experiment—the effect of the drug is—it is possible that the sex of the individual will affect the amount of weight lost.

Blocking used for nuisance factors that can be controlled

In thestatisticaltheory of thedesign of experiments,blocking is the arranging ofexperimental unitsin groups (blocks) that are similar to one another. Typically, a blocking factor is a source ofvariabilitythat is not of primary interest to the experimenter.

No blocking (left) vs blocking (right) experimental design

When studying probability theory the blocks method consists of splitting a sample into blocks (groups) separated by smaller subblocks so that the blocks can be considered almost independent.The blocks method helps proving limit theorems in the case of dependent random variables.

The blocks method was introduced byS. Bernstein: The method was successfully applied in the theory of sums of dependent random variables and inextreme value theory.

Example

Without blocking: diet pills vs placebo on weight loss

In our previous diet pills example, a blocking factor could be the sex of a patient. We could put individuals into one of two blocks (male or female). And within each of the two blocks, we can randomly assign the patients to either the diet pill (treatment) or placebo pill (control). By blocking on sex, this source of variability is controlled, therefore, leading to greater interpretation of how the diet pills affect weight loss.

With blocking: diet pills vs placebo on weight loss

Definition of blocking factors

A nuisance factor is used as a blocking factor if every level of the primary factor occurs the same number of times with each level of the nuisance factor.The analysis of the experiment will focus on the effect of varying levels of the primary factor within each block of the experiment.

Block a few of the most important nuisance factors

The general rule is:

"Block what you can; randomize what you cannot."

Blocking is used to remove the effects of a few of the most important nuisance variables. Randomization is then used to reduce the contaminating effects of the remaining nuisance variables. For important nuisance variables, blocking will yield higher significance in the variables of interest than randomizing.

Implementation

Implementing blocking inexperimental designinvolves a series of steps to effectively control for extraneous variables and enhance the precision of treatment effect estimates.

Identify nuisance variables

Identify potential factors that are not the primary focus of the study but could introduce variability.

Select appropriate blocking factors

Carefully choose blocking factors based on their relevance to the study as well as their potential to confound the primary factors of interest.

Define block sizes

There are consequences to partitioning a certain sized experiment into a certain number of blocks as the number of blocks determines the number ofconfoundedeffects.

Assign treatments to blocks

You may choose to randomly assign experimental units to treatment conditions within each block which may help ensure that any unaccounted for variability is spread evenly across treatment groups. However, depending on how you assign treatments to blocks, you may obtain a different number of confounded effects.Therefore, the number of as well as which specific effects get confounded can be chosen which means that assigning treatments to blocks is superior overrandom assignment.

Replication

By running a different design for eachreplicate,where a different effect gets confounded each time, the interaction effects are partially confounded instead of completely sacrificing one single effect.Replication enhances the reliability of results and allows for a more robust assessment of treatment effects.

Example

Table

One useful way to look at a randomized block experiment is to consider it as a collection ofcompletely randomizedexperiments, each run within one of the blocks of the total experiment.

Randomized block designs (RBD)

Name of design	Number of factorsk	Number of runsn
2-factor RBD	2	L1*L2
3-factor RBD	3	L1*L2*L3
4-factor RBD	4	L1*L2*L3*L4
$\vdots$	$\vdots$	$\vdots$
k-factor RBD	k	L1*L2*$\cdots$*Lk

with

L₁= number of levels (settings) of factor 1

L₂= number of levels (settings) of factor 2

L₃= number of levels (settings) of factor 3

L₄= number of levels (settings) of factor 4

$\vdots$

L_k= number of levels (settings) of factork

Example

Suppose engineers at a semiconductor manufacturing facility want to test whether different wafer implant material dosages have a significant effect on resistivity measurements after a diffusion process taking place in a furnace. They have four different dosages they want to try and enough experimental wafers from the same lot to run three wafers at each of the dosages.

The nuisance factor they are concerned with is "furnace run" since it is known that each furnace run differs from the last and impacts many process parameters.

An ideal way to run this experiment would be to run all the 4x3=12 wafers in the same furnace run. That would eliminate the nuisance furnace factor completely. However, regular production wafers have furnace priority, and only a few experimental wafers are allowed into any furnace run at the same time.

A non-blocked way to run this experiment would be to run each of the twelve experimental wafers, in random order, one per furnace run. That would increase the experimental error of each resistivity measurement by the run-to-run furnace variability and make it more difficult to study the effects of the different dosages. The blocked way to run this experiment, assuming you can convince manufacturing to let you put four experimental wafers in a furnace run, would be to put four wafers with different dosages in each of three furnace runs. The only randomization would be choosing which of the three wafers with dosage 1 would go into furnace run 1, and similarly for the wafers with dosages 2, 3 and 4.

Description of the experiment

LetX₁be dosage "level" andX₂be the blocking factor furnace run. Then the experiment can be described as follows:

k= 2 factors (1 primary factorX₁and 1 blocking factorX₂)

L₁= 4 levels of factorX₁

L₂= 3 levels of factorX₂

n= 1 replication per cell

N=L₁*L₂= 4 * 3 = 12 runs

Before randomization, the design trials look like:

X1	X2
1	1
1	2
1	3
2	1
2	2
2	3
3	1
3	2
3	3
4	1
4	2
4	3

Matrix representation

An alternate way of summarizing the design trials would be to use a 4x3 matrix whose 4 rows are the levels of the treatmentX₁and whose columns are the 3 levels of the blocking variableX₂.The cells in the matrix have indices that match theX₁,X₂combinations above.

Treatment	Block 1	Block 2	Block 3
1	1	1	1
2	1	1	1
3	1	1	1
4	1	1	1

By extension, note that the trials for any K-factor randomized block design are simply the cell indices of akdimensional matrix.

Model

The model for a randomized block design with one nuisance variable is

$Y_{ij}=\mu +T_{i}+B_{j}+\mathrm {random\ error}$

where

Y_ijis any observation for whichX₁=iandX₂=j

X₁is the primary factor

X₂is the blocking factor

μis the general location parameter (i.e., the mean)

T_iis the effect for being in treatmenti(of factorX₁)

B_jis the effect for being in blockj(of factorX₂)

Estimates

Estimate forμ:${\overline {Y}}$= the average of all the data

Estimate forT_i:${\overline {Y}}_{i\cdot }-{\overline {Y}}$with${\overline {Y}}_{i\cdot }$= average of allYfor whichX₁=i.

Estimate forB_j:${\overline {Y}}_{\cdot j}-{\overline {Y}}$with${\overline {Y}}_{\cdot j}$= average of allYfor whichX₂=j.

Generalizations

• Generalized randomized block designs(GRBD) allow tests of block–treatment interaction, and has exactly one blocking factor like the RCBD.
• Latin squares(and other row–column designs) have two blocking factors that are believed to have no interaction.
• Latin hypercube sampling
• Graeco-Latin squares
• Hyper-Graeco-Latin square designs

See also

• Algebraic statistics
• Block design
• Combinatorial design
• Generalized randomized block design
• Glossary of experimental design
• Optimal design
• Paired difference test
• Dependent and independent variables
• Blockmodeling

References

• This article incorporatespublic domain materialfrom theNational Institute of Standards and Technology

Bibliography

• Addelman, S.(1969). "The Generalized Randomized Block Design".The American Statistician.23(4): 35–36.doi:10.2307/2681737.JSTOR2681737.
• Addelman, S. (1970). "Variability of Treatments and Experimental Units in the Design and Analysis of Experiments".Journal of the American Statistical Association.65(331): 1095–1108.doi:10.2307/2284277.JSTOR2284277.
• Anscombe, F.J.(1948). "The Validity of Comparative Experiments".Journal of the Royal Statistical Society.A (General).111(3): 181–211.doi:10.2307/2984159.JSTOR2984159.MR0030181.
• Bailey, R. A(2008).Design of Comparative Experiments.Cambridge University Press.ISBN978-0-521-68357-9.Archived from the original on 2011-03-06.Retrieved2010-02-22.{{cite book}}:CS1 maint: bot: original URL status unknown (link)Pre-publication chapters are available on-line.
• Bapat, R. B. (2000).Linear Algebra and Linear Models(Second ed.). Springer.ISBN978-0-387-98871-9.
• Caliński T.; Kageyama S. (2000).Block designs: A Randomization approach.Vol. I: Analysis. New York: Springer-Verlag.ISBN0-387-98578-6.
• Caliński T.; Kageyama S. (2003).Block designs: A Randomization approach.Vol. II: Design. New York: Springer-Verlag.ISBN0-387-95470-8.MR1994124.
• Gates, C.E. (Nov 1995). "What Really Is Experimental Error in Block Designs?".The American Statistician.49(4): 362–363.doi:10.2307/2684574.JSTOR2684574.
• Kempthorne, Oscar(1979).The Design and Analysis of Experiments(Corrected reprint of (1952) Wiley ed.). Robert E. Krieger.ISBN0-88275-105-0.
• Hinkelmann, Klaus;Kempthorne, Oscar(2008).Design and Analysis of Experiments.Vol. I and II (Second ed.). Wiley.ISBN978-0-470-38551-7.
  • Hinkelmann, Klaus;Kempthorne, Oscar(2008).Design and Analysis of Experiments.Vol. I: Introduction to Experimental Design (Second ed.). Wiley.ISBN978-0-471-72756-9.
  • Hinkelmann, Klaus;Kempthorne, Oscar(2005).Design and Analysis of Experiments.Vol. 2: Advanced Experimental Design (First ed.). Wiley.ISBN978-0-471-55177-5.
• Lentner, Marvin; Thomas Bishop (1993). "The Generalized RCB Design (Chapter 6.13)".Experimental design and analysis(Second ed.). Blacksburg, VA: Valley Book Company. pp. 225–226.ISBN0-9616255-2-X.
• Raghavarao, Damaraju(1988).Constructions and Combinatorial Problems in Design of Experiments(corrected reprint of the 1971 Wiley ed.). New York: Dover.ISBN0-486-65685-3.
• Raghavarao, Damaraju;Padgett, L.V. (2005).Block Designs: Analysis, Combinatorics and Applications.World Scientific.ISBN981-256-360-1.
• Shah, Kirti R.; Sinha, Bikas K. (1989).Theory of Optimal Designs.Springer-Verlag.ISBN0-387-96991-8.
• Street, Anne Penfold;Street, Deborah J.(1987).Combinatorics of Experimental Design.Oxford U. P. [Clarendon].ISBN0-19-853256-3.
• Wilk, M. B. (1955). "The Randomization Analysis of a Generalized Randomized Block Design".Biometrika.42(1–2): 70–79.doi:10.2307/2333423.JSTOR2333423.
• Zyskind, George (1963)."Some Consequences of randomization in a Generalization of the Balanced Incomplete Block Design".The Annals of Mathematical Statistics.34(4): 1569–1581.doi:10.1214/aoms/1177703889.JSTOR2238364.