Most espresso comparisons are not comparisons. You pull a shot, change the grind, pull another, and decide the second is better because you remember the first as worse. Memory is unreliable, and expectation is strong: you changed something, so you expect an improvement.
A side-by-side comparison, done properly, removes some of that bias. It will not make tasting objective, but it will stop you from crowning a winner that only exists in your imagination.
Decide what you are comparing
A good comparison changes exactly one variable:
- Grind setting A versus B.
- Dose A versus B at the same ratio.
- Yield A versus B at the same dose.
- Two coffees at the same recipe.
- Two preparation methods, such as stirred versus unstirred.
If you change two things, the result cannot tell you which one mattered. Write the question down before you start: "Is 4.0 or 3.8 sweeter at the same dose and yield?"
Prepare both shots under the same conditions
- Same coffee, same roast date, same basket.
- Same machine warm-up and flush routine.
- Same distribution and tamp.
- Same target yield and same timer start point.
- Same cup size and temperature.
Pull the shots close together. A ten-minute gap lets the group cool and your palate drift.
If you can, pull them in alternating order across multiple rounds: A then B, then B then A. This controls for the first-shot effect, where the first shot of a pair often tastes different for thermal reasons.
Taste blind if you can
Ask someone to label the cups A and B without telling you which is which, or shuffle them yourself and note the order on a hidden slip. Blind tasting is humbling. Shots you were sure would win often do not.
If no one is available, at least avoid watching which cup was poured into. Small cues influence judgement more than most people admit.
The tasting protocol
- Smell both before tasting. Note the difference, if any.
- Taste A, then B. Take a small sip of each, then a second sip.
- Wait briefly, then taste B, then A. Reversing the order reduces order bias.
- Write notes before discussing or deciding. Use the same fields for both.
- Rinse or take a plain water sip between cups.
- Taste again as they cool. Some differences only appear at lower temperature.
Do not swallow quickly and move on. Espresso's finish is part of the comparison, and the finish often carries the defect you are looking for.
What to rate
Use the same small field set you use in your log: sweetness, acidity, body, finish, defects. Add a forced preference at the end: which would you rather drink? Preference is data, even when it disagrees with the individual ratings.
| Field | Shot A | Shot B | Preference |
|---|---|---|---|
| Sweetness | |||
| Acidity | |||
| Body | |||
| Finish | |||
| Defect | |||
| Overall | A / B / tie |
Interpreting a result
- Clear winner on multiple fields: the change is likely real. Repeat once to be sure.
- Winner on one field only: the change may be real but narrow. Decide whether that field matters to you.
- Tie: the change may be too small, or the coffee may be at a plateau. Do not force a winner.
- Contradictory rounds: palate fatigue or inconsistency. Stop and try again another day.
A result that flips when you reverse the order is not a result. It is noise.
Palate fatigue
Espresso is intense. After three or four shots, discrimination drops. Keep comparisons to two or three rounds, and take breaks. Do not schedule a big comparison after a meal or when you are rushed.
Record the comparison
Write the question, the two settings, the order, and the result. Future you will want to know not just which won but what exactly was different. A comparison is only useful if it can be repeated.
When not to compare
Do not compare when one shot is visibly channeled, when the machine is not warmed up, or when the coffees are at very different ages. Those differences swamp the variable you are testing. Fix the obvious problem first.
Bottom line
Change one variable, prepare both shots under the same conditions, taste blind and in both orders, and write notes before deciding. Accept ties. A disciplined A/B test is slower than a hunch and far more useful.
Keep the record
Log the next shot while it is fresh.
Espresso Journal keeps the recipe, gear, and taste note together.