The fan in the corner of the small briefing room was clicking every 8 seconds, a rhythmic reminder that time was leaking away while we sat in a silence that felt heavy enough to bruise. Across from me, a candidate with 5808 hours in a stickpit was staring at a diagram of a depressurization event, his thumb rubbing against the side of his coffee cup. He said, “The air, it just… went thin. We felt it in the teeth.” I froze. My pen stayed exactly 8 millimeters above the paper. Beside me, my co-evaluator was already scribbling something that looked suspiciously like a low score for ‘Vocabulary.’ But I was stuck on the teeth. I knew what he meant-the expansion of gas in the dental pulp during rapid decompression. It was a visceral, accurate, and operationally significant description. Yet, to a purely linguistic auditor, it might sound like a lack of technical terminology. This is where the job stops being about him and starts being entirely about me. We like to pretend we are measuring them, but most of the time, we are just measuring our own capacity to see through the fog of our own expectations.

The Ghost in the Machine of Metrics

I remember once, during a particularly grueling 48-hour certification cycle, I caught myself doing that thing where you look extremely busy the moment a supervisor walks past. I was rearranging my highliers by ink level, making sure the caps were all aligned, projecting an image of clinical precision. The boss walked by, nodded at my ‘dedication,’ and I realized then that the entire industry of assessment is built on these tiny, performative lies. We act as if the rubric is a physical law, like gravity or the way 188 grams of fuel occupies a specific volume at a specific temperature. But it isn’t. It’s a consensus of ghosts. When we listen to a pilot or a controller, we aren’t just checking boxes; we are reconciling an inventory of meaning that doesn’t always have a physical counterpart.

This reminds me of Julia J.-C., an inventory reconciliation specialist I met during a layover in a rainy city where the streetlights hummed at a low 58 hertz. Julia J.-C. didn’t work in aviation, but she understood the soul of the problem. She spent her days in massive warehouses, looking for things that were supposed to be there but weren’t, or things that were there but didn’t exist on the ledger. She told me once, over a plate of 18 oysters, that the biggest mistake people make is trusting the system over the shelf. “If the computer says there are 78 gaskets and the bin is empty,” she said, “it’s not the bin’s fault. It’s the person who didn’t understand how the gasket was actually used.” Language assessment is the same. We have a ledger-a set of descriptors for fluency, structure, and interaction-and then we have the shelf, which is the actual human being trying to communicate a life-or-death situation through the filter of a secondary tongue. If we aren’t careful, we spend all our time blaming the bin for being empty instead of questioning the person who wrote the number 78.

Proximity to Self

I find myself constantly fighting the urge to correct instead of understand. It’s a professional hazard. You hear a missing preposition and your brain registers a 28% drop in ‘accuracy’ before the sentence is even finished. But then you realize the candidate just navigated a complex linguistic turn that most native speakers would trip over, and you have to decide: are you a gatekeeper of grammar, or a judge of communicative competence? Most of us pretend to be both, which is a lie that costs us a lot of sleep. I once sat through 38 consecutive interviews where I realized I was scoring people higher simply because they used the same idioms I use. It was a terrifying realization. I wasn’t assessing their English; I was assessing their proximity to my own personality. I was looking for my own reflection in the stickpit glass, and when I didn’t see it, I marked them down. It’s a form of institutional narcissism that we rarely discuss because it makes the whole process feel fragile, which it is.

There is a specific kind of exhaustion that comes from trying to be a neutral observer. It’s like trying to hold your breath for 108 seconds while running a marathon. Eventually, you have to inhale, and when you do, you take in all the pollutants of your own bias. I’ve seen evaluators who have been doing this for 28 years who still think ‘accents’ are a sign of poor proficiency, despite the ICAO standards being very clear on the matter. They aren’t listening to the message; they are listening to the friction. They hear the way a vowel hits the roof of the mouth and they categorize it as ‘noise.’ But in a real emergency, that noise doesn’t matter. What matters is if the person on the other end of the radio can tell you exactly where the 8800-pound engine just fell off. If they can do that, they have achieved the goal. Yet, we still find ways to penalize them for the way they shaped the word ‘engine.’

The Ink and the Terrain

Level 6 Aviation We need to talk about the psychological toll of being the one who decides. It’s not just about the candidate’s career, though that is the obvious weight. It’s about the erosion of our own certainty. The more you do this, the more you realize that a ‘Level 4’ in one room is a ‘Level 5’ in another, and a ‘Level 6’ is often just a ‘Level 4’ with a better haircut or a more confident handshake. We try to standardize the unstandardizable. We create training programs to calibrate our brains, like we’re adjusting the sights on a rifle that has been dropped 68 times. We go through this training and we learn the fine art of the rater’s eye, but even the best training is a shield, not a cure. It gives us the tools to be more honest about our own fallibility. That’s the real secret of expert assessment: it’s not that you become a perfect judge; it’s that you become aware of exactly how biased a judge you actually are.

The Weight of Error

I spent the next 18 days trying to figure out how to undo the damage, but the paperwork was already filed, the 8-copy carbon forms distributed to the various ministries of bureaucracy. That mistake sits in my stomach like a cold stone. It’s a reminder that every time I pick up the pen, I am bringing my whole history of misunderstandings with me.

Julia J.-C. would have called it an ‘entry error.’ In her world of inventory, if you put a decimal point in the wrong place, you suddenly have 8000 valves instead of 8. In my world, if you put your bias in the wrong place, you have a pilot who can’t work despite being perfectly capable of flying a plane through a hurricane. We have to be reconciliation specialists of the human spirit. We have to look at the ‘discrepancy reports’ of our own ears. Why did I find that person’s tone arrogant? Was it because they were actually arrogant, or because they reminded me of a cousin I haven’t spoken to in 28 years? Why did I think that pause was too long? Was it because they were struggling for words, or because I am a nervous person who hates silence?

Quantifying Smoke with Wire

It gets complicated when you involve the technical side of the industry. Pilots are trained to be precise, to stick to the checklist, to ensure that the 128 items on the pre-flight are checked in order. They expect the same from us. They want a linguistic checklist where 1+1=2. But language is more like 1+1=8 if you say it with the right inflection. You can’t checklist a soul. You can’t quantify the way a person uses a metaphor to explain a complex electrical failure that isn’t covered in the standard phraseology manual. This is the heart of the frustration. We are using a rigid system to measure a fluid medium. We are trying to catch smoke with a net made of 48-gauge wire.

It’s like Julia’s warehouse: it’s easier to count the boxes that are overflowing than it is to account for the one box that contains exactly what is needed but is tucked away in a corner where the light doesn’t reach.

Witness, Not Protagonist

I’m still learning. Every time I sit down across from someone, I feel that familiar tension in my shoulders. I check my watch-it’s usually about 8 minutes past the hour when we start. I look at the candidate, I look at my co-evaluator, and I try to remember that I am not the protagonist of this story. I am just a witness. I am an inventory specialist trying to make sure the shelf and the ledger match up, even when the items on the shelf are made of breath and intention. It’s a messy, imperfect, and deeply human process. We will keep making mistakes. We will keep misinterpreting the ‘teeth’ for something else. But as long as we keep questioning our own filters, as long as we keep looking for the 188 reasons why we might be wrong, we are doing the job. The fan keeps clicking. The pen stays poised. We listen. Not just to the language, but to the person beneath it, hoping that our own interpretation doesn’t get in the way of the truth.