In May I wrote a post here called "The last 20% took 80% of the time." I meant it as a dispatch from the finish line. Four months on, I can report that it was a dispatch from somewhere near the middle.
This is a very authorly thing to have done. Every writer I know has announced they were nearly finished with a draft, and every one of them has been wrong, and not one of us has learned anything from it. I have now managed it about software, which is at least a change of genre.
So, in the spirit of the thing, here is what "nearly done" turned out to contain.
I built a benchmark. The idea is simple enough: take clean manuscripts, plant errors at known places in four languages, and count what Betty actually catches. The first thing it told me was that I had been guessing about how good she was. The second was that I had run an entire round of it with the grammar checker switched off without noticing, which meant four days of results were worth nothing and one of my conclusions was exactly backwards.
Then I spent a week arguing with myself about commas. Betty scores badly on them, and I had a very comfortable theory about why: commas are a matter of taste, so failing to reproduce one author's choices isn't really an error. I liked that theory a lot. It was doing me a favour. So I went and measured it properly instead, and it turned out to be half right — and the half that survived pointed at a genuine fault I hadn't known about. That is roughly the story of this whole summer.
There is also now a way to run Betty without a powerful computer, on servers in France that keep no copy of your writing. That was not in the plan in May either. Most things weren't.
None of this is the interesting part of building a writing tool. All of it was necessary, and none of it was visible from where I was standing in May — which, I suspect, is the actual lesson, and not the tidy one about percentages I thought I had learned the first time.
So I am not going to tell you I'm nearly done. Betty works, she is out, the numbers are published including the unflattering ones, and I will go on finding the next 20% for as long as it keeps turning up.
If you want to see what she catches and what she doesn't, it's all on the performance page. The comma row is still the worst one there. I've stopped pretending that's fine.
— Simon