This page was translated from Japanese by machine translation. The Japanese page is the original.

Post-editing text (Gemini)

An arrow from the original document to a document with edit marks

Written on 2026-11-05. To make the Japanese text on this site easier to read, we explored a way to ask Gemini for post-editing (touching up sentences after they are written). The writer can be either a human or an AI. First, we tried it out on a single page. [Test] shows the results of actually running it.

How we do it now (from 2026-11-06)

The method described on this page is from when we tested it with local tools on 2026-11-05. After trying it, we found the cost was too high, so we have now changed our approach.

Looking at Google's billing, it cost about 1,000 yen for a single day on 11-04 Pacific Time (11-04 17:00 to 11-05 17:00 JST). Most of that was for the Pro model called by our local tools. We asked section by section, requested a redo when it missed the mark, and had it revise the same page over and over to compare models, which drove up the call count. Using it like this every day would come to about 360,000 yen a year (1,000 yen × 365 days). That was simply too expensive for touching up text.

So, we now follow this order instead:

  1. The writer does their own routine polishing. When the writer is an AI, that AI revises its own work. It does not call external APIs. When you worry about quirks in your own writing, ask a separate AI that does not know the previous conversation, purely for polishing. This is to get a fresh pair of eyes.
  2. Use the site's proofreading feature only when you want a fresh pair of eyes, such as before publishing. When you click "✍" on the editing screen, a cheaper model (Gemini Flash) suggests revisions. Only the parts where you review the comparison and click "Accept" are incorporated into the main text. It can be used up to 50 times a day across the whole site. Checks for blocked words, numbers, and certainty markers are the same as the method on this page.
  3. Use the expensive model (Pro) only when requested by the person who decides on publishing. We also set our local tools to use Flash unless specified by name.

Conclusion

1. Steps

Post-editing procedure

  1. First, the writer writes the text. They decide on the content, numbers, and sources, and add certainty markers (such as estimated, unverified, [source]).
  2. Next, tools check whether it is safe to publish. If there are blocked words like company names, personal names, server names, or tokens, processing stops right there. The blocked-words list is kept in an unpublished file. This is because the words themselves are information that must not be made public.
  3. Then, tools replace elements with tokens. Tags, code (pre, code), headings, and links are turned into ⟦number⟧ tokens.
  4. After that, Gemini polishes the Japanese. Text is sent section by section (by h2). The response is received as JSON. Its contents are the revised text and notes on places where the meaning was unclear and could not be revised.
  5. Next, tools verify it programmatically. If it fails, we ask for a redo only once, giving the reason. If it still fails, we leave that section as it was originally.
  6. From here, the writer compares and decides. They read through the entire comparison, where deleted text is shown in red and added text in green.
  7. Finally, the writer saves the changes. If another person has edited the page while reading, the site's write endpoint will reject the save. This is to avoid overwriting that person's edits. For public pages, saving pushes the changes to the live site within a few dozen seconds. When making large revisions, it is safer to give a quick heads-up to the person who decides on publishing beforehand.
  8. The person who decides on publishing marks it as published. For new pages, the person who decides on publishing applies the published mark.

2. Why divide the roles

RoleReason
Content and decisions by writerThe writer is the one who researched the numbers and sources. In an earlier investigation, Gemini produced numbers without sources (Section 5 of How to use rigid tapping). Because of this, we prevent Gemini from adding facts.
Japanese by GeminiIt excels at making Japanese sentences easier to read. Since it reads with a fresh pair of eyes, it also catches awkward phrasing that the author might miss.
Guardrails and checks by toolsEven a single changed digit in a number or part number is easy for human eyes to overlook. A machine will not miss it.
Publishing by the publishing deciderSince this is published to the world, a human decides whether to release it.

3. Instructions to Gemini

The same instructions are sent every time (system instructions). The key points are as follows:

We set the temperature (variability of answers) to 0.2. The model used during testing was gemini-pro-latest. Currently, our local tool defaults to Flash (see "Current Workflow").

4. Automated Checks

What we checkWhat it prevents
⟦number⟧ tokens stay in the same orderBroken tags; ruined table or list layouts
The set of numbers matchesNumbers changing, disappearing, or being added
The set of alphanumeric words matchesModel numbers, G-codes, and signal names changing
Uncertainty markers (estimated, unverified, expected, assumed, source, calculated, etc.) have not decreasedUncertain facts being rewritten as if they were certain
Length is 0.6 to 1.4 times the originalMajor deletions or excessive additions
No blocked words present (same check as Step 2)Unpublishable words introduced by Gemini's revisions

5. Test Results

We tested this three times on How to Use Rigid Tapping (12 sections). The author of that page was an AI (Claude). The same author also read and compared the revisions. [Test]

RunWhat changedAutomated checkAuthor's judgment
1Initial instructions10 sections passed. However, 2 sections were kept as-is because the token order and alphanumeric words changed.Many sentences ended in plain "da". Also, spaces between Japanese text and alphanumeric characters were lost. The tone became stiff, turning "反転のとき" into "反転時" and "比べ" into "比較".
2We added style instructions. Spaces are restored with a tool. If a section fails, we retry once.All 12 sections passed.The writing style improved. However, the meaning changed in two spots: the "(assumed... unverified)" note drifted away from the inertia value, and the causal link in "triggers an E-stop, leaving the tap in the hole" was split across two separate sentences.
3Headings and links were also placed inside tokens.All 12 sections passed.We read through all 52 revised spots. None had changed in meaning. The two issues from the second run were also fixed properly.

Here are examples of good revisions from the third run.

BeforeAfter
M3〜M8 は常用、M10 は短い時間なら使える、M12 以上はスレッドミル。M3〜M8 は常用する。M10 は短い時間なら使える。M12 以上はスレッドミルを使う。
…とすると、0.6 N·m 程度で、最大 11 N·m に比べて小さい。…とすると、トルクは 0.6 N·m 程度になる。これは最大 11 N·m に比べて小さい。
ねじの精度と振れは落ちる。ねじの精度が落ち、振れも大きくなる。
同期の問題がなく、効くのは XY の円の正確さと工具のたわみで、どちらもねじの公差より小さいか、後から合わせられる。同期の問題はない。影響するのは XY の円の正確さと工具のたわみ。どちらもねじの公差より小さいか、後から合わせられる。

This page itself was also rewritten using post-editing into the polite style (--tone desu). [Test]

Comparing Models (2026-11-05)

With the same instructions (polite style, --tone desu), we had three models revise the same page. We used Control and Electrical Configuration (6 sections, approx. 2,300 characters), which has not been post-edited yet. We ran each model once. The revised text has not been applied to that page. [Test]

ModelTime takenAutomated checkWhere the meaning shiftedTone
gemini-pro-latest132 sAll 6 sections with sentences to revise passed1 spot. "Confirm with a licensed electrician" became "To be safe, it gives peace of mind to confirm with a licensed electrician," making an absolute requirement read like an optional suggestion.Polite, with slightly more connecting words. Adds a few impressions not in the original, such as "...so it gives peace of mind."
gemini-4-argon67 sAll 6 sections with sentences to revise passed1 spot. "Therefore" was inserted between two sentences that were originally just written side by side, making the grounding and shielding near the welder read like a result of the differential design.The softest tone. Frequently adds connecting words like "the reason being" and "note that."
gemini-flash-latest97 sAll 6 sections with sentences to revise passed1 spot. "Keep the input filter" became "It gives peace of mind to keep it," weakening a firm decision into a recommendation.A tone close to pro. Softens decisive statements into "...is done for now" in many places.

Here is what we found:

So, we added two rules to the instructions and tried the same page once more (run 2). The additions were "Do not weaken decisions into recommendations" and "Do not add cause-and-effect connections not present in the original" (section 3). We also removed "...gives peace of mind" from the tone examples. [Test]

ModelTime takenAutomated checkWhere the meaning shifted
gemini-pro-latest151 sAll 6 sections with sentences to revise passedNone found. It remained a decisive statement: "We confirm with a licensed electrician."
gemini-4-argon49 sAll 6 sections with sentences to revise passedNone found. "Therefore" was not inserted, connecting instead with "When using near a welder..."
gemini-flash-latest101 sAll 6 sections with sentences to revise passedNone found. It remained a decisive statement: "We keep the input filter."

6. Considerations for Public Release

7. Uncertainties

Comments

No comments yet.

Comments with links, phone numbers or email addresses appear after the site approves them.

Sending needs JavaScript in your browser.

QR code for this page

https://robo100.jp/en/000024