6 Commits
Author SHA1 Message Date
KharecandClaude Opus 5.5 643adffb12 chore: release 1.4
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 16:41:35 +02:00
KharecandClaude Opus 5.5 b6b58c7aca chore: update source-map-js to fix a high severity advisory
GHSA-68fv-2mgg-jv7q: event-loop denial of service through indexed
source-map section offsets. Build-time dependency only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 16:41:27 +02:00
Kharec 839e9291d6 feat: resumable download and cancellable load of the translation model
Downloading the 300 MB model restarted from zero after any failure and
hung forever on a stalled connection. Download into a .partial file
that survives interruptions, resume it with a Range request (falling
back to a fresh download when the server cannot), skip files already
verified, and abort when nothing arrives for 30 s. A model directory
only counts as installed when every file has its pinned size, so a
truncated model is offered for download again instead of failing to
load.

The model load held the translation mutex, so Cancel did nothing for
the seconds it takes to read 300 MB. Load without holding the lock,
make marian.Load context-aware, and let CancelTranslation wait for the
task to wind down so a new one can start at once. The idle release
timer re-arms when it fires while a download holds the task slot,
instead of never freeing the model.
2026-10-13 18:17:53 +02:00
Kharec 8181c6e885 docs: update readme 2026-10-13 18:15:14 +02:00
Kharec 082152fc31 chore: update changelog 2026-10-13 18:15:10 +02:00
Kharec b84284b60c docs: update agent 2026-10-13 18:15:05 +02:00
11 changed files with 343 additions and 82 deletions

No files matched your search

+11 -5
View File
@@ -46,8 +46,9 @@ behaviour or shortcuts changed.
```
main.go Wails bootstrap: frameless translucent window, LANGUAGE=en, CLI file argument
app.go App struct bound to JS: file I/O, dialogs, pagination, autosave recovery
translation.go App methods for translation: model status/download (pinned files + SHA-256),
Translate, CancelTranslation, model loaded lazily and freed after 5 min idle
translation.go App methods for translation: model status/download (pinned files + SHA-256,
resumable), Translate, CancelTranslation, model loaded lazily and freed
after 5 min idle
desktop_linux.go cgo: desktop light/dark preference for GTK dialogs, window button layout, compositing
desktop/ app icon (plotzilla.svg, source of truth; plotzilla.png = 256 px render embedded as
the X11 window icon), plotzilla.desktop, MIME types for .fountain/.fdx
@@ -80,7 +81,7 @@ frontend/src/icons.ts inline Lucide-style SVG icons
frontend/src/style.css the whole UI theme (dark, blue) and the on-screen page geometry
screenshots/ README images (2880Ă—1800 UI captures + pdf-output.png)
tools/screenshots/ `make screenshots`: sample script, mock server (main.go), Firefox capture (capture.mjs)
VERSION current version (1.0)
VERSION current version
CHANGELOG.md Keep a Changelog; sections Added, Changed, Fixed only
```
@@ -211,11 +212,16 @@ change `style.css` too** (and vice versa).
- Translation (`Ctrl+Shift+L`) runs in Go, offline: `internal/marian` runs the OPUS-MT fr-en
model (Hugging Face form: `config.json`, `model.safetensors`, `source.spm`, `target.spm`,
`vocab.json`), downloaded on demand into `~/.local/share/plotzilla/models/opus-mt-fr-en`
(also looked up in `$XDG_DATA_DIRS/plotzilla/models/`). `translate.Document` returns the
(also looked up in `$XDG_DATA_DIRS/plotzilla/models/`). The download resumes the `.partial`
files an interruption left, skips files already downloaded, and aborts when nothing arrives
for 30 s; a directory only counts as installed when every file has its pinned size.
`translate.Document` returns the
changed elements (flat indexes) and the title page; the frontend replaces them in one
transaction (`applyTranslation`), only if the doc is unchanged. Both tasks report progress
with the `translation-progress` event (done, total; `0, 0` while loading) and stop on
`CancelTranslation`, returning `nil`/`false` (not an error) when cancelled.
`CancelTranslation`, returning `nil`/`false` (not an error) when cancelled. The model loads
without holding the translation lock (and `marian.Load` takes the context) so Cancel stays
responsive during the seconds-long load; `CancelTranslation` waits for the task to wind down.
- Find & replace is frontend-only (`search.ts`): matches are computed on `blockText`, where one
character is one document position. Replacements go through `replaceText()` (commands.ts),
which keeps the marks, and each one is its own undo step (`closeHistory`).
+11
View File
@@ -5,6 +5,17 @@ All notable changes to Plotzilla are documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/). The current
version is in the `VERSION` file.
## [Unreleased]
## [1.4] - 2026-10-15
### Fixed
- The Cancel button responds while the translation model is loading.
- The translation model download resumes where it stopped after an interruption, skips files
already downloaded, and reports a stalled connection instead of hanging. A model directory
with missing or truncated files is offered for download again instead of failing to load.
## [1.3] - 2026-10-01
### Added
+3 -3
View File
@@ -318,9 +318,9 @@ The model is [OPUS-MT French–English](https://huggingface.co/Helsinki-NLP/opus
University of Helsinki (Apache 2.0 license). Plotzilla runs it itself, in Go, with nothing else
to install. The first translation asks to download it (about 300 MB) from Hugging Face into
`~/.local/share/plotzilla/models/opus-mt-fr-en`; every file is checked against its known
checksum. The model takes about 300 MB of memory while it is loaded, and is unloaded after five
minutes without translating. A machine translation is a first draft: read it over, especially
the dialogue.
checksum, and an interrupted download resumes where it stopped. The model takes about 300 MB of
memory while it is loaded, and is unloaded after five minutes without translating. A machine
translation is a first draft: read it over, especially the dialogue.
## Pages and scenes
+1 -1
View File
@@ -1 +1 @@
1.2
1.4
+3 -3
View File
@@ -1155,9 +1155,9 @@
"license": "MIT"
},
"node_modules/source-map-js": {
"version": "1.2.1",
"resolved": "https://registry.npmjs.org/source-map-js/-/source-map-js-1.2.1.tgz",
"integrity": "sha512-UXWMKhLOwVKb728IUtQPXxfYU+usdybtUrK/8uGE8CQMvrhOpwvzDBwj0QhSL7MQc7vIsISBG8VQ8+IDQxpfQA==",
"version": "1.2.2",
"resolved": "https://registry.npmjs.org/source-map-js/-/source-map-js-1.2.2.tgz",
"integrity": "sha512-KGj/8Y43x35aZVDtt+J4mK1hoLGHULMYfSkODJNQjNDC3oW1PqPoxMwo0pLUsWM/UEGzON/NxeHywEfNXNP3Vw==",
"dev": true,
"license": "BSD-3-Clause",
"engines": {
+110 -19
View File
@@ -4,6 +4,7 @@ import (
"context"
"crypto/sha256"
"encoding/hex"
"errors"
"fmt"
"io"
"net/http"
@@ -30,10 +31,12 @@ func Installed(dir string) bool {
return true
}
// Download fetches files into dir. Each file is written next to its
// final name and renamed once its digest is checked, so an interrupted
// download never leaves a half-written model behind. progress receives
// the bytes downloaded so far and the total.
// Download fetches files into dir. A file already there with the right
// size and digest is skipped. A file is downloaded into a ".partial" file
// that is renamed only once its digest checks out, so an interrupted
// download never leaves a half-written model behind; the partial file is
// kept and the next Download resumes it where it stopped. progress
// receives the bytes downloaded so far and the total.
func Download(ctx context.Context, client *http.Client, dir string, files []RemoteFile, progress func(done, total int64)) error {
if err := os.MkdirAll(dir, 0o755); err != nil {
return err
@@ -42,57 +45,145 @@ func Download(ctx context.Context, client *http.Client, dir string, files []Remo
for _, f := range files {
total += f.Size
}
report := func(n int64) {
if progress != nil {
progress(done+n, total)
}
}
for _, f := range files {
n, err := download(ctx, client, dir, f, func(n int64) {
if progress != nil {
progress(done+n, total)
}
})
report(0)
n, err := download(ctx, client, dir, f, report)
if err != nil {
return fmt.Errorf("downloading %s: %w", f.Name, err)
}
done += n
report(0)
}
return nil
}
// download fetches one file, resuming the partial download left by an
// interrupted run when the server supports it.
func download(ctx context.Context, client *http.Client, dir string, f RemoteFile, progress func(int64)) (int64, error) {
final := filepath.Join(dir, f.Name)
if ok, err := verify(final, f); err != nil {
return 0, err
} else if ok {
return f.Size, nil // downloaded by a previous run
}
partial := filepath.Join(dir, "."+f.Name+".partial")
var off int64
if st, err := os.Stat(partial); err == nil && st.Size() > 0 && st.Size() <= f.Size {
off = st.Size()
}
if off == f.Size {
// A previous run was interrupted between the digest check and
// the rename.
if ok, _ := verify(partial, f); !ok {
off = 0 // corrupt: start over
} else if err := os.Rename(partial, final); err != nil {
return 0, err
} else {
return f.Size, nil
}
}
req, err := http.NewRequestWithContext(ctx, http.MethodGet, f.URL, nil)
if err != nil {
return 0, err
}
if off > 0 {
req.Header.Set("Range", fmt.Sprintf("bytes=%d-", off))
}
resp, err := client.Do(req)
if err != nil {
return 0, err
}
defer resp.Body.Close()
if resp.StatusCode != http.StatusOK {
if off > 0 && resp.StatusCode == http.StatusOK {
off = 0 // the server cannot resume: start over
}
want := http.StatusOK
if off > 0 {
want = http.StatusPartialContent
}
if resp.StatusCode != want {
if resp.StatusCode == http.StatusRequestedRangeNotSatisfiable {
os.Remove(partial) // the partial file cannot be resumed
}
return 0, fmt.Errorf("server answered %s", resp.Status)
}
tmp, err := os.CreateTemp(dir, "."+f.Name+".*")
tmp, err := os.OpenFile(partial, os.O_CREATE|os.O_RDWR, 0o644)
if err != nil {
return 0, err
}
defer os.Remove(tmp.Name()) // no-op once renamed
hash := sha256.New()
w := &countingWriter{w: io.MultiWriter(tmp, hash), progress: progress}
_, err = io.Copy(w, io.LimitReader(resp.Body, f.Size+1))
if off > 0 {
// The digest covers the whole file: seed it with the bytes
// already on disk.
if _, err := io.CopyN(hash, tmp, off); err != nil {
tmp.Close()
return 0, fmt.Errorf("reading the partial download: %w", err)
}
} else if err := tmp.Truncate(0); err != nil {
tmp.Close()
return 0, err
}
if _, err := tmp.Seek(off, io.SeekStart); err != nil {
tmp.Close()
return 0, err
}
w := &countingWriter{w: io.MultiWriter(tmp, hash), progress: func(n int64) { progress(off + n) }}
_, err = io.Copy(w, io.LimitReader(resp.Body, f.Size-off+1))
if cerr := tmp.Close(); err == nil {
err = cerr
}
if err != nil {
return 0, err
return 0, err // the partial file stays, for the next run
}
if w.n != f.Size {
return 0, fmt.Errorf("got %d bytes, expected %d", w.n, f.Size)
if got := off + w.n; got != f.Size {
return 0, fmt.Errorf("got %d bytes, expected %d", got, f.Size)
}
if sum := hex.EncodeToString(hash.Sum(nil)); sum != f.SHA256 {
os.Remove(partial) // corrupt: resuming it would fail again
return 0, fmt.Errorf("checksum mismatch")
}
if err := os.Chmod(tmp.Name(), 0o644); err != nil {
if err := os.Chmod(partial, 0o644); err != nil {
return 0, err
}
return w.n, os.Rename(tmp.Name(), filepath.Join(dir, f.Name))
return f.Size, os.Rename(partial, final)
}
// verify reports whether path holds the file, with its expected size and
// digest. A missing file is not an error.
func verify(path string, f RemoteFile) (bool, error) {
st, err := os.Stat(path)
if err != nil {
if errors.Is(err, os.ErrNotExist) {
return false, nil
}
return false, err
}
if st.Size() != f.Size {
return false, nil
}
sum, err := hashFile(path)
if err != nil {
return false, err
}
return sum == f.SHA256, nil
}
func hashFile(path string) (string, error) {
r, err := os.Open(path)
if err != nil {
return "", err
}
defer r.Close()
h := sha256.New()
if _, err := io.Copy(h, r); err != nil {
return "", err
}
return hex.EncodeToString(h.Sum(nil)), nil
}
type countingWriter struct {
+74 -12
View File
@@ -127,7 +127,7 @@ func TestSentencePiece(t *testing.T) {
func TestSafetensors(t *testing.T) {
path := filepath.Join(t.TempDir(), "m.safetensors")
writeSafetensors(t, path, []testTensor{{"w", []int{2, 2}, []float32{1, -2, 3.5, 0}}})
got, err := readSafetensors(path)
got, err := readSafetensors(context.Background(), path)
if err != nil {
t.Fatal(err)
}
@@ -141,7 +141,7 @@ func TestSafetensors(t *testing.T) {
data = append(data, h...)
data = append(data, 0x00, 0x3c, 0x00, 0xc0, 0x80, 0x3f) // 1, -2 (F16), 1 (BF16)
writeFile(t, path, data)
got, err = readSafetensors(path)
got, err = readSafetensors(context.Background(), path)
if err != nil {
t.Fatal(err)
}
@@ -151,7 +151,7 @@ func TestSafetensors(t *testing.T) {
h = []byte(`{"a":{"dtype":"F32","shape":[3],"data_offsets":[0,4]}}`)
writeFile(t, path, append(binary.LittleEndian.AppendUint64(nil, uint64(len(h))), append(h, 0, 0, 0, 0)...))
if _, err := readSafetensors(path); err == nil {
if _, err := readSafetensors(context.Background(), path); err == nil {
t.Error("shape mismatch accepted")
}
}
@@ -254,7 +254,7 @@ func TestTinyModel(t *testing.T) {
if !Installed(dir) {
t.Fatal("tiny model not installed")
}
m, err := Load(dir)
m, err := Load(context.Background(), dir)
if err != nil {
t.Fatal(err)
}
@@ -284,7 +284,7 @@ func TestTinyModel(t *testing.T) {
if Installed(dir) {
t.Error("incomplete model reported installed")
}
if _, err := Load(dir); err == nil {
if _, err := Load(context.Background(), dir); err == nil {
t.Error("incomplete model loaded")
}
}
@@ -297,7 +297,7 @@ func TestRealModel(t *testing.T) {
if dir == "" {
t.Skip("PLOTZILLA_MT_MODEL not set")
}
m, err := Load(dir)
m, err := Load(context.Background(), dir)
if err != nil {
t.Fatal(err)
}
@@ -315,12 +315,23 @@ func TestRealModel(t *testing.T) {
func TestDownload(t *testing.T) {
content := []byte("model weights")
sum := sha256.Sum256(content)
var requests int
srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
if r.URL.Path == "/missing" {
requests++
switch r.URL.Path {
case "/missing":
http.NotFound(w, r)
return
case "/full": // a server without resume support
w.Write(content)
default:
var off int
if _, err := fmt.Sscanf(r.Header.Get("Range"), "bytes=%d-", &off); err == nil && off > 0 && off < len(content) {
w.WriteHeader(http.StatusPartialContent)
w.Write(content[off:])
return
}
w.Write(content)
}
w.Write(content)
}))
defer srv.Close()
dir := filepath.Join(t.TempDir(), "model")
@@ -334,6 +345,52 @@ func TestDownload(t *testing.T) {
t.Errorf("downloaded %q, progress %d", got, last)
}
// A file already downloaded and verified is skipped.
if err := Download(context.Background(), srv.Client(), dir, []RemoteFile{file}, nil); err != nil {
t.Fatal(err)
}
if requests != 1 {
t.Errorf("a complete file was downloaded again (%d requests)", requests)
}
// An interrupted download resumes its partial file.
resumed := file
resumed.Name, resumed.URL = "r.bin", srv.URL+"/r"
writeFile(t, filepath.Join(dir, ".r.bin.partial"), content[:6])
if err := Download(context.Background(), srv.Client(), dir, []RemoteFile{resumed}, nil); err != nil {
t.Fatal(err)
}
if got, _ := os.ReadFile(filepath.Join(dir, "r.bin")); string(got) != string(content) {
t.Errorf("resumed download = %q", got)
}
// A server that cannot resume answers the whole file: the partial
// download is restarted.
full := file
full.Name, full.URL = "full.bin", srv.URL+"/full"
writeFile(t, filepath.Join(dir, ".full.bin.partial"), content[:6])
if err := Download(context.Background(), srv.Client(), dir, []RemoteFile{full}, nil); err != nil {
t.Fatal(err)
}
if got, _ := os.ReadFile(filepath.Join(dir, "full.bin")); string(got) != string(content) {
t.Errorf("restarted download = %q", got)
}
// A corrupt partial file fails the digest check and is removed: the
// next download starts from scratch.
corrupt := file
corrupt.Name, corrupt.URL = "c.bin", srv.URL+"/c"
writeFile(t, filepath.Join(dir, ".c.bin.partial"), []byte("garbag"))
if err := Download(context.Background(), srv.Client(), dir, []RemoteFile{corrupt}, nil); err == nil {
t.Error("corrupt partial file accepted")
}
if _, err := os.Stat(filepath.Join(dir, ".c.bin.partial")); err == nil {
t.Error("corrupt partial file kept")
}
if err := Download(context.Background(), srv.Client(), dir, []RemoteFile{corrupt}, nil); err != nil {
t.Fatal(err)
}
bad := file
bad.Name, bad.SHA256 = "bad.bin", strings.Repeat("0", 64)
missing := file
@@ -348,8 +405,13 @@ func TestDownload(t *testing.T) {
t.Errorf("%s: a failed download left the file", f.Name)
}
}
entries, _ := os.ReadDir(dir)
if len(entries) != 1 {
t.Errorf("temporary files left: %v", entries)
// Only the interrupted download keeps a partial file, to be resumed.
for _, f := range []RemoteFile{bad, missing} {
if _, err := os.Stat(filepath.Join(dir, "."+f.Name+".partial")); err == nil {
t.Errorf("%s: a failed download left a partial file", f.Name)
}
}
if _, err := os.Stat(filepath.Join(dir, ".short.bin.partial")); err != nil {
t.Error("an interrupted download left no partial file to resume")
}
}
+10 -3
View File
@@ -79,8 +79,12 @@ type Model struct {
activation func(float32) float32
}
// Load reads the model in dir.
func Load(dir string) (*Model, error) {
// Load reads the model in dir. The load can take seconds for a large
// model: it stops early when ctx is cancelled.
func Load(ctx context.Context, dir string) (*Model, error) {
if err := ctx.Err(); err != nil {
return nil, err
}
var cfg config
data, err := os.ReadFile(filepath.Join(dir, "config.json"))
if err != nil {
@@ -130,7 +134,10 @@ func Load(dir string) (*Model, error) {
}
m.unk = m.ids["<unk>"]
tensors, err := readSafetensors(filepath.Join(dir, "model.safetensors"))
if err := ctx.Err(); err != nil {
return nil, err
}
tensors, err := readSafetensors(ctx, filepath.Join(dir, "model.safetensors"))
if err != nil {
return nil, fmt.Errorf("reading model.safetensors: %w", err)
}
+5 -1
View File
@@ -1,6 +1,7 @@
package marian
import (
"context"
"encoding/binary"
"encoding/json"
"fmt"
@@ -27,7 +28,7 @@ type tensorInfo struct {
// little-endian header length, a JSON header, then the raw data) as
// float32. F32 tensors are read straight into their slice: the file is
// large and a second copy would double the memory needed to load it.
func readSafetensors(path string) (map[string]tensor, error) {
func readSafetensors(ctx context.Context, path string) (map[string]tensor, error) {
f, err := os.Open(path)
if err != nil {
return nil, err
@@ -54,6 +55,9 @@ func readSafetensors(path string) (map[string]tensor, error) {
if name == "__metadata__" {
continue
}
if err := ctx.Err(); err != nil {
return nil, err
}
var info tensorInfo
if err := json.Unmarshal(raw, &info); err != nil {
return nil, fmt.Errorf("tensor %s: %w", name, err)
+1 -1
View File
@@ -1,7 +1,7 @@
# Maintainer: Sandro Cazzaniga <sandro@cazzaniga.fr>
pkgname=plotzilla
pkgver=1.2
pkgver=1.4
pkgrel=1
pkgdesc='Screenwriting app for Linux: scripts in the Hollywood standard format, Fountain, FDX and PDF'
arch=('x86_64' 'aarch64')
+114 -34
View File
@@ -3,6 +3,7 @@ package main
import (
"context"
"errors"
"fmt"
"net/http"
"os"
"path/filepath"
@@ -28,8 +29,14 @@ const (
// modelIdle is how long the model (300 MB of memory) stays loaded
// after a translation, ready for the next one.
modelIdle = 5 * time.Minute
// stallTimeout is how long a download may go without receiving a byte
// (or its response headers) before it is aborted as stalled.
stallTimeout = 30 * time.Second
)
// errStalled aborts a download that receives nothing for stallTimeout.
var errStalled = errors.New("the download stalled (no data received for 30 seconds)")
var modelFiles = []marian.RemoteFile{
{Name: "config.json", Size: 1416, SHA256: "b3be13d046d9899d7aab8cf4ed624d9a79f5776038ba793f6b4d2ce3e02192f7"},
{Name: "source.spm", Size: 802397, SHA256: "78d0e717c77053f1c4b856d8661d9cb87c64f083a35418c087b9146300e4f585"},
@@ -46,6 +53,7 @@ type translation struct {
lexicon translate.Lexicon
release *time.Timer
cancel context.CancelFunc
done chan struct{} // closed when the running task is over
}
// TranslationStatus says whether the model is installed, and how much a
@@ -72,15 +80,29 @@ func modelDirs() []string {
return dirs
}
// installedModel returns the first model directory holding every file at
// its pinned size. Checking the digests would mean reading 300 MB on
// every call; the sizes catch truncated or stale files, and the digests
// were checked when the files were downloaded.
func installedModel() string {
for _, d := range modelDirs() {
if marian.Installed(d) {
if modelComplete(d) {
return d
}
}
return ""
}
func modelComplete(dir string) bool {
for _, f := range modelFiles {
st, err := os.Stat(filepath.Join(dir, f.Name))
if err != nil || st.Size() != f.Size {
return false
}
}
return true
}
func (a *App) TranslationStatus() TranslationStatus {
var size int64
for _, f := range modelFiles {
@@ -94,10 +116,11 @@ func (a *App) startTask() (context.Context, error) {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
if a.tr.cancel != nil {
return nil, errors.New("a translation is already running")
return nil, errors.New("a translation task is already running")
}
ctx, cancel := context.WithCancel(a.ctx)
a.tr.cancel = cancel
a.tr.done = make(chan struct{})
return ctx, nil
}
@@ -107,16 +130,22 @@ func (a *App) endTask() {
if a.tr.cancel != nil {
a.tr.cancel()
a.tr.cancel = nil
close(a.tr.done)
a.tr.done = nil
}
}
// CancelTranslation stops the running download or translation.
// CancelTranslation stops the running download or translation, waiting
// for it to wind down so that a new task can start right away.
func (a *App) CancelTranslation() {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
if a.tr.cancel != nil {
a.tr.cancel()
cancel, done := a.tr.cancel, a.tr.done
a.tr.mu.Unlock()
if cancel == nil {
return
}
cancel()
<-done
}
// progressEmitter sends "translation-progress" events, at most every
@@ -136,8 +165,12 @@ func (a *App) progressEmitter() func(done, total int64) {
}
// DownloadTranslationModel downloads the model into the user's data
// directory. It returns false if the user cancelled.
// directory. An interrupted download resumes where it stopped. It returns
// false if the user cancelled.
func (a *App) DownloadTranslationModel() (bool, error) {
if installedModel() != "" {
return true, nil
}
ctx, err := a.startTask()
if err != nil {
return false, err
@@ -148,11 +181,30 @@ func (a *App) DownloadTranslationModel() (bool, error) {
f.URL = modelURL + f.Name
files[i] = f
}
err = marian.Download(ctx, &http.Client{}, modelDirs()[0], files, a.progressEmitter())
if errors.Is(err, context.Canceled) {
return false, nil
// No total timeout (300 MB can take a while) but abort a stalled
// transfer: the watchdog is reset by every progress report.
ctx, stop := context.WithCancelCause(ctx)
defer stop(nil)
emit := a.progressEmitter()
stalled := time.AfterFunc(stallTimeout, func() { stop(errStalled) })
defer stalled.Stop()
transport := http.DefaultTransport.(*http.Transport).Clone()
transport.ResponseHeaderTimeout = stallTimeout
client := &http.Client{Transport: transport}
err = marian.Download(ctx, client, modelDirs()[0], files, func(done, total int64) {
stalled.Reset(stallTimeout)
emit(done, total)
})
if err != nil {
if errors.Is(context.Cause(ctx), errStalled) {
return false, errStalled
}
if errors.Is(err, context.Canceled) {
return false, nil
}
return false, err
}
return err == nil, err
return true, nil
}
// Translate translates the French text of the elements (flat indexes; all
@@ -164,8 +216,14 @@ func (a *App) Translate(doc screenplay.Document, elements []int, titlePage bool)
return nil, err
}
defer a.endTask()
if installedModel() == "" {
return nil, errors.New("the translation model is not installed")
}
wails.EventsEmit(a.ctx, "translation-progress", 0, 0) // loading
model, lexicon, err := a.translator()
model, lexicon, err := a.translator(ctx)
if errors.Is(err, context.Canceled) {
return nil, nil
}
if err != nil {
return nil, err
}
@@ -189,38 +247,60 @@ func (a *App) Translate(doc screenplay.Document, elements []int, titlePage bool)
}
// translator returns the model and the dictionaries that help tell French
// from English, loading them the first time.
func (a *App) translator() (*marian.Model, translate.Lexicon, error) {
// from English, loading them the first time. The load happens without
// a.tr.mu: reading 300 MB takes seconds, and CancelTranslation must stay
// responsive.
func (a *App) translator(ctx context.Context) (*marian.Model, translate.Lexicon, error) {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
if a.tr.release != nil {
a.tr.release.Stop()
}
if a.tr.model == nil {
dir := installedModel()
if dir == "" {
return nil, nil, errors.New("the translation model is not installed")
}
m, err := marian.Load(dir)
if err != nil {
return nil, nil, err
}
a.tr.model = m
a.tr.lexicon = loadLexicon()
model, lexicon := a.tr.model, a.tr.lexicon
a.tr.mu.Unlock()
if model != nil {
return model, lexicon, nil
}
return a.tr.model, a.tr.lexicon, nil
dir := installedModel()
if dir == "" {
return nil, nil, errors.New("the translation model is not installed")
}
m, err := marian.Load(ctx, dir)
if err != nil {
if ctx.Err() != nil {
return nil, nil, ctx.Err()
}
return nil, nil, fmt.Errorf("loading the translation model: %w", err)
}
lexicon = loadLexicon()
a.tr.mu.Lock()
if ctx.Err() == nil { // cancelled while loading: cache nothing
a.tr.model, a.tr.lexicon = m, lexicon
}
a.tr.mu.Unlock()
if err := ctx.Err(); err != nil {
return nil, nil, err
}
return m, lexicon, nil
}
// releaseLater frees the model once it has been unused for modelIdle.
func (a *App) releaseLater() {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
a.tr.release = time.AfterFunc(modelIdle, func() {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
if a.tr.cancel == nil {
a.tr.model, a.tr.lexicon = nil, nil
}
})
a.tr.release = time.AfterFunc(modelIdle, a.releaseModel)
}
// releaseModel frees the model when no task is running. When one is (a
// download loads nothing but holds the task slot), it tries again after
// another modelIdle.
func (a *App) releaseModel() {
a.tr.mu.Lock()
defer a.tr.mu.Unlock()
if a.tr.cancel != nil {
a.tr.release = time.AfterFunc(modelIdle, a.releaseModel)
return
}
a.tr.model, a.tr.lexicon = nil, nil
}
// lexicon tells French words from English ones with the installed