Apertus 8B is the reader. A sheaf head sits on its hidden states. A note and a closed question go in. The head returns a choice, a yes or no, or a score. It does not write an open answer.

The training notes are published datasets that already carry their own label: intents, topics, reviews, entailment, and the Federal Supreme Court tasks. A row stays only when that label still matches the stored text. Copies are removed, and one source cannot fill the file.

The court rulings are also a project of their own, Apertus Court Decisions, trained only on those rulings. This page is the general decision model, trained on the larger pack. The 8B stays frozen. The sheaf head is what gets trained. The 70B does not fit this machine. The head is not trained yet.

Built With

Share this project:

Updates

posted an update —

Two projects, Swiss smoke test

This page is the general decision model. Apertus Court Decisions stays the narrow case and trains only on the Swiss rulings.

The Swiss train file has 63,328 original-language rows: 53,474 judgments (dismissed or approved) and 9,854 legal-area cases (13 sub-areas). A smoke step ran on one batch of each. Both losses were finite and the head weights moved.

The 8B weights are gated. Hugging Face is not logged in on this machine, so the smoke reader was a small stand-in with the same head interface. The real Apertus forward waits on that login and on the swiss-ai transformers branch.

Submission history