Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased]

Added

• Initial release of pretok
• Core pipeline for text adaptation
• Language detection module with FastText and langdetect backends
• Model capability registry
• Segment processing for prompt structure preservation
• Translation engine with NLLB, M2M100, OpenAI, Google, and DeepL backends
• Translation caching with memory, Redis, and SQLite backends
• Comprehensive configuration system
• Full documentation

Changed

• Nothing yet

Deprecated

• Nothing yet

Removed

• Nothing yet

Fixed

• Nothing yet

Security

• Nothing yet