Wals Roberta Sets 136zip Fix Jun 2026

The fix explicitly handles the <zip> special token (used in WALS to denote compressed contexts) to ensure it is not conflated with standard text tokens, preventing it from being interpreted as a malformed Unicode character.

import sys sys.path.append('./wals_module') # fix import error wals roberta sets 136zip fix

The 136zip fix involves the following steps: The fix explicitly handles the &lt;zip&gt; special token