Can Jarvis Translate a Foreign-Language App Interface on My Screen?

Yes. Jarvis (getjarvis.eu) can read a foreign-language UI on your screen and translate it for you. Press Cmd+/ on macOS or Ctrl+/ on Windows to open the floating bar, then ask "what does this screen say in English?" Jarvis captures the visible window, recognizes the on-screen text in languages like German, Japanese, French, Spanish, or Chinese, and translates the menus, buttons, dialogs, and labels. This is useful when you're stuck in a foreign-language installer, a banking portal, or an error dialog you can't read. Because Jarvis reads rendered pixels with vision models (Claude frontier models from Anthropic, OpenAI, and Google), it works even in apps with no language setting. It can also tell you which button to click to proceed. Jarvis is a screen-aware desktop assistant; free to start, then $16/month. Screenshots are never used to train any model.

Translating individual words is easy; knowing what to do with a foreign screen is the hard part. Jarvis does both. Show it a Japanese settings panel and ask "where do I turn off notifications?" and it translates the relevant labels and points to the specific toggle. For an unfamiliar checkout flow in French, it can tell you which field is the postal code and which button confirms payment. It preserves layout context, so "the red button bottom-right says Delete" is far more actionable than a flat word list. This makes Jarvis genuinely useful for travel, localized software, and cross-border work.

Traditional translation means selecting text and pasting it into Google Translate or DeepL, which fails when the text isn't selectable: image-based menus, canvas-rendered apps, locked installers, or screenshots a colleague sent you. Jarvis reads the pixels, so selectability doesn't matter. It also keeps surrounding visual cues that a paste loses, like which warning icon sits next to which sentence. You stay in the original app the whole time, summoning Jarvis with one hotkey and dismissing it when done, rather than juggling a browser tab.

Screen-aware AI