natively cluely ai assistant

The Problem

You’re in a meeting, interview, or live call and need instant help—summaries, context, follow-ups—without tipping anyone off that you’re using an AI. Most tools are either bulky, cloud-dependent, or straight-up violate your privacy. Screen shares and recordings make your “assistant” obvious, which is not ideal if you want to keep your edge (or just not look like a robot).

What This Does

natively-cluely-ai-assistant is a desktop AI sidekick that stays invisible and runs locally. It hooks into your mic and screen using files like electron/audio/MicrophoneCapture.ts and electron/ScreenshotHelper.ts, grabs context, and feeds it to your chosen LLM (local via Ollama or BYOK for Gemini). Everything is handled on your machine—check out electron/LLMHelper.ts for the actual prompt/response magic, and electron/IntelligenceManager.ts for orchestration. Privacy isn’t just a checkbox; the repo literally won’t work without your own Google STT credentials (see .env.example). No telemetry, no shady uploads.

The UI is always-on-top but invisible during screen shares and recordings. That’s handled by electron/WindowHelper.ts and some clever window flagging. Global shortcuts (see electron/SettingsWindowHelper.ts) mean you can summon magic in any app—PowerPoint, Zoom, whatever.

Real-World Use

Say you’re in a technical interview on Zoom. You hit your shortcut, and Natively grabs your mic audio (MicrophoneCapture.ts), transcribes it locally (GoogleSTT.ts), and analyzes the question. Then it generates a succinct answer or a follow-up prompt using your local Ollama model (no cloud unless you opt-in). No one sees a floating window, no popups in your recording—just context-aware help piped straight to your clipboard or text box.

// Example: Grab audio, transcribe, get reply const audio = await MicrophoneCapture.start(); const transcript = await GoogleSTT.transcribe(audio); const reply = await LLMHelper.generate(transcript, screenshotContext);

The Bottom Line

If you want privacy-first, instant AI help during calls—without exposing yourself or your data—this is what you’re looking for. Setup’s a bit annoying (Google Cloud keys, Rust for audio), but you’re trading convenience for actual privacy. Not for casual users, but if you care about local control and undetectable help, Natively delivers.