Point and Yap

Point and Yap is a free, open-source Mac app: press Control twice, point at things on screen and talk, and each recording becomes a queued item (your words, the element under the cursor and a cropped screenshot) that Claude Code, Codex or Cursor pick up over MCP and fix.

Why it matters

For anyone building an app or website with a coding agent who finds it slow to describe visual problems in text. You show the agent what's wrong by pointing and talking, and it gets the exact element and a screenshot.

Highlights

• Press Control twice to start and stop; a small recording pill stays on top and is never captured in the screenshots. Esc cancels a recording.
• Each recording stores what you said, the UI element under the cursor (role, label, window, app) and cropped screenshots in a local queue.
• A local MCP server offers get_open_items, mark_done, release_items and session tools; it can connect itself to Claude Code, Codex and Cursor after asking, backing up each config first.
• Speech is transcribed by Apple's on-device model; there is no account, server or analytics, and the app only goes online to check for updates.
• Items show as To fix, In progress (by which agent) or Done, and an unfinished item returns to the queue after two hours.

Taken from the project's own README, docs or launch page. Claims about speed or accuracy are the maker's unless stated otherwise.

Worth knowing: It needs Microphone, Screen Recording and Accessibility permissions. Your words and screenshots stay on your Mac until your coding agent reads them, at which point they go to whatever AI model that agent uses. Very new project (first release Oct 18, 2026).

Quick facts

Links

• Official site: https://pointandyap.com/
• Repository: https://github.com/mfmaur/pointandyap
• Release notes: https://github.com/mfmaur/pointandyap/releases

Related ranking

See how established tools compare in Best AI Coding Tools for Developers. New releases aren't scored until we review them against the rubric.

Checked 2026-10-19 from the tool's own pages. Prices and star counts change, so confirm on the official site. Listing here is not a ranking or an endorsement.