Testing gemini-4-neon with a DIY PowerShell agent harness: "benchmarks are for tourists"

dfinke · x · 2026-11-19

Developer dfinke says Google just dropped gemini-4-neon (unverified) and argues the best way to test a new model is pointing your own tools at it — "Benchmarks are for tourists." His PSAISuite PowerShell module offers a one-cmdlet harness: New-AgentHarness takes a model, tools, and a prompt. A screenshot shows gemini-4-neon correctly enumerating and summarizing 8 PowerShell tool scripts (system info, text processing) and even noticing fib.ps1 wasn't registered in tools.json. Install: Install-Module PSAISuite.

Original post →

More from coding & agent

coding & agent channel →