Sumit Sharma
Open source tools I build and release publicly, newest first.
Tools
Deterministic drift detection for LLM APIs. Runs a fixed, human-written set of test questions against a pinned model version and flags the moment an answer changes from the approved baseline, so a vendor silently swapping the model behind a stable API name doesn't go unnoticed.
MIT · Python · pip install idem-check
