METHODOLOGY / VERSION 1.0
How we test
A reproducible process before a publishable verdict.
By Christopher Brown · Last updated
This is our protocol, version 1.0. Four tools have completed it on the same three sources: Klap, Pictory, Opus Clip and Vugola (see the results table). Descript is a partial sample. Captions has clip grades but no overall score. Every other tool on this site is a documentation check, labeled as such. Provisional scores come from a single tester and one round per tool, on a 100-point scale; they will change as more runs are added and are not a stable industry ranking.
About the tester, Christopher Brown
What a Scrutator page gives you
What you get
- Independent pages about AI video clipping tools. Scrutator is not affiliated with, endorsed by or sponsored by the companies whose tools we cover, and vendors do not set our conclusions.
- A label on each research page for what kind of work it is: a documentation check of the vendor’s public pages on a stated date, or a hands-on test of what the tool produced on our videos.
- Hands-on tests with screenshots so far for Opus Clip, Vugola, Klap, Captions, Pictory and Descript. A score appears only when that page has a run record. Scores are provisional: one tester, one round per tool, and the page says which scores can be compared.
- On a tested page, clips logged as accepted, repairable or rejected, with caption errors, repair time and what the job charged.
- Prices copied from the vendor’s own page, with the date we checked them. When the vendor page does not state a fact, the page says unverified instead of guessing.
Not included
- A hands-on score for a tool we have not run. A documentation check is not a completed test.
- A promise that a price, plan, credit limit or free-tier rule is still current. Confirm it on the vendor’s site before you buy or subscribe.
- Legal, financial or professional advice, or a replacement for a trial on your own footage.
- Affiliate links. We do not use them. If a page ever contains one, that page will say so.
- Coverage or a score given in exchange for payment or a free plan.
- Star ratings. The plan named on a hands-on page is the plan that run used.
One source set, two kinds of work
Use three rights-cleared English videos: a single-speaker tutorial, a two-speaker interview, and a screen-sharing demonstration. Record each source’s duration, resolution, frame rate, transcript, license, and file hash. Submit the same files and settings to each tool. Run each source twice to expose variability; label reruns and their charges separately.
Define an accepted clip before seeing results
A usable clip must communicate a complete idea, preserve meaning, keep the relevant speaker or demonstration visible, and have no blocking export or caption defect. Record accepted, repairable, and rejected outputs separately. Count repair time; do not silently discard failures.
What the run record must contain
Save source ID, settings, plan, start and completion timestamps, job ID, credits before and after, refunds, output count, accepted count, export resolution, codec, frame rate, and caption errors. Retain original exports and redacted screenshots. Product screenshots appear only for tools we have actually run.
Our score, out of 100
| Dimension | Weight | Evidence | How it was scored |
|---|---|---|---|
| Clip quality | 30% | Coherent opening, complete idea, clean ending, and correct framing. | Accepted 10; repairable 8, 6, 4 or 2 as the fix grows (up to 2, 3–5, 6–10, over 10 min); rejected 0 |
| Caption accuracy | 20% | Word error rate against a manually checked transcript. | 10 − 5 × error rate in %, minus 1 for a visible placement problem |
| Automation | 20% | Completion, recovery, and verified delivery in the intended workflow. | Share of clips with a complete idea, clean start and end, meaning kept and subject in frame, without help |
| Value | 20% | Subscription cost and repair time per accepted clip. | Cost per usable and per accepted clip, banded from $0.10 or less (10) to over $2 or none accepted (0) |
| Usability | 10% | Time and interventions needed to reach an acceptable export. | Seven-item checklist from the run log, from defaults to credit transparency |
Final score = sum of each dimension’s 0–10 score × its weight ÷ 10. Every dimension needs a published rationale and evidence. A missing dimension means no overall score, not a zero or an invented average.
Cost that reflects a real workflow
Report both allocated credit cost and actual cash cost per accepted clip. Include unused subscription capacity, repeated jobs, and editing labor. Never compare credits between vendors as though they were a shared unit.
Limits of our results
One tester graded every clip, applying the same written rules. Each tool has had one round of tests, so a second round could move any score. Repair minutes are estimates, not stopwatch times for every clip. Only tools labeled “Full protocol (comparable)” can be ranked against each other; “Partial sample” (Descript) and “Clip grades, no overall score” (Captions) cannot.
Editorial independence & corrections
Scrutator is an independent research project. Product vendors do not set the score. Vendor statements, our calculations, and observed results are labeled distinctly. Corrections must retain a dated record of what changed and why.
Found a mistake? Email support@scrutator.ai or use the contact page with the page and what is wrong. We check it against the source, fix the page and add a dated correction note; earlier figures stay on record instead of being silently replaced.
How we test AI clipping tools, step by step
When we test AI clipping tools, the order matters more than any single step. First we write down what a usable clip is. Then we pick the sources and freeze the settings. Only then do we run the tools, collect every output, and score them against the definition we wrote before seeing a single clip. Doing it in that order stops a tool’s best clip from quietly redefining what “good” means.
- Define the clip. A complete idea, meaning preserved, the right speaker or screen visible, no blocking caption or export defect.
- Fix the sources. The same three rights-cleared videos for every tool, with file hashes recorded.
- Fix the settings. Same plan level where possible, default clip length unless the vendor recommends otherwise, and the same aspect ratio.
- Run twice. Each source goes through each tool twice, so variability is visible rather than hidden.
- Grade every output. Accepted, repairable or rejected, with repair minutes estimated for each repairable clip.
- Cost it. Credits and cash per accepted clip, including reruns.
Documentation checks versus tests
Most pages on Scrutator are documentation checks, not tests. A documentation check reads the vendor’s own pricing page, help center and terms on a stated date and reports what they say. It answers “what does this AI clipping tool promise, and what does it cost?” A test answers “what did it actually produce on our videos?” Each page says which kind it is in a notice near the top, and no page gives a score without a test behind it. Pricing pages such as Opus Clip pricing and the AI video pricing tracker are documentation checks with a checked date on every figure.
How we handle prices and unverified claims
Prices change often, so every price carries the date we read it and a link to the vendor page. When a vendor page does not state something, such as the export resolution on a free plan or the price of a top-up, we write “unverified” instead of filling the gap with a guess or a third-party figure. When two vendor sources disagree, we report both. When a vendor page changes, we update the figure and the checked date rather than keeping an old number.
What we will not do when we test AI clipping tools
- Accept payment or free plans in exchange for coverage or a score.
- Use affiliate links.
- Publish a score from a vendor’s demo reel instead of our own sources.
- Compare credits between vendors as if they were the same unit.
- Publish fabricated star ratings or review schema.
Where the protocol is applied
The same rules govern every research file: the Opus Clip review, the Opus Clip pricing breakdown, the Opus Clip alternatives comparison and the Vugola AI review. Published prices are labeled with the date we checked them and a link to the vendor page; anything we could not confirm is described as unverified rather than estimated.
Browse the research ↗