Tools

The arithmetic, on your numbers.

Each of these settles in about a minute something teams argue about for a quarter. They span the whole lifecycle and the whole stack, because the number that decides a program is rarely in the layer everyone is looking at. No sign-up, no wall, and nothing you type leaves your browser.

Filter by layer, model to metal
Filter by industry
30 tools, all free, all running in your browser.

Diagnose

7 tools

Find out what is actually wrong before committing to a fix. These settle in an afternoon what teams argue about for a quarter.

Diligence
What will an acquirer find in your verification?

Twelve controls, each weighted by how expensive its absence has proven and mapped to the public report it corresponds to. A control that exists but has never been watched failing scores half, because to somebody doing diligence that is exactly what it is worth.

Answers: Before a raise or an acquisition, where is our verification thin?
ApplicationFirmwareDistributed systems
Silent failures
How often does a default get returned?

Fallback paths return a value and a success status, so latency and error rate look fine while the model appears to have produced a wrong answer from a default it was handed. This estimates the rate from your timeout and latency percentiles, before anybody writes the counter.

Answers: Behind a 2 second timeout with two retries, how many requests fall back?
ApplicationDistributed systems
Retrieval
Your recall is your ceiling

If the passage carrying the answer is never retrieved, no prompt, model or reranker recovers it. This computes the hard cap recall puts on end-to-end accuracy, splits your failures into the two halves that need different fixes, and shows how much is reachable by reranking alone.

Answers: At 72 percent recall, what can a perfect model actually deliver?
The modelPipelines
Program structure
How many boundaries, and who owns them?

Cross-team failures live between components rather than inside them. This counts the seams in your program, measures how many are documented, owned and instrumented, and shows what the next specialist would add to the surface.

Answers: Six parties in a program: how many boundaries is that?
ApplicationDistributed systems
Evaluation
Your effective n is groups, not rows

Once you hold out whole speakers, sites or devices, the confidence interval on your headline number is computed on how many of those you held out. This shows both intervals side by side, how many groups a target precision needs, and what reporting slices does to the arithmetic.

Answers: 40,000 rows from 12 speakers: how wide is the real interval?
PipelinesThe model
Agent reliability
What your per-step number actually delivers

Reliability multiplies across steps, so a chain of individually good steps is a bad system. Enter your steps and per-step reliability to get the end-to-end figure, the per-step number your target really requires, and what a tree of individually capped runs can cost.

Answers: At 95 percent per step, what does a 20-step task deliver?
ApplicationThe model
Evaluation
Can your test set detect a shortcut?

A random split measures how much your test data resembles your training data. Enter your row count, group count and the largest source's share to see what that split does with it, and what your effective sample size really is once you split by group.

Answers: If one speaker is 70 percent of the data, what does a random split prove?
Pipelines

Architect

8 tools

Decide before the money is spent. Every one of these answers a question that is cheap now and a rebuild later.

Retries and timeouts
Do your nested timeouts actually work?

Timeouts must decrease inward and retry counts multiply, so a stack where every layer looks reasonable on its own can be one where almost none of the configured attempts can finish. Those attempts still reach the dependency and still consume its capacity.

Answers: Four layers, eighteen attempts: how many can actually complete?
Distributed systemsApplication
Control loops
Does your model fit inside the loop?

Existing Modbus calculators do serial frame timing. This does the whole deadline: the protocol read, the controller scan counted twice, preprocessing, inference, the write back, and what other masters on the link do to all of it. Returns the inference budget you actually have.

Answers: At 19200 baud with a 10 ms scan, how much time is left for inference?
ProtocolsSiliconApplication
Irreversible actions
How long must the keys live?

Retry counts multiply rather than add, and the retry that causes the duplicate charge usually arrives on Monday morning from a person rather than on Tuesday afternoon from a library. This works out your worst-case attempt count and the deduplication window that actually covers it.

Answers: Three retry layers of three: how many attempts, and how long a window?
Distributed systemsApplication
Biosignal front end
Your CMRR is not the datasheet figure

The electrodes and the input impedance form a divider, and any mismatch between them converts common-mode interference into a differential signal before the amplifier has a say. This computes your effective rejection and shows which of the two terms is actually limiting the recording.

Answers: What does a 5 kohm electrode mismatch do to a 110 dB amplifier?
Signal processingSilicon
Agent reliability
What does the tree actually spend?

Bounding one agent bounds nothing about a tree of them. This simulates fifteen hundred tasks over your branching factor, depth, latency and retry policy, and returns spend and wall clock as distributions rather than a worst case nobody can plan against.

Answers: At 70 percent spawn rate and depth four, what is the p99 spend?
ApplicationDistributed systems
Fleet platforms
Can you poll the fleet without breaking it?

A baseboard controller supports four to eight sessions and stops responding rather than queueing, so naive fan-out degrades the thing it monitors and more workers make it arrive sooner. This checks feasibility against the per-node limit and tells you how long a dark node stays invisible.

Answers: Can 64 workers poll 25,000 nodes every five minutes?
ProtocolsDistributed systemsDrivers
Edge and latency
Is your latency bytes, or arithmetic?

On fixed hardware the cost of running a model is moving weights and activations across a bus, not doing math. Enter your model size, precision and bandwidth to get the memory-bound floor, how much of your measured latency it explains, and how much silicon is sitting idle.

Answers: Does 7B at 8-bit fit a 40 ms budget at 200 GB/s?
The modelSilicon
Biosignal front end
Can your reference amplifier survive its own actuator?

The current you inject is a loop, and it comes home through the electrode you added to protect your front end. One multiplication and one comparison tell you whether the amplifier can absorb it or rails and takes your signal with it.

Answers: Does 0.8 microamps through 1.2 megohms clear a single-supply rail?
Signal processingSilicon

Build

5 tools

While it is being built: what to integrate first, what the bench does not reproduce, and where the schedule actually goes.

Validation
How much of the field does your bench reproduce?

Coverage multiplies rather than averages, so six conditions each covered eighty percent of the time is a bench that reproduces the field twenty-six percent of the time. No single row in that list looks like a problem, which is why nobody ever computes the product.

Answers: Six conditions, none of them terrible: what does the bench actually cover?
Signal processingFirmwareApplicationDrivers
Programme
How much of your schedule is waiting?

Plans are written in effort and delivered in elapsed time, and the gap is queues you do not control: site access, a data extract, a change-control board, a vendor release train. Waiting does not divide by headcount, which is why the standard remedy fails so reliably.

Answers: Seventy-five person-days of work: why is the date four months out?
ApplicationPipelinesDistributed systems
Sequencing
Which seam should you integrate first?

Programmes start with the easy seam because it produces a demo, and reach the one nobody understands in the last month, when there is no schedule left to absorb what it says. Ordering by information per day changes when the surprise arrives.

Answers: Six seams and a twenty day horizon: which one first?
ApplicationDistributed systemsFirmware
Interfaces
What does each side think crosses the boundary?

Both teams fill in the same thirteen properties separately, without conferring, and the tool diffs them. Ranked by how each mismatch fails rather than by importance, because a units error returns a plausible number while an encoding error throws on the first message.

Answers: Units, byte order, who retries: do both sides actually agree?
ApplicationProtocolsDistributed systems
Protocols
What do your devices actually do?

A standard is a starting point; what is on your estate is a vendor's implementation of it. Record observed behaviour per controller family, firmware revision and call, and see what share of the fleet runs a combination nobody has exercised. Includes a reference table of the divergences that recur.

Answers: How much of a 24,000 unit estate is on an untested firmware combination?
ProtocolsDriversFirmware

Harden

7 tools

It runs in the lab. These are for closing the distance to the field: failure modes, degradation, margin.

Verification
The MC/DC test cases, with the reason for each one

Enter a boolean decision and get the minimal test set showing every condition independently affecting the outcome, with the independence pair printed for each so it can be checked by hand. It also flags conditions no test set can show matter, which is a defect in the expression rather than a gap in the tests.

Answers: How many tests does MC/DC need on this decision, and which ones?
ApplicationFirmwareDrivers
Verification
Both suites say 100 percent. Only one is evidence.

Branch coverage and MC/DC each report full coverage of their own criterion on the same decision. This injects a deliberate fault at a time and shows which one notices. On one four condition decision, branch coverage reports 100 percent and catches none of nineteen injected faults.

Answers: My branch coverage is 100 percent. What does that actually catch?
ApplicationThe modelFirmware
Reliability
What is your burn-in actually removing?

Burn-in durations are chosen by convention and defended by habit. What a duration removes depends entirely on the shape of the hazard curve, and on a memoryless one it removes exactly nothing, at any duration, while still costing chamber time and consumed life.

Answers: Forty-eight hours of burn-in: how many field failures does that remove?
FirmwareSiliconDrivers
Graceful degradation
What does your system turn off first?

Under pressure every system sheds something, and without a planned order it sheds whatever contention reaches first. Contention does not know which capability is safety-critical, and a monitor consuming three percent of the budget starves in the same queue as a report nobody reads.

Answers: At 60% capacity, what should stay running and what comes off?
ApplicationDistributed systemsFirmware
Failure modes
What detects each failure, and how fast?

Full FMEA is heavyweight enough that software teams skip it, so the failures nothing watches for stay undiscovered until one happens. This is the twenty-minute version, scoring the two things a risk register leaves out: how long detection takes, and whether the safe state is enforced below the layer that fails.

Answers: Which failure carries the most exposure, and what is the cheapest detector to add?
ApplicationDistributed systems
Pricing and money
Does your engine return the same money as the spreadsheet?

Four implementations of round to two decimal places disagree on ordinary values, and the disagreement is one unit in the last place, which is exactly the size that survives review and fails an audit. Paste the values your engine actually sees and find the ones where they part company.

Answers: Which of your values round differently in code than they do in the workbook?
ApplicationPipelines
Agent reliability
Two limits, or one protection twice?

A hung call does zero iterations, so the counter freezes and can never fire. A spin does iterations and goes nowhere, so only the counter catches it. This sizes both from your own traces and finds the edge you have left uncovered.

Answers: Does my timeout actually catch a hang, or only a spin?
Application

Operate

3 tools

Launch is not the finish line. Systems drift, fleets grow, inputs change, and these are the numbers that track it.