Industrial AutomationField engagement

Adaptive control on a machine that cannot be taken out of service, where the only test environment is the running equipment.

Control systems lead.
live
PLC, in service
Modbus TCP
over an industrial VPN
no
model in the system
setpoint hold as the operating point moves
adaptive law, holds across the rangefixed gain, drifts as load and wear move the plant
What was at stake

A hydraulic top-drive system in active service. The equipment earns while it runs, so it cannot be taken offline to suit an engineering schedule, and no test rig exists that behaves like it. Whatever gets written has to be correct against the real machine the first time it touches it. That is a different discipline from most software work. There is no staging environment and no safe window for rolling back, and the feedback loop for a mistake runs through several tonnes of moving hydraulic machinery.

How this works

A controller is a loop that keeps correcting a machine, and it only corrects well for the machine it was tuned on.

A control loop does one thing over and over. It measures what the machine is doing, compares that with what the machine should be doing, called the setpoint, and adjusts an output to close the gap. Then it measures again. A thermostat is the simplest example: too cold, open the valve, check again. In hydraulic equipment the same loop runs quickly, driving valves that move fluid under pressure to hold a speed, a position or a force.

The most common controller, PID, decides how hard to push from three views of the error: how large it is now, how long it has persisted, and how fast it is changing. Each view has a weight, called a gain, and choosing the gains is called tuning. Tuning is done against a particular machine in a particular state. Push too gently and the machine wanders away from its setpoint. Push too hard and it overshoots and oscillates, and on hydraulic equipment oscillation means wear, noise and stress on every component in the loop.

The trouble is that the machine does not stay in the state it was tuned in. Load changes what the controller is pushing against. Hydraulic fluid behaves differently as it warms. Seals and valves wear. Each of these changes how strongly the machine responds to the same push, so gains that were right at commissioning become too gentle in some conditions and too aggressive in others. Gain scheduling is the standard engineering answer. The controller keeps a set of tunings, recognises which operating regime it is in, and uses the tuning that fits, with limits on how far and how fast it may change. The idea is simple. The difficulty lies in choosing the regimes, bounding the transitions and showing that the result is safe, and that is where the engineering effort goes.

Measure the machine
read from the controller over Modbus TCP
Compare with the setpoint
how far off, for how long, how fast
Compute the correction
the gains decide how hard to push
Drive the hydraulics
valves move fluid under pressure
Machine responds
and the loop measures again
Load, temperature and wear change how the machine responds, so the same correction does not stay correct.
FigureOne turn of a feedback control loop on this machine. Every step repeats on a fixed deadline, and both the measurement and the command cross an industrial protocol link to reach the controller. The gains decide how hard the correction pushes, and they are only right for the conditions they were tuned in.
The constraint

A controller with fixed gains is tuned at one operating point. Load, temperature and wear then move the machine away from that point, and a live machine never sits still. The controller does not fail loudly when this happens. It simply holds the setpoint less well, in conditions nobody is watching. Two more constraints bind beneath the control law. The loop deadline is part of the specification, and the protocol round trip to the PLC happens inside it. And the controller behaves according to how it actually implements Modbus, which is not always how the standard describes it, and that can only be discovered against this controller.

one loop, inside its deadline
38%
22%
16%
24%
Modbus round-trip to the PLC38%
estimate and adapt22%
write and verify16%
reserved headroom24%
deadline edge
A control loop that meets its deadline on average and misses it occasionally is a control loop that does the wrong thing occasionally. The round-trip is measured against this controller rather than taken from the standard, and the headroom is reserved rather than left over.
Where it usually breaks

Control loops on live equipment fail slowly, and at their edges.

A fixed-gain controller almost never fails dramatically. It degrades. As load, temperature and wear move the machine away from its commissioning point, the loop holds its setpoint a little less tightly, overshoots a little more, settles a little later. Nothing alarms, because the controller is still working. It is working worse, in conditions that nobody has instrumented, and by the time anyone notices, the machine has been out of specification for some while.

The other failures live at the edges of the design. A loop that depends on a network round trip can miss its deadline when that round trip stretches, and a late correction is a wrong correction. A device that implements its industrial protocol differently from the standard behaves unexpectedly in exactly the cases the standard covers least. And an adaptive controller with no bounds can adapt itself into instability, which on several tonnes of hydraulic machinery is far worse than the drift it was meant to fix.

01

The silent drift

Fixed gains tuned at one operating point slowly lose their grip as the machine changes. Setpoint hold degrades with no alarm and no obvious cause.

02

The late correction

The loop deadline is missed because a protocol round trip took longer than assumed. A correction that arrives late is applied to a machine that has already moved on.

03

The standard that was not followed

The controller implements its protocol in its own way. Code written to the specification behaves correctly on paper and unexpectedly on the machine.

04

The runaway adaptation

An adaptive law with no limits chases a disturbance into oscillation. The fix becomes the fault.

05

The change with no way back

New control code reaches live equipment with no fallback. When it misbehaves, the only remaining option is to stop a machine that cannot be stopped.

Gains tuned at commissioning
right for one load, one temperature, new parts
Load changes
the machine pushes back differently
Fluid warms up
the hydraulics respond differently
Components wear
the response shifts again
The failure point
Setpoint hold degrades, and nothing alarms
the controller is still running, only worse
Each change on its own is ordinary operation.
Together they move the machine away from the point its fixed gains were chosen for.
FigureWhy a fixed-gain controller drifts out of specification on a live machine. Nothing breaks. The machine simply stops being the machine the gains were tuned for, and the loop's correction becomes too weak in some conditions and too strong in others.
The fork

The reflex, and the fix.

Road not taken

A fixed-gain PID

Pull

Faster to deploy, well understood, and fine in a demonstration.

Why not

It cannot hold across the operating range of live equipment, and its degradation is silent, so nobody finds out until the machine is already out of specification.

Road taken

An adaptive control law

Accepted

More design and tuning work, carried out against a running machine with conservative bounds and a fallback to the known-good controller.

Bought

Stability across the range of conditions the machine actually meets, and not only at the point where it was commissioned.

Decision

Adapt to the operating regime, because the plant will not hold still and a silent drift out of specification is the worst failure available.

How it was built
01Read over Modbus
›
02Estimate regime
›
03Adapt gains
›
04Write setpoint
›
05Verify
01

Protocol and transport as ground truth

The controller is read and written over Modbus TCP through an industrial VPN gateway. Its observed behaviour is treated as ground truth, ahead of what the standard says it should do. The round trip is measured and budgeted as part of the loop, never assumed.

02

A gain-scheduled law in place of fixed gains

The controller carries a tuning for each operating regime and moves between them, so stability holds across the load, temperature and wear the machine actually meets. The scheme runs inside a safety-instrumented basic process control system, which bounds what the adaptation is allowed to do.

03

The deadline as part of the specification

The loop closes inside its deadline with the protocol round trip included and headroom reserved. A control loop that meets its deadline on average and misses it occasionally is a control loop that occasionally does the wrong thing.

04

Correct against the running machine, first time

The only test environment is the equipment in service, which raises the bar on everything upstream: staged rollout, conservative bounds on adaptation, and the ability to fall back to the known-good controller at any point.

Inside the key decisions

What each choice cost, and what it bought.

AChoosing adaptive control over a fixed-gain PID

A fixed-gain PID would have been quicker to deploy and easier to explain, and it would have looked fine on the day it was commissioned. The adaptive law costs more design and more tuning, done against a running machine. What it buys is a controller that holds across the conditions the machine actually meets, and protection from the worst failure available here, a slow and silent drift out of specification.

BBounding the adaptation and keeping a fallback

An adaptive controller allowed to change freely can find its way into instability. Bounding what the adaptation may do, inside a safety-instrumented basic process control system, means accepting a controller that is sometimes less than ideal at the edges of its range. Keeping the known-good controller available at every point means any problem has an exit that does not involve stopping the machine. On live hydraulic equipment those limits are the price of being allowed to adapt at all.

CPutting the round trip inside the deadline

It is common to treat communication delay as somebody else's problem and to design the control law as if measurements arrived instantly. Here the Modbus round trip through the VPN gateway is measured and counted against the loop deadline, with headroom reserved. That leaves less time for computation. In exchange the loop's timing becomes a guarantee, and each correction is applied to the machine as it is now.

DTreating the controller's behaviour as ground truth

The protocol standard describes how a device should behave. This controller behaves the way it actually implements the protocol. Learning that against the real device takes care and time on equipment that cannot be disturbed. It removes a whole class of surprises that would otherwise appear only in service, which is the one place where there is no room for them.

Gain-scheduled control lawa tuning per operating regime
Bounds on adaptationhow far and how fast the law may change
Fallback to known-good controlleravailable at any point, without a stop
Safety-instrumented control systemlimits what any control action may do
Deadline including the round tripModbus TCP over an industrial VPN, budgeted inside it
Adaptation is permitted only inside limits that were designed, never discovered.
FigureThe layers of protection around an adaptive law on live equipment. The adaptation sits at the top and is the part most likely to be wrong, so everything beneath it limits what it can do. The machine stays in service because every layer has a defined behaviour when the one above it misbehaves.
How it was measured

A single headline number hides where a system fails. This work was scored on the dimensions that actually decide whether it holds in production, measured on real, held-out cases rather than the demo path.

Setpoint hold across the operating rangeLoop timing including protocol round-tripBehavior at the adaptation boundsFallback reliability
The gate
Is the machine operating inside the range the law was designed and bounded for?
Adapt within bounds
setpoint held across load, temperature and wear
Flag it, stay bounded
operation near the bounds is flagged, and the known-good controller stays available
A mechanical fault sits outside this envelope, and no control law fixes one.
FigureHow the controller was judged in service. Inside its designed envelope, the measure is how well it holds setpoint across the conditions the machine actually meets, with every loop closing on time. Near the edges of that envelope, the measure is whether it flags the condition and stays predictable.
figures

What it produces
Without this discipline

A controller tuned beautifully at commissioning that quietly stops holding specification a few months later, in operating conditions nobody instrumented, with no alarm and no obvious cause.

This system

Stable control held across the machine's real operating range, on equipment that stayed in service throughout, over an industrial protocol path with the round trip budgeted inside the loop deadline.

adaptive control lawModbus TCP over an industrial VPNdeadline includes the round-tripno model in it
The operating envelope

What it owns, and what it hands to a person.

Handled with confidence
The operating range the law was designed and bounded for
Live operation with no service interruption
Flagged for review
Operation approaching the adaptation bounds
Out of scope by design
Mechanical faults
Unbounded adaptation
The honest limit

Adaptive control widens the range over which a controller holds. The plant still has to stay inside the envelope the law was designed for, and a mechanical fault is still a mechanical fault. The adaptation is bounded on purpose, because an unbounded adaptive law on live hydraulic equipment is a worse failure than a slightly detuned fixed one.

What it generalizes to

There is no machine learning in this engagement. The work is a control law, a timing budget, an industrial protocol, and the discipline of being correct against hardware you cannot stop. It sits alongside the real-time closed-loop work in robotics and the fail-closed architecture in defence, and the same discipline runs through all three. The deadline is part of the specification. The hardware is ground truth and the document is a guide. What the system does at its boundaries is designed in advance, never discovered in service.

What to take from this

A controller tuned at one operating point is only right at that point. If the machine's load, temperature or wear changes, expect a fixed-gain loop to drift.

Control loops rarely fail loudly. They hold setpoint a little worse over time, so judge them across the operating range and not only at commissioning.

In a networked control loop, the communication round trip is part of the deadline and has to be budgeted like any other step.

An adaptive controller needs bounds and a fallback, because unlimited adaptation on heavy equipment is more dangerous than mild detuning.

When a device and its protocol standard disagree, the device is right. Learn its behaviour against the real hardware.

How we engage

You have a system like this one.
Tell us where it stands.

Whether it is failing, not yet built, or about to meet a scale it has never seen, we can tell you what we see.

Start a conversation
mostafa@opulion.dev · Response within 24 hours · By inquiry