Cloud Labs: Remote Experimentation Architecture (2026)

Cloud Labs: Remote Experimentation Architecture (2026)

Cloud Lab Remote Experimentation: The Architecture Behind Experiment-as-a-Service

A biologist in Bengaluru writes a few hundred lines of protocol code, presses submit, and eight time zones away a robotic arm in a windowless building starts pipetting her samples. She never touches a bench. Cloud lab remote experimentation turns a physical wet-lab into something you call over an API — the same mental model that turned servers into EC2 instances. You describe the experiment you want; a shared fleet of robots and instruments executes it; structured data and a full audit trail come back. No pipette tips, no autoclave, no facilities lease.

This is a systems story, not a bench-science one. The interesting engineering is not the chemistry — it is the control plane: how a declarative experiment gets validated, queued fairly across paying tenants, dispatched to the right instrument, tracked as physical samples move, captured with enough provenance to replay, and isolated so one customer never sees another’s molecules. That control plane is what separates a cloud lab from a room full of expensive machines.

What this covers: what a cloud lab actually is, how its architecture differs from a self-driving lab, the experiment API and scheduling model, workcell orchestration, sample logistics, reproducibility, isolation, failure modes, and the build-versus-rent economics.

Non-advisory note: this is a systems and industry architecture analysis. It is not laboratory-safety, scientific, regulatory, or investment advice.

Context and Background

The idea of renting lab time is old; renting lab time as an API is not. The category-defining operator is Emerald Cloud Lab (ECL), a Wolfram-language-backed facility whose Symbolic Lab Language (SLL) has, by the company’s own account, been used to run more than 600,000 experiments across roughly 200 instrument models under a single unified control interface called the Command Center. In August 2023 ECL open-sourced SLL for research use — a notable move, because the protocol language, not the robots, is the real intellectual property. The second major operator, Strateos, runs automated cloud labs in Menlo Park and San Diego and famously partnered with Eli Lilly to stand up a remote-controlled robotic lab; its software doubles as an on-premise control plane for private facilities.

Both sit inside a wider “autonomous science” movement. It helps to place cloud labs against two neighbours. A traditional automated lab buys its own robots and runs them in-house. A self-driving lab closes an AI-driven loop — an algorithm proposes the next experiment, robots run it, results feed back — usually on hardware the same team owns. A cloud lab is the substrate: a multi-tenant, remotely operated wet-lab you rent. You can run a self-driving loop on top of a cloud lab, but the cloud lab itself is agnostic about who writes the protocol — a human or a planner.

Underneath, connectivity standards matter. SiLA 2, built on gRPC over HTTP/2 with a machine-readable Feature Definition Language and mDNS discovery, is the most mature open protocol for talking to instruments; AnIML (an ASTM XML standard) captures completed analytical results. These are the “lab-as-code” plumbing a cloud lab either adopts or reinvents internally.

Cloud Lab Reference Architecture

A cloud lab is a distributed system with a very unusual peripheral: physical matter that degrades, spills, and cannot be rolled back. The reference architecture has six planes — client SDK, experiment API, scheduler, workcell orchestrator, sample logistics, and a provenance store — and the discipline is keeping the digital control plane authoritative while accepting that the physical plane is only eventually consistent with it.

Cloud lab remote experimentation reference architecture from client API to instruments and provenance

Figure 1: The six planes of a cloud lab. A declarative protocol enters through the experiment API, is validated and scheduled, then dispatched to a workcell orchestrator that drives instruments and sample logistics; every action lands in a provenance store that returns results to the client.

In this reference model, the client submits a declarative protocol through the experiment API. A validator checks it against instrument schemas and safety constraints and returns a cost and time estimate. The scheduler places the accepted job in a queue and, when a matching instrument frees up, hands it to the workcell orchestrator. The orchestrator drives device drivers, coordinates the sample-logistics subsystem that physically moves plates and vials, and streams every measurement and log line into a provenance store. That store is the system of record; the results returned to the scientist are a view over it.

The experiment is data, not a session

The defining architectural choice is that an experiment is a declarative document, not an interactive session. You do not remote-desktop into a microscope. You submit a description — samples, steps, parameters, acceptance criteria — and the platform decides how and when to realise it. This is the same shift that made infrastructure-as-code work: the artifact is inspectable, diffable, version-controlled, and replayable. ECL’s SLL and Strateos’s protocol layer are both, at heart, ways to serialise “what I want done” into something a scheduler and a robot can consume without a human in the loop.

The physical plane is eventually consistent

In ordinary distributed systems you reason about eventual consistency between replicas. Here the gap is between the digital record and physical reality. A job can be “complete” in the database a few seconds before the plate is actually sealed and returned to cold storage. A sample can be recorded as 200 microlitres while evaporation has quietly taken it to 190. Good cloud-lab designs treat every physical action as a command that must be confirmed by a sensor reading or a second measurement, never assumed. The provenance store records both the intended and the observed state, and the difference between them is where most real-world debugging happens.

Multi-tenancy is the business, and the hazard

A single-customer automated lab is just automation. The moment you share the same liquid handler across three companies’ molecules, you have a multi-tenant system with all its classic problems — fairness, isolation, noisy neighbours — plus a new one: cross-contamination is a physical data leak. Tenancy is therefore not a feature bolted on; it runs through scheduling (who gets the instrument next), logistics (whose samples share a rack), and security (who can read which run). We will return to each.

Experiment API, Scheduling, and Orchestration

The hardest engineering in a cloud lab lives between “job accepted” and “instrument busy.” This section walks the request lifecycle, the scheduling model that makes a shared fleet fair, and the orchestration layer that turns a validated protocol into robot motion.

Sequence diagram of a cloud lab experiment from submission to returned dataset

Figure 2: The submit-to-result lifecycle. The scientist submits a protocol; the API validates and estimates cost; the scheduler enqueues the job and dispatches it only when a matching instrument is free; the orchestrator runs the steps and streams data; the store marks completion and returns the dataset with provenance.

Figure 2 traces one job. Note the asynchronous gap between enqueue and dispatch — it can be minutes or days depending on queue depth and instrument availability, and the API is built around that latency rather than pretending it away. Clients poll or subscribe to status; they do not block on a synchronous call.

The declarative protocol language

The experiment API’s job is to accept a protocol and refuse the ones that cannot or should not run. A good protocol language is declarative: it states the desired steps and constraints, not a hard-coded instrument sequence. That indirection is what lets the scheduler substitute an equivalent plate reader, batch several tenants’ incubations together, or re-order independent steps. ECL encodes this in SLL on top of Wolfram Language; other operators use JSON- or Python-based DSLs. The common requirement is a typed, machine-checkable schema so the validator can reject an impossible volume, an unavailable reagent, or a step no instrument in the fleet can perform — before any physical resource is committed.

Validation also produces the cost and time estimate. Because the platform knows each step’s instrument, duration, and consumables, it can price a run and predict its completion window at submission time. This estimate is contractual: it shapes which queue the job lands in and what the tenant is billed.

Scheduling across shared instruments

Scheduling is where cloud labs earn their margin. A fleet of expensive instruments is only economical at high utilisation, but utilisation fights fairness: a single tenant submitting a thousand jobs could starve everyone else. The scheduler must therefore balance throughput, fairness, and priority simultaneously.

Scheduling and queueing across shared instruments with multi-tenant fairness

Figure 3: Multi-tenant scheduling. Jobs from several tenants land in a shared priority queue; a planner matches each job to a compatible instrument slot, respecting fairness and priority; completed runs feed a metering system that drives usage-based billing.

The dominant pattern is a priority queue with per-tenant fairness — conceptually the lab-robotics analogue of weighted fair queueing or the dominant-resource fairness used in compute clusters. Each tenant gets a share of instrument-time; within their share, they set relative priorities. Higher tiers can pay for preemptive or reserved capacity. The planner in Figure 3 is a matching engine: it maps ready jobs onto compatible, free instrument slots while honouring sample constraints (a step that must follow another within thirty minutes cannot be scheduled arbitrarily far apart).

This is a bin-packing and job-shop scheduling problem, and it is NP-hard in the general case, so real schedulers use heuristics and rolling horizons rather than optimal solutions. They also have to respect physical dependencies that pure compute schedulers never face: an incubation blocks its plate for exactly ninety minutes whether or not anything else needs that slot, and a sample thawed for one step degrades if the next step slips.

A second subtlety is batching. Many instrument operations have high fixed overhead — a plate reader that takes two minutes to warm up but seconds to read — so the scheduler is rewarded for coalescing compatible steps from different tenants into one instrument run. This is exactly the kind of cross-tenant optimisation that makes a shared fleet cheaper than any single tenant’s private lab, but it also entangles tenants’ fates: a batched run that fails takes several customers’ samples down with it. Operators therefore batch aggressively on cheap, low-risk steps and keep expensive or contamination-sensitive steps single-tenant, an explicit risk-versus-utilisation policy decision rather than a purely algorithmic one.

Worked reasoning: why utilisation and latency trade off

Consider a fleet with one mass spectrometer that processes a sample in ten minutes — six per hour, about 144 per day at full tilt. Suppose three tenants each submit sixty jobs one morning, 180 total. Even with a perfectly efficient scheduler, the instrument needs roughly thirty hours of continuous run-time to clear the backlog, so the last jobs finish more than a day after submission. Push target utilisation to 95% and the queue stays deep, so median wait time climbs; drop it to 60% to keep waits short and a third of your most expensive asset sits idle, wrecking unit economics.

There is no free lunch here — it is the same latency-versus-utilisation curve as any queueing system (M/M/1 waiting time blows up as utilisation approaches one), only the “server” costs hundreds of thousands of dollars and the “jobs” are physical. The operator’s real product is a scheduling policy that keeps instruments busy enough to be affordable while keeping p95 turnaround inside what customers will tolerate. Reserved-capacity tiers exist precisely to let latency-sensitive tenants buy their way out of the shared queue.

Workcell orchestration and device drivers

Below the scheduler, the orchestrator turns an abstract step (“dispense 50 microlitres into wells A1 to A12”) into device-specific commands. This is a driver problem indistinguishable in spirit from operating-system device drivers: each instrument model exposes different capabilities, error codes, and quirks, and the orchestrator normalises them behind a common interface. SiLA 2’s Feature Definition Language exists to make this tractable — a typed, discoverable capability description per instrument — but many operators still maintain bespoke drivers because vendor firmware predates the standard or exposes capabilities SiLA does not model. A workcell (a robotic arm plus the instruments it can reach) is orchestrated as a small state machine, and the orchestrator sequences arm moves, instrument commands, and sensor confirmations while watching for faults at every transition.

Error recovery is where the state machine earns its keep. A compute driver that gets a bad response can retry idempotently; a lab driver cannot, because the previous attempt may have physically committed a step. So the orchestrator classifies faults: transient ones (a communication timeout, a re-seatable plate) can be retried at a known-safe checkpoint, while terminal ones (a dropped vial, an out-of-range reading) must halt the run, quarantine the sample, and escalate. The safe-checkpoint boundaries are designed into the protocol language itself — steps are marked with whether they are re-runnable — so the orchestrator always knows where it can rewind and where it cannot. This is the physical-world equivalent of designing idempotency keys into an API, and it is the single most under-appreciated part of building a reliable cloud lab.

Sample Logistics, Provenance, and Reproducibility

Two subsystems separate a cloud lab from a compute cloud: the one that moves physical matter without losing track of it, and the one that captures enough about each run to reproduce it. Both are harder than they look.

Sample logistics and inventory

Every vial, plate, and reagent is an inventory object with a barcode, a location, a lot number, and a lifecycle. The logistics subsystem is a real-time asset tracker: it knows that plate P-4471 is in incubator slot 3, was filled from reagent lot R-90210, and must be read within two hours. Consumables — tips, buffers, columns — are tracked and decremented so the scheduler never dispatches a job that would run the fleet dry mid-protocol. This is warehouse-management-system logic fused with laboratory-information-management-system (LIMS) semantics, and it is where “eventual consistency with physical reality” bites hardest: a mis-scanned barcode or a robot that drops a plate creates a divergence between the digital inventory and the physical shelf that no amount of software can silently reconcile. Reconciliation needs a sensor, a re-scan, or a human.

Logistics also sets a hard limit on throughput that has nothing to do with instrument speed. Samples have to physically travel between workcells — a plate read on one station, then incubated on another, then imaged on a third — and the robotic transport and storage capacity between stations is finite. A cloud lab can be instrument-rich but transport-poor, and when that happens the arms that move plates, not the instruments that process them, become the bottleneck. Mature operators model the facility as a small internal logistics network, and their capacity planning tracks transport and cold-storage slots as first-class constrained resources alongside the headline instruments.

Data capture and provenance

Every run emits raw instrument signals, processed results, logs, and metadata. Provenance is the discipline of binding all of it to the exact conditions that produced it.

Provenance and reproducibility data flow binding protocol, samples, and instrument state to an immutable ledger

Figure 4: Reproducibility as a data-capture problem. The run record links the protocol version, sample lineage, instrument calibration and firmware, and environmental conditions; raw signals become processed data; everything lands in an immutable provenance ledger that a replay engine can re-execute.

Data format matters as much as data capture. Returning results as vendor-specific binary blobs makes them analysis-hostile and locks the customer to one operator. The value of a cloud lab is partly that results come back structured — typed, self-describing, and tied to their metadata. Standards like AnIML (an ASTM XML format for analytical results) exist precisely so a mass-spec trace carries its own units, method, and sample context rather than living in a proprietary file. A cloud lab that returns clean, standardised, provenance-linked data gives the scientist something a private lab rarely produces without extra effort: a dataset that is immediately queryable and portable.

Figure 4 shows why replayability is the hard part. To reproduce a result you need more than the protocol code. You need the exact protocol version (a code hash), the sample lineage (which lot, split from which parent), the instrument’s calibration and firmware at run time, and the environmental conditions — temperature, humidity, timing between steps. Miss any of these and “re-run the same experiment” quietly becomes “run a similar experiment.” The provenance ledger captures the full tuple so a replay engine can, in principle, dispatch an identical job. In practice, perfect replay is impossible because the physical world is non-deterministic: reagents age, instruments drift between calibrations, and ambient conditions vary. The best a cloud lab can offer is bounded reproducibility — the same protocol against equivalent inputs within a documented tolerance, with every deviation recorded so a scientist can judge whether a difference is real signal or instrument noise. That honest recording is worth more than a false promise of bit-for-bit repeatability.

Tenant isolation and security

Isolation in a cloud lab has a digital and a physical dimension. Digitally, it is standard multi-tenant access control: run data, protocols, and inventory are partitioned by tenant, encrypted, and gated by role-based permissions, so tenant B can never read tenant A’s results or reverse-engineer their protocols. Intellectual property here is a molecule and a method, so the confidentiality stakes are high. Physically, isolation means preventing cross-contamination: shared liquid handlers need validated wash cycles between tenants, disposable tips must never be reused across jobs, and the scheduler must avoid racking incompatible samples together. A physical leak — one tenant’s compound trace in another’s well — is both a data-integrity failure and a confidentiality breach with no software rollback. This is why serious operators treat contamination controls as part of the security model, not just quality control.

Where AI planners plug in

A cloud lab exposes exactly the interface an autonomous planner wants: submit a protocol, get structured data, repeat. That is why cloud labs are natural substrates for self-driving science. An optimiser such as Merck KGaA’s open-source Bayesian Back End (BayBE) can propose the next experiment, submit it through the same experiment API a human would use, read the returned dataset, and update its model — closing the loop without owning a single robot. The cloud lab does not need to know a planner is on the other end; the API is the clean seam. This is the deepest architectural point of the whole category: by making the experiment a declarative, replayable document behind an API, a cloud lab makes a human scientist and an AI planner interchangeable clients.

The economics of that seam are what make autonomous science plausible at all. A closed-loop campaign might run hundreds of small experiments to optimise a single reaction — a workload that is punishing to staff manually but trivial to express as a loop of API calls. Because the cloud lab already meters, schedules, and provenances every run, the planner inherits all of that for free; it does not have to reimplement inventory tracking or fairness. Emerging agent-to-instrument protocols in the research literature are pushing this further, standardising how an autonomous agent negotiates with a lab’s capabilities the way SiLA standardised instrument control. Whether those settle into one standard or many, the architectural direction is clear: the experiment API is becoming the ABI of physical science, and cloud labs are its most complete implementation to date.

Trade-offs, Gotchas, and What Goes Wrong

Cloud labs fail in ways that pure software systems never do, because the failure domain includes matter, time, and shared physical resources. Naming the failure modes precisely is the difference between a robust operator and a demo.

Instrument failure mid-run. A robot arm jams or a detector faults halfway through a protocol. Unlike a crashed compute job, you cannot simply retry — the sample may be partially processed, consumed, or contaminated. Robust designs checkpoint at safe boundaries, quarantine the affected sample, and surface a partial result with an explicit failure annotation rather than silently discarding the run.

Queue starvation. Weak fairness lets a high-priority or high-volume tenant monopolise an instrument, pushing others’ p95 turnaround out indefinitely. The symptom is a healthy fleet with furious customers. The fix is enforced per-tenant shares and, for the fleet, capacity planning that treats each instrument type as a separate bottleneck.

Sample degradation. A scheduled job slips, and a thawed reagent or a time-sensitive intermediate expires in the queue. The result is not an error — it is a valid-looking wrong answer, the most dangerous kind. Deadline-aware scheduling and hard sample-lifetime constraints are the only defence; the scheduler must be able to refuse or re-order a job whose inputs will expire before it runs.

Non-determinism mistaken for a bug. Two identical submissions return slightly different numbers, and a user files it as a platform defect when it is real physical variance. Without rich provenance and documented tolerances, teams waste weeks chasing ghosts. This is why the honest answer is bounded, not bit-exact, reproducibility.

Capacity ceilings. A cloud lab cannot autoscale by spinning up a container. Adding a mass spectrometer means procurement, installation, calibration, and driver integration — weeks to months. Demand spikes hit a hard physical wall, and the only elastic lever is the queue. Customers who assume cloud-like elasticity are surprised; mature operators publish capacity and lead times up front.

The anti-pattern that ties these together is treating a cloud lab like a compute cloud. Matter does not roll back, latency is measured in hours, and “just retry” can destroy an irreplaceable sample. Teams that internalise this design defensively — bounded expectations, deadline-aware jobs, explicit partial-result handling — and are rewarded with a platform that behaves predictably even when the physical world does not.

Practical Recommendations

Treat the decision as an architecture choice, not a procurement one. The matrix below compares the three paths on the axes that actually drive the outcome.

Factor Cloud lab (rent) In-house automated lab Manual bench
Upfront capital Near zero High (instruments, facility, integration) Low to moderate
Time to first result Days Months to years Days to weeks
Elasticity Queue-bounded, no capex to scale Fixed until you buy more Limited by staff
Reproducibility Strong provenance, bounded replay Depends on your discipline Operator-dependent
Throughput ceiling Shared fleet, subject to queue Yours alone, but fixed Low
IP exposure On a third-party platform Fully internal Fully internal
Best fit Variable or bursty demand, small teams, need for audit trail Sustained high volume, sensitive IP, custom instruments Exploratory, low-volume, highly manual work

A short decision checklist:

  • Estimate your duty cycle first. If instruments would sit idle most of the month, rent. If you would saturate them, in-house amortises the capex.
  • Value the provenance, not just the robots. For regulated or publication-bound work, a cloud lab’s audit trail can be worth more than the automation.
  • Prototype on a cloud lab even if you plan to build. It de-risks protocol design before you commit capital to hardware.
  • Design for asynchrony. Build your own tooling around submit-and-poll, deadline-aware jobs, and explicit handling of partial results from the start.
  • Read the isolation and contamination controls as carefully as the pricing. For sensitive IP, they are the real contract.

Frequently Asked Questions

What is a cloud lab in simple terms?

A cloud lab is a remote, robotic wet-laboratory you access over an API instead of in person. You write an experiment as a declarative protocol, submit it, and a shared fleet of instruments in a physical facility executes it, returning structured data and a full provenance trail. The model mirrors cloud computing: you rent experimentation capacity on demand rather than buying and operating your own instruments, facility, and staff.

How is a cloud lab different from a self-driving lab?

A self-driving lab closes an AI-driven loop — an algorithm proposes each next experiment, robots run it, and results feed back — usually on hardware the team owns. A cloud lab is the underlying substrate: a multi-tenant, remotely operated facility that executes whatever protocol it is handed, whether a human or an AI planner wrote it. You can run a self-driving loop on top of a cloud lab, because the experiment API is the same clean seam for both kinds of client.

Who are the main cloud lab providers in 2026?

Emerald Cloud Lab is the most established, with its Wolfram-language-based Symbolic Lab Language and, by its own reporting, over 600,000 experiments across roughly 200 instrument models. Strateos operates automated cloud labs in Menlo Park and San Diego and partnered with Eli Lilly on a remote-controlled robotic lab. Both figures come from the operators; independently verified public numbers are scarce, so treat vendor-reported counts as claims rather than audited facts.

Why is reproducibility so hard in a cloud lab?

Because reproducing a result needs far more than the protocol code. You must capture the exact protocol version, sample lineage, instrument calibration and firmware, and environmental conditions at run time. Even with all of that, the physical world is non-deterministic — reagents age and instruments drift — so bit-for-bit replay is impossible. The realistic goal is bounded reproducibility: the same protocol against equivalent inputs within a documented tolerance, with every deviation recorded.

How does scheduling stay fair across multiple customers?

The scheduler uses a priority queue with per-tenant fairness, conceptually similar to weighted fair queueing or dominant-resource fairness in compute clusters. Each tenant gets a share of instrument-time and sets priorities within it; higher tiers can buy reserved or preemptive capacity. A matching engine maps ready jobs to compatible, free instrument slots while honouring physical dependencies like time-linked steps, so no single high-volume tenant can starve the rest.

When does building an in-house lab beat renting a cloud lab?

Build in-house when demand is sustained and high enough to keep expensive instruments near saturation, when the intellectual property is too sensitive to place on a third party’s shared fleet, or when you need custom instruments the cloud operator does not offer. Rent when demand is bursty or uncertain, when time-to-first-result matters more than long-run unit cost, or when a strong, portable provenance trail is worth more to you than owning the hardware.

Further Reading

By Riju — about

Comments

No comments yet. Why don’t you start the discussion?

Leave a Reply

Your email address will not be published. Required fields are marked *