Technology / WORLD

AWS details labsweep measurements for AI training sandboxes

AWS published a technical evaluation on October 9 of reinforcement-learning rollouts in Firecracker microVMs. It reported more than 100,000 samples across over 500 configurations using the labsweep measurement harness. In the tested workloads, tail latency rose sharply beyond one microVM per virtual CPU, while median latency changed much less.

The source does not state the event date; the period shown is the source review period.

Reading sizeSources ↓Share story ↗
Conceptual illustration of technology, processors and connected information.Illustration
Symbolic illustration

AWS published a technical evaluation on October 9 of reinforcement-learning rollouts in Firecracker microVMs. It reported more than 100,000 samples across over 500 configurations using the labsweep measurement harness. In the tested workloads, tail latency rose sharply beyond one microVM per virtual CPU, while median latency changed much less.

Published latency and throughput results cover m8i and m8a hardware; m8g results are still to follow. Storage and network latency to the model endpoint were held constant, and dynamic sandbox churn was outside the evaluation. CPU pinning and simultaneous multithreading effects depended on the workload; AWS does not claim one setting is best for every training system.

Data

Timeline

AWS details labsweep measurements for AI training sandboxes

AWS details labsweep measurements for AI training sandboxes

  1. · Occurred

    Publication of the research report

    AWS published a technical evaluation on October 9 of reinforcement-learning rollouts in Firecracker microVMs. It reported more than 100,000 samples across over 500 configurations using the labsweep measurement harness. In the tested workloads, tail latency rose sharply beyond one microVM per virtual CPU, while median latency changed much less.

Methodology

Reported research results are attributed to the source; no independent performance measurement was made.

Updated:

Structured coverage

Subjects and places

Subject proposals

Geographic references

Only source-provided geographic references are shown. Opening an external map is optional. Optional story maps use OpenStreetMap. Opening a map sends your IP address and this site’s address to the map provider; location data remains readable as text without loading the map.

  • United States · Place role: Coverage · Place type: Country or area · Location precision: Regional
    Evidence
    • Explicit preserved editorial country/region; no city or national centroid inferredaws.amazon.com ↗
Taxonomy version: IPTC Media Topics 2026-Q2

Continue reading

Technology

AWS reports MoE kernel optimization results on SageMaker

AWS detailed GPU kernel optimizations for mixture-of-experts models on SageMaker AI on October 13. The company described swapping matrix operands, routing FP8 operations to the Triton backend and removing unnecessary just-in-time recompilations.

AWS Artificial Intelligence Blog1 min read
Data included
Technology

Microsoft reports completion of MAI-Base-2 pre-training

Microsoft AI said on October 15 that it completed pre-training MAI-Base-2, a mixture-of-experts model with 2.8 trillion total and 80 billion active parameters. The company says training used 16,000 GB200 GPUs over 38 days in August and September; the model is still undergoing post-training.

Microsoft AI1 min read
Data included