Newsverum.
SearchK

Search stories

Find the story. Follow the source.

Explore
Explore the data3171Agriculture341Business497Climate63Culture28Economy459Education89Energy580Environment72Finance94Fiscal Policy55Government62Health141Infrastructure225Politics55Science39Security49Society35Sports121Technology470
EN
العربيةDeutschEnglishEspañolFrançaisPortuguêsTürkçe
Sections
Technology / WORLD

Intel introduces Inference Microservices for LLM serving on Xeon

Intel announced container-based Inference Microservices software for serving large language models on Intel Xeon processors. Each container serves one model behind an OpenAI-compatible API and detects its host processor at startup to select Intel’s validated profile for that model and hardware.

Newsverum · Source brief1 min read

Event / data period: 2026-10-14

Published: · Updated:

Reading sizeSources ↓Share story ↗
Conceptual illustration of technology, processors and connected information.Illustration
Symbolic illustration

The first release runs vLLM at BF16 on 4th-, 5th- and 6th-generation Xeon processors; Intel suggests 32 GB of RAM. The company says profiles configure precision, core scheduling and memory layout and are based on its own hardware testing.

Intel says the software runs locally, without a hosted endpoint or API key, and applications can use the standard interface by changing the base URL. GPU support, other engines, Helm charts and a Kubernetes operator are future plans, not capabilities of this release.

Data

Timeline

Intel software release

Intel released LLM inference software using per-model tuned containers on Xeon processors.

  1. · Occurred

    Intel introduces Inference Microservices for LLM serving on Xeon

    Intel released LLM inference software using per-model tuned containers on Xeon processors.

Methodology

The event is Intel’s software announcement dated October 14, 2026. Product scope and statements about validated tuning are Intel’s; the announcement provides no independent benchmark result.

Updated:

DownloadCSV ↓JSON ↓
Structured coverage

Subjects and places

Subject proposals

Geographic references

Only source-provided geographic references are shown. Opening an external map is optional. Optional story maps use OpenStreetMap. Opening a map sends your IP address and this site’s address to the map provider; location data remains readable as text without loading the map.

  • United States · Place role: Coverage · Place type: Country or area · Location precision: Regional
    Evidence
    • Explicit preserved editorial country/region; no city or national centroid inferredwww.intel.com ↗
Taxonomy version: IPTC Media Topics 2026-Q2

Continue reading

Technology

Intel Xeon edge AI tracks queues at Alabama stadium

Intel said WaitTime software uses Intel Xeon processors to measure queues and crowd movement at the University of Alabama’s football and basketball venues. At Bryant-Denny Stadium, the deployment processes visual data from sensors on local servers inside the venue.

Intel Newsroom1 min read Data included
Technology

AMD and Intel align x86 CPU software work for PyTorch

AMD and Intel said on 20 October they will combine x86 CPU optimizations for PyTorch in the open-source oneDNN library. The companies aim to give developers a common software path for AI workloads across AMD and Intel processors.

Intel Newsroom1 min read Data included