# NVIDIA describes agents rewriting Spark UDFs for GPU execution

> NVIDIA reported that a Spark UDF rewrite cut operator time from 274.55 hours to 12.78 hours on one 600-billion-row workload at an unnamed consumer technology company.

- Canonical URL: https://newsverum.com/en/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026
- Publisher: Newsverum
- Section: Technology
- Published: 2026-10-15T19:00:45+00:00
- Updated: 2026-10-15T19:00:45+00:00
- Event / data period: 2026-10-13
- Other editions: [Türkçe](https://newsverum.com/tr/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md), [العربية](https://newsverum.com/ar/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md), [Français](https://newsverum.com/fr/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md), [Español](https://newsverum.com/es/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md), [Deutsch](https://newsverum.com/de/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md), [Português](https://newsverum.com/pt/news/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026.md)

NVIDIA described how user-defined functions (UDFs) in Apache Spark can force a GPU pipeline to fall back to CPU execution, adding data-transfer and runtime overhead. Its cuDF skills guide coding agents to test a UDF's behavior, rewrite it with Spark SQL, cuDF or custom CUDA, then measure equivalence and performance. The post cites an unnamed consumer technology company that converted more than 30 production UDFs using the workflow.

For one 600-billion-row workload, reported operator time was 274.55 hours with a CPU-based UDF and 12.78 hours with a cuDF GPU implementation; NVIDIA called this a 22-fold speedup. The post specifies 16 TB of input and 17.4 TB of output, but does not name the customer or provide an independent measurement. This result belongs to one workload and is not a performance guarantee for all Spark jobs.

## Data

### Operator time for a rewritten Spark UDF

Reported CPU and GPU implementation times for one 600-billion-row workload at an unnamed consumer technology company.

Methodology: CPU and cuDF/RapidsUDF operator times for one production UDF, as reported in NVIDIA's 13 October 2026 post. The source describes a 600-billion-row workload with 16 TB of input; this is one example and should not be generalized to all Spark jobs.

| label | value | unit | period | basis |
|---|---|---|---|---|
| CPU-based UDF operator time | 274.55 | hours | 2026-10-13 | observed |
| cuDF GPU-accelerated UDF operator time | 12.78 | hours | 2026-10-13 | observed |

Sources: <https://developer.nvidia.com/blog/rewrite-apache-spark-udfs-gpu-acceleration-ai-agents/> · Download data: [JSON](https://newsverum.com/api/v1/articles/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026/data/spark-udf-operator-time?lang=en&format=json) · [CSV](https://newsverum.com/api/v1/articles/nvidia-agent-rewrites-spark-udf-gpu-workload-october-2026/data/spark-udf-operator-time?lang=en&format=csv)

## Sources

- [NVIDIA Technical Blog](<https://developer.nvidia.com/blog/rewrite-apache-spark-udfs-gpu-acceleration-ai-agents/>) (Source checked: 2026-10-15; Published: 2026-10-13)

---

Cite the canonical URL above. [Editorial standards and corrections](https://newsverum.com/en/editorial)