RepoNVIDIANVIDIApublished Nov 3, 2022seen 5d

NVIDIA/spark-rapids-tools

Scala

Open original ↗

Captured source

source ↗
published Nov 3, 2022seen 5dcaptured 9hhttp 200method plain

NVIDIA/spark-rapids-tools

Description: User tools for Spark RAPIDS

Language: Scala

License: Apache-2.0

Stars: 71

Forks: 52

Open issues: 285

Created: 2022-11-03T15:58:22Z

Pushed: 2026-06-09T08:49:41Z

Default branch: dev

Fork: no

Archived: no

README:

RAPIDS Accelerator for Apache Spark Tools

This repo provides the tools to use RAPIDS Accelerator for Apache Spark.

![Ask DeepWiki](https://deepwiki.com/NVIDIA/spark-rapids-tools)

Catalog

  • [RAPIDS core tools](./core): Tools that help developers getting the most out of their Apache

Spark applications without any code change:

  • Report acceleration potential of RAPIDS Accelerator for Apache Spark on a set of Spark applications.
  • Generate comprehensive profiling analysis for Apache Sparks executing on accelerated GPU instances. This information

can be used to further tune and optimize the application.

  • [spark-rapids-user-tools](./user_tools): A simple wrapper process around cloud service

providers to run [RAPIDS core tools](./core) across multiple cloud platforms. In addition, the output educates the users on the cost savings and acceleration potential of RAPIDS Accelerator for Apache Spark and makes recommendations to tune the application performance based on the cluster shape.