Skip to content
aarness.
Marketplace

Skill

Apache Spark

Writes and tunes Spark jobs: DataFrame transforms, partitioning, joins, caching and cluster settings.

Haarnessverifieddatasparkpysparkbig dataetlperformance
InstallAdd to a workspace

Install

  1. 1

    Get Haarness

    Free and open source. Skip this step if Haarness is already on your computer.

    Download for macOSor
    curl -fsSL https://haarness.ai/install.sh | sh

    Free and open source. Skip this step if Haarness is already on your computer.

    Download for Windowsor
    irm https://haarness.ai/install.ps1 | iex

    Free and open source. Skip this step if Haarness is already on your computer.

    Download for Linuxor
    curl -fsSL https://haarness.ai/install.sh | sh

    Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.

    Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.

    Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.

    Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.

  2. 2

    Add Apache Spark

    Run this in a terminal. Add --global to install for every project, or --local for this project only.

    haarness marketplace install skill haarness/spark-engineer

Notes

From Jeffallan/claude-skills (skills/spark-engineer), by Jeffallan. Licence: MIT. Haarness keeps it in sync with the repository; installs update themselves.

Details

Publisher
Haarness
Version
v1
License
MIT
Visibility
public
Updated
Source
github.com/Jeffallan/claude-skillsskills/spark-engineer · mainKept in sync · 143243c

Versions

  • v1