Alternatives to spark-optimization
50 AI Skills apps to use instead, best rated first.
Top picks
- W
webapp-testing
LaunchNative Python Playwright scripts for testing local web applications with server lifecycle management. Includes with_server.py helper to automatically start and manage single or multiple servers before running automation scripts. Supports re
- C
content-research-writer
LaunchAssists in writing high-quality content by conducting research, adding citations, improving hooks, iterating on outlines, and providing real-time feedback on
- O
openhue
Launchopenhue is an agent skill from the OpenClaw project, listed on skills.sh. It lets an agent control Philips Hue lights and scenes through a Hue Bridge with the OpenHue CLI: turn lights on and off, dim rooms, set scenes such as movie mode, an
- B
batch-grill-me
Launchbatch-grill-me is an agent skill from Matt Pocock's skills collection, listed on skills.sh. It interviews you relentlessly about a plan until you share an understanding. It maps decisions as a tree and asks every question it can answer now
- I
implement
Launchimplement is an agent skill from Matt Pocock's skills collection, listed on skills.sh. It implements work from a spec or tickets: it fetches the ticket, works test-first at agreed seams, runs type checks and tests as it goes, reviews the re
- F
frontend-design
LaunchDistinctive, production-grade frontend interfaces that reject generic AI aesthetics through intentional design choices. Guides aesthetic direction selection (brutalist, maximalist, retro-futuristic, luxury, organic, etc.) before implementat
More AI Skills apps
brainstorming
Transform rough ideas into fully-formed designs through structured questioning
finishing-a-development-branch
Guides completion of development work by presenting clear options
test-driven-development
Use when implementing any feature or bugfix, before writing implementation code
About spark-optimization
spark-optimization
Optimize Apache Spark jobs
spark-optimization is an agent skill from the wshobson/agents collection for optimizing Apache Spark jobs. It covers production patterns for partitioning data sensibly, caching data that is reused, reducing the cost of shuffles, which move data between machines and are often the slowest part of a job, and tuning memory and executor configuration. The core concepts begin with the Spark execution model, which explains how a job is split into stages and tasks, so that the agent can reason about where time is spent. The skill applies when optimizing slow Spark jobs, tuning memory and executor settings, implementing efficient partitioning, debugging Spark performance problems, scaling pipelines to large datasets, and reducing shuffle and data skew, where a few partitions hold most of the data and hold back the whole job. It is written for data engineers who run Spark on large datasets and need faster, cheaper jobs without guessing at the causes. The skill's guidance is most reliable when it is checked against the job's own metrics, such as the Spark UI's stage and task timings, before and after each change. The agent proposes changes and the data team decides which ones to adopt on production clusters. The skill is installed with the skills CLI from the wshobson/agents repository. Its skills.sh page showed about 10.5K installs and passing results from three security audits at the time of the scan.
- Price
- Free
- Made by
- wshobson
- Category
- AI Skills
- Website
- github.com/wshobson/agents/spark-optimization