- Resolve symlinks with realpathSync before path containment check
to prevent symlink-based directory escape in skillkit_resource
- Search project-local skills before home-level (cwd first in roots)
- AGENT_DIR_MAP now maps to arrays, includes non-standard global
paths (opencode: .config/opencode/skills, windsurf: .codeium/...)
- Extra global dirs scanned when agent filter matches
Three new tools for token-efficient local skill access:
- skillkit_catalog (L1): lightweight catalog of installed skills (~50 tokens/skill)
- skillkit_load (L2): full SKILL.md content for a single skill
- skillkit_resource (L3): specific reference file with path traversal protection
Bumps server version to 1.21.0. Adds 14 new tests (18 total).
- Fix "44 agents" → "45 agents" across 34 files (website, docs,
package.json, tests, extension, API, TUI)
- README: add tap, check, update, publish submit to commands section
- Commands.tsx: add Sources category with tap commands, update manage
group with remove --source/--all and check
- commands.mdx: full docs for tap, check, update, remove, publish
submit with all new flags and behaviors
- configuration.mdx: document lock.json and taps.json
- security.mdx: document trust badges system
- install: use actual installed path (handles .md files) for lock
entry and results instead of reconstructing from skillName
- update: call addSkillToLock after both local and remote updates
so lock.json stays in sync with metadata
- update: --force bypasses GitHub activity and checksum skip-checks
- update: timestamp comparison falls back to installedAt when
updatedAt is not set
- Use finally for temp cleanup so user cancels don't leak cloned dirs
- Move addSkillToLock outside inner agent loop, merge agents array
- Use source:name as lock key to avoid cross-source collisions
- Gate GitHub activity check on provider.type (skip for GitLab/Bitbucket)
- Normalize source URL to owner/repo before official check
- Include skill name in trust badge output
- Atomic lock.json writes via tmp file + renameSync
- Remove stale --federated suggestion from find no-results message
Introduce tap add/remove/list commands to manage custom skill sources
stored in ~/.skillkit/taps.json. Taps are included in find/search
results, allowing users to add private or community repositories.
Introduce ~/.skillkit/lock.json with LockEntry/LockFile schemas to
track all installed skills in a single file. Install writes entries,
remove deletes them. Enables future team sync and reproducible setups.
Compute SHA-256 checksum of SKILL.md on install and store in metadata.
During update, check GitHub pushedAt timestamp and compare checksums
to skip unnecessary re-downloads when content hasn't changed.
Show trust badges for each skill during install: [Official] for known
official sources (Anthropic, Vercel, Expo, Remotion, Supabase, Stripe),
or [Trusted]/[Review]/[Caution] based on TrustScorer analysis.
- Hoist cloneResult above try block so catch can clean up temp dir
on any failure path, not just the happy path
- Always include GitHub API in find search results (was behind
--federated flag, now default)
publish submit:
- Runs quality eval + security scan before submission
- Shows quality badge, stars, last push date, and warnings
- Creates issue directly via gh CLI (no browser needed)
- Falls back to manual URL if gh is not installed/authenticated
- Issue body includes quality score, stars, and push date
check:
- Fetches pushed_at from GitHub API for real update detection
- Shows quality badges next to skill names
- Shows stars and push date in verbose mode
- Displays average quality score across all skills
- findSkill: fall through to .md check when parseSkill returns null
- Use isPathInside instead of dir.includes(cwd) for location detection
- Optional chaining on meta.source in remove --source filter
- Track fence delimiter type per CommonMark (backtick vs tilde)
- Wrap statSync in try-catch so one bad source doesn't abort all installs
- Add cleanup fallback when sparse-checkout/checkout fails
Standalone .md skills (e.g. doc_explanation.md) now get metadata saved
as .doc_explanation.skillkit.json in the same directory. This allows
remove --source to find and remove them. Updated saveSkillMetadata,
loadSkillMetadata, loadMetadata, and remove command to handle both
directory and sibling metadata patterns.
- skillkit remove --all: removes all installed skills
- skillkit remove --source iii-hq/iii: removes all skills from that source
- Both check .skillkit.json metadata to match source
getSearchDirs now collects skill directories from ALL agent adapters
instead of only the configured agent. This fixes 'skill not found' when
skills were installed to .claude/skills/ but the default agent is
universal (which only searches skills/).
findSkill now also checks name.md for standalone .md skills that were
installed as plain files.
Move isStandaloneFile detection and .md suffix normalization before
the existence/force/symlink checks so all code paths use the same
effective target path. Fixes --force not detecting previously installed
standalone skills and symlinks pointing to the wrong filename.
- Restrict try/catch to only the partial clone spawn so
sparse-checkout/checkout failures bubble up as real errors instead
of being misreported as "partial clone unsupported"
- Cap stderr accumulator to 4KB to bound memory on verbose clones
- Add -- terminator before sparsePaths in sparse-checkout set to
prevent user-controlled subpath from being parsed as git options
Instead of wrapping standalone .md skills in a directory, copy them
as-is with .md extension. Skip saveSkillMetadata for standalone files
since it requires a directory. This preserves the original format that
repos like iii-hq/iii use for lightweight single-file skills.
Standalone .md skills (e.g. doc_explanation.md) were copied as plain
files, then saveSkillMetadata tried to write .skillkit.json inside
them causing ENOTDIR. Now detects file sources via statSync and
creates a directory with SKILL.md inside instead.
- spawnGit: set stdout to 'ignore' instead of 'pipe' to prevent
buffer deadlock (git clone writes to stderr, not stdout)
- tryPartialClone: emit fallback message via onProgress instead of
silently swallowing the error
- scanner: preserve fence markers so PI011 delimiter injection is
still detected, only strip inner code block content
- scanner: guard against unclosed frontmatter by looking ahead for
closing --- before entering frontmatter mode
cloneRepo now accepts a subpath option. When set, sparse-checkout
includes both the subpath itself and SKILL_DISCOVERY_PATHS under it.
All four providers pass their parsed subpath through to cloneRepo.
Without this, sparse checkout would skip the subpath directory and
discoverSkills would find nothing.
Strip fenced code blocks and standard YAML frontmatter before scanning
markdown files. This eliminates three categories of false positives:
- PI013: no longer flags standard --- frontmatter delimiters
- CI007: no longer flags curl|sh in code examples
- DE003: no longer flags process.env in code examples
Real threats in prose (outside code blocks) are still caught.
Replace silent execFileSync with async spawn + --progress flag so the
spinner shows real download progress (e.g. "Receiving objects 45%").
For large monorepos, try partial clone (--filter=blob:none) with sparse
checkout of SKILL_DISCOVERY_PATHS first, falling back to regular
--depth 1 clone if the server doesn't support it. Also adds
--single-branch --no-tags to all clones.
Shared cloneRepo() helper in base.ts eliminates duplicate clone logic
across all four git providers.
- selectSkills/selectAgents now return { result, exitCode } to
distinguish errors (exit 1) from cancellations (exit 0)
- Fixes: --skill with nonexistent name returned 0 instead of 1
- Fixes: --agent with invalid name returned 0 instead of 1
- ai.ts: s.stop('msg', 1) → s.stop(colors.error('msg'))
(clack spinner.stop only accepts message, not exit code)
generate.ts and manifest.ts now warn when --agents (deprecated) is
used instead of --agent. Message: "Warning: --agents is deprecated,
use --agent instead (--agents will be removed in v2.0)"
Findings 3 (scan.ts stderr) and 4 (translate.ts stderr) skipped:
error() from onboarding goes to stdout via clack — this is the
standard pattern across all migrated commands. Changing individual
commands would break consistency.
The TUI had a manually-maintained 44-agent AgentType union in
translator.service.ts that fell out of sync when openclaw was added
to core. Replace with re-export from @skillkit/core so it stays in
sync automatically. Fixes CI typecheck failure from #86.
* fix: version display, install UX — audit findings
- Fix version showing hardcoded 1.7.6 instead of actual 1.19.2
- Export setVersion/setAgentCount from @skillkit/cli
- Call setVersion(version) and setAgentCount(getAllAdapters().length) in cli.ts
- Change fallback from '1.7.6' to 'dev' so stale values are obvious
- Fix install pre-selecting all skills by default (bad UX)
- Add "Install all / Select specific" prompt before multiselect
- When selecting manually, start with nothing pre-selected
- Apply same fix to both InstallCommand and runInstallFlow()
- Matches existing quickAgentSelect pattern
Fixes found during comprehensive codebase audit.
Related issues: #87, #88, #89, #90, #91, #92, #93, #94
* refactor: extract quickSkillSelect, use getAdapterCount
- Extract duplicated "Install all / Select specific" pattern into
quickSkillSelect() in prompts.ts (mirrors existing quickAgentSelect)
- Both install.ts and runInstallFlow() now use the shared helper
- Add getAdapterCount() to @skillkit/agents to avoid allocating 44
spread-copied objects just to call .length
- Use getAdapterCount() in cli.ts instead of getAllAdapters().length
- Remove legacy clawdbot path checks from OpenClawAdapter.isDetected()
so pure clawdbot workspaces are not hijacked by OpenClaw detection
- Add '.openclaw/agents' to ALL_AGENT_DISCOVERY_PATHS so agent
discovery works for OpenClaw agent directories
* feat: add multi-tier eval engine (skillkit eval)
6-tier evaluation system for comprehensive skill assessment:
- Tier 1: LLM quality scoring (G-Eval pattern, 6 dimensions)
- Tier 2: Contradiction detection (formal rules + LLM semantic)
- Tier 3: Behavioral security (code analysis + taint tracking + LLM)
- Tier 4: Sandbox execution testing (Docker, graceful skip)
- Tier 5: Dynamic marketplace benchmarks (percentile ranking)
- Tier 6: Community signals (freshness, metadata, content health)
Works without API keys (heuristic fallback for Tier 1, Tiers 5-6).
Full LLM evaluation with --provider flag.
* fix: address Devin review — input validation for eval CLI
- --min-score NaN bypass: validate parseInt result before comparison
- --timeout NaN propagation: skip NaN timeout instead of passing to Docker
- --tier invalid input: graceful error message instead of unhandled throw
- scoreContentSize formula: cap sub-optimal at 99 to distinguish from optimal
* fix: address CodeRabbit review findings on eval system
- Harden contradiction/security prompts against prompt injection by
wrapping untrusted content in <skill_content> XML tags and adding
explicit "treat as untrusted data" instructions
- Use head+tail content sampling in security prompt instead of head-only
truncation to catch malicious payloads at end of content
- Add missing Tier 4 sandbox formatter to reporter.ts
- Fix misleading sampleSize fallback in dynamic-benchmark.ts
- Move --min-score NaN validation before engine.evaluate() to avoid
wasting LLM calls on invalid input
- Add truncation indicator to quality-cot.ts prompts
- Add term length limits (>100 chars) in contradiction.ts to mitigate
ReDoS risk on dynamically constructed regex
* fix: address round 2 review findings on eval system
- Wrap quality-cot prompts with <skill_content> XML tags and untrusted
data instructions, consistent with contradiction/security prompts
- Change truncateContent to head+tail sampling (4000+2000) instead of
head-only, so completeness/token-efficiency evaluators see both
beginning and end of long skills
- Fix escapeXmlTags regex to handle whitespace variants before closing
angle bracket (</skill_content >, </skill_content\n>)
- Type DIMENSION_PROMPTS with Record<EvalDimension, PromptBuilder> for
compile-time key validation
- Clamp estimatePercentile return to [0,100] range defensively
- Make buildStatsFromMarketplace async with periodic yields (every 50
skills) to avoid blocking the event loop on first-run cache miss
- Extract parsedTimeout local variable in eval.ts to avoid double
parseInt parsing
* fix: address round 3 Devin + CodeRabbit findings on eval system
- Scan both code blocks AND full content for dangerous patterns in
behavioral-security.ts, with deduplication by description+snippet
to avoid double-reporting (Devin: security scanner skipped prose)
- Use non-greedy regex /\[[\s\S]*?\]/ in parseSemanticFindings to
match first complete JSON array instead of greedily spanning to
last bracket in LLM response (Devin: greedy regex corrupted JSON)
- Fix formatSandboxDetails to use r.testCase matching SandboxResult
type instead of r.name which doesn't exist (Devin: property mismatch)
- Make MarketplaceSkill.description optional to match marketplace
schema where only id/name/source/tags are required (CodeRabbit)
- Rename sandbox test case from "code example execution" to "code
block content validation" since it validates content not execution
(CodeRabbit)
* fix: address round 4 Devin + CodeRabbit findings on eval system
Inline fixes:
- Replace greedy JSON regex in behavioral-security.ts runLLMAnalysis
with balanced bracket extraction that correctly handles ] inside
JSON string values
- Replace non-greedy regex in contradiction.ts parseSemanticFindings
with same balanced bracket extraction (non-greedy also breaks on
inner brackets)
- Fix crossValidatedCount in behavioral-security.ts to accumulate
(+= uniqueEngines.size) instead of replacing (Math.max)
- Fix gradeDeterministic: cleanExit && hasOutput without matching
expectedOutcome now returns passed:false score:50 instead of
passed:true score:75
- Docker unavailable returns score:-1 sentinel instead of 0/F;
engine.ts filters score<0 tiers from overall average so
Docker-less machines aren't penalized
Duplicate fix:
- Add score field to SandboxResult type; store gradeResult.score
in each result; compute tier score from average of numeric scores
instead of boolean pass rate
Nitpick fixes:
- Distinguish "Docker unavailable" from "No tests executed" in
formatSandboxDetails
- Tighten base64 obfuscation regex to require 4-char groups
- Only push 'llm' to engines when LLM actually produced findings
- Bound \s+ to \s{1,10} in dynamically constructed regexes in
contradiction.ts to prevent catastrophic backtracking
- Validate cache timestamp with Number.isFinite() in loadCache to
reject corrupted cache files with NaN timestamps