Skip to content
Agentmart
Submit a tool

local-models

Running AI models locally with Ollama and llama.cpp.

Skill by neuron-one

IndexedMIT★ 36
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/neuron-one-local-models

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Running AI models locally with Ollama and llama.cpp. Free inference, privacy, custom model deployment. Use for cost-free routine tasks or private data processing. Don't use when quality of Opus is needed.

Use cases: data, ml

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/local-models

Tools it pre-approves 3

From allowed-tools in SKILL.md: the agent may use these without asking you each time.

  • Read,
  • Write,
  • Bash

What's inside

Skill name
local-models
Description
Running AI models locally with Ollama and llama.cpp. Free inference, privacy, custom model deployment. Use for cost-free routine tasks or private data processing. Don't use when quality of Opus is needed.
License
MIT
Allowed tools
Read,, Write,, Bash
Instructions
34 lines in SKILL.md · view on GitHub

Before installing

  • Pre-approves any shell command
  • Instructions call the network

Files (1)

  • SKILL.md

SKILL.md (first lines)

# Local Model Deployment

## Ollama Setup
```bash
# Install model
ollama pull qwen2.5:7b

# Run
ollama run qwen2.5:7b

# API endpoint
curl http://localhost:11434/api/generate
```

## llama.cpp (for Claude Code integration)
```bash
# Start server
llama-server --model model.gguf --port 8001

# Point Claude Code to local
ANTHROPIC_BASE_URL=http://localhost:8001
```

## Model Selection
- Routine tasks: Qwen 3B (fast, light)
- Code generation: Qwen 7B or CodeLlama 7B
- Reasoning: Qwen 27B (heavy but capable)

## When to Use Local vs Cloud
- Private data processing -> local
- Cost-free batch operations -> local
- Complex reasoning -> cloud (Opus)
- Critical decisions -> cloud (Opus)

From neuron-one/GODMODE, MIT.

More from neuron-one/GODMODE

Signals

Stars
36
Forks
11
Open issues
0
Last commit (this folder)
Apr 1, 2026 (7 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
MIT
Repository
github.com/neuron-one/GODMODE
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
GitHubgithub-graphql

More from neuron-one

Cite this page

local-models skill. Agent Mart. https://agentmart.dev/skills/neuron-one-local-models (last updated 2026-10-24)