Articles by tag: local-llm

Secure LLM Agents: CorpClaw-Lite for Business | Overview

CorpClaw-Lite solves security and scalability issues in LLM agents. Learn about strict isolation, support for local models, and multi-user mode. Read the technical overview.

Foundation Models in SwiftUI: Local AI

Integrate Foundation Models into SwiftUI for streaming text generation on device. Code example, streaming features and on-device inference. For iOS developers.

Local 200B models: Bonsai and TurboQuant

Breakdown of 1-bit weights Bonsai 8B and KV-cache compression TurboQuant. Memory reduction 14x for weights, 6x for cache. Calculations for 235B models. Learn how to run giants locally.