Skip to content

10. Chat inference on your own llama.cpp

This chapter has moved to pages organised by task.

What you want to do Page
Start llama-server, point the Control Plane at it with AF_LLM_URL, register the models; switching from a borrowed engine, a member’s own connection Chat on a llama.cpp on your LAN

For agents

Send this prompt to your agent to read this page.

Read https://agent-fleet.org/docs/operate/10-llm-lan/index.md