Packages

req_llm

1.2.0
1.28.0 1.27.0 1.26.0 1.25.0 1.24.0 1.23.0 1.22.0 1.21.1 1.21.0 1.20.0 1.19.0 1.18.0 1.17.1 1.17.0 1.16.0 1.15.0 1.14.0 1.13.0 1.12.0 1.11.0 1.10.0 1.9.0 1.8.0 1.7.1 1.7.0 1.6.0 1.5.1 1.5.0 1.4.1 1.4.0 1.3.0 1.2.0 1.1.0 1.0.0 1.0.0-rc.8 1.0.0-rc.7 1.0.0-rc.6 1.0.0-rc.5 1.0.0-rc.4 1.0.0-rc.3 1.0.0-rc.2 1.0.0-rc.1

Composable Elixir library for LLM interactions built on Req & Finch

HexDocs Report package

Current section

Files

Jump to
Documentation
Changelog
License
42 Versions
12 Dependencies
Dependants
Files
Activity
req_llm guides zai_coder.md
Raw

guides/zai_coder.md 

# Z.AI Coder

OpenAI-compatible API for Z.AI GLM models (Coding Endpoint).

## Configuration

```bash
ZAI_API_KEY=your-api-key
```

## Provider Options

No custom provider options - uses OpenAI-compatible defaults.

Passed via standard ReqLLM options:
- `temperature`, `max_tokens`, `top_p`
- `tools` for function calling
- Standard context and streaming

## Supported Models

- **glm-4.5** - Advanced reasoning model with 131K context
- **glm-4.5-air** - Lighter variant with same capabilities
- **glm-4.5-flash** - Free tier model with fast inference
- **glm-4.5v** - Vision model supporting text, image, and video inputs
- **glm-4.6** - Latest model with 204K context and improved reasoning

## Standard vs Coder Endpoints

This provider uses Z.AI's **coding endpoint** (`/api/coding/paas/v4`) optimized for:
- Code generation
- Technical tasks
- Programming assistance

For general-purpose chat and reasoning, use the [Z.AI Provider](zai.md).

## Implementation Notes

- Extended timeout for thinking mode (300s)
- Full OpenAI compatibility
- Automatic thinking mode detection and timeout adjustment
- Optimized for code-related prompts

## Resources

- [Z.AI Documentation](https://z.ai/docs)