Early previewThis guide is in development. Items tagged verify are still being checked against official docs.
nebx Learn
GitHub
Menu
Home/C++/AI utilities
C++

C++

Zero-cost abstractions and full control over memory.

Paradigm
Multi-paradigm, OOP, generic
Typing
Static, strong-ish
Memory
Manual / RAII, no GC
Runs
Native machine code (AOT)
Concurrency
Threads, atomics, coroutines (C++20)

AI utilities

Libraries for machine learning and LLM integration in C++, plus AI coding assistants that work with any language.

The AI ecosystem changes quickly. Check each project's repository for current maintenance status and versions before adopting.
LLM inference

llama.cpp

Runs open-weight LLMs locally on CPU and GPU; the engine behind many local AI tools.

Inference

ONNX Runtime

Microsoft's cross-platform runtime for models exported to ONNX from PyTorch, TensorFlow and others.

Deep learning

LibTorch

The C++ distribution of PyTorch, for training or serving models without Python.

Computer vision

OpenCV (dnn module)

Image processing plus a module that runs pretrained neural networks.

Speech to text

whisper.cpp

C/C++ port of OpenAI's Whisper speech-recognition model.

Edge inference

TensorFlow Lite / LiteRT verify

On-device inference for mobile and embedded targets. Google has been rebranding it as LiteRT.

AI-assisted development

Agentic coding

Claude Code

Anthropic's coding agent for the terminal, IDEs, desktop and web.

Completion & chat

GitHub Copilot

In-editor suggestions and chat across many IDEs.

AI editor

Cursor

A VS Code-based editor built around AI assistance.

Saved in this browser only. Part of From code to production (0/5).