Concept

A collection of 34 posts

Concept

OSS

Open Source Software, software with source code freely available for modification and distribution.

Concept

Docker

A platform for developing, shipping, and running applications in containers.

Concept

PyPI

The Python Package Index, a repository for Python software packages.

Concept

LLM

Large Language Model, a type of AI trained on vast text data for natural language tasks.

Concept

GGUF

A file format for efficient storage and loading of quantized LLMs in llama.cpp.

Concept

CUDA

NVIDIA's parallel computing platform and API for GPU acceleration.

Concept

Ollama

An open-source runtime for running large language models locally on various hardware.

Concept

vLLM

An open-source library for high-throughput LLM inference and serving.

Concept

llama.cpp

An open-source C++ implementation for running LLMs efficiently on CPUs and GPUs.