Solution brief · AI Infrastructure
Clastiq Orchestrator AI Platform
The AI workstation that arrives as a platform. NVIDIA GPU hardware and Clastiq Orchestrator, delivered, installed and supported as one unit. Open models behind an OpenAI-compatible gateway, GPUs shared fairly down to a fraction of a card, and full visibility of who is using what. Plug it in, sign in, serve your first model the same day. Nothing leaves the box.
Platform walkthrough
Clastiq Orchestrator demo
Configurations
Hardware and platform, one solution
Four NVIDIA systems, from a desk-side station to an eight-GPU Blackwell Ultra node, each shipped with Clastiq Enterprise installed, tuned for its GPUs and covered by one support contract.
Delivered ready to serve
The box arrives with Clastiq Enterprise installed, GPU sharing configured and single sign-on ready to connect. The first model is serving on delivery day.
One contract
Hardware, platform updates and support under one agreement with one point of contact. No separate software licence to track.
Grows with you
Add a second system later and Clastiq Enterprise treats both as one pool, with the same projects, queues and gateway.
Architecture
Three layers, validated as one system
Clastiq Orchestrator
Orchestration
Kubernetes, storage and VMs with fractional GPU scheduling and an OpenAI-compatible inference gateway.
- GPU scheduler with ¼ fractions & queues
- vLLM · SGLang · llama.cpp · TensorRT-LLM
- OpenAI-compatible API gateway
- Fine-tuning: SFT, DPO, LoRA/QLoRA
- Marketplace: vector DBs, MLOps, apps
- Guardrails, SSO, audit, observability
Solution brief · Page 2
One box, every team
THE SOLUTION
One box, every team
Clastiq AI Platform is an NVIDIA GPU system with Clastiq Enterprise pre-installed. It gives each team a project of its own: members, roles, quotas, storage and keys. Teams deploy models, start databases and tools from the marketplace, run their own containers and notebooks, and fine-tune on the shared GPUs without ever touching the machine.
One vendor, one invoice, one support contract for hardware and software. The administrator decides how the GPUs are split. Every request, every GPU minute and every token is visible on one dashboard.
| Category | Value |
|---|---|
| Deployments | 9 9 healthy |
| Requests / min | 640 p95 380 ms |
| Tokens today | 41 M 7 projects |
| GPU utilisation | 78% 6.75 of 8 GPUs allocated |
| TIME | input · output |
|---|---|
| 00:00 | 1 |
| 06:00 | 2 |
| 12:00 | 4 |
| 18:00 | 6 |
| now | 7 |
| DEPLOYMENT | GPUS | UTILISATION | STATUS |
|---|---|---|---|
| qwen3-32b | 2 | 84% | Serving |
| llama-3.3-70b | 4 | 67% | Serving |
| bge-m3 | 0.25 | 22% | Serving |
| gemma-3-27b-q4 | 0.5 | — | Queued |
The model console: deployments, gateway traffic and GPU utilisation for the whole workstation on one screen, from one hour to seven days.
1/4 GPU
the smallest slice a notebook or embedding model can take, so eight cards serve dozens of jobs
4
inference engines: vLLM, SGLang, llama.cpp and TensorRT-LLM, chosen per deployment
1
OpenAI-compatible endpoint for every model, with keys and token quotas per project
0
bytes of weights, prompts or usage data leaving the box
Solution brief · Page 3
GPU sharing & observability
GPU SHARING
Every GPU fully used, every team fairly served
The GPUs are the most valuable part of the box, and Clastiq treats them that way. The administrator gives each project a queue with a guaranteed GPU quota and a hard limit. When other teams are idle, a queue may borrow beyond its quota according to its weight. When demand returns, borrowed capacity is handed back.
- Fractional GPUs. A notebook, an embedding model or a small chat model can request a quarter or half of a card. Several workloads share one GPU safely, each with its own memory budget.
- Multi-GPU models. A 70B-class model spans four cards with tensor parallelism and still appears as one deployment.
- Queued, never refused. Work that exceeds the quota waits in the project's queue and starts the moment capacity frees up. Users see where their job stands.
- Autoscaling within limits. Deployments add replicas on load and give them back when it drops, never beyond the project's ceiling.
| GPU | Capacity | Allocation |
|---|---|---|
| GPU 0 | 80 GB | qwen3-32b · 1 of 2 |
| GPU 1 | 80 GB | qwen3-32b · 2 of 2 |
| GPU 2 | 80 GB | llama-3.3-70b · 1 of 4 |
| GPU 3 | 80 GB | llama-3.3-70b · 2 of 4 |
| GPU 4 | 80 GB | llama-3.3-70b · 3 of 4 |
| GPU 5 | 80 GB | llama-3.3-70b · 4 of 4 |
| GPU 6 | 80 GB | bge-m3 ¼ · 2 notebooks ¼ each · ¼ free |
| GPU 7 | 80 GB | fine-tune job ½ · notebook ½ |
| QUEUE | QUOTA | LIMIT | IN USE | PENDING |
|---|---|---|---|---|
| research | 2 | 4 | 2 | — |
| product | 3 | 6 | 4 +1 borrowed | — |
| data-platform | 1 | 2 | 0.75 | gemma-3-27b-q4 · 0.5 |
| notebooks | 1 | 1 | 1 | — |
Whole cards for large models, fractions for small ones. Each team's queue has a guaranteed share, a hard ceiling and a weight for borrowing idle capacity.
OBSERVABILITY
See every GPU minute and every token
You paid for the GPUs; you should see them work. The model dashboard shows utilisation and memory per GPU and per deployment, request rates, token volume and latency, from the last hour to the last seven days. Project members see the same for their own workloads.
- Per deployment: GPU utilisation, GPU memory, replicas, requests per minute, tokens in and out, time to first token, errors.
- Per project: CPU, memory, GPU and storage against quota, with usage history and the workloads behind it.
- Per workload: live logs, events and resource graphs, and alerts when a model stops answering.
- For the administrator: the whole system at a glance, GPU temperatures and power included, plus ready-made monitoring dashboards for deeper analysis.
| Category | Details |
|---|---|
| GPU utilisation | 4 GPUs · 6 h |
| GPU memory | of 320 GB |
| Latency | p50 · p95 |
| Recent log | replica 1 |
| Metric | Value |
|---|---|
| now | 67% |
| avg 6 h | 71% |
| weights + KV cache | 286 GB |
| headroom | 34 GB |
| time to first token | 210 · 480 ms |
| per output token | 18 · 26 ms |
| requests / min | 142 |
| errors | 0 |
| 12:04:11 | Running: 28 reqs, Waiting: 3 |
| 12:04:11 | KV cache usage: 71.2% |
| 12:04:06 | Throughput 1,812 tok/s |
| 12:03:58 | Running: 24 reqs, Waiting: 0 |
One deployment, one screen: GPU, memory, latency and logs side by side.
Solution brief · Page 4
Model console
MODEL CONSOLE
Deploy any open model in minutes
From a Hugging Face checkpoint or a GGUF file to a production endpoint with autoscaling, guardrails and per-project keys. No infrastructure knowledge required from the team that needs the model.
| Feature | Description | Tags |
|---|---|---|
| Model catalog | A curated library of chat, completion, embedding and vision-language models, plus the entries your teams add. Weights are downloaded once into the local model store and reused by every deployment. | Hugging Face, GGUF, private models |
| Multi-engine deployments | Pick the engine per deployment. Fractional GPUs for small models, tensor parallelism for large ones, fp8 KV cache, speculative drafts and an engine cache so replicas start in parallel. | vLLM, SGLang, llama.cpp, TensorRT-LLM |
| API gateway | One OpenAI-compatible endpoint in front of every model. Project-scoped keys, tokens-per-minute quotas, routing across several deployments and usage tracked per project as input and output tokens. | /v1/chat/completions, keys per project, TPM quota |
| Playground | Try any gateway model with text, images and documents before writing a line of code. Compare answers, tune parameters and copy a working request. | vision, PDF & text files, streaming |
| Fine-tuning | Train catalog models on your own data on the shared GPUs. Datasets are validated and previewed, jobs show live loss curves, and the result is a private model that deploys like any other. | SFT, DPO, ORPO, KTO, LoRA / QLoRA / full |
| Guardrails | Admins enforce, projects opt in. PII detection and masking, content filters, code-execution blocking and LLM-as-a-judge checks, applied per model, project or key, before or after the call. | Presidio, policies, runs offline |
| Autoscaling | Replicas follow demand on engine signals such as running requests, queue depth and KV-cache pressure, within the project's GPU limit. Vertical right-sizing trims CPU and memory without restarts. | engine metrics, GPU quota aware |
| Managed notebooks | JupyterLab with a GPU preset, single sign-on and an idle timeout that frees the GPU when nobody is working. Packages survive restarts and every notebook counts against the project's quota. | JupyterLab, fractional GPU, idle stop |
| Agentic assistant | A chat panel in every console that deploys, starts, scales and changes workloads with an approval card for each action, and diagnoses a failing workload from its logs, events and metrics with a fix ready to approve. | acts with approval, diagnoses failures, your own model |
Solution brief · Page 5
Marketplace & custom workloads
MARKETPLACE
Everything around the model, one click away
A model alone is not an application. Teams need a vector database for retrieval, a relational database for state, a chat front end, an experiment tracker, a workflow engine. The marketplace starts each of them inside the project with a short form, on the same GPUs, storage and sign-on as the models.
- Vector databases: Qdrant, Milvus, Weaviate, Chroma.
- SQL and NoSQL: PostgreSQL, MariaDB, MongoDB, Redis, Elasticsearch, InfluxDB.
- AI applications: Open WebUI, Dify, Langflow, Langfuse, Ollama, Gradio, Streamlit.
- Data science and MLOps: JupyterLab, RStudio, MLflow, Aim, Optuna, Superset, Metabase, DataHub.
- Workflow and platform: Airflow, Dagster, NiFi, Argo Workflows, Keycloak, Authentik, container registries.
Every template is pinned to a tested version, validated on delivery, and updated with the platform. Administrators can add their own templates for in-house services.
| Item | Description | Action |
|---|---|---|
| Qdrant | Vector database with filtering and hybrid search | Deploy → |
| Milvus | Vector database for billion-scale similarity search | Deploy → |
| PostgreSQL | Relational database with persistent volume | Deploy → |
| Redis | In-memory cache and queue | Deploy → |
| Open WebUI | Chat front end on the project's gateway models | Deploy → |
| Dify | Build agents and RAG apps visually | Deploy → |
| Langfuse | Tracing and evaluation for LLM apps | Deploy → |
| MLflow | Experiment tracking and model registry | Deploy → |
| Airflow | Scheduled data and training pipelines | Deploy → |
Dozens of services, each started with a form: name, size, a password, done.
| NAME | SOURCE | TYPE | RESOURCES | STATUS |
|---|---|---|---|---|
| qwen3-32b | Model catalog | Service | 2 GPU · 16 GB | Running |
| qdrant | Marketplace | Service | 2 CPU · 8 GB · 50 GB disk | Running |
| postgres | Marketplace | Service | 2 CPU · 4 GB · 20 GB disk | Running |
| rag-api | Own image | Service · 2 replicas | 1 CPU · 2 GB | Running |
| reindex-docs | Own image | Scheduled job · 02:00 | 4 CPU · ¼ GPU | Scheduled |
| eval-run-41 | Own image | Job | ½ GPU · 8 GB | Running |
| analyst-notebook | Notebooks | Notebook | ¼ GPU · 16 GB | Idle, stopped |
| All workloads share the project's network, volumes, secrets and quota · 6.75 of 8 GPU quota in use | ||||
One project, one list: the model, the databases around it, your own code and the nightly job.
CUSTOM WORKLOADS
Bring your own containers
Anything that runs in a container runs on the box, next to the models and with the same GPU fractions, quotas and monitoring. Teams submit their own images without a ticket and without learning the infrastructure underneath.
- Services with replicas, ports and a public or internal address, such as a retrieval API in front of a vector database.
- Jobs and scheduled jobs for evaluations, data preparation, nightly re-indexing or batch inference, with a GPU slice when they need one.
- Virtual machines for software that is not containerised, with SSH access through the platform's sign-on.
- Three levels of control: a simple form (image, command, CPU, memory, GPU, ports, env), an advanced form (volumes, probes, autoscaling) or raw YAML for experts.
- Project resources attached: persistent volumes, object storage buckets, Hugging Face repos as folders, secrets and environment variables.
Solution brief · Page 6
Inference, gateway & playground
INFERENCE, GATEWAY & PLAYGROUND
From any open model to a production API
Pick a model from the catalog, pick the engine that runs it best, and it is live behind one OpenAI-compatible endpoint. Teams try it in the playground first, then copy the same request into their code with a project key.
- The right engine per model. vLLM, SGLang, llama.cpp or TensorRT-LLM, chosen per deployment with optimized presets: fractional GPUs for small models, tensor parallelism for large ones, fp8 KV cache and speculative drafts for throughput.
- One gateway for everything. Every model behind the same OpenAI-compatible API, so existing SDKs, agents and tools work unchanged. Project-scoped keys, tokens-per-minute quotas, routing across replicas and deployments.
- Playground before code. Chat with any gateway model using text, images, PDFs and code files. Compare answers, tune parameters, copy a working request.
- Usage you can see. Input and output tokens per project and per model, next to GPU time, so you always know which team is using what.
| Label | Value |
|---|---|
| Playground | qwen3-32b |
| vLLM | 2 GPUs |
| temperature | 0.2 |
| vision | |
| 128k context | |
| project | legal |
| key | legal-prod |
| Input | 3,412 |
| Output tokens | 96 |
| Time | 1.9 s |
| guardrail | pii-mask ✓ |
| model | qwen3-32b |
| Authorization | Bearer sk-legal-prod-... |
| POST | /v1/chat/completions |
Same model, same key, same endpoint as the application that ships next week.
Playground example from the brief
supplier-contract-2026.pdf · 14 pages
Summarise the termination clauses and flag anything shorter than 90 days’ notice.
Two clauses allow termination. Clause 14.2 gives either party 180 days’ written notice. Clause 14.5 lets the supplier terminate on 30 days’ notice after a missed payment, which is below your 90-day threshold and should be renegotiated.
Ask a follow-up or attach a file…
Solution brief · Page 7
Agentic AI assistant
AGENTIC AI ASSISTANT
An operator that diagnoses and acts, with your approval
Every console carries a chat panel that does more than answer questions. Ask why a workload is not running and it reads the status, restarts, last log lines, events and memory peaks, then returns findings with evidence and a fix. Ask it to deploy a model, scale an API or add a teammate, and it does it through the same permissions you have.
- Recognises the usual suspects. Out-of-memory kills, image pull errors, crash loops by exit code, pods no GPU can take, failed mounts, evictions, failing health checks, failed model downloads.
- Approval before any change. Each action or fix is a card with the exact call. Nothing runs until you approve, the approval is signed by the server, and every approved change is in the audit log.
- Never destructive, always in scope. It can create, start, stop, scale and change, never delete, and sees only what you could see yourself.
- Your model, on your box. Runs on a model served by the system itself or on any provider you choose. Voice input in the browser.
- Open to your agents. The same tools are exposed as an MCP endpoint, so coding agents and automation use the platform with a personal access token.
Assistant example from the brief
Assistant Project · product Why is api-gateway not running? I read its status, events, last log lines and memory history. Two findings: ! Out of memory. The container was killed (OOMKilled) 4 times in 20 minutes. Peak memory 3.9 GB against a 4 GB limit. ! Health check failing. Readiness on /healthz never passed because the process restarts first. ✓ Image pull, volumes and GPU scheduling are fine. The fix is a larger memory limit. 6 GB fits the project's quota.
Change workload update_workload workload: api-gateway ram: 4 GB → 6 GB · restart: yes [Approve] [Decline]
Approved. Also scale qwen3-32b to two replicas for the launch.
Scale deployment set_model_deployment_replicas deployment: qwen3-32b · replicas: 1 → 2 · GPUs: 2 → 4 (2 free in queue) [Approve] [Decline]
Ask or tell the assistant...
Findings with evidence, fixes and actions as approval cards: nothing runs until you say so.
Solution brief · Page 8
Your hardware. Your identity. Your data.
BUILT FOR ONE ORGANIZATION
Your hardware. Your identity. Your data.
Everything runs on the box: models, prompts, datasets, fine-tuned weights, logs and metrics. Users sign in with your single sign-on, and projects keep teams' work apart.
Consoles & APIs
How people and automation use the platform
- Admin console
- Organization console
- Project console
- Model console
- REST API · OpenAPI
- MCP endpoint
IDENTITY AND QUOTAS ON EVERY CALL
Clastiq Enterprise
The model lifecycle, end to end
- Catalog & model store
- Deployments
- Gateway
- Fine-tuning
- Datasets
- Notebooks
- Guardrails
- Hugging Face volumes
SCHEDULED ONTO
NVIDIA hardware
Pre-installed, tuned and supported by Clastiq
- NVIDIA HGX or DGX GPUs with NVLink
- GPU scheduler with fractions & queues
- NVMe model & dataset storage
- Image registry
- Single sign-on
- Secrets
- Metrics & dashboards
- Backups
Projects for teams
Each team gets a project with its own members and roles, quotas for CPU, memory, GPU, storage and tokens, and its own API keys, buckets and secrets. Network policies keep projects apart on the shared machine.
Quotas you can trust
A project cannot take more than its limit, and never starves another team of its guaranteed share. Idle GPUs are lent out automatically and reclaimed when their owner needs them.
Operable by one admin
The box arrives installed and tuned for its GPUs. Upgrade in one step, back up and restore workloads from the console, and read every administrative change in the audit log. No platform team required.
Solution brief · Pages 10–11
Complete feature list
AT A GLANCE
Feature list
| Capability | What you get |
|---|---|
| GPU SHARING & SCHEDULING | |
| Fractional GPUs | Notebooks, embedding models and small chat models request a quarter or half of a card. Several workloads share one GPU, each within its own memory budget. |
| Project queues | Guaranteed GPU quota, hard limit and a weight for borrowing idle capacity, per project. The same for CPU and memory. |
| Queued work | Jobs beyond quota wait in the queue and start when capacity frees up. Users see their position and the reason. |
| Multi-GPU models | Tensor parallelism across cards for 70B-class models, presented as one deployment. |
| Autoscaling | Replicas follow running requests, queue depth or KV-cache pressure, within the project's GPU limit. Vertical right-sizing of CPU and memory. |
| OBSERVABILITY | |
| GPU metrics | Utilisation and memory per GPU and per deployment, from one hour to seven days, on the model dashboard. |
| Gateway metrics | Requests, input and output tokens, latency and errors per model and per project. |
| Workload insight | Live logs, events and resource graphs for every deployment, notebook and job; usage history per project against quota. |
| Monitoring dashboards | Ready-made dashboards for the administrator, with every metric available for custom views and alerts. |
| MODELS & INFERENCES | |
| Model catalog | Hugging Face and GGUF sources, custom entries, private fine-tuned models. |
| Model store and downloads | Weights are downloaded once from Hugging Face into the local NVMe store, with progress shown and downloads that pause and resume. Every deployment and fine-tune loads from the store, and an engine cache lets replicas start in parallel. |
| Inference engines | vLLM, SGLang, llama.cpp and TensorRT-LLM, chosen per deployment, with optimized presets. |
| API gateway | OpenAI-compatible endpoint, per-project keys, tokens-per-minute quotas, routing across deployments. |
| Playground | Chat with any gateway model using text, images, PDFs and code files. |
| Fine-tuning | SFT, DPO, ORPO and KTO; LoRA, QLoRA and full; vision models; datasets validated and previewed; private results. |
| Managed notebooks | JupyterLab with GPU presets, single sign-on, persistent packages and idle stop. |
| Hugging Face volumes | Model and dataset repos mounted into workloads as folders, fetched on first read. |
| AGENTIC ASSISTANT & DIAGNOSTICS | |
| Acts on your behalf | Deploy models, submit, start, stop, scale and change workloads, create projects, add members, start marketplace services. Each action shown as an approval card with the exact call; nothing runs unapproved and nothing deletes. |
| Workload diagnostics | "Why is it not running?" answered from status, restarts, container exits, last log lines, events and memory peaks, with findings, evidence and a proposed fix for approval. |
| Answers and lookups | Quota left, running workloads, GPU usage, how-to questions, all scoped to what the user may see. |
| Your model or any provider | Runs on a model served by the system itself, or on an external provider; the key never reaches the browser. Voice input in the browser. |
| Capability | What you get |
|---|---|
| MCP endpoint | The same tools for coding agents and automation, authenticated with personal access tokens. |
| SECURITY & GOVERNANCE | |
| Guardrails | PII masking, content filter, code-execution block and LLM-as-a-judge, scoped globally, per model, per project or per key. Runs fully offline. |
| Identity | Single sign-on for every console and notebook, roles per project, personal access tokens for scripts. |
| Isolation | Projects separated by network policies and firewalls; private buckets and a private model store per project. |
| Audit | Every administrative change recorded with who, what and when. |
| MARKETPLACE & WORKLOADS | |
| Vector and relational databases | Qdrant, Milvus, Weaviate, Chroma, PostgreSQL, MariaDB, MongoDB, Redis, Elasticsearch and InfluxDB, started with a form and backed by project volumes. |
| AI applications and tooling | Open WebUI, Dify, Langflow, Langfuse, Ollama, Gradio, Streamlit, MLflow, Aim, Optuna, Superset, Metabase, DataHub, Airflow, Dagster, NiFi, Argo Workflows and more, pinned to tested versions. |
| Custom containers | Your own images as services, jobs, scheduled jobs or virtual machines, with GPU fractions, replicas, ports, volumes, buckets, secrets and environment variables. |
| Object storage buckets | S3-compatible buckets per project on the box: browse and upload in the console, mount into any workload as a folder, and use from code with standard S3 clients and project keys. |
| Submission modes | Simple form, advanced form with probes and autoscaling, or raw YAML for experts. The same quota and monitoring for all three. |
| Own templates | Administrators publish in-house services to the marketplace for every team. |
| PLATFORM & OPERATIONS | |
| Automation | REST API with OpenAPI description and personal access tokens for scripts and infrastructure-as-code. |
| Operations | One-step upgrades, backups and snapshots from the console, GPU health and temperatures on the admin dashboard. |
| HARDWARE & DELIVERY | |
| NVIDIA systems | Clastiq Station on DGX Station (desk-side Grace Blackwell), and Clastiq H200, B200 and B300 on HGX H200, B200 and B300 (eight SXM GPUs with NVLink), each with an NVMe model store sized for its GPUs. |
| Pre-installed | Clastiq Enterprise, GPU scheduler, registry, single sign-on and monitoring configured and tested before shipment. |
| One contract | Hardware warranty, platform updates and support in one agreement, with one point of contact. |
| Enablement | On-site or remote workshop for administrators and the first teams; first model serving on delivery day. |
Solution brief · Page 12
Next step
NEXT STEP
Ready to run AI on your own terms?
A one-hour walkthrough covers the GPU class that fits your models, the teams that will share the box and how it connects to your sign-on and network. Your Clastiq AI Platform arrives installed and serves its first model on delivery day.
Book a walkthrough
Request the datasheet
Clastiq clastiq.ai
© 2026 Clastiq. NVIDIA, HGX, DGX, Grace, Hopper, Blackwell and ConnectX are trademarks of NVIDIA Corporation. Other names are trademarks of their respective owners.
vLLM, SGLang, llama.cpp, TensorRT-LLM and Hugging Face are independent projects. Specifications subject to change.
Book a consultation call
Discuss your workloads, teams and requirements. We'll help match the right NVIDIA hardware with the best-fit enterprise AI solution for your organisation.
A cooperation between Tiada and Cognition AI
NVIDIA hardware supplied, integrated and warrantied by Tiada, with Clastiq Orchestrator from Cognition AI's rFactorial product group — delivered as one solution with one support contract.