AI Knowledge Base · AI Cloud Platforms · GPU marketplaces
Vast.ai
A GPU marketplace for the lowest cost per hour.
Ideal para: Experiments, batch jobs and fine-tuning where cost matters more than guarantees.
AI services
- Rent GPUs from many independent hosts, from consumer cards to datacentre H100s.
- On-demand and interruptible (bid) pricing; Docker-based instances; serverless endpoints.
GPUs and accelerators
- Very wide choice of GPUs; filter for verified datacentre hosts for more reliability.
Agents and identity
- API keys for automation; keep them in a secrets manager, never in images.
Security and data
- Hosts are third parties: never place confidential or regulated data on community hosts. Encrypt data at rest and in transit.
Scaling and optimisation
- Spread batch work across many cheap instances, with checkpointing for interruptions.
UK and EU regions
Hosts worldwide; choose location filters, but treat residency as unguaranteed.
Watch out for
Variable reliability and security between hosts; design for interruption and treat data as exposed.
How Workstation helps: We automate checkpointed, interruption-tolerant jobs and keep sensitive data on trusted infrastructure.
Scaling AI at large scale with Amazon Bedrock →CI/CD for LLMs, agents and data in the cloud →Securing LLM and agent APIs →The AI agent harness →Identity and authentication for AI →
Other providers we work with
Logos are trademarks of their respective owners, used only to identify each platform, and come from Wikimedia Commons. Diagrams by the Workstation team.