Run a Pydantic AI agent on cloud-provisioned infrastructure using Kiso — a template for reproducible agentic workloads.
This is a proof-of-concept that provisions a node (via Chameleon or Vagrant/VirtualBox), installs Ollama to serve a local open-source LLM, and runs a minimal Python agent using Pydantic AI. The agent asks where the 2012 Olympics were held and parses the response into a typed CityLocation object.
Use this as a starting template for running more complex agentic workloads on reproducible, cloud-provisioned infrastructure.
System requirements:
- Python 3.9+
- a Chameleon account (for remote provisioning), or Vagrant + VirtualBox (for local VM provisioning)
Install Kiso:
# Install the provider-specific dependencies for your target environment
pip install kiso[chameleon] # for Chameleon Cloud
pip install kiso[vagrant] # for Vagrant/VirtualBox
pip install kiso[chameleon,vagrant] # for both1. Add credentials
Place any required credentials in the secrets/ directory. See Credentials for details.
2. Provision infrastructure
kiso up3. Run the agent
kiso run
# Check the output
cat agent-output.txt4. Tear down
kiso downOutputs defined in the experiment configuration are written to the path specified in that config.
Note
secrets/chi-tacc-app-cred-openrc.sh is required for the default chameleon site in experiment.yml. No files are required in secrets/ when using the local Vagrant/VirtualBox setup. To use Vagrant/VirtualBox comment out the chameleon site and uncomment the vagrant site in experiment.yml.
- A Chameleon account at chameleoncloud.org
- An active Chameleon project allocation — create a new project or join an existing one
- An OpenRC credentials file — create an application credential and download the OpenRC v3 file from the Chameleon dashboard under Identity → Application Credentials — used as the
rc_filefield in the config - An SSH keypair registered in your Chameleon project — used as the
key_namefield in the config
- EnOSlib — Python library for reproducible distributed systems experiments, used internally by Kiso for resource management.
- Chameleon Cloud
- Vagrant — Tool for building and managing portable virtual machine environments, used for local provisioning.
Kiso is funded by the National Science Foundation (NSF) under award 2403051.
Apache 2.0 © Pegasus ISI