Setting up Zep in a Kubernetes Cluster
Setup a Kubernetes Cluster
Setup a Kubernetes Cluster (e.g. using Docker Desktop for local testing on your laptop).
Make sure cluster is running...
Create an OpenAI API Key secret
Create a Secret to store the
Run the deployment yaml
Make sure you have setup port forwarding (default listen port in the config is localhost:8000)
http://localhost:8000 to access the Zep API.
Installing on EKS, GKE, and other managed Kubernetes services
The base instructions above will bring up a local Kubernetes deployment of a Zep server and related containers, with a very limited configuration. For production or managed Kubernetes deployment, this template should be edited to include resource requests and limits, and other Zep configuration options and secrets.
For resource requirements to consider, see the production deployment guide.