Skip to content

Add embedding/response cache with pluggable backends (disk, Redis) #357

Description

@himanshu231204

Problem

Once the basic local disk response cache lands (see related issue), larger/team deployments will want a shared cache backend rather than a per-machine disk cache.

Goal

The response cache is generalized behind a small backend interface so it can be pointed at Redis (or similar) without changing pipeline code.

Suggested implementation

Extract a CacheBackend interface from the initial disk-cache implementation (core/cache.py), with a DiskCacheBackend (default) and a RedisCacheBackend (optional extra, following the existing pattern of optional-dependency extras like qdrant/pinecone in pyproject.toml).

Files/components

  • openagent_eval/core/cache.py
  • openagent_eval/providers/base/* (interface touchpoints)
  • pyproject.toml (new redis extra)

Acceptance criteria

  • Cache backend is configurable via config.cache_backend, defaulting to disk.
  • A Redis-backed cache is demonstrated working in an integration test (using a test Redis instance or fakeredis).

Difficulty

Advanced


Filed from a repository audit. Full report: https://claude.ai/code/artifact/134cec04-96c5-4d58-af5e-207def4ab524
Depends on the local disk cache issue (#343).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions