Skip to content

Maintenance & Operations

This document covers operational best practices for maintaining the LLM Telemetry Proxy and Dashboard in production.

🗄 Database Compaction (db_compress.py)

As millions of LLM requests are processed, the SQLite database grows. The built-in database compressor aggregates historical calls older than 14 days into 2-week summary buckets.

Manual CLI Execution

# 1. Preview changes without modifying data
python proxy/db_compress.py --dry-run

# 2. Execute database compression
python proxy/db_compress.py

Triggering via Dashboard API

You can also trigger database compression from the Dashboard UI or via HTTP:

curl -X POST http://localhost:9118/api/db/compress

Automation via Cron

To automate database compaction every Sunday at 3:00 AM:

0 3 * * 0 /path/to/llm-proxy/.venv/bin/python /path/to/llm-proxy/proxy/db_compress.py >> /path/to/llm-proxy/data/db_compress.log 2>&1

💲 Model Cost Synchronization (update_model_costs.py)

Pricing for LLM models frequently drops across competitive providers. To keep cost metrics accurate over time without manual JSON editing:

python dashboard/update_model_costs.py
  • Fetches latest pricing from LiteLLM Pricing Dataset.
  • Checks if the new price differs from the current active tier.
  • If changed, creates a new entry with the current effective_date while preserving past historical tiers.
  • Does not overwrite past dates, ensuring past telemetry calculations remain accurate.

🧹 Log Rotation & Maintenance

Runtime logs and process metadata are stored in data/:

Path Purpose
data/proxy.log Standard output and error logs from the proxy gateway.
data/dashboard.log Standard output and error logs from the dashboard server.
logger/payloads.jsonl Raw request/response payloads (when raw logging is active).
data/.proxy.pid Process ID of the active proxy process.
data/.dashboard.pid Process ID of the active dashboard process.

Clearing Logs

To clear logs safely without stopping running processes:

# Clear proxy logs
curl -X POST http://localhost:9118/api/proxy/clear-logs

# Clear raw inspector payloads
curl -X POST http://localhost:9118/api/raw-log/clear

🔄 Service Lifecycle Management

Use dashboard/dashboard.sh or start.sh for reliable service control:

# Graceful restart with port configuration
./start.sh restart 9118

# Stop all processes (including proxy)
./start.sh stop --all