test: K8s Job-based integration testing with migrations
CI / CI (pull_request) Successful in 16m41s

Add proper integration test infrastructure:

migrations/run_migrations.sh:
  - Database migration runner (used by K8s Job)
  - Applies all SQL migrations in order
  - Waits for DB to be ready
  - Verifies schema creation
  - Reports success/failure

k8s/test/integration-test-job.yaml:
  - Kubernetes Job manifest for E2E testing
  - Two-stage execution:
    1. migrate: Apply database migrations
    2. test: Run integration test against new pod
  - Uses new image SHA from CI build
  - Proper secret management via K8s secretKeyRef
    (passwords stored in cluster, not in manifests)
  - Resource limits and liveness probes
  - Cleanup after 1 hour (ttlSecondsAfterFinished)

.gitea/workflows/integration-test.yaml:
  - CI workflow that runs after image build
  - Validates image exists in registry
  - Deploys Job with correct image SHA
  - Waits for job completion (10 min timeout)
  - Collects pod logs on failure
  - Automatic cleanup

Security:
  • No plaintext credentials in manifests
  • Uses K8s secretKeyRef for DB password
  • All secrets encrypted with SOPS/Age (ArgoCD plugin)
  • Never embed credentials in git

Usage:
  - Automatic: Runs after each CI build on main
  - Manual: Trigger with specific image SHA via workflow_dispatch
  - Tests: Full E2E ingest + persistence + query

URGENT: Rotate memory-db-app password
  (was visible in debugging shell history)
This commit is contained in:
2026-09-14 22:44:53 +09:00
parent 6915dc2462
commit 6499dae6e5
3 changed files with 521 additions and 0 deletions
+127
View File
@@ -0,0 +1,127 @@
#!/bin/bash
# Database Migration Runner
# Used by K8s Job to apply all migrations before integration tests
#
# Environment variables (from K8s):
# DB_HOST - PostgreSQL host
# DB_PORT - PostgreSQL port
# DB_NAME - Database name
# DB_USER - Database user
# DB_PASSWORD - Database password (from Secret)
set -e
DB_HOST="${DB_HOST:-memory-db-rw.poimen.svc.cluster.local}"
DB_PORT="${DB_PORT:-5432}"
DB_NAME="${DB_NAME:-memory}"
DB_USER="${DB_USER:-app}"
if [ -z "$DB_PASSWORD" ]; then
echo "ERROR: DB_PASSWORD not set"
exit 1
fi
echo "=========================================="
echo "Database Migration Runner"
echo "=========================================="
echo ""
echo "Configuration:"
echo " Host: $DB_HOST:$DB_PORT"
echo " Database: $DB_NAME"
echo " User: $DB_USER"
echo ""
# Export for psql
export PGPASSWORD="$DB_PASSWORD"
# Get migration directory (where this script is)
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
MIGRATION_DIR="$SCRIPT_DIR"
echo "Migration directory: $MIGRATION_DIR"
echo ""
# Collect all SQL files
MIGRATIONS=($(ls -1 "$MIGRATION_DIR"/*.sql 2>/dev/null | sort))
if [ ${#MIGRATIONS[@]} -eq 0 ]; then
echo "ERROR: No migration files found in $MIGRATION_DIR"
exit 1
fi
echo "Found ${#MIGRATIONS[@]} migration(s):"
for m in "${MIGRATIONS[@]}"; do
echo " - $(basename $m)"
done
echo ""
# Wait for DB to be ready
echo "Waiting for database to be ready..."
for i in {1..30}; do
if psql -h "$DB_HOST" -p "$DB_PORT" -U "$DB_USER" -d "$DB_NAME" -c "SELECT 1;" >/dev/null 2>&1; then
echo "✓ Database is ready"
break
fi
if [ $i -eq 30 ]; then
echo "✗ Database not ready after 30 attempts"
exit 1
fi
echo " Attempt $i/30..."
sleep 1
done
echo ""
echo "=========================================="
echo "Running Migrations"
echo "=========================================="
echo ""
SUCCESS=0
FAILED=0
for migration in "${MIGRATIONS[@]}"; do
name=$(basename "$migration")
echo -n "$name ... "
if psql -h "$DB_HOST" -p "$DB_PORT" -U "$DB_USER" -d "$DB_NAME" -f "$migration" >/dev/null 2>&1; then
echo "✓"
((SUCCESS++))
else
echo "✗ FAILED"
echo ""
echo "Error output:"
psql -h "$DB_HOST" -p "$DB_PORT" -U "$DB_USER" -d "$DB_NAME" -f "$migration" 2>&1 | sed 's/^/ /'
((FAILED++))
fi
done
echo ""
echo "=========================================="
echo "Migration Summary"
echo "=========================================="
echo " Success: $SUCCESS"
echo " Failed: $FAILED"
echo ""
if [ $FAILED -eq 0 ]; then
echo "✓ All migrations applied successfully"
echo ""
echo "Verifying schema..."
echo ""
# Verify key tables exist
for table in memory_entity memory_edge ingest_jobs; do
if psql -h "$DB_HOST" -p "$DB_PORT" -U "$DB_USER" -d "$DB_NAME" -c "SELECT 1 FROM information_schema.tables WHERE table_name='$table';" 2>&1 | grep -q "1 row"; then
echo " ✓ Table $table exists"
else
echo " ⚠ Table $table not found"
fi
done
exit 0
else
echo "✗ Some migrations failed"
exit 1
fi