Lewati ke isi

Troubleshooting — CDC Consumer Errors

Gejala

  • clickhouse-etl restart loop di PM2
  • Log: unknown column, type mismatch, DLQ insert

Diagnosis

pm2 logs clickhouse-etl --lines 100

Periksa event Kafka terakhir vs skema erp_clickhouse.<tabel>.

Penyebab umum

Error Penyebab Fix
Unknown column DDL PG sebelum CH (tambah kolom) Migrasi CH dulu, restart consumer
Type mismatch Ubah tipe tanpa stop consumer Stop → CH → PG → start
DLQ spike Data invalid / constraint CH Inspect DLQ table; fix source PG
TENANT_SCHEMAS kosong Env Set tenant list, restart PM2

Urutan DDL (wajib)

Lihat AGENTS.md dan clickhouse-patterns.md.

Rujukan