Digital Lexicon Hub logo

Digital Lexicon Hub

THE TECHNICAL LANGUAGE OF DIGITAL B2B INFRASTRUCTURE

PRACTICE
DATA ENGINEERING

Change Data Capture (CDC)

A technique that detects inserts, updates and deletes in a source database and delivers them as a stream of change events to other systems.


BUSINESS RELEVANCE

CDC keeps analytics, search indexes and downstream apps current within seconds instead of nightly batch loads, without heavy queries or code changes on the production database.


IMPLEMENTATION EXAMPLE

An e-commerce team runs Debezium on PostgreSQL to stream order table changes into Apache Kafka, then loads them into Snowflake, so revenue dashboards update within a minute and deleted orders are reflected too.


LIMITATIONS

Log-based CDC requires database configuration, log retention and handling of schema changes, and initial snapshots of large tables take time. It captures row changes, not business meaning, so events often need transformation.


TECHNICAL EXPLANATION

Log-based CDC reads the database's write-ahead or transaction log, such as the PostgreSQL WAL or MySQL binlog, and converts each committed change into an event with before and after values, operation type and transaction metadata. In SQL Server, a capture job reads the transaction log and copies changes into change tables. Alternatives such as timestamp polling and triggers miss deletes or add load. CDC feeds a Data Pipeline or an Event-Driven Architecture through brokers like Kafka.


Secondary Topics

Systems Architecture

Related terms

A/B Testing

PRACTICE
EXPERIENCE DESIGN

How A/B tests split traffic between a control and a variant, set sample size and significance, and decide which version improves conversions.

Entity SEO

PRACTICE
SEARCH OPTIMIZATION

An SEO practice that makes people, organizations, products and their relationships clear to search engines through consistent content and structured data.

Loyalty Program

PRACTICE
REVENUE OPERATIONS

Points, tiers and member benefits designed to increase repeat purchases and retention, measured by redemption, active members and incremental revenue.

System Integration

PRACTICE
SYSTEMS ARCHITECTURE

The technical discipline of linking disparate enterprise software, databases, and APIs into a coherent operating ecosystem.

Prompt Engineering

PRACTICE
INTELLIGENT AUTOMATION

Prompt engineering structures instructions, roles, examples and context for language models, then tests prompt versions against evaluations to improve output.