GLOSSARY logo

GLOSSARY

THE TECHNICAL LANGUAGE OF DIGITAL B2B INFRASTRUCTURE

CONCEPT
DATA ENGINEERING

Data Pipeline

A sequence of processes that collects, moves, validates, transforms, and delivers data from one or more sources to target systems.


BUSINESS RELEVANCE

Data pipelines make operational and analytical information available consistently for reporting, automation, personalisation, and AI.


IMPLEMENTATION EXAMPLE

A pipeline ingests product events, validates schemas, removes duplicates, enriches records, loads a warehouse, and alerts owners when freshness or quality thresholds fail.


LIMITATIONS

A successful job does not guarantee correct data. Pipelines can propagate source errors quickly, and unmanaged dependencies, schema changes, or reprocessing can create inconsistent results.


TECHNICAL EXPLANATION

Pipelines may operate in batches or streams and include ingestion, storage, transformation, orchestration, quality checks, metadata capture, error handling, and delivery. Reliable designs address schemas, idempotency, retries, lineage, observability, security, and recovery.


Secondary Topics

Systems Architecture

Sources

Apache Airflow Documentation — https://airflow.apache.org/docs/; OpenLineage — https://openlineage.io/

Related terms

Lifecycle Stage

CONCEPT
REVENUE OPERATIONS

A CRM classification defining an account or contact's current position within the buyer journey from lead to customer.

Noindex

CONCEPT
SEARCH OPTIMIZATION

A robots meta directive instructing web crawlers to exclude a designated webpage from search engine index results.

Design Token

CONCEPT
EXPERIENCE DESIGN

A named variable encapsulating atomic visual design attributes such as color values, typography rules, and spacing scales.

Search Intent

CONCEPT
SEARCH OPTIMIZATION

The primary objective and information need driving a user to submit a specific query into a search engine.

Unique Selling Proposition (USP)

CONCEPT
REVENUE OPERATIONS

The distinct, defensible attribute that differentiates a business offer from competitors in the minds of target customers.