Definition
A deduplication merge field is a data point within each subscriber record that is used as the matching key to detect duplicates — typically the email address itself. When records share the same value in this field, they are treated as the same person and merged.
Choosing the right merge field is essential for accurate deduplication. A stable, unique field such as email catches true duplicates, while a weak or shared field can cause real people to be merged together incorrectly.
Choosing a Dedupe Field
| Field | Reliability | Notes |
|---|---|---|
| Email address | High | Most dependable key |
| Customer ID | High | If consistently populated |
| Name + address | Medium | Prone to collision |
| Phone number | Medium | May be shared or blank |
Email is usually the safest merge key.
How Dedupe Merge Works
- Normalise the field: Lowercase and trim email before matching.
- Match on the key: Group records sharing the same merge value.
- Merge the groups: Combine records into one canonical profile.
- Preserve best data: Keep the strongest values from each record.
Best Practices for the Merge Field
- Use a stable, unique field: Prefer email or a reliable ID.
- Normalise consistently: Prevent case and spacing from hiding duplicates.
- Guard against overwrites: Keep the best data when merging.
- Test before bulk run: Validate the field catches true duplicates only.
Related Glossary Terms
Custom Field
A custom field is a user-defined data field in an email platform that stores specific subscriber information beyond the standard email address and name.
Customer Data Platform (CDP) for Email
A customer data platform (CDP) is a system that unifies customer data from multiple sources into a single profile, enabling advanced email personalisation, segmentation, and cross-channel coordination.
Right to Data Portability (GDPR)
The right to data portability allows individuals to obtain and reuse their personal data across different services, including exporting subscriber data from email marketing platforms.
Data Subject Access Request (DSAR)
A Data Subject Access Request (DSAR) is a GDPR right allowing individuals to request access to their personal data held by an organisation, including email marketing data.
Email Address Hygiene
Email address hygiene is keeping a list free of invalid, stale and risky addresses through verification, bounce handling and deduplication. Learn why hygiene protects deliverability and your sending reputation.
Email Append
Email append is a service that matches customer records against a database of known email addresses to append missing email data to existing contact profiles.
Frequently Asked Questions
A deduplication merge field is the data value used as the key to detect and merge duplicate subscriber records. The email address is the most common and reliable key.
Because it is meant to be unique to a person and stays constant, the email address is a reliable way to tell that two records are the same subscriber. A consistent, unique value is exactly what a dedupe merge needs.
A weak or shared field can merge genuinely different people into one record, losing data and misdirecting mail. A good merge field is stable and unique, so deduplication merges true duplicates without collapsing distinct subscribers.
Normalise the key field, match records on it, then merge while preserving the strongest values from each record — such as the most recent consent or most complete profile — rather than blindly overwriting one with the other.