Description

Prevent dedup and FRBR in the new and updated records.

Note: the following instructions do not break existing Dedups.

Resolution

Procedure:

To prevent Deduping in the future:

1. Edit dedup section on the Normalization Rules:
    a. Set dedup:t subfield to 99 to avoid future matching for Deduping.
    b. Change dedup:c1 rule source from LCCN to recordid (control/recordid)
    c. Disable rules c2-c5, and f1-f11.

To prevent FRBR in the future:

2. Edit FRBR section on the Normalization Rules:
    a. Set frbr:t subfield to 99 to avoid future matching for FRBR.
    b. Change frbr:K1 rule source from author's source fields to control/recordid;
        Add the following transformations: Add $$K to the beginning of the string, and $$AA to the end of it.

3. Save and Deploy Normalization Rule changes

Note: setting t = 99 means the Dedup and FRBR algorithms skip the record. It does not remove it from Dedup or FRBR grouping as calculations are skipped.

Additional optional procedure:

To break existing Dedup group:

4. Edit dedup section on the Normalization Rules:
    a. Set dedup:t subfield to 1 to force calculation of Dedup keys (reset rules to default).
    b. Change dedup:c1 rule source from LCCN to recordid (control/recordid)
    c. Disable rules c2-c5, and f1-f11.

To break existing FRBR groups:

5. Edit FRBR section on the Normalization Rules:
    a. Set frbr:t subfield to 1 to force calculations for FRBR.
    b. Change frbr:K1 rule source from author's source fields to control/recordid;
        Add the following transformations: Add $$K to the beginning of the string, and $$AA to the end of it.

6. Run the NO_HARVEST pipe with force FRBR and force dedup selected in the pipe configuration

7. Index and Hotswap.

Once completed and confirmed:

8. De-select force FRBR and force dedup in the pipe configuration

9. Set Dedup section rules as described in #1 to avoid future calculation all together.

Additional Information

For customers with a Network Zone in Alma and a Centralized Publishing pipe in Primo additional steps are required:

1. In the main Regular pipe's configuration uncheck the "Include DEDUP" and/or "Include FRBR" checkboxes.

2. In the Dedup_Frbr pipe's configuration:

a. If turning off FRBR only, change the "System Last Stage" value to DEDUP.

b. If turning off Dedup only, change the "System Last Stage" value to FRBR WITHOUT DEDUP.

c. If turning off both - remove the pipe from the schedule as it's no longer needed.

• Article last edited: 08-Aug-2018