Skip to main content
ExLibris

Knowledge Assistant

BETA
 
  • Subscribe by RSS
  • Back
    Primo

     

    Ex Libris Knowledge Center
    1. Search site
      Go back to previous article
      1. Sign in
        • Sign in
        • Forgot password
    1. Home
    2. Primo
    3. Community Knowledge
    4. How to remove records from deduplilcation

    How to remove records from deduplilcation

    1. Last updated
    2. Save as PDF
    3. Share
      1. Share
      2. Tweet
      3. Share
    No headers
    Created By: Knut Bøckman
    Created on: 8/08/2018

    Question:

    How do I remove deduplication from record sets that are already deduped?

     

    Answer:

    To avoid deduplication of records, you can use t=99 in the dedup section of the Normalization rules, or you can set you pipes to end after stage "Persistence" (if you want neither dedup or FRBR) or stage "FRBR without dedup" (if you want FRBR). But this only keeps new records from going through the deduplication process, it does not reverse the process for records that are already deduped. In order to achieve this, you need to ensure that the data elements that creates a match between records are unique for each record, so they are separated insted of match. The solution is to configure you NR set so that the pnx/dedup/c.. and pnx/dedup/f.. fields are populated with a unique value for each record, instead of the standard values (ISBN, Title, Author, etc., that are there to find matches). The safest way to ensure uniqueness is to populate all theses fields (or the morst significant of them) with PNX value control/recordid. Make sure PNX/dedup value of subfield "t" is set to 1 or 2, Then deploy the normalization set and run a no-harvest pipe through the dedup stage - the records will go through the deduplication process, and since none of them are matching, they will not be part of any dedup_mrg group. Run indexing and hotswap to complete the process.

    Set PNX/dedup value of subfield  "t" to 99 to skip the dedup process for future pipe runs.

     
    Report Abuse
    View article in the Exlibris Knowledge Center
    1. Back to top
      • How to modify the normalization rules for the ‘Subject’ field to include subfield v and for the 'Genre' field to display 655 field in Primo VE
      • Improving the 505 Table of Contents display
    • Was this article helpful?

    Recommended articles

    1. Article type
      Topic
      Community Content Type
      How To
      Language
      English
      Product
      Primo
    2. Tags
      This page has no tags.
    1. © Copyright 2025 Ex Libris Knowledge Center
    2. Powered by CXone Expert ®
    • Term of Use
    • Privacy Policy
    • Contact Us
    2025 Ex Libris. All rights reserved