Jump to content
  • 0

Duplicate Data





I need my users to be able to easily identify duplicate data.


Please consider the following scenarios:


Lead                               Address

John Daly                        11 Main St

Kerry Webb                     11 Main St


Byron Nelson                   22 Wall St

Sam Snead                      22 Wall St


John and Kerry are married and should be merged.

Byron and Sam are roommates and should not be merged.


A computer is not capable of determining who should be merged and who shouldn't; rules like same last name = merged or different last name = not-merged don't work in the real world, so I need want to perform a search the identifies duplicate data and allow the users to decide what to do next.


Consider this sample list:

Lead                               Address

Albert                              11 Main St

Betty                               33 3rd

Chris                               22 Wall St

Dan                                 44 Monroe

Eve                                 55 Post St

Frank                              11 Main St

Gloria                              66 6th St

Harry                               77 Sky Dr

Isla                                  44 Monroe

Jenny                              88 Broadway

Kyle                                 99 Bourbon St

Lenny                              33 3rd


The results of the duplicate identification should be:

Albert & Frank - 11 Main St

Chris & Lenny - 33 3rd

Dan & Isla - 44 Monroe


The user will then decide what to do with each match.


Any ideas?





Link to comment
Share on other sites

9 answers to this question

Recommended Posts

  • 0

Hello CHAD,


As far as I know, the Filter option allows users to find all duplicate records.


If you open a table and click Filter, you will see the Show duplicates in field check box. You can select a field and click Apply, that only duplicate records will be displayed.


Does it work for you?

Or do you want to display duplicate records on a Report DataPage?

Link to comment
Share on other sites

  • 0

Hello CHAD,


I think, you can try the following script:

​<script type="text/javascript">

function compare_three_values(first,second,third)
if ((first == second)||(first == third)) return true;
else return false;

//create the list of all cells
var elems = document.getElementsByClassName("cbResultSetTableCell");

//insert the number of columns
var number_columns = 2;

//insert the order of the column with address, the first column is 0, the second is 1...
var correct_column = 0;

//select only required cells from all cells
var k = 0; var n = 0; var list_tds = [];
for (var i=0, m=elems.length; i<m; i++) 
   if (k == correct_column)
   { list_tds[n] = elems[i]; n = n + 1;   }
   k = k + 1;
   if (k == number_columns) { k = 0; }

//the list for rows, true means the data is duplicate, false means that data is not duplicate
var display_row = [];
var index_display_row = 1;

//check the first row
display_row[index_display_row] = compare_three_values(list_tds[0].innerHTML, list_tds[1].innerHTML,"");
index_display_row = index_display_row + 1;

//check other rows
for (var i=1, m=list_tds.length-1; i<m; i++) 
   display_row[index_display_row] = compare_three_values(list_tds[i].innerHTML,list_tds[i-1].innerHTML,list_tds[i+1].innerHTML);
index_display_row = index_display_row + 1;

//check the last row
var i = list_tds.length-1;
display_row[index_display_row] = compare_three_values(list_tds[i].innerHTML,list_tds[i-1].innerHTML,"");
index_display_row = index_display_row + 1;

//create the list of elements Row
var list_rows = document.getElementsByTagName("tr");

//if the data is not duplicate, to hide the row
for (var i=1, m=index_display_row; i<=m; i++) 
if (!display_row[i]) { list_rows[i].style.display='none'; }


This script hides all not duplicated records.

Please note, that the script works only if:

- the Tabular Report DataPage is used;

- the table is sorted by the correspond field (you can select your field in the Default Sort order field and deselect "Interactive Sorting" on the Search Results Options step).

Please, enter your values instead 0 and 2 in the following lines:
//insert the number of columns
var number_columns = 2;

//insert the order of the column with address, the first column is 0, the second is 1...
var correct_column = 0;

I hope it helps.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Create New...