Customer Engagement & Dynamics CRM Forum

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

@Heather Laughlin​​

Yes, it is probably due to the accounts having the same name.

I think the easiest way for you to get around this is to simply turn off the duplicate detection rules before importing the records, and then turn them on again when the import is finished.


------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime
------------------------------

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

Upon importing, you have the option to allow duplicates or not. Choosing YES for that setting should bypass your duplicate detection rules. So no need to unpublish / re-publish them manually.

As long as the Account GUID is unique, you should not get the duplicate message anymore.

------------------------------
Rogier Vriezen
CRM Consultant
Amsterdam, Netherlands
------------------------------

Original Message:
Sent: Feb 19, 2021 02:58 AM
From: Niels Søgaard Lønberg
Subject: my import keeps failing- any advice?

@Heather Laughlin​​

Yes, it is probably due to the accounts having the same name.

I think the easiest way for you to get around this is to simply turn off the duplicate detection rules before importing the records, and then turn them on again when the import is finished.


------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

Hi Heather
I've had the same issue in the past.  It seemed to be the duplicate checker, like you suggested.

I got round this by creating and Advanced Find for the data i want to update and exported that.  The export includes all the GUID's for the records, so then once you've made changes you can import from there.  I then switch the button on one of the import screens that asks about Duplicates to YES, which seems to bypass the duplicate checker and update all the records.

I feel confident that this isn't 'creating' duplicates, because it's only updating the records according to the GUID for each.

------------------------------
Amanda Squires
Met Office
Exeter
------------------------------

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

Hi Heather

We have come across that same issue recently and found that the "Allow Duplicates" switch should set to "On" and that solved the problem. The import didn't create any new duplicates but it updated all records in the file without any errors.

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense
------------------------------

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

It is also possible to turn fully turn off duplicate detection during data import under duplicate detection settings:



------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime
------------------------------

Original Message:
Sent: Feb 19, 2021 05:20 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

Hi Heather

We have come across that same issue recently and found that the "Allow Duplicates" switch should set to "On" and that solved the problem. The import didn't create any new duplicates but it updated all records in the file without any errors.

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

But why would You do that when the solution is as simple as just allowing duplicates during the import ?

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense
------------------------------

Original Message:
Sent: Feb 19, 2021 08:03 AM
From: Niels Søgaard Lønberg
Subject: my import keeps failing- any advice?

It is also possible to turn fully turn off duplicate detection during data import under duplicate detection settings:



------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime

Original Message:
Sent: Feb 19, 2021 05:20 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

Hi Heather

We have come across that same issue recently and found that the "Allow Duplicates" switch should set to "On" and that solved the problem. The import didn't create any new duplicates but it updated all records in the file without any errors.

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

I prefer that, too. It leaves you the option to choose on every import. There may be a scenario where you want to exclude duplicates, and if the system doesn't prompt you to make that choice, you may end up updating records that you didn't mean to touch.

------------------------------
Rogier Vriezen
CRM Consultant
Amsterdam, Netherlands
------------------------------

Original Message:
Sent: Feb 19, 2021 08:16 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

But why would You do that when the solution is as simple as just allowing duplicates during the import ?

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 19, 2021 08:03 AM
From: Niels Søgaard Lønberg
Subject: my import keeps failing- any advice?

It is also possible to turn fully turn off duplicate detection during data import under duplicate detection settings:



------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime

Original Message:
Sent: Feb 19, 2021 05:20 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

Hi Heather

We have come across that same issue recently and found that the "Allow Duplicates" switch should set to "On" and that solved the problem. The import didn't create any new duplicates but it updated all records in the file without any errors.

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

I fully agree to leave the option on every import under normal circumstances.

However, it was just to highlight that there are other options available. E.g. when migrating large data volumes there maybe some advantage in fully disabling duplicate detection, turning off during data import or unpublish the rules.

------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime
------------------------------

Original Message:
Sent: Feb 19, 2021 08:16 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

But why would You do that when the solution is as simple as just allowing duplicates during the import ?

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 19, 2021 08:03 AM
From: Niels Søgaard Lønberg
Subject: my import keeps failing- any advice?

It is also possible to turn fully turn off duplicate detection during data import under duplicate detection settings:



------------------------------
Niels Lønberg
Digital Sales Specialist
Semco Maritime

Original Message:
Sent: Feb 19, 2021 05:20 AM
From: Stig Højmark Jensen
Subject: my import keeps failing- any advice?

Hi Heather

We have come across that same issue recently and found that the "Allow Duplicates" switch should set to "On" and that solved the problem. The import didn't create any new duplicates but it updated all records in the file without any errors.

Br.

------------------------------
Stig Højmark Jensen
Kompan A/S
Odense

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

thank you everyone! So I was originally following the steps in this blog... but it said to not allow duplicates. I did pull my export from an advanced find- and added my field I wanted to edit so I was surprised when I still got failing for most... I will remove this field build it again and pull my export but allow duplicates and pray this works!!
I am nervous!! :)
I guess if it doesnt work I can just delete that import but based on all of your advice this seems to be the solution!


------------------------------
Heather L
------------------------------

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

very excited that allowing duplicates WORKED!!! I always thought the rule of thumb was NO to that but it worked...
so my next question then is do I do this for the rest of my entities that I need to update with uniqe id's? the contact the geographical location, the opportunity topic?
we do have contacts that will be listed multiple times due to the nature of how we use CRM and they are the POC of certain accounts.
I was going to test this with a handful because I am nervous to allow duplicates but it worked with accounts!

------------------------------
Heather L
------------------------------

Original Message:
Sent: Feb 19, 2021 09:10 AM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

thank you everyone! So I was originally following the steps in this blog... but it said to not allow duplicates. I did pull my export from an advanced find- and added my field I wanted to edit so I was surprised when I still got failing for most... I will remove this field build it again and pull my export but allow duplicates and pray this works!!
I am nervous!! :)
I guess if it doesnt work I can just delete that import but based on all of your advice this seems to be the solution!

https://carldesouza.com/updating-dynamics-365-records-using-export-and-import-with-excel/  

------------------------------
Heather L

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------

Rule of thumb for me is: 

when you're sure you're not importing NEW records, set allow duplicates to YES. You've ran an export in which you defined your filters, so you should be good.
when you're importing NEW records and updating some existing, considder leaving it to NO, as you don't want to import a duplicate record.
For this reason I rarely ever update and insert (upsert) records in the same load.

Good luck! Happy to hear that your current update worked! 

------------------------------
Rogier Vriezen
CRM Consultant
Amsterdam, Netherlands
------------------------------

Original Message:
Sent: Feb 22, 2021 08:42 AM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

very excited that allowing duplicates WORKED!!! I always thought the rule of thumb was NO to that but it worked...
so my next question then is do I do this for the rest of my entities that I need to update with uniqe id's? the contact the geographical location, the opportunity topic?
we do have contacts that will be listed multiple times due to the nature of how we use CRM and they are the POC of certain accounts.
I was going to test this with a handful because I am nervous to allow duplicates but it worked with accounts!

------------------------------
Heather L

Original Message:
Sent: Feb 19, 2021 09:10 AM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

thank you everyone! So I was originally following the steps in this blog... but it said to not allow duplicates. I did pull my export from an advanced find- and added my field I wanted to edit so I was surprised when I still got failing for most... I will remove this field build it again and pull my export but allow duplicates and pray this works!!
I am nervous!! :)
I guess if it doesnt work I can just delete that import but based on all of your advice this seems to be the solution!

https://carldesouza.com/updating-dynamics-365-records-using-export-and-import-with-excel/  

------------------------------
Heather L

Original Message:
Sent: Feb 18, 2021 04:57 PM
From: Heather Laughlin
Subject: my import keeps failing- any advice?

I tried to export a view to an excel file and import it after I made my changes (taking all acrive accounts and adding a unique id to each one). however, most failed. I keep getting the message that a record was not created or updated because a duplicate already exists.... that FUN fun message I hate to see!
All I can think is that my dup det is set up to fail this? The issue is we have multiple accounts in CRM with diff locations so its not duplicates but the account is listed multiple times for each location.... could this be the issue below? the same name - if I unpublished that and tried again would it maybe work?
I just dont want new accounts created for some reason- as I literally did nothing but update the unique field with data for each account. so why it is showing that there are duplicates when I am simply updating the files...


------------------------------
Heather L
------------------------------