Thank you for all the replies, and happy new year! I have passed this along to my IT partner and will reach out if we have any follow-up questions.
------------------------------
John Zielinski
Technology Product Manager
Baird
Milwaukee WI
------------------------------
Original Message:
Sent: Dec 29, 2020 10:51 AM
From: Shawn Hickey
Subject: Azure Data Lake
We are also using the Data Export Service to export Dynamics CE data into a SQL database. We have an Analytics team we work with internally that uses this data to provide data models to the rest of the organization for analysis and visualizations through Excel and/or Power BI. A challenge with the current Data Export Service is it doesn't automatically account for any schema changes to the environment (i.e. new fields added). So updates to our production Dynamics environment often require us to drop specific tables/relationships and then rebuild them. The dropping of the tables involves SQL queries and rebuilding them is done by selecting the tables/relationships in the Dynamics Data Export user interface. Although it isn't terribley difficult, it requires a lot of babysitting because you can't select and rebuild all tables/relationships at the same time as it will overwhelm the system. So we have to select the larger tables one by one and monitor to make sure they complete before moving on to the others.
It sounds like the Azure data lake is where Microsoft is heading. We have started to explore this and need to get our Analytics team onboard so all of the data models can be migrated if and when we go this route.
------------------------------
Shawn Hickey
Burns & McDonnell
Kansas City MO
Original Message:
Sent: Dec 28, 2020 09:25 AM
From: Jon Meyer
Subject: Azure Data Lake
John,
We use Data Export Service to export data into an Azure SQL Database -- not sure if this exactly the same thing as what you are looking to do. We are happy to speak with you about it. We've been running the solution since August of 2017.
Jon
------------------------------
Jon Meyer
Chief Technology Officer
CAPTRUST
Raleigh NC
Original Message:
Sent: Dec 07, 2020 01:05 PM
From: John Zielinski
Subject: Azure Data Lake
Is anyone currently leveraging the data extract services out of Dynamics platform into the Azure data lake? This is Microsoft's recommended approach for addressing our API growth, and we are nearing closure on our assessment to use it. Right now, it's highly likely we will go this route, but we wanted to speak with a few customers (perhaps 2 or 3) of Dynamics who use this feature so we can ask them some questions about how they've implemented it, how it performs, and what are the pros and cons they've experienced.
Please let me know if you have any feedback and would be open to a discussion.
------------------------------
John Zielinski
Technology Product Manager
Baird
Milwaukee WI
------------------------------