Is anyone currently leveraging the data extract services out of Dynamics platform into the Azure data lake? This is Microsoft's recommended approach for addressing our API growth, and we are nearing closure on our assessment to use it. Right now, it's highly likely we will go this route, but we wanted to speak with a few customers (perhaps 2 or 3) of Dynamics who use this feature so we can ask them some questions about how they've implemented it, how it performs, and what are the pros and cons they've experienced.
Please let me know if you have any feedback and would be open to a discussion.
We use Data Export Service to export data into an Azure SQL Database -- not sure if this exactly the same thing as what you are looking to do. We are happy to speak with you about it. We've been running the solution since August of 2017.
We are also using the Data Export Service to export Dynamics CE data into a SQL database. We have an Analytics team we work with internally that uses this data to provide data models to the rest of the organization for analysis and visualizations through Excel and/or Power BI. A challenge with the current Data Export Service is it doesn't automatically account for any schema changes to the environment (i.e. new fields added). So updates to our production Dynamics environment often require us to drop specific tables/relationships and then rebuild them. The dropping of the tables involves SQL queries and rebuilding them is done by selecting the tables/relationships in the Dynamics Data Export user interface. Although it isn't terribley difficult, it requires a lot of babysitting because you can't select and rebuild all tables/relationships at the same time as it will overwhelm the system. So we have to select the larger tables one by one and monitor to make sure they complete before moving on to the others.
It sounds like the Azure data lake is where Microsoft is heading. We have started to explore this and need to get our Analytics team onboard so all of the data models can be migrated if and when we go this route.
If you've found this thread useful, dive deeper into User Group community content by role