Customer Engagement & Dynamics CRM Forum

Expand all | Collapse all

Azure Data Lake

  • 1.  Azure Data Lake

    SILVER CONTRIBUTOR
    Posted Dec 07, 2020 01:06 PM

    Is anyone currently leveraging the data extract services out of Dynamics platform into the Azure data lake? This is Microsoft's recommended approach for addressing our API growth, and we are nearing closure on our assessment to use it. Right now, it's highly likely we will go this route, but we wanted to speak with a few customers (perhaps 2 or 3) of Dynamics who use this feature so we can ask them some questions about how they've implemented it, how it performs, and what are the pros and cons they've experienced.

    Please let me know if you have any feedback and would be open to a discussion.



    ------------------------------
    John Zielinski
    Technology Product Manager
    Baird
    Milwaukee WI
    ------------------------------
    Digital Acceleration Binge Day.  January 28th 2021 | 11:00 AM - 2:00 PM EST


  • 2.  RE: Azure Data Lake

    Posted Dec 15, 2020 03:44 AM
    Hi

    This was discussed in a recent local D365UG meeting. You can rewatch the presentation here,

    https://www.youtube.com/watch?v=YBRRwZr4Ez8&t=2363s

    ------------------------------
    Jonathan Farmer
    Guestline Limited
    ------------------------------

    Digital Acceleration Binge Day.  January 28th 2021 | 11:00 AM - 2:00 PM EST


  • 3.  RE: Azure Data Lake

    GOLD CONTRIBUTOR
    Posted 24 days ago

    John,

    We use Data Export Service to export data into an Azure SQL Database -- not sure if this exactly the same thing as what you are looking to do.  We are happy to speak with you about it.  We've been running the solution since August of 2017.

    Jon



    ------------------------------
    Jon Meyer
    Chief Technology Officer
    CAPTRUST
    Raleigh NC
    ------------------------------

    Digital Acceleration Binge Day.  January 28th 2021 | 11:00 AM - 2:00 PM EST


  • 4.  RE: Azure Data Lake

    TOP CONTRIBUTOR
    Posted 23 days ago

    We are also using the Data Export Service to export Dynamics CE data into a SQL database.  We have an Analytics team we work with internally that uses this data to provide data models to the rest of the organization for analysis and visualizations through Excel and/or Power BI.  A challenge with the current Data Export Service is it doesn't automatically account for any schema changes to the environment (i.e. new fields added).  So updates to our production Dynamics environment often require us to drop specific tables/relationships and then rebuild them.  The dropping of the tables involves SQL queries and rebuilding them is done by selecting the tables/relationships in the Dynamics Data Export user interface.  Although it isn't terribley difficult, it requires a lot of babysitting because you can't select and rebuild all tables/relationships at the same time as it will overwhelm the system.  So we have to select the larger tables one by one and monitor to make sure they complete before moving on to the others.

    It sounds like the Azure data lake is where Microsoft is heading.  We have started to explore this and need to get our Analytics team onboard so all of the data models can be migrated if and when we go this route.



    ------------------------------
    Shawn Hickey
    Burns & McDonnell
    Kansas City MO
    ------------------------------

    Digital Acceleration Binge Day.  January 28th 2021 | 11:00 AM - 2:00 PM EST


  • 5.  RE: Azure Data Lake

    SILVER CONTRIBUTOR
    Posted 17 days ago
    Thank you for all the replies, and happy new year!  I have passed this along to my IT partner and will reach out if we have any follow-up questions.

    ------------------------------
    John Zielinski
    Technology Product Manager
    Baird
    Milwaukee WI
    ------------------------------

    Digital Acceleration Binge Day.  January 28th 2021 | 11:00 AM - 2:00 PM EST


If you've found this thread useful, dive deeper into User Group community content by role