Customer Engagement & Dynamics CRM Forum

Expand all | Collapse all

Rapid increase in consumed storage

  • 1.  Rapid increase in consumed storage

    TOP CONTRIBUTOR
    Posted Aug 06, 2019 08:47 AM
    Hi, everyone.

    I have been tracking our storage consumption for quite a while now. I typically check it on a weekly basis just to keep an eye on things. We will typically see our production environment increase slightly from week to week, but I have a general feel for how quickly it increases. Our two sandbox environments are quite steady as we don't import/integrate data there.

    When I checked our storage today, all three environments jumped by about 2.5 GB more than what would be expected between 7/29 and 8/6. Production was probably a little more unexpected of a jump than that. I've looked at audit logs and system jobs in the two sandbox environments and nothing seems out of the ordinary. Unfortunately, with the change in storage capacity breakdown, I haven't found a replacement to the Organizational Insights storage analysis, so I can't even see where the bulk of my storage is consumed.

    Is there any chance that something Microsoft pushed out would have hit us this hard across the board?

    Any ideas if there is a way to determine where in the system the increase occurred?

    I think I'm going to be watching on a daily basis for a bit here. This is just way too big of a jump for my comfort level.

    Thanks in advance for any suggestions.

    ------------------------------
    Julie Reynolds
    Enterprise Information Steward II
    Brotherhood Mutual Insurance
    Fort Wayne IN
    ------------------------------
    Conference-CRMUG_200x200


  • 2.  RE: Rapid increase in consumed storage

    MICROSOFT MVP
    Posted Aug 06, 2019 09:52 AM
    @Julie Reynolds - I just found this free tool that may help you out: https://uds.systems/storageanalyzer/ ​​

    ------------------------------
    Aaron Back, MCSE
    Sr. Microsoft Dynamics 365 Consultant
    www.acemicrotech.com
    _______________________________________
    CRMUG Board Member
    CRMUG Chapter Leader - Cincinnati, Ohio
    ------------------------------

    Conference-CRMUG_200x200


  • 3.  RE: Rapid increase in consumed storage

    GOLD CONTRIBUTOR
    Posted Aug 06, 2019 10:37 AM
    We had a case about 5 years ago when our storage ended up increasing at an insanely fast rate. What happened was that there was some kind of background process/workflow running in an endless loop and generating hundreds of audit records per second. At the time we were operating with a storage buffer of about 2-3 GB which was plenty for us during normal times (very small organization) but in those days the audit records used up that space in a matter of hours.

    It took me 3 days to get through Microsoft support and have them provide me with database insights, before I finally noticed that I had to turn off Auditing and then try to figure out what was causing the endless loop. I never actually really found out what was causing it. I just deactivated a workflow that was referenced, reactivated it and everything was ok again. I hadn't touched that workflow before, so it must have been some update that was pushed by Microsoft.

    Now you mentioned you already checked your audit logs, but still maybe you can check your workflows.

    Another thing you could check if you are using clickdimensions: Site Visits. Your site may have been attacked and it could have created a ton of site visit records.

    ------------------------------
    Sissy Bottcher
    Business Process Innovation Specialist
    StudyPortals
    San Diego CA
    ------------------------------

    Conference-CRMUG_200x200


  • 4.  RE: Rapid increase in consumed storage

    SILVER CONTRIBUTOR
    Posted Aug 07, 2019 03:46 AM
    Hi Julie,

    I noticed a similar jump in our production environment and couldn't see any reason for it. I raised a ticket with MS support and they stated it was due to indexing.
    After just over a week MS provided stats to show that the storage had dropped back again as the indexing became more efficient.

    Initial Email from MS Support
    "The organization observed an increase in size nearly equal to 1.7GB over the morning of 28th July, i.e. between 28th July morning to 29th July afternoon.
    When checked further, I could find out that maximum contribution to this storage increase has come from the tables 'ActivityPointerBase' and 'ActivityPartyBase'.

    The increase in the org DB size is majorly due to the increase in the index size of the tables 'ActivityPointerBase' and 'ActivityPartyBase'.
    Please note that, indexing has a major role played in the performance of the organization. Hence, it may take up some additional storage but, ultimately it is for the better performance of the organization."


    Final email from MS Support
    "I have been monitoring on the index sizes for the tables and certianly, they have dropped back to the values even lower than what they were on the 28th of July

    The explanation to this is as follow,

    With any data or values added to the database, the indexing jobs re-builds the indexes. Usually this may go to a higher value depending on what pattern the jobs observe for the reads to that specific table, however, with time, it does keeps re-indexing them and if the usage of the table is identified to be lesser, it in turn does releases the index space. Which is what has happened in this scenario."


    Hope this helps,
    Sean

    ------------------------------
    Sean O Malley
    AIG
    ------------------------------

    Conference-CRMUG_200x200


  • 5.  RE: Rapid increase in consumed storage

    Posted Aug 07, 2019 09:12 AM
    Hi Julie -

    I was disappointed when Organization Insights took away the ability to download table sizes and storage consumption.  After reading your post, I checked our storage and to my surprise, I found that MS had restored that ability.  Perhaps you've already found it, but if not, it's the download tab just below the storage tab.

    Hope this helps -



    ------------------------------
    Keith Zimmerman
    CRM Project Manager
    Illinois Tool Works (Hobart Service sister company)
    Troy OH
    937-332-2208
    ------------------------------

    Conference-CRMUG_200x200


  • 6.  RE: Rapid increase in consumed storage

    TOP CONTRIBUTOR
    Posted Aug 08, 2019 07:26 AM
    Thanks, everyone! I have opened a ticket with Microsoft to see if they can provide any insight as nothing looks out of the ordinary other than the storage consumption.

    ------------------------------
    Julie Reynolds
    Enterprise Information Steward II
    Brotherhood Mutual Insurance
    Fort Wayne IN
    ------------------------------

    Conference-CRMUG_200x200


  • 7.  RE: Rapid increase in consumed storage

    SILVER CONTRIBUTOR
    Posted Aug 08, 2019 09:07 AM
    Hi Julie,

    I ran into a similar problem a few months ago with our storage increasing at an alarming rate. After getting top 10 tables size information from Microsoft I found that the increase was due to our workflows. By default we were not deleting workflows after they completed.

    To resolve the problem I set, any (what we deemed) insignificant​ workflows to delete by default. For the remainder of the workflows I set up a bulk delete job to run on a monthly basis. This has significantly reduced our storage.

    Hope this helps,

    ------------------------------
    Brian Mergen
    Dynamics 365 CE (CRM) / DBA
    Morton Buildings, Inc.
    Morton IL
    ------------------------------

    Conference-CRMUG_200x200


  • 8.  RE: Rapid increase in consumed storage

    D365UG/CRMUG ALL STAR
    Posted Aug 08, 2019 04:22 PM
    I do not have that option to download the tables.  Weird?


    ------------------------------
    Laura Mortick
    Marketing Information Systems Manager
    Terracon
    Olathe KS
    ------------------------------

    Conference-CRMUG_200x200


  • 9.  RE: Rapid increase in consumed storage

    TOP CONTRIBUTOR
    Posted Aug 09, 2019 01:29 AM
    Microsoft has recently rolled out Capacity Analytics in the Power Platform Admin Center.

    There you can see the top database, file and log capacity by table.

    It might be a help.


    ------------------------------
    BR,
    Niels
    ------------------------------

    Conference-CRMUG_200x200


  • 10.  RE: Rapid increase in consumed storage

    TOP CONTRIBUTOR
    Posted Aug 09, 2019 03:36 AM
    Niels - still not seeing the per environment capacity


    @Laura Mortick - this is what I see in the Organization Insights app. I notice that the order of items on your nav are different to mine. Have you checked the Capacity report in the Power Platform Admin Center  https://admin.powerplatform.microsoft.com/environments



    ------------------------------
    Donal McCarthy
    Digital Marketing Administrator
    BrightWork
    Galway
    ------------------------------

    Conference-CRMUG_200x200


  • 11.  RE: Rapid increase in consumed storage

    TOP CONTRIBUTOR
    Posted Aug 09, 2019 07:23 AM
    Niels, we don't have access to the breakdowns of the capacity analytics yet either. Perhaps that's because we're not on that model yet.

    Update from our end, according to Microsoft support, ​the increase was due to indexing that may have triggered from the last weekly patch and that we shouldn't experience any more unexpected increases. They're attempting to try to correct the issue.

    Between the three environments, that was over 8 GB! I'm hoping they can correct the issue and it doesn't happen again!

    Thanks again to everyone for your input. I'm looking forward to having some more of our analytics back in the admin center.

    ------------------------------
    Julie Reynolds
    Enterprise Information Steward II
    Brotherhood Mutual Insurance
    Fort Wayne IN
    ------------------------------

    Conference-CRMUG_200x200


If you've found this thread useful, dive deeper into User Group community content by role