Customer Engagement & Dynamics CRM Forum

Expand all | Collapse all

Database size in MB WebResourceBase

  • 1.  Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Nov 04, 2019 10:30 AM
    Is there a good way to monitor and purge the WebResourceBase it sits for us at about 1 gig and it would be nice to recover this storage if the data is not needed.

    -Ryan

    ------------------------------
    Ryan Green
    Landscape Structures
    Delano MN
    ------------------------------


  • 2.  RE: Database size in MB WebResourceBase

    TOP CONTRIBUTOR
    Posted Nov 05, 2019 01:23 PM
    Ours is around the same size.  You could go into Settings > Customization > Customize the System, then Web Resources, and then look through the list to delete any custom web resources that were added by you/your team/your partner.  You could also uninstall old managed solutions you no longer use.  Other than that, I'm not sure if there is a way to reduce that table.  I'm interested to hear if others have tips for it though.

    ------------------------------
    Ben Edgren
    CRM Applications Manager
    Hufcor, Inc
    Janesville WI
    ------------------------------



  • 3.  RE: Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Oct 06, 2020 05:20 PM
    Running into capacity issues and the Web Resource base is a major culprit.  I don't want to start deleting these in the SBX without knowing what is being used and what's not.  You know how to run statistics on Web Resource usage?

    ------------------------------
    Jeff Orris
    Jeffrey Steven Orris - Independent Consultant
    Harrisburg
    ------------------------------



  • 4.  RE: Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Oct 07, 2020 09:23 AM
    I recommend talking to MS Support. Our Web Resource table was also growing each month. Support was able to run some cleanup jobs on the backend that improved the storage significantly. They also said they were looking at a more universal solution of some kind as this table is a common problem for most customers.
    Here's a quote from MS Support on 8/3/2020: "The Web Resource Table growth became a common issue to our customers and we are actively working on a generic solution for this which may take some weeks but no specific time for this and there is no update to share you for now. Once this is available the same will be shared to the customers."
    I've not yet heard anything further about this.

    ------------------------------
    Greg Enns
    ERP Coordinator
    Technical Prospects
    Appleton WI
    ------------------------------



  • 5.  RE: Database size in MB WebResourceBase

    Posted Oct 08, 2020 03:11 AM
    There is actually a brand new tool in the XrmToolBox​ that investigates sizes of individual webresources and by solution.
    Does not help purge, but can give you some good hard facts for your communication with MS.
    Link from here: https://twitter.com/rappen/status/1311227448432963589

    ------------------------------
    Jonas Rapp
    MVP
    Sweden
    ------------------------------



  • 6.  RE: Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Oct 08, 2020 11:04 AM
    Thanks for the tip @Jonas Rapp! I like the new tool.
    Any thoughts on using the XRMToolbox tool: "Webresources Manager" by Mscrm Tools in conjunction with the new tool? It seems like with these 2 tools combined, you can do just about anything with WebResources.
    The Mscrm tool provides a search for dependencies and says it can delete web resources too.
    I'm hesitant to trust the dependency search, and even more hesitant to delete web resources that aren't from my own solutions.
    However, WebResources takes up about 25% of my CRM storage--and I've already removed all the solutions I could!
    Any suggestions/thoughts?​​

    ------------------------------
    Greg Enns
    ERP Coordinator
    Technical Prospects
    Appleton WI
    ------------------------------



  • 7.  RE: Database size in MB WebResourceBase

    Posted Oct 08, 2020 11:44 AM
    Hi Greg
    Web Resource Manager is good when you are working with your own web resources in DEV, but you can't (shouldn't!) really use it to purge MS files.
    I would say we just have to live with their perhaps bloating of our DBs. but having good metrics is essential when confronting MS about "We pay for storage, your own solutions consume silly amounts of that storage - let us pay for what WE add!"
    Jonas

    ------------------------------
    Jonas Rapp
    MVP
    Sweden
    ------------------------------



  • 8.  RE: Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Oct 08, 2020 03:00 PM
    Edited by Greg Enns Nov 16, 2020 12:12 PM
    I figured that was probably the situation. Any chance we could get a button in the new tool for exporting the list--perhaps to .csv or .xlsx? It'd be nice to see that list in Excel.
    Update: I figured out you can do this by highlighting with your mouse.
    ------------------------------
    Greg Enns
    ERP Coordinator
    Technical Prospects
    Appleton WI
    ------------------------------



  • 9.  RE: Database size in MB WebResourceBase

    SILVER CONTRIBUTOR
    Posted Nov 16, 2020 12:23 PM

    Update: I highly recommend that everyone reach out to support to get them to reduce the size of the Web Resource table in your CRM database. CRM storage prices are crazy expensive, and doing this could get you back significant space.
    I just (again) finished working with MS Support to get them to run some scripts to clean up their orphaned resources. I also asked again about a more permanent fix for this ridiculous situation (Over 25% of my total storage is taken up by the Web Resource table--and it's 90% MS resources--not mine.)
    At first they told me there was no way to reduce the "Web Resource" storage except that I remove solutions and any other web resources on my side. But after pushing further, I got to an "Escalation Manager" who got this taken care of. Here is what he said:
    "I traced down this issue to a future work item to reduce the web resource footprint in the SQL DB. At this point there is [no] ETA on that feature implementation. If I get any update on the feature, there should be a broader communication from Microsoft. 

    We also got some mitigation scripts to detect and delete the orphan web resource items in the table that might help you. We will attempt these on your instance to see if that helps." (They did. And it reduced the size of Web Resource table by about 15% in both my Sandbox and Production instances.)



    ------------------------------
    Greg Enns
    ERP Coordinator
    Technical Prospects
    Appleton WI
    ------------------------------



  • 10.  RE: Database size in MB WebResourceBase

    Posted Nov 17, 2020 09:24 AM
    Edited by Dave Storey Nov 17, 2020 09:24 AM
    We just had the exact same experience.  We noticed all of our environments had grown significantly in usage since Aug/Sept, and the WebResourceBase table was the culprit.  This increase even happened in 2 environments that were barely used in the past 2 months, as the clients were not yet ready to go.  I submitted a ticket, and they came back with exactly what you described.  They ran their "orphan scripts", and it reduced the usage by about 190MB, which is 15%.  Hopefully if more people report this, it will increase the priority of implementing a solution.

    -----------------------------------------------------------------
    Here's the response from Microsoft Support:
    -----------------------------------------------------------------

    It's a known behavior of the web resource table to increase in size after big updates.

    The reason for this is because user interface components (such as images, GIFs, JScripts, CSS, HTML) added to your applications/solutions, custom or out of the box, will increase the size of this table, since these are the records stored on the table. This would explain why you saw and increase in space consumption for an environment that has not yet been used to enter any application data. 

    Our engineering team have already identified this behavior, and are working on an internal Microsoft Project to address it. 

    The project consists of moving a few columns of the 'WebResourceBase' table to Azure Blob Storage to diminish the SQL footprint the table has on CDS storage.

    Currently, the project is in the planning phases and we don't have an ETA for its completion or roll out.

    They did mention that it could take up any time between 3-6 months, since it is a complex transition. 

    There is an internal back-end script we can run in order to identify if there is a significant amount of orphaned records within the webresource table.

    We can proceed to execute this script and then delete the orphaned web resources identified.

    This won't have any functionality issues on your applications/solutions or organization.



    ------------------------------
    Dave Storey
    Ocean Pearl Consulting
    Nepean ON
    ------------------------------



  • 11.  RE: Database size in MB WebResourceBase

    GOLD CONTRIBUTOR
    Posted 26 days ago

    As of Friday 18th it looks like WebResourceBase and RibbonClientMetadataBase are being counted against File storage and not Database storage.

    Across multiple environments that frees up a lot of DB storage!



    ------------------------------
    Sean O Malley
    Laya Healthcare, proudly part of AIG
    ------------------------------



If you've found this thread useful, dive deeper into User Group community content by role