Wednesday, March 13, 2019

Jan. 2019 Exchange Security Update KB4471389 issue

It seems some admins broke their exchange server after installing KB4471389
Symptoms are all exchange related services dies after the update and admins had to reinstall exchange server in recovery mode.

M$ says that can happen when a admin runs the update in normal mode.

Yes next exchange CU will have that patch as well. So run all exchange updates in admin mode all the time!!

Tuesday, March 05, 2019

WSUS server cleanup

WSUS clean up sometime takes really long time and fail.

I like to explain how you can automate the process so there will be not much to clean up so clean up process will run faster.

You can run the gui version of the WSUS server cleanup or run a powershell script.

On wsus server, open PowerShell in admin mode and run

Get-WsusServer | Invoke-WsusServerCleanup -CleanupObsoleteComputers -CleanupObsoleteUpdates -CleanupUnneededContentFiles -CompressUpdates -DeclineExpiredUpdates -DeclineSupersededUpdates 


Yes you can save it and run it from the task manager! run it daily or weekly.

While the clean up job runs, "Wsus Service" service will be stopped, and automatically started when the clean up job ends. Do not start it manually, it will extend the clean up time.

If the clean up job runs too long and fail, your best option is to rebuild the wsus.

After you rebuild the wsus and if you are using SCUP and got errors like "xxxxx not found on WSUS SMS_WSUS_CONFIGURATION_MANAGER " on WSyncMgr.log while WSUS try to sync, see this blog

Wednesday, February 27, 2019

SCCM ADR failed with error 404

I was getting ADR error, it has content ID but it is not unique content ID. I was trying to find out what kind of update it is.

Downloading content with ID 17423088 in the package SMS_RULE_ENGINE 2/27/2019 4:03:50 PM 14756 (0x39A4)
Failed to download the update from internet. Error = 404 SMS_RULE_ENGINE 2/27/2019 4:04:23 PM 14756 (0x39A4)
Failed to download ContentID 17423088 for UpdateID 17459792. Error code = 404 SMS_RULE_ENGINE 2/27/2019 4:04:23 PM 14756 (0x39A4)
Downloading contents (count = 1) for UpdateID 17459793 SMS_RULE_ENGINE 2/27/2019 4:04:23 PM 14756 (0x39A4)
List of update content(s) which match the content rule criteria = {17423089} SMS_RULE_ENGINE 2/27/2019 4:04:23 PM 14756 (0x39A4)
Downloading content with ID 17423089 in the package SMS_RULE_ENGINE 2/27/2019 4:04:23 PM 14756 (0x39A4)
Failed to download the update from internet. Error = 404 SMS_RULE_ENGINE 2/27/2019 4:04:54 PM 14756 (0x39A4)
Failed to download ContentID 17423089 for UpdateID 17459793. Error code = 404 SMS_RULE_ENGINE 2/27/2019 4:04:54 PM 14756 (0x39A4)
Downloading contents (count = 1) for UpdateID 17459794 SMS_RULE_ENGINE 2/27/2019 4:04:54 PM 14756 (0x39A4)
List of update content(s) which match the content rule criteria = {17423090} SMS_RULE_ENGINE 2/27/2019 4:04:54 PM 14756 (0x39A4)
Downloading content with ID 17423090 in the package SMS_RULE_ENGINE 2/27/2019 4:04:54 PM 14756 (0x39A4)
Failed to download the update from internet. Error = 404 SMS_RULE_ENGINE 2/27/2019 4:05:26 PM 14756 (0x39A4)
Failed to download ContentID 17423090 for UpdateID 17459794. Error code = 404 SMS_RULE_ENGINE 2/27/2019 4:05:26 PM 14756 (0x39A4)
Ran this from SCCM DB, it showed content Unique ID

select * from vsms_content where Content_ID = '17423089'

Copy and pasted it to SCCM and look for what it is on "All Software updates"

I was able to identify what it is, it was an old adobe flash update from SCUP, so I expired the update from SCUP and published it, and the problem got resolved.

Wednesday, January 16, 2019

Problem applying Sharepoint 2013 cumulative update

So I was applying Dec 2018 Sharepoint 2013 cumulative update, once binaries got installed, I ran the SharePoint configuration wizard and got this error.


Curiously, there is no "Additional exception information", so I opened the log file and found not so helpful information:
----------------------------------------------------------------
5  INF  Resource retrieved id PostSetupConfigurationFailedEventLog is Configuration of SharePoint Products failed.  Configuration must be performed in order for this product to operate properly.  To diagnose the problem, review the extended error information located at {0}, fix the problem, and run this configuration wizard again.


 5  INF  Received a TaskDriverEventHandler: TaskDriverEventArgs.EventCriticalityType error, TaskDriverEventArgs.EventType stop, message Configuration of SharePoint Products failed.  Configuration must be performed before you use SharePoint Products.  For further details, see the diagnostic log located at C:\Program Files\Common Files\Microsoft Shared\Web Server Extensions\15\LOGS\PSCDiagnostics_1_14_2019_10_13_6_911_869397427.log and the application event log.
------------------------------------------------------------------

According to this blog (https://www.mssqltips.com/sqlservertip/5516/how-to-apply-microsoft-sharepoint-2013-cumulative-updates-and-handling-issues/PostSetupConfigurationFailedEventLog means database upgrade issue.

So all binary update process are done and when the wizard tried to upgrade content database it failed.
The blog said to dismount content DB, run config wizard and mount the content DB and run DB upgrade, but it SP config wizard failed even when the content DB was dismounted.

So my theory was, all SP servers got binaries updated, it is the DB that failed, why not upgrade the DB after the SP wizard failed?

So login story short, to fix the problem, I did:

- Run get-spproduct -local on all SharePoint servers. Just in case.

- Reboot the CA server, to make all services start again. Especially all Sharepoint services and Net.pipe xxxx and Net.Tcp xxxx services on all SP servers.

- Run "Upgrade-SPContentDatabase -Name -WebApplication /"  
For example: Upgrade-SPContentDatabase -name WSS_Content -WebApplication https://sharepoint.domain.com

If you check the status of the DB from CA, CA will show that the DB is being upgraded:
Once it is done, I got this message, if the upgrader seems stuck after you enter Y and Enter, hit enter again.



- Run "psconfig.exe -cmd helpcollections -installall -cmd secureresources -cmd services -install -cmd installfeatures -cmd applicationcontent -install -cmd upgrade -inplace b2b -force -wait" as the SP config wizard suggested.

- Run SP config wizard gui on all servers to confirm there is no error.

- Reboot all SharePoint servers

Hopefully it would help someone who face the same error like me.

Ref:
Why SharePoint 2013 Cumulative Update takes 5 hours to install?
https://blogs.msdn.microsoft.com/russmax/2013/04/01/why-sharepoint-2013-cumulative-update-takes-5-hours-to-install/#commentmessage

How to install update packages on a SharePoint farm where search component and high availability search topologies are enabled
https://blogs.technet.microsoft.com/tothesharepoint/2013/03/13/how-to-install-update-packages-on-a-sharepoint-farm-where-search-component-and-high-availability-search-topologies-are-enabled/

How to apply Microsoft SharePoint 2013 Cumulative Updates and Handling Issues
https://www.mssqltips.com/sqlservertip/5516/how-to-apply-microsoft-sharepoint-2013-cumulative-updates-and-handling-issues/

Tuesday, April 17, 2018

Commvault backup and windows server 2008 r2 quiesce error "Failed Unable to quiesce guest file system during snapshot creation"

After getting a new Commvault V11, when tried to backup a windows server 2008 R2, getting "Failed Unable to quiesce guest file system during snapshot creation".



Reason:This issue occurs if there is a conflict between the Microsoft based volume shadow copy services and VMware snapshot provider. 
Fix:
To resolve this issue, use any one Quiescing tool. As VMware snapshot provider is only used for snapshot / Quiesing purposes, this can be disabled.


1. Stop and Disable VMware snapshot provider

2. Start and set VSS to Automatic / Manual

3. Restart Virtual disk service and then  attempt to create a manual Quiesced snapshot. 



F5 BIGIP VE and ESX 6.5, Invalid configuration for device '0' or Failed to connect virtual device 'Ethernet0'

I was receiving "Failed to connect virtual device 'Ethernet0'" and "Invalid configuration for device '0' "error after moved F5 BIGIP VE 13.0.x.x to ESX 6.5 with vcenter 6.5 with distributed switches, and upgraded HW compatibility to version 13.
I searched google and could not find why it was happening.
After I found that the highest VM HW version it support is 10. (https://support.f5.com/csp/article/K69120675)
When you update VM's HW to a higher version, it works with VMware tools to fix any complication,
F5 does not support VMtools to be updated on F5 BIGIP VE. (https://support.f5.com/csp/article/K11744866)

Long story short, here is how I fixed the problem.
1. Turnoff the VM.
2. Download VMX files of the VM to your PC.
3. Go to Edit window the VM, take a screen shot of the nic's setting especially networks they are connected to.
3. Remove all virtual NICs from the VM, and save.
4. Go back to the Edit window again and add NICs, assign correct network. On NIC settings, manually set the MAC address, get the original MAC address from the VMX file you downloaded from the step 2.
5. Turn on the VM.


Wednesday, April 11, 2018

System Center Updates Publisher (SCUP) 2017 is now avilable

System Center Updates Publisher (SCUP) 2017 is now available

Using SCUP, you can:
  • Import updates from external catalogs (non-Microsoft update catalogs). 
  • Modify update definitions including applicability, and deployment metadata. 
  • Export updates to external catalogs. 
  • Publish updates to an update server. 

This release of SCUP adds support for Windows 10 and Windows Server 2016.

Indexing for quicker imports of previously imported catalogs –  Catalog producers can now index their catalogs. This will allow users to more quickly import large catalogs containing few new updates.  

Inclusion of signing certificates within updates catalogs – Catalog producers can now include signing certificates with their updates catalogs.  This enables users to add the certificates to the trusted publishers list during import so that approval prompts will not block publish operations. 

Signature Timestamp – Updates published to a WSUS server will by default have the signature time-stamped.  Note, this functionality requires internet access. If you have upgraded from preview 1 this will not be automatically enabled.  To enable or disable this functionality or configure the timestamp server that is used, see the Advanced page under Options

This installer updated my preview 2 (ver 6.0.219.0) version of SCUP 2017 to production version (ver 6.0.278.0)

Announcement is here

Download from here

Tuesday, December 26, 2017

SCUP 2011 Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher xx/xx/xxxx x:xx:xx AM 13 (0x000D)

I was getting error message while updating Dell updates using SCUP 2011


    Import: Skipped import due to no change in creation date for update 56c63df6-5267-44ca-b7d9-78c22b2e9843, title: Intel Unite Protected Guest Access  Plugin Application,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 0dc345fb-52fe-4380-8565-11758a02e64d, length 7397 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 0dc345fb-52fe-4380-8565-11758a02e64d, title: Intel Unite Hub Application Installer,3.1.45.26,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 56e205cf-16dc-4b63-81d1-a3b748a89c86, length 7364 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 56e205cf-16dc-4b63-81d1-a3b748a89c86, title: Intel Unite Client Application Installer,3.1.45.26,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 4eaf38b8-b3d8-4596-a6ed-3dd3be80a8d4, length 7525 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Importing new update 4eaf38b8-b3d8-4596-a6ed-3dd3be80a8d4, title: Intel Unite Add-In for Microsoft Outlook,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

    Import: Processing XML for package 388a5fae-a141-46d1-8968-6c15501a6a7d, length 7671 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Importing new update 388a5fae-a141-46d1-8968-6c15501a6a7d, title: Intel Unite Plugin for Telemetry for Business Installer,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

    Import: Processing XML for package 08cc667b-043d-4afc-89a5-1700560bbbbf, length 4434 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 08cc667b-043d-4afc-89a5-1700560bbbbf, title: Dell OptiPlex 7050 System BIOS,1.6.5 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

I had 27 of Import: Exception: An error occurred while updating the entries errors and I was scratching my head on this for a few days.
I found a similar problem on https://community.spiceworks.com/topic/1751827-service-pack-3-for-sql-server-2012-breaks-scup-2011-any-suggestions
and
https://social.technet.microsoft.com/Forums/en-US/e8267fe0-9c39-4fdc-8bdc-6b4b471b2e96/scup-fails-importing-of-updates?forum=ConfigMgrCompliance

But I use SQL 2008 so it was not the case.

To fix this problem, there are two options:

1, Get list of all failed updates and delete them individually from the Dell updates, and reimport.

If you miss any failed updates, you will still get the same error!. Delete them all and close SCUP 2011 and open again, and reimport the catalog.

2. Delete the "Dell" folder on the "Updates" and import Dell catalog again.
Warning: You will lose your all of your local information such as "Date Published", "Expired" and "Date Modified" information, if you expired or published and updates.

To delete the "Dell" folder on Updates:
Make a backup of your SCUP DB first (simply do copy and paste of the DB),  SCUP -> Updates -> Overview -> All Software Updates -> Dell. Highlight the "Dell", right click, and delete.


UPDATE: SCUP 2017 production version is now available! and it works much better! http://exchcluster.blogspot.com/2018/04/system-center-updates-publisher-scup.html