Wednesday, January 16, 2019

Problem applying Sharepoint 2013 cumulative update

So I was applying Dec 2018 Sharepoint 2013 cumulative update, once binaries got installed, I ran the SharePoint configuration wizard and got this error.


Curiously, there is no "Additional exception information", so I opened the log file and found not so helpful information:
----------------------------------------------------------------
5  INF  Resource retrieved id PostSetupConfigurationFailedEventLog is Configuration of SharePoint Products failed.  Configuration must be performed in order for this product to operate properly.  To diagnose the problem, review the extended error information located at {0}, fix the problem, and run this configuration wizard again.


 5  INF  Received a TaskDriverEventHandler: TaskDriverEventArgs.EventCriticalityType error, TaskDriverEventArgs.EventType stop, message Configuration of SharePoint Products failed.  Configuration must be performed before you use SharePoint Products.  For further details, see the diagnostic log located at C:\Program Files\Common Files\Microsoft Shared\Web Server Extensions\15\LOGS\PSCDiagnostics_1_14_2019_10_13_6_911_869397427.log and the application event log.
------------------------------------------------------------------

According to this blog (https://www.mssqltips.com/sqlservertip/5516/how-to-apply-microsoft-sharepoint-2013-cumulative-updates-and-handling-issues/PostSetupConfigurationFailedEventLog means database upgrade issue.

So all binary update process are done and when the wizard tried to upgrade content database it failed.
The blog said to dismount content DB, run config wizard and mount the content DB and run DB upgrade, but it SP config wizard failed even when the content DB was dismounted.

So my theory was, all SP servers got binaries updated, it is the DB that failed, why not upgrade the DB after the SP wizard failed?

So login story short, to fix the problem, I did:

- Run get-spproduct -local on all SharePoint servers. Just in case.

- Reboot the CA server, to make all services start again. Especially all Sharepoint services and Net.pipe xxxx and Net.Tcp xxxx services on all SP servers.

- Run "Upgrade-SPContentDatabase -Name -WebApplication /"  
For example: Upgrade-SPContentDatabase -name WSS_Content -WebApplication https://sharepoint.domain.com

If you check the status of the DB from CA, CA will show that the DB is being upgraded:
Once it is done, I got this message, if the upgrader seems stuck after you enter Y and Enter, hit enter again.



- Run "psconfig.exe -cmd helpcollections -installall -cmd secureresources -cmd services -install -cmd installfeatures -cmd applicationcontent -install -cmd upgrade -inplace b2b -force -wait" as the SP config wizard suggested.

- Run SP config wizard gui on all servers to confirm there is no error.

- Reboot all SharePoint servers

Hopefully it would help someone who face the same error like me.

Ref:
Why SharePoint 2013 Cumulative Update takes 5 hours to install?
https://blogs.msdn.microsoft.com/russmax/2013/04/01/why-sharepoint-2013-cumulative-update-takes-5-hours-to-install/#commentmessage

How to install update packages on a SharePoint farm where search component and high availability search topologies are enabled
https://blogs.technet.microsoft.com/tothesharepoint/2013/03/13/how-to-install-update-packages-on-a-sharepoint-farm-where-search-component-and-high-availability-search-topologies-are-enabled/

How to apply Microsoft SharePoint 2013 Cumulative Updates and Handling Issues
https://www.mssqltips.com/sqlservertip/5516/how-to-apply-microsoft-sharepoint-2013-cumulative-updates-and-handling-issues/

Tuesday, April 17, 2018

Commvault backup and windows server 2008 r2 quiesce error "Failed Unable to quiesce guest file system during snapshot creation"

After getting a new Commvault V11, when tried to backup a windows server 2008 R2, getting "Failed Unable to quiesce guest file system during snapshot creation".



Reason:This issue occurs if there is a conflict between the Microsoft based volume shadow copy services and VMware snapshot provider. 
Fix:
To resolve this issue, use any one Quiescing tool. As VMware snapshot provider is only used for snapshot / Quiesing purposes, this can be disabled.


1. Stop and Disable VMware snapshot provider

2. Start and set VSS to Automatic / Manual

3. Restart Virtual disk service and then  attempt to create a manual Quiesced snapshot. 



F5 BIGIP VE and ESX 6.5, Invalid configuration for device '0' or Failed to connect virtual device 'Ethernet0'

I was receiving "Failed to connect virtual device 'Ethernet0'" and "Invalid configuration for device '0' "error after moved F5 BIGIP VE 13.0.x.x to ESX 6.5 with vcenter 6.5 with distributed switches, and upgraded HW compatibility to version 13.
I searched google and could not find why it was happening.
After I found that the highest VM HW version it support is 10. (https://support.f5.com/csp/article/K69120675)
When you update VM's HW to a higher version, it works with VMware tools to fix any complication,
F5 does not support VMtools to be updated on F5 BIGIP VE. (https://support.f5.com/csp/article/K11744866)

Long story short, here is how I fixed the problem.
1. Turnoff the VM.
2. Download VMX files of the VM to your PC.
3. Go to Edit window the VM, take a screen shot of the nic's setting especially networks they are connected to.
3. Remove all virtual NICs from the VM, and save.
4. Go back to the Edit window again and add NICs, assign correct network. On NIC settings, manually set the MAC address, get the original MAC address from the VMX file you downloaded from the step 2.
5. Turn on the VM.


Wednesday, April 11, 2018

System Center Updates Publisher (SCUP) 2017 is now avilable

System Center Updates Publisher (SCUP) 2017 is now available

Using SCUP, you can:
  • Import updates from external catalogs (non-Microsoft update catalogs). 
  • Modify update definitions including applicability, and deployment metadata. 
  • Export updates to external catalogs. 
  • Publish updates to an update server. 

This release of SCUP adds support for Windows 10 and Windows Server 2016.

Indexing for quicker imports of previously imported catalogs –  Catalog producers can now index their catalogs. This will allow users to more quickly import large catalogs containing few new updates.  

Inclusion of signing certificates within updates catalogs – Catalog producers can now include signing certificates with their updates catalogs.  This enables users to add the certificates to the trusted publishers list during import so that approval prompts will not block publish operations. 

Signature Timestamp – Updates published to a WSUS server will by default have the signature time-stamped.  Note, this functionality requires internet access. If you have upgraded from preview 1 this will not be automatically enabled.  To enable or disable this functionality or configure the timestamp server that is used, see the Advanced page under Options

This installer updated my preview 2 (ver 6.0.219.0) version of SCUP 2017 to production version (ver 6.0.278.0)

Announcement is here

Download from here

Tuesday, December 26, 2017

SCUP 2011 Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher xx/xx/xxxx x:xx:xx AM 13 (0x000D)

I was getting error message while updating Dell updates using SCUP 2011


    Import: Skipped import due to no change in creation date for update 56c63df6-5267-44ca-b7d9-78c22b2e9843, title: Intel Unite Protected Guest Access  Plugin Application,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 0dc345fb-52fe-4380-8565-11758a02e64d, length 7397 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 0dc345fb-52fe-4380-8565-11758a02e64d, title: Intel Unite Hub Application Installer,3.1.45.26,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 56e205cf-16dc-4b63-81d1-a3b748a89c86, length 7364 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 56e205cf-16dc-4b63-81d1-a3b748a89c86, title: Intel Unite Client Application Installer,3.1.45.26,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Processing XML for package 4eaf38b8-b3d8-4596-a6ed-3dd3be80a8d4, length 7525 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Importing new update 4eaf38b8-b3d8-4596-a6ed-3dd3be80a8d4, title: Intel Unite Add-In for Microsoft Outlook,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

    Import: Processing XML for package 388a5fae-a141-46d1-8968-6c15501a6a7d, length 7671 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Importing new update 388a5fae-a141-46d1-8968-6c15501a6a7d, title: Intel Unite Plugin for Telemetry for Business Installer,3.2.82.42,A00 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Exception: An error occurred while updating the entries. See the inner exception for details. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

    Import: Processing XML for package 08cc667b-043d-4afc-89a5-1700560bbbbf, length 4434 characters. Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)
    Import: Skipped import due to no change in creation date for update 08cc667b-043d-4afc-89a5-1700560bbbbf, title: Dell OptiPlex 7050 System BIOS,1.6.5 Updates Publisher 12/26/2017 9:49:19 AM 13 (0x000D)

I had 27 of Import: Exception: An error occurred while updating the entries errors and I was scratching my head on this for a few days.
I found a similar problem on https://community.spiceworks.com/topic/1751827-service-pack-3-for-sql-server-2012-breaks-scup-2011-any-suggestions
and
https://social.technet.microsoft.com/Forums/en-US/e8267fe0-9c39-4fdc-8bdc-6b4b471b2e96/scup-fails-importing-of-updates?forum=ConfigMgrCompliance

But I use SQL 2008 so it was not the case.

To fix this problem, there are two options:

1, Get list of all failed updates and delete them individually from the Dell updates, and reimport.

If you miss any failed updates, you will still get the same error!. Delete them all and close SCUP 2011 and open again, and reimport the catalog.

2. Delete the "Dell" folder on the "Updates" and import Dell catalog again.
Warning: You will lose your all of your local information such as "Date Published", "Expired" and "Date Modified" information, if you expired or published and updates.

To delete the "Dell" folder on Updates:
Make a backup of your SCUP DB first (simply do copy and paste of the DB),  SCUP -> Updates -> Overview -> All Software Updates -> Dell. Highlight the "Dell", right click, and delete.


UPDATE: SCUP 2017 production version is now available! and it works much better! http://exchcluster.blogspot.com/2018/04/system-center-updates-publisher-scup.html

Monday, June 12, 2017

That damn event ID 129

I was getting this event id 129 on several server 2012 R2 systems

Log Name:      System
Source:        LSI_SAS
Date:          
Event ID:      129
Task Category: None
Level:         Warning
Keywords:      Classic
User:          N/A
Computer:      
Description:
Reset to device, \Device\RaidPort0, was issued.

and I found this

Changed LSI_SAS to PVSCSI and got:

Log Name:      System
Source:        pvscsi
Date:          
Event ID:      129
Task Category: None
Level:         Warning
Keywords:      Classic
User:          N/A
Computer:      
Description:
Reset to device, \Device\RaidPort0, was issued.

Contacted VMware and they blamed on M$, and told me to upgrade the SAS driver.
Went to broadcom.com site and look for newer driver for "Lsi SAS 3801E", that is what the real name of the "LSI Adaptoer, SAS 3000 series, 8-port with 1068"


and failed to find any newer drivers for windows 2012 R2, ended up downloading driver for 2008 R2 and replaced it, but still got the event id 129.


but still getting the 129.

Called M$ and they blamed VMware, ended up doing 3way call with VMware and M$, it was fun to hear them blaming each others, and finally they agreed(!) that it was disk system's problem.

Called SAN manufacture and they said there is no error recorded.

Finally I found that event id 129 recorded only when vsphere replication in active.
Called vmware, still was blaming SAN system, and two days later I got this reply:

"I want you to try one more troubleshooting step, which helps to identify and regulate if vSphere Replication is replicating huge data though there are no changes happening on the VM.

This issue is could also be caused by a GuestOS sent unmap command. 
To disable Unmap in the Guest OS:

Using a Windows CMD window on the Host, run the command:

fsutil behavior set DisableDeleteNotify 1

To re-enable the feature, use the following command:

fsutil behavior set DisableDeleteNotify 0

To verify the current setting, use the following command:

fsutil behavior query DisableDeleteNotify

DisableDeleteNotify=0 - indicates the 'Trim and Unmap' feature is on (enabled)
DisableDeleteNotify=1 - indicates the 'Trim and Unmap' feature is off (disabled)

Kindly try the above steps and update the status to us, Awaiting your response."

Tried the solution and the event id 129 is gone.

BUT, unmap is to reclaim TPVV's space!



I asked if VMware can make changes so when replication happens the replication process ignore the unmap command. Their answer was "We will surely consider  the inputs suggested by your side which helps us to enhance the product"

Hope this help someone and save their time.




Thursday, February 02, 2017

SCCM UEFI OS deployment error 0x80004005

I tried to push Windows 10 through UEFI on SCCM 2016 and got error like this

<![LOG[!sBootDevicePath.empty(), HRESULT=80004005 (e:\qfe\nts\sms\framework\tscore\bootvolume.cpp,34)]LOG]!>
<![LOG[System partition not set]LOG]!>
<![LOG[Unable to find the partition that contains the OS boot loaders. Please ensure the hard disks have been properly partitioned
Unspecified error (Error: 80004005; Source: Windows)]LOG]!>
<![LOG[BootVolume::GetCurrent(pBootVolume), HRESULT=80004005 (e:\qfe\nts\sms\framework\tscore\bootimage.cpp,542)]LOG]!>

The problem was, on "Partition Disk 0 - UEFI" step, I forgot to check "Make this the book disk"

Tuesday, December 13, 2016

How to create a clustered task to repeate

It is not possible to create a task with single trigger with repeat. In stead, you can created multiple triggers. It is not recommended to add it manually using the gui, when the cluster fail over the manually changed/added triggers will be vanished. Always use powershell to insure multiple triggers stay with the task.

In this example I created a resource specific task (R: is clustered disk 2), this task runs on a node where the R: is active.

$action = New-ScheduledTaskAction -Execute "PowerShell.exe" -Argument "-executionpolicy bypass -file test.ps1" -WorkingDirectory "R:\scripts"
$triggers = @()
$triggers += New-ScheduledTaskTrigger -Daily -At 04:00
$triggers += New-ScheduledTaskTrigger -Daily -At 08:00
$triggers += New-ScheduledTaskTrigger -Daily -At 15:00
$triggers += New-ScheduledTaskTrigger -Daily -At 22:00
Register-ClusteredScheduledTask –Cluster fileClusterServer –TaskName testTask –TaskType ResourceSpecific –Resource "cluster disk 2" –Action $action –Trigger $triggers



The script below is a bit messy but it creates a clustered task that runs on every hour


$action = New-ScheduledTaskAction -Execute "PowerShell.exe" -Argument "-executionpolicy bypass -file test.ps1" -WorkingDirectory "R:\scripts"
$triggers = @()
for ($i=0; $i -le 23; $i++)
{

[string] $j = $i
if ($i -le 9)
{
 
$j = "0"+ $j

}
$taksTriggerTime = $j

$taskTime = $j + ":00"

$triggers += New-ScheduledTaskTrigger -Daily -At $taskTime

}
  
Register-ClusteredScheduledTask –Cluster fileClusterServer –TaskName testTask –TaskType ResourceSpecific –Resource "cluster disk 2" –Action $action –Trigger $triggers  


Note: the resource specific task will run under the system (node), if fail over happens the active node's system account will run the task, folder security will change automagically so you don't have to add all nodes to folder's security tab.
It is not possible to make the task run under some sort of a service account at this point. It runs under only system account.