This error has been showing up in our QA environment and I could use some tips on how to debug it.
Both our prod and qa environments recently had the December 2015 CU installed.
Our 3rd party vendor sent an update to their workflow code (uses Nintex 2013) last night and there were only 2 instances of this error after that was installed. The 3rd party solution was not installed on production and we are not getting this error in production.
This is only happening in our QA environment where the 3rd party code is installed so I am fairly certain there is a connection with their code. The error comes up when the workflow timer job runs.
Timestamp Process TID Area Category EventID Level Message Correlation 03/15/2016 03:00:00.08 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Logging Correlation Data xmnv Medium Name=Timer Job job-workflow 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.39 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Upgrade ajyw6 High 03/15/2016 03:00:00.39 OWSTIMER (0x1D74) 0x3218 SharePoint Foundation Upgrade SPHierarchyManager ajyw6 DEBUG [SPTree Value=SPSite Url=https://our.qa.site.com] added to dependency cache by lookup 6cb7689d-6b05-2008-a9e5-f1822f9c683d 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.43 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Upgrade ajyw6 High 03/15/2016 03:00:00.43 OWSTIMER (0x1D74) 0x3218 SharePoint Foundation Upgrade SPHierarchyManager ajyw6 DEBUG [SPTree Value=SPSite Url=https://our.qa.site.com] added to dependency cache by lookup 6cb7689d-6b05-2008-a9e5-f1822f9c683d 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.47 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Monitoring b4ly High Leaving Monitored Scope (EnsureListItemsData). Execution Time=91.9296307212229 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.52 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Files aiv4w Medium Spent 0 ms to bind 10415 byte file stream 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.55 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Monitoring nasq Medium Entering monitored scope (WorkflowTelemetryScope). Parent Timer Job job-workflow 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.60 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Files aiv4w Medium Spent 0 ms to bind 426474 byte file stream 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:00.68 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Files aiv4w Medium Spent 0 ms to bind 189746 byte file stream 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:02.38 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation General ahjnc Unexpected SPReaderWriterLock named [SPInitializeOnceLock] held for 1438 milliseconds. Call stack: at Microsoft.SharePoint.Utilities.SPReaderWriterLock.SPReaderWriterLockScope.Dispose() at Microsoft.SharePoint.Workflow.SPNoCodeXomlCompiler.get_ReferencedAssemblies() at Microsoft.SharePoint.Workflow.SPNoCodeXomlCompiler.SubCompiler.AddReferenceableAssemblies(WorkflowCompilerParameters theParameters) at Microsoft.SharePoint.Workflow.SPNoCodeXomlCompiler.SubCompiler.DoCompile(WorkflowCompilerParameters parameters, String xomlSource, String assemblyName, CompilationPacket& packet, DirectoryInfo& tempDir) 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Legacy Workflow Infrastructure 936l High Engine RunWorkflow: System.IO.FileNotFoundException: Could not load file or assembly 'Activity.Libraries.WF, Version=5.6.0.0, Culture=neutral, PublicKeyToken=e608b71d03b28d9f' or one of its dependencies. The system cannot find the file specified. File name: 'Activity.Libraries.WF, Version=5.6.0.0, Culture=neutral, PublicKeyToken=e608b71d03b28d9f' at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks) at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& sta... 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24* OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Legacy Workflow Infrastructure 936l High ...ckMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks) at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean forIntrospection) at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, Boolean forIntrospection) at System.Reflection.Assembly.Load(String assemblyString) at System.UnitySerializationHolder.GetRealObject(StreamingContext context) at System.Runtime.Serialization.ObjectManager.ResolveObjectReference(ObjectHolder holder) at System.Runtime.Serialization.ObjectManager.DoFixups() at System.Runtime.Serialization.Formatters.... 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24* OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Legacy Workflow Infrastructure 936l High ...Binary.ObjectReader.Deserialize(HeaderHandler handler, __BinaryParser serParser, Boolean fCheck, Boolean isCrossAppDomain, IMethodCallMessage methodCallMessage) at System.Runtime.Serialization.Formatters.Binary.BinaryFormatter.Deserialize(Stream serializationStream, HeaderHandler handler, Boolean fCheck, Boolean isCrossAppDomain, IMethodCallMessage methodCallMessage) at System.Runtime.Serialization.Formatters.Binary.BinaryFormatter.Deserialize(Stream serializationStream) at System.Workflow.ComponentModel.Activity.Load(Stream stream, Activity outerActivity, IFormatter formatter) at System.Workflow.Runtime.Hosting.WorkflowPersistenceService.RestoreFromDefaultSerializedForm(Byte[] activityBytes, Activity outerActivity) at Microsoft.SharePoint.Workflow.SPWinOePersistenceSer... 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24* OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Legacy Workflow Infrastructure 936l High ...vice.LoadWorkflowInstanceState(Guid instanceId) at System.Workflow.Runtime.WorkflowRuntime.InitializeExecutor(Guid instanceId, CreationContext context, WorkflowExecutor executor, WorkflowInstance workflowInstance) at System.Workflow.Runtime.WorkflowRuntime.Load(Guid key, CreationContext context, WorkflowInstance workflowInstance) at System.Workflow.Runtime.WorkflowRuntime.GetWorkflow(Guid instanceId) at Microsoft.SharePoint.Workflow.SPWinOeHostServices.Send(SPWorkflow workflow, SPWinOeWorkflow winoeworkflow, SPWorkflowEvent e) at Microsoft.SharePoint.Workflow.SPWinOeEngine.RunWorkflow(SPWorkflowHostService host, SPWorkflow workflow, Collection`1 events, TimeSpan timeOut) WRN: Assembly binding logging is turned OFF. To enable assembly bind failure logging, set the re... 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24* OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Legacy Workflow Infrastructure 936l High ...gistry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1. Note: There is some performance penalty associated with assembly bind failure logging. To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog]. 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.24 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Monitoring b4ly Medium Leaving Monitored Scope (WorkflowTelemetryScope). Execution Time=15685.4028933845 6cb7689d-6b05-2008-a9e5-f1822f9c683d 03/15/2016 03:00:16.29 OWSTIMER.EXE (APPSERVER:0x1D74) 0x3218 SharePoint Foundation Monitoring b4ly High Leaving Monitored Scope (Timer Job job-workflow). Execution Time=16189.6563669405 6cb7689d-6b05-2008-a9e5-f1822f9c683d
Love them all...regardless. - Buddha