Hello,
We're trying to upload a lot of data (350+GB) to our on premises instance of SharePoint 2013.
This data is currently on a shared drive and consists of 1M+ documents on probably 10000+ different folders.
I've written a simple multithreaded tool that uploads the files to SP.
The his uses Parallel.ForEach. and works ok with small amounts of data, but when we try it in anger we tart getting this exception
Net.WebException: The remote server returned an error: (409) Conflict.
at System.Net.HttpWebRequest.GetResponse()
at Microsoft.SharePoint.Client.SPWebRequestExecutor.Execute()
at Microsoft.SharePoint.Client.File.SaveBinary(ClientContext context, String serverRelativeUrl, Stream stream, String etag, Boolean overwriteIfExists, SaveBinaryCheckMode checkMode)
at Migrator.Program.UploadFile(ClientContext context, String filePath, Boolean exception) in c
Interestingly, if I ramp up the number of threads, I get a lot more of these exceptions.
Perhaps, more interestingly we seem to get the error always for the same files, at least after two tries.
I can't really see anything on the SP log, at least anything I can make sense out of.
The below seems to happen after the issue occurrs but not sure if this is the case or just an unrelated exception.
Set EventFiringDisabled to [False]. Stack trace: [ at Microsoft.Office.Server.Utilities.EventReceiverUtility.DisabledEventFiringScope.Dispose()
at Microsoft.Office.Server.Utilities.EventReceiverUtility.RunItemEventReceiverExProps(Boolean handleVersionConflicts, MonitoredScopeWrapper monitoredScopeWrapper, Boolean disableEventFiring, SPItemEventProperties properties, ItemEventReceiverCodeToRunProps
codeToRun) at Microsoft.Office.Server.Utilities.EventReceiverUtility.RunAndHandleVersionConflictsExProps(MonitoredScopeWrapper monitoredScopeWrapper, Boolean disableEventFiring, SPItemEventProperties properties, ItemEventReceiverCodeToRunProps
codeToRun) at Microsoft.Office.DocumentManagement.DocumentId.ItemChangedInternal(SPItemEventProperties properties, Boolean fOverwrite) a...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...t Microsoft.Office.DocumentManagement.Internal.DocIdHandler.ItemChangedInternal(SPItemEventProperties properties, Boolean fOverwrite) at Microsoft.Office.DocumentManagement.Internal.DocIdHandler.ItemAdded(SPItemEventProperties properties) at Microsoft.SharePoint.SPEventManager.RunItemEventReceiver(SPItemEventReceiver receiver, SPUserCodeInfo userCodeInfo, SPItemEventProperties properties, SPEventContext context, String receiverData) at Microsoft.SharePoint.SPEventManager.RunItemEventReceiverHelper(Object
receiver, SPUserCodeInfo userCodeInfo, Object properties, SPEventContext context, String receiverData) at Microsoft.SharePoint.SPEventManager.<>c__DisplayClassa`1.<InvokeEventReceiver>b__7() at Microsoft.SharePoint.SPSecurity.RunAsUser(SPUserToken
userToken, Boolean bRe...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...setContext, WaitCallback code, Object param) at Microsoft.SharePoint.SPEventManager.InvokeEventReceiver[ReceiverType](SPUserToken userToken, Guid tranLockerId, RunEventReceiver runEventReceiver, Object receivers, Int32 n, Object properties,
SPEventReceiverOperationsType operationsType, Boolean& canceled, String& error) at Microsoft.SharePoint.SPEventManager.InvokeEventReceivers[ReceiverType](SPRemoteEventReceiverCallType remoteCallType, SPUserToken userToken, Guid tranLockerId,
RunEventReceiver runEventReceiver, RunRemoteEventReceiver runRemoteEventReceiver, Object receivers, Object properties, Boolean checkCancel, SPEventReceiverOperationsType operationsType) at Microsoft.SharePoint.SPEventManager.InvokeEventReceivers[ReceiverType](SPRemoteEventReceiverCallType
remoteCallType,...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
... Byte[] userTokenBytes, Guid tranLockerId, RunEventReceiver runEventReceiver, RunRemoteEventReceiver runRemoteEventReceiver, Object receivers, Object properties, Boolean checkCancel, SPEventReceiverOperationsType operationsType) at Microsoft.SharePoint.SPEventManager.ExecuteItemEventReceivers(Byte[]&
userToken, Guid& tranLockerId, Object& receivers, ItemEventReceiverParams& itemEventParams, Object& changedFields, EventReceiverResult& eventResult, String& errorMessage) at Microsoft.SharePoint.Library.SPRequestInternalClass.AddOrDeleteUrl(String
bstrUrl, String bstrDirName, Boolean bAdd, UInt32 dwDeleteOp, Int32 iUserId, Guid& pgDeleteTransactionId) at Microsoft.SharePoint.Library.SPRequestInternalClass.AddOrDeleteUrl(String bstrUrl, String bstrDirName, Boolean bAdd, UInt32 dwDel...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...eteOp, Int32 iUserId, Guid& pgDeleteTransactionId) at Microsoft.SharePoint.Library.SPRequest.AddOrDeleteUrl(String bstrUrl, String bstrDirName, Boolean bAdd, UInt32 dwDeleteOp, Int32 iUserId, Guid& pgDeleteTransactionId)
at Microsoft.SharePoint.SPFolderCollection.AddInternal(String strUrl, Int32 userId) at LD_FolderStructure.Events.Events.CreateFolderStructure(SPItemEventProperties properties) at Microsoft.SharePoint.SPEventManager.RunItemEventReceiver(SPItemEventReceiver
receiver, SPUserCodeInfo userCodeInfo, SPItemEventProperties properties, SPEventContext context, String receiverData) at Microsoft.SharePoint.SPEventManager.RunItemEventReceiverHelper(Object receiver, SPUserCodeInfo userCodeInfo, Object properties,
SPEventContext context, String receiverData) at Mi...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...crosoft.SharePoint.SPEventManager.<>c__DisplayClassa`1.<InvokeEventReceiver>b__7() at Microsoft.SharePoint.SPSecurity.RunAsUser(SPUserToken userToken, Boolean bResetContext, WaitCallback code, Object param) at Microsoft.SharePoint.SPEventManager.InvokeEventReceiver[ReceiverType](SPUserToken
userToken, Guid tranLockerId, RunEventReceiver runEventReceiver, Object receivers, Int32 n, Object properties, SPEventReceiverOperationsType operationsType, Boolean& canceled, String& error) at Microsoft.SharePoint.SPEventManager.InvokeEventReceivers[ReceiverType](SPRemoteEventReceiverCallType
remoteCallType, SPUserToken userToken, Guid tranLockerId, RunEventReceiver runEventReceiver, RunRemoteEventReceiver runRemoteEventReceiver, Object receivers, Object properties, Boolean checkCancel, SPE...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...ventReceiverOperationsType operationsType) at Microsoft.SharePoint.SPEventManager.InvokeEventReceivers[ReceiverType](SPRemoteEventReceiverCallType remoteCallType, Byte[] userTokenBytes, Guid tranLockerId, RunEventReceiver runEventReceiver,
RunRemoteEventReceiver runRemoteEventReceiver, Object receivers, Object properties, Boolean checkCancel, SPEventReceiverOperationsType operationsType) at Microsoft.SharePoint.SPEventManager.HandleEventCallback[ReceiverType,PropertiesType](Object
callbackData) at Microsoft.SharePoint.Utilities.SPThreadPool.WaitCallbackWrapper(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(Execution...
7f311d9d-2565-e02b-95fa-1ca09f0d4749
...Context executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem() at System.Threading.ThreadPoolWorkQueue.Dispatch() ]
7f311d9d-2565-e02b-95fa-1ca09f0d4749
Any ideas?
Thanks