Installation v1.0.0.1440 - Replacing existing files failed

Continua CI Discussion
1

Morning,

Thanks for the breadcrumb fixes over the weekend.

I'm just trying to upgrade to v1.0.0.1440 and I'm getting a stack of exceptions during the install, where the process is not overwriting existing files.  I noticed that a stack of the services were still running, even after the installation UI said it was turning them off. I was also unable to stop the "Continua CI Application Service" as I get a "Error 1061: The service cannot accept control messages at this time."  I think there is something funky going on here.  I can't get the "Retry" button to work, only the "Ignore" button. I've eventually "Aborted" the installation.

Attachment unavailable

2

Sounds like the service crashed during shutdown. You will need to terminate the process. Have a look in the windows eventlog and see if there is anything noteworthy there.

3
Posted By Vincent Parrett on 10 Feb 2013 05:17 PM
Sounds like the service crashed during shutdown. You will need to terminate the process. Have a look in the windows eventlog and see if there is anything noteworthy there.

I eventually did a multi server reboot as there were a few things in play here. The SQL Server 2012 Server 2012 was due for reboot. It looks like there was a crash in some part of the service, as you said and no amount of IIS restarting or attempts to restart the service worked.

I had a repo with a setting issue:

Cannot get new changesets for @link(2002, 31aa26d0-bcf4-4880-8daf-be634d7b4741)[NBStore-Codeplex]: Value cannot be null.
Parameter name: path1
This event has been reported 297 times.

I had some other events that just look like timing/upgrade events, post upgrade like:

Exception: ResourceNotFoundException
Message: Could not update properties of agent 'jdbne01' as a connection could not be established on 192.168.***.***:9002. Make sure the port has been excluded from any firewalls enabled on the target machine.
Stack Trace: at Continua.Modules.Builds.Agents.AgentManager.UpdatePropertiesForAgent(RegisteredAgent agent)
at Continua.Modules.Builds.Agents.AgentManager.Register(String address, String hostname, Int32 port, String version)
at Continua.Modules.Builds.Services.AgentRegistrationService.Register(String hostname, Int32 port, String version)
at SyncInvokeRegister(Object , Object[] , Object[] )
at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs)
at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage31(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)

And

The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:10'.
This event has been reported 3 times.

I'm going to assume they are just "agent upgrade/timing issues", so I'm not worried.

 

The more concerning events were a series of transaction failures, which I've added for your reference (as they seemed to be one off failures).

The Build Queue Monitor threw the following exception:
NHibernate.TransactionException: Begin failed with SQL exception ---> System.Data.SqlClient.SqlException: Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception: The wait operation timed out
--- End of inner exception stack trace ---
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObject stateObj, UInt32 error)
at System.Data.SqlClient.TdsParserStateObject.ReadSniSyncOverAsync()
at System.Data.SqlClient.TdsParserStateObject.TryReadNetworkPacket()
at System.Data.SqlClient.TdsParserStateObject.TryPrepareBuffer()
at System.Data.SqlClient.TdsParserStateObject.TryReadByte(Byte& value)
at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.TdsExecuteTransactionManagerRequest(Byte[] buffer, TransactionManagerRequestType request, String transactionName, TransactionManagerIsolationLevel isoLevel, Int32 timeout, SqlInternalTransaction transaction, TdsParserStateObject stateObj, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnection.BeginSqlTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlInternalConnection.BeginTransaction(IsolationLevel iso)
at System.Data.SqlClient.SqlConnection.BeginDbTransaction(IsolationLevel isolationLevel)
at System.Data.Common.DbConnection.System.Data.IDbConnection.BeginTransaction(IsolationLevel isolationLevel)
at NHibernate.Transaction.AdoTransaction.Begin(IsolationLevel isolationLevel)
--- End of inner exception stack trace ---
at Continua.Shared.Data.Hibernate.NHibernateDatabase..ctor(ISession session)
at Continua.Shared.Data.Hibernate.NHibernateDatabaseFactory.Open()
at Continua.ApplicationSessionContext.get_Database()
at Continua.LicenseManager.GetLicenseDTOs()
at Continua.LicenseManager.GetEffectiveLicenseCount()
at Continua.Modules.Builds.BuildQueue.Monitor()
at Continua.Modules.Builds.BuildQueue.<.ctor>b__0()

Exception: TransactionException
Message: Begin failed with SQL exception
Stack Trace: at Continua.Shared.Data.Hibernate.NHibernateDatabase..ctor(ISession session)
at Continua.Shared.Data.Hibernate.NHibernateDatabaseFactory.Open()
at Continua.ApplicationSessionContext.get_Database()
at Continua.Modules.Builds.Agents.AgentManager.Register(String address, String hostname, Int32 port, String version)
at Continua.Modules.Builds.Services.AgentRegistrationService.Register(String hostname, Int32 port, String version)
at SyncInvokeRegister(Object , Object[] , Object[] )
at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs)
at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage31(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)

Exception: SqlException
Message: A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - The semaphore timeout period has expired.)
Stack Trace: at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObject stateObj, UInt32 error)
at System.Data.SqlClient.TdsParserStateObject.ReadSniSyncOverAsync()
at System.Data.SqlClient.TdsParserStateObject.TryReadNetworkPacket()
at System.Data.SqlClient.TdsParserStateObject.TryPrepareBuffer()
at System.Data.SqlClient.TdsParserStateObject.TryReadByte(Byte& value)
at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.TdsExecuteTransactionManagerRequest(Byte[] buffer, TransactionManagerRequestType request, String transactionName, TransactionManagerIsolationLevel isoLevel, Int32 timeout, SqlInternalTransaction transaction, TdsParserStateObject stateObj, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnection.BeginSqlTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlInternalConnection.BeginTransaction(IsolationLevel iso)
at System.Data.SqlClient.SqlConnection.BeginDbTransaction(IsolationLevel isolationLevel)
at System.Data.Common.DbConnection.System.Data.IDbConnection.BeginTransaction(IsolationLevel isolationLevel)
at NHibernate.Transaction.AdoTransaction.Begin(IsolationLevel isolationLevel)

Exception: Win32Exception
Message: The semaphore timeout period has expired
Stack Trace: 
The background process XMPP notification queue threw the following exception: NHibernate.TransactionException: Begin failed with SQL exception ---> System.Data.SqlClient.SqlException: A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - The semaphore timeout period has expired.) ---> System.ComponentModel.Win32Exception: The semaphore timeout period has expired
--- End of inner exception stack trace ---
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObject stateObj, UInt32 error)
at System.Data.SqlClient.TdsParserStateObject.ReadSniSyncOverAsync()
at System.Data.SqlClient.TdsParserStateObject.TryReadNetworkPacket()
at System.Data.SqlClient.TdsParserStateObject.TryPrepareBuffer()
at System.Data.SqlClient.TdsParserStateObject.TryReadByte(Byte& value)
at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.TdsExecuteTransactionManagerRequest(Byte[] buffer, TransactionManagerRequestType request, String transactionName, TransactionManagerIsolationLevel isoLevel, Int32 timeout, SqlInternalTransaction transaction, TdsParserStateObject stateObj, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnection.BeginSqlTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlInternalConnection.BeginTransaction(IsolationLevel iso)
at System.Data.SqlClient.SqlConnection.BeginDbTransaction(IsolationLevel isolationLevel)
at System.Data.Common.DbConnection.System.Data.IDbConnection.BeginTransaction(IsolationLevel isolationLevel)
at NHibernate.Transaction.AdoTransaction.Begin(IsolationLevel isolationLevel)
--- End of inner exception stack trace ---
at Continua.Shared.Data.Hibernate.NHibernateDatabase..ctor(ISession session)
at Continua.Shared.Data.Hibernate.NHibernateDatabaseFactory.Open()
at Continua.ApplicationSessionContext.get_Database()
at Continua.Notification.NotificationManager.GetPublisherById(Guid id)
at Continua.Notification.Queues.XmppQueue.CreateClient()
at Continua.Notification.Queues.XmppQueue.Monitor()
at Continua.Shared.BackgroundMonitor.Run()