Hi
in our vCenter, the Storage Monitoring service cannot intialize. Storage views fail to launch orrectly, and for example, VC Operations manager cannot collect informations about storage capacity.
While exploring the vCenter logs, especially the sms.log, I can find errors talking about : Got duplicate entries for non ISCSI Targets.
I tried to reinstall completely the vCenter system, but no luck. I -t seems that the issue is in the vCenter DB
Could you help us with some advices, please.
Here is an extract of the sms.log :
2013-02-14 02:03:59,733 [pool-7997-thread-2] ERROR com.vmware.vim.sms.provider.VcProviderImpl - Got duplicate entries for non ISCSI Targets
2013-02-14 02:03:59,733 [pool-7997-thread-2] ERROR com.vmware.vim.sms.provider.VcProviderImpl - PopulateStorageInfoTask Failed :
com.vmware.vim.binding.sms.fault.ProviderSyncFailed:
inherited from com.vmware.vim.binding.sms.fault.ProviderSyncFailed
at com.vmware.vim.sms.provider.VcProviderImpl.populateScsiTargets(VcProviderImpl.java:799)
at com.vmware.vim.sms.provider.VcProviderImpl.access$300(VcProviderImpl.java:41)
at com.vmware.vim.sms.provider.VcProviderImpl$PopulateStorageInfoTask.run(VcProviderImpl.java:3006)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
2013-02-14 02:03:59,742 [pool-7997-thread-1] DEBUG com.vmware.vim.sms.provider.VcProviderImpl - Populated VM information
2013-02-14 02:04:00,736 [pool-7997-thread-3] DEBUG com.vmware.vim.sms.provider.VcProviderImpl - Populated VM File information
2013-02-14 02:04:00,736 [Thread-17] ERROR com.vmware.vim.sms.provider.VcProviderImpl - Failed populating service cache
java.util.concurrent.ExecutionException: java.lang.RuntimeException: com.vmware.vim.binding.sms.fault.ProviderSyncFailed:
inherited from com.vmware.vim.binding.sms.fault.ProviderSyncFailed
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
at java.util.concurrent.FutureTask.get(FutureTask.java:83)
at com.vmware.vim.sms.provider.VcProviderImpl.waitForTasks(VcProviderImpl.java:2672)
at com.vmware.vim.sms.provider.VcProviderImpl.sync(VcProviderImpl.java:133)
at com.vmware.vim.sms.ServiceImpl.syncServiceCache(ServiceImpl.java:374)
at com.vmware.vim.sms.ServiceImpl.init(ServiceImpl.java:262)
at com.vmware.vim.sms.ServiceImpl.access$100(ServiceImpl.java:59)
at com.vmware.vim.sms.ServiceImpl$ServiceInitializer.run(ServiceImpl.java:157)
Caused by: java.lang.RuntimeException: com.vmware.vim.binding.sms.fault.ProviderSyncFailed:
inherited from com.vmware.vim.binding.sms.fault.ProviderSyncFailed
at com.vmware.vim.sms.provider.VcProviderImpl$PopulateStorageInfoTask.run(VcProviderImpl.java:3031)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.vmware.vim.binding.sms.fault.ProviderSyncFailed:
inherited from com.vmware.vim.binding.sms.fault.ProviderSyncFailed
at com.vmware.vim.sms.provider.VcProviderImpl.populateScsiTargets(VcProviderImpl.java:799)
at com.vmware.vim.sms.provider.VcProviderImpl.access$300(VcProviderImpl.java:41)
at com.vmware.vim.sms.provider.VcProviderImpl$PopulateStorageInfoTask.run(VcProviderImpl.java:3006)
... 6 more
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.provider.VcProviderImpl - Checking in inactiveCacheDbClient
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.provider.VcProviderImpl - Checking in vcDbClient
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.ServiceImpl - Checking in inactiveCacheDbClient
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.util.SimpleTimeCounter - TIMER STOPPED: Service cache sync
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.util.SimpleTimeCounter - TIME TAKEN: Service cache sync: 1.888
2013-02-14 02:04:00,738 [Thread-17] INFO com.vmware.vim.sms.HealthAgentImpl - Changing health status from INIT_IN_PROGRESS to PROVIDER_SYNC_FAILED
2013-02-14 02:04:00,738 [Thread-17] DEBUG com.vmware.vim.sms.HealthAgentImpl - Publishing service health information
2013-02-14 02:04:00,739 [Thread-17] INFO com.vmware.vim.sms.HealthAgentImpl - Changing health status from PROVIDER_SYNC_FAILED to INIT_FAILED
2013-02-14 02:04:00,739 [Thread-17] DEBUG com.vmware.vim.sms.HealthAgentImpl - Publishing service health information
2013-02-14 02:04:00,739 [Thread-17] ERROR com.vmware.vim.sms.ServiceImpl - Unknown exception encountered during service initialization
com.vmware.vim.binding.sms.fault.ProviderSyncFailed:
inherited from com.vmware.vim.binding.sms.fault.ProviderSyncFailed
at com.vmware.vim.sms.provider.VcProviderImpl.sync(VcProviderImpl.java:167)
at com.vmware.vim.sms.ServiceImpl.syncServiceCache(ServiceImpl.java:374)
at com.vmware.vim.sms.ServiceImpl.init(ServiceImpl.java:262)
at com.vmware.vim.sms.ServiceImpl.access$100(ServiceImpl.java:59)
at com.vmware.vim.sms.ServiceImpl$ServiceInitializer.run(ServiceImpl.java:157)
2013-02-14 02:04:00,739 [Thread-17] INFO com.vmware.vim.sms.ServiceImpl$ServiceInitializer - Retry #1017 in 1800 seconds
2013-02-14 02:33:59,814 [Thread-17] DEBUG com.vmware.vim.sms.ServiceImpl - Initializing service...
2013-02-14 02:33:59,814 [Thread-17] INFO com.vmware.vim.sms.HealthAgentImpl - Changing health status from INIT_FAILED to INIT_IN_PROGRESS
2013-02-14 02:33:59,814 [Thread-17] DEBUG com.vmware.vim.sms.HealthAgentImpl - Publishing service health information
2013-02-14 02:33:59,814 [Thread-17] DEBUG com.vmware.vim.sms.util.VpxdConnection - Creating client for VC server at https://localhost:8089/sdk
2013-02-14 02:33:59,877 [Thread-17] DEBUG com.vmware.vim.sms.util.VpxdConnection - Ignoring exception during vpxd connection logout
com.vmware.vim.binding.vim.fault.NotAuthenticated:
inherited from com.vmware.vim.binding.vim.fault.NoPermission:
object = com.vmware.vim.binding.vmodl.ManagedObjectReference@c1f8a09,
privilegeId = System.View
inherited from com.vmware.vim.binding.vmodl.fault.SecurityError:
inherited from com.vmware.vim.binding.vim.fault.NotAuthenticated: The session is not authenticated.
at sun.reflect.GeneratedConstructorAccessor233.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at java.lang.Class.newInstance0(Class.java:355)
at java.lang.Class.newInstance(Class.java:308)
at com.vmware.vim.vmomi.core.types.impl.ComplexTypeImpl.newInstance(ComplexTypeImpl.java:143)
at com.vmware.vim.vmomi.core.types.impl.DefaultDataObjectFactory.newDataObject(DefaultDataObjectFactory.java:26)
at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.ComplexStackContext.<init>(ComplexStackContext.java:33)
at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.parse(UnmarshallerImpl.java:135)
at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.unmarshall(UnmarshallerImpl.java:98)
at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoapFault(UnmarshallerImpl.java:84)
at com.vmware.vim.vmomi.client.common.impl.SoapFaultStackContext.setValue(SoapFaultStackContext.java:37)
at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.unmarshal(ResponseUnmarshaller.java:97)
at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.unmarshalResponse(ResponseImpl.java:243)
at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.setResponse(ResponseImpl.java:202)
at com.vmware.vim.vmomi.client.http.impl.HttpExchange.run(HttpExchange.java:105)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
2013-02-14 02:33:59,878 [Thread-17] DEBUG com.vmware.vim.sms.util.VpxdConnection - Attempting to log in to vpxd at https://localhost:8089/sdk as extension 'com.vmware.vim.sms'
2013-02-14 02:33:59,897 [Thread-17] DEBUG com.vmware.vim.sms.util.VpxdConnection - Login successful!
2013-02-14 02:33:59,920 [Thread-17] DEBUG com.vmware.vim.sms.ServiceImpl - Count of retrieved endpoints = 23
2013-02-14 02:33:59,920 [Thread-17] DEBUG com.vmware.vim.sms.ServiceImpl - Proxy endpoint already registered.
2013-02-14 02:33:59,920 [Thread-17] INFO com.vmware.vim.common.vdb.VdbConfig - Config name=vcdb
2013-02-14 02:33:59,921 [Thread-17] INFO com.vmware.vim.common.vdb.VdbConfig - Property file=C:\ProgramData\VMware\VMware VirtualCenter\vcdb.properties
2013-02-14 02:33:59,921 [Thread-17] INFO com.vmware.vim.common.vdb.VdbConfig - Loaded url from props=jdbc:sqlserver://CloudbVSVvcs001\cloudbvsvvcs001;databaseName=VIM_VCDB;integratedSecurity=true
2013-02-14 02:33:59,921 [Thread-17] INFO com.vmware.vim.common.vdb.VdbConfig - Overrides=
2013-02-14 02:33:59,933 [Thread-17] INFO com.vmware.vim.sms.data.VcDbConnectionInfo - VC DB Connection: url = jdbc:sqlserver://CloudbVSVvcs001\cloudbvsvvcs001;databaseName=VIM_VCDB;integratedSecurity=true, username = , driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
2013-02-14 02:34:00,001 [Thread-17] INFO com.vmware.vim.sms.data.CacheDbConnectionInfo - CacheDbConnection initialized with parameters: DbUrl = jdbc:h2:file:C:/Program Files/VMware/Infrastructure/tomcat/webapps/sms/WEB-INF/classes/com/vmware/vim/sms/data//sms-cache0;LOCK_TIMEOUT=10000;CACHE_SIZE=524288 DbDriver = org.h2.Driver DbUser = sa