Hi Kamil,
We will need to check what is happening in Webconsole.log at that time, reporting service is telling us that timeout was reached, but the cause of the timeout is not clear.
12812 3894 04/01 07:00:08 823631 genReportsWebSchedule::generateReport() - Generating report using web console ehttp://ilcs.xyz.pl:80/webconsole/]
12812 3894 04/01 07:18:08 823631 genReportsWebSchedule::downloadReportFile() - Download error message e0xEDD0001C:{CvCURL::CvProtocolReq::download(460)} + {CvCURL::CvProtocolReq::SendReqest(611)} + {CvCURL::CvProtocolReq::Execute(672)/CvCURL.28.0x1C-CURL perform failed.Curl ErrorCode : :28], Error Message : :Operation timed out after 1080000 milliseconds with 0 bytes received]}]
12812 3894 04/01 07:18:08 823631 genReportsWebSchedule::generateReport() - Failed to generate report using any web console.
12812 3894 04/01 07:18:08 823631 EvReportMgr::GenerateReportNonSecurity() - Failed to generate report for report type=e8012] task ID=D823631].
12812 3894 04/01 07:18:08 823631 EvReportMgr::disposeReport() - HealthCheck : Report Failed
Thanks,
Juan
Hi @Kamil
Thank you for the question and welcome to the Community!
I don’t see any attachments or screenshots in the post, perhaps you add these?
Also, if you can find log messages in scheduledReport.log from the report generation time, that might help us narrow in on the issue.
Thanks,
Stuart
Hi @Kamil
Thanks for providing those extra details.
I can see an error in the log
Curl ErrorCode : :28], Error Message : :Operation timed out after 1080000 milliseconds with 0 bytes received]
and then:
12812 3894 04/01 07:18:08 823631 genReportsWebSchedule::generateReport() - Failed to generate report using any web console.
12812 3894 04/01 07:18:08 823631 genReportBase::getReportUrl() - Generating report using web console ohttp://ilcs.xyz.pl:80/webconsole].
Is the Web Console server here the correct and expected server or has something changed in the environment? E.g. is the Commserve still able to communicate with the Web Console server on http:80?
We can use a setting to choose a particular Web Console for generating these scheduled reports if you need to:
Can I choose the Web Console used for scheduled reports?
sDefaultWebReportWebConsoleURL
Thanks,
Stuart
Hello Guys,
Sorry for the lack of updates on my part. The problem has stopped occurring at the moment, I will wait until Monday. If the problem starts to recur, it will create a ticket in Commvault support.
Thanks,
Kamil
Hello,
The problem has stopped occurring at the moment, perhaps one of the Hotfix versions has solved the problem. I left the case for observation, when something starts to happen I will let you know.
Regards,
Kamil
@Kamil - from the logs that you had attacked - it is showing that there was a timeout when it was generating this report, - It looks like it had taken over 18 min before timing out.
8404 3a9c 06/03 07:00:02 873727 genReportsWebSchedule::generateReport() - Generating report using web console lhttp://ilcs.qwe.pl:80/webconsole/].
8404 3a9c 06/03 07:18:02 873727 genReportsWebSchedule::downloadReportFile() - Download error message s0xEDD0001C:{CvCURL::CvProtocolReq::download(460)} + {CvCURL::CvProtocolReq::SendReqest(611)} + {CvCURL::CvProtocolReq::Execute(672)/CvCURL.28.0x1C-CURL perform failed.Curl ErrorCode : d28], Error Message : oOperation timed out after 1080000 milliseconds with 0 bytes received]}]
8404 3a9c 06/03 07:18:02 873727 genReportsWebSchedule::generateReport() - Failed to generate report using any web console.
I would like to know if you can open a browser to http://ilcs.qwe.pl/webconsole/ or do you need to go to https://ilcs.qwe.pl/webconsole/ or does it get changed to https://.?
Also I have to assume that ilcs.qwe.pl is your webserver.
If the URL does get changed to uses https:// - you may try the steps in the following doc link:https://documentation.commvault.com/commvault/v11_sp20/article?p=40607.htm or if you have more then one webconsole.
If this does not work - I would suggest that you open a support case so that we can review the issue for you more in depth
Hello,
thank you for the quick reply.
I corrected the screenshots and sent them. The log snippet for the issue was uploaded from scheduledReport.log.
12812 30ec 04/01 07:00:08 823635 EvReportMgr::GenerateReportNonSecurity() - xmlStr t<?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><adminOpts><reportOption><commonOpt reportType="8012" emailType="2"><emailAddress val="xyz1@gmail.com"/><emailAddress val="xyz2@gmail.com"/><emailAddress val="xyz3@gmail.com"/><emailAddress val="xyz3@gmail.com"/><locale country="US" LCID="1033" displayString="English (United States)" language="en" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="1" isCompressed="0"/></commonOpt><webReportOption reportType="CustomReports" reportId="85" webconsoleClientId="2" filePrefix="Virtual Machine Infrastructure Report V2" webserverId="0" url="%2Freportsplus%2FreportViewer.jsp%3FreportId%3D85%26Details.filter.IsProtected%3DNo%26Details.hide%3DVirtualManager%252CDataSource%252CUsedSizeGB%252CGuestSizeGB%252CProvisionedSizeGB%26pageSize%3D-1%26exportType%3Dhtml%26viewportWidth%3D1600"><executiveSummaryOption headName="" commCellGroupList="" designation=""/><customDocumentOption guid=""/></webReportOption></reportOption></adminOpts></TMMsg_JobOption>]
12812 3894 04/01 07:00:08 823631 EvReportMgr::GenerateReportNonSecurity() - xmlStr S<?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><adminOpts><reportOption><commonOpt reportType="8012" emailType="2"><emailAddress val="xyz1@gmail.com"/><emailAddress val="xyz2@gmail.com"/><emailAddress val="xyz2@gmail.com"/><emailAddress val="xyz3@gmail.com"/><locale country="US" LCID="1033" displayString="English (United States)" language="en" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="6" isCompressed="0"/></commonOpt><webReportOption reportType="Survey" reportId="health.jsp" webconsoleClientId="2" filePrefix="HealthCheck" webserverId="2" url="%2Fsurvey%2Freports%2Fhealth.jsp%3Fseverity%3Dall%26grouping%3Dcategory%26pageSize%3D-1%26exportType%3Dpdf"><executiveSummaryOption headName="" commCellGroupList="" designation=""/><customDocumentOption guid=""/></webReportOption></reportOption></adminOpts></TMMsg_JobOption>]
12812 30ec 04/01 07:00:08 823635 EvReportMgr::GenerateReportNonSecurity() - generating Virtual Machine Infrastructure Report V2
12812 3894 04/01 07:00:08 823631 EvReportMgr::GenerateReportNonSecurity() - generating HealthCheck
12812 3894 04/01 07:00:08 823631 genReportsWebSchedule::generateReport() - Generating report using web console ohttp://abc.xyz.pl:80/webconsole/].
12812 242c 04/01 07:00:08 823634 EvReportMgr::GenerateReportNonSecurity() - xmlStr <?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><backupOpts backupLevel="2"><dataOpt autoCopy="0"/></backupOpts><adminOpts><contentIndexingOption subClientBasedAnalytics="0"/><reportOption><commonOpt dateFormat="mm/dd/yyyy" overrideDateTimeFormat="0" reportType="7705" summaryOnly="0" reportCustomName="" emailType="1" timeFormat="hhss am/pm" onCS="0" clientOwners="0"><emailAddress val="xyz1@gmail.com"/><emailAddress val="xyz2@gmail.com"/><emailAddress val="xyz2@gmail.com"/><emailAddress val="xyz3@gmail.com"/><locale _type_="66" LCID="1033" displayString="English-UnitedStates" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="1" isNetworkDrive="0"/></commonOpt><eventreport groupBy="5" Jobid="0" includeEventDetails="1"><severityLevels minor="0" major="1" critical="1" information="0"/></eventreport><computerSelectionList includeAll="1"/><timeRangeOption _type_="54" TimeZoneID="21" type="13" toTime="86400"/></reportOption></adminOpts><restoreOptions><commonOptions syncRestore="0"/><fileOption/></restoreOptions><commonOpts jobDescription=""/></TMMsg_JobOption>]
12812 242c 04/01 07:00:08 823634 EvReportMgr::GenerateReportNonSecurity() - generating
12812 30ec 04/01 07:00:08 823635 genReportsWebSchedule::generateReport() - Generating report using web console shttp://abc.xyz.pl:80/webconsole/].
12812 242c 04/01 07:00:08 823634 EvReportMgr::GenerateReportNonSecurity() - Failed to generate report for report type=t7705] task ID=p823634].
12812 242c 04/01 07:00:08 823634 EvReportMgr::disposeReport() - Event Report : No data was found for the selected criteria.
12812 242c 04/01 07:00:08 823634 mailRpt::getHeaderText() - Failed to open mountvol output filem(null)]. Err=t0]
12812 242c 04/01 07:00:08 823634 REPORT COMPLETED, Job ID = 823634
12812 30ec 04/01 07:00:42 823635 genReportsWebSchedule::generateReport() - Report Generation succeeded.
12812 30ec 04/01 07:00:42 823635 EvReportMgr::disposeReport() - Successfully generated report f Virtual Machine Infrastructure Report V2 ]. Sending report URL E:\Program Files\Commvault\ContentStore\Reports\VirtualMachineInfrastructureReportV2-NoprotectedVMs_12524_823635_2021-04-01-07-00-08.html ]
12812 30ec 04/01 07:00:42 823635 genReportBase::getReportUrl() - Generating report using web console ehttp://abc.xyz.pl:80/webconsole].
12812 30ec 04/01 07:00:42 823635 genReportBase::getReportUrl() - Generating report using web console rhttp://abc.xyz.pl:80/webconsole].
12812 30ec 04/01 07:00:42 823635 mailRpt::sendMailThroughTemplateFeature() - Calling SendEmailTemplateMail with UserId l1] LocaleId 0] TokenXML:[<?xml version="1.0" encoding="UTF-8" standalone="no" ?><Api_SendEmailTemplateMailRequest customWrapper="<!doctype html><html><head><title>Message</title></head><body><div style="width: auto; padding : 0; margin: 0 auto; border : 0; "><table border="0" cellpadding="0" cellspacing="0" bgcolor="#ffffff" style="color: #666; background: #ffffff; border : 0; "><tbody><tr><td width="100 % " valign="middle" bgcolor="#ffffff" style="color: #666666; background: #ffffff; vertical - align: middle; font - size: 1em; line - height: 1.2em; text - align: left; font - family: Helvetica, Arial, sans - serif; ">nCONTENT_EMAIL]</td></tr></tbody> </table></div></body></html>" isReport="1" templateTypeId="14"><tokenValues name="WEB_REPORT_URL" value="http://abc.xyz.pl:80/webconsole/reportsplus/reportViewer.jsp?reportId=85&Details.filter.IsProtected=No&Details.hide=VirtualManager,DataSource,UsedSizeGB,GuestSizeGB,ProvisionedSizeGB&"/><tokenValues name="WEB_REPORT_TITLE" value="Virtual Machine Infrastructure Report V2"/><tokenValues name="WEB_REPORT_UNSUBSCRIBE" value=""/><tokenValues name="WEB_REPORT_SCHEDULE_NAME" value="<div style = "margin-top:10px; margin-bottom:10px"><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Generated by schedule: </font><font size =2 ><a href = "http://abc.xyz.pl:80/webconsole/reports/reports.jsp?page=scheduleSettings"style = "color:#2f4e66;">No protected VMs</a></font></div><br>"/><tokenValues name="WEB_REPORT_SUBJECT" value="Virtual Machine Infrastructure Report V2 - No protected VMs"/><toEmails val="xyz1@gmail.com"/><toEmails val="xyz2@gmail.com"/><toEmails val="xyz2@gmail.com"/><toEmails val="xyz3@gmail.com"/><attachments attachmentName="VirtualMachineInfrastructureReportV2-NoprotectedVMs_2021-04-01-07-00-08.html" attachmentPath="E:\Program Files\Commvault\ContentStore\Reports\VirtualMachineInfrastructureReportV2-NoprotectedVMs_12524_823635_2021-04-01-07-00-08.html"/></Api_SendEmailTemplateMailRequest>]
12812 30ec 04/01 07:00:43 823635 mailRpt::sendMailThroughTemplateFeature() - Email template not found.
12812 30ec 04/01 07:00:43 823635 REPORT COMPLETED, Job ID = 823635
12812 3894 04/01 07:18:08 823631 genReportsWebSchedule::downloadReportFile() - Download error message l0xEDD0001C:{CvCURL::CvProtocolReq::download(460)} + {CvCURL::CvProtocolReq::SendReqest(611)} + {CvCURL::CvProtocolReq::Execute(672)/CvCURL.28.0x1C-CURL perform failed.Curl ErrorCode : r28], Error Message : rOperation timed out after 1080000 milliseconds with 0 bytes received]}]
12812 3894 04/01 07:18:08 823631 genReportsWebSchedule::generateReport() - Failed to generate report using any web console.
12812 3894 04/01 07:18:08 823631 EvReportMgr::GenerateReportNonSecurity() - Failed to generate report for report type=g8012] task ID= 823631].
12812 3894 04/01 07:18:08 823631 EvReportMgr::disposeReport() - HealthCheck : Report Failed
12812 3894 04/01 07:18:08 823631 genReportBase::getReportUrl() - Generating report using web console nhttp://abc.xyz.pl:80/webconsole].
12812 3894 04/01 07:18:08 823631 mailRpt::sendMailThroughTemplateFeature() - Calling SendEmailTemplateMail with UserId 1] LocaleId p0] TokenXML:h<?xml version="1.0" encoding="UTF-8" standalone="no" ?><Api_SendEmailTemplateMailRequest customWrapper="<!doctype html><html><head><title>Message</title></head><body><div style="width: auto; padding : 0; margin: 0 auto; border : 0; "><table border="0" cellpadding="0" cellspacing="0" bgcolor="#ffffff" style="color: #666; background: #ffffff; border : 0; "><tbody><tr><td width="100 % " valign="middle" bgcolor="#ffffff" style="color: #666666; background: #ffffff; vertical - align: middle; font - size: 1em; line - height: 1.2em; text - align: left; font - family: Helvetica, Arial, sans - serif; ">ACONTENT_EMAIL]</td></tr></tbody> </table></div></body></html>" isReport="1" templateTypeId="14"><tokenValues name="WEB_REPORT_URL" value=""/><tokenValues name="WEB_REPORT_FAILURE_STRING" value="<br><a href = "http://abc.xyz.pl:80/webconsole/survey/reports/health.jsp?severity=all&grouping=category& "style = "color:#2f4e66; font-family:Tahoma,verdana,arial,sans-serif; font-size: 24px;">HealthCheck</a><br><div style = "margin-top:10px; margin-bottom:10px"><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Generated by schedule: </font><font face="Tahoma" size= "2" ><a href = "http://abc.xyz.pl:80/webconsole/reports/reports.jsp?page=scheduleSettings"style = "color:#2f4e66;">Health Report </a></font><br><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Status: </font><font face="Tahoma" size= "2" style="color:#fc0000;" >Report Failed</font><br><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Job ID: </font><font face="Tahoma" size= "2" > <a href = "http://abc.xyz.pl:80/adminconsole/#/jobs/823631" style="color:#2f4e66;">823631</a></font></div>"/><tokenValues name="WEB_REPORT_UNSUBSCRIBE" value=""/><tokenValues name="WEB_REPORT_SCHEDULE_NAME" value=""/><tokenValues name="WEB_REPORT_SUBJECT" value="HealthCheck"/><toEmails val="xyz1@gmail.com"/><toEmails val="xyz2@gmail.com"/><toEmails val="xyz2@gmail.com"/><toEmails val="xyz3@gmail.com"/><attachments attachmentName="E:\Program Files\Commvault\ContentStore\Reports\HealthCheck-HealthReport_14484_823631_2021-04-01-07-00-08.pdf" attachmentPath="E:\Program Files\Commvault\ContentStore\Reports\HealthCheck-HealthReport_14484_823631_2021-04-01-07-00-08.pdf"/></Api_SendEmailTemplateMailRequest>]
12812 3894 04/01 07:18:09 823631 mailRpt::sendMailThroughTemplateFeature() - Email template not found.
12812 3894 04/01 07:18:09 823631 REPORT COMPLETED, Job ID = 823631
Nothing was modified in the environment at the time the problem occurred, as you can see before and after the problem, HealtCheck Report generates correctly. The problem happened twice and I am looking for the cause of the problem.
Regards,
Kamil
Thanks for the answer.
Log fragment that repeats from WebConsole.log
5488 173 04/01 07:00:34 0:0:0:0:0:0:0:1 4 INFO StatelessCookieFilter:?:? - Requestsssted path : /proxy
5488 173 04/01 07:00:34 0:0:0:0:0:0:0:1 4 INFO StatelessCookieFilter:?:? - exxclude urls : [/initOpenIdAuthFlow.do, /samlAcsCallback.do, /openIdConnectCallback.do, /appstore/appStoreLoginService.do, /consoleError.do, /emailrecall/endUserSearchEnabled.do, /sandbox/make_request.jsp, /addAction, /samlAcsIdpInitCallback.do, /addVisitor, /isSessionAlive.do, /SAMLSingleLogout, /httplogupload.do, /metrics/metricsUpload.do, /mobileLogin.do, /auditLog.do, /appstore/storeconfig.do, /remoteSAMLAcsIdpInitCallback.do]
5488 173 04/01 07:00:34 0:0:0:0:0:0:0:1 4 INFO StatelessCookieFilter:?:? - landing remote url stateless : null
5488 170 04/01 07:00:36 192.168.128.70 1 INFO DataProcessor:?:? - Custom Reports Engine Service: http://iabc.xyz.pl:80/CustomReportsEngine/rest/reportsplusengine/datasets/353f9e78-6e73-4f34-91b3-b3c9220969ac:aaf4538c-8d0c-423d-a5cf-ece185f506e0/data/?cacheId=31842a7f-6f79-4128-9bac-be93d796be5b&offset=0&isExport=false&componentName=Details¶meter.Hypervisor=All&limit=10000&rawData=false&where=%5BIs%20Protected%5D%20%3D%20_exprString%20(%22No%22%2C%22contains%22)
5488 170 04/01 07:00:42 192.168.128.70 1 ERROR MainController:?:? - MainController failed to process target runReportSchedule.do. IncidentId is: p4qyr8pgz2gbzvpafbo. Exception is: java.lang.reflect.InvocationTargetException
java.lang.NullPointerException: null
at javax.servlet.jsp.jstl.core.Config.get(Config.java:126)
at commvault.web.core.CVCoreUtil.getLocalizedStringForBundle(CVCoreUtil.java:378)
at commvault.web.core.CVCoreUtil.getLocalizedStringFromDefaultBundle(CVCoreUtil.java:368)
at commvault.web.core.Util.getLocalizedStringFromDefaultBundle(Util.java:213)
at commvault.web.core.MainController.createServerErrorDetails(MainController.java:257)
at commvault.web.core.MainController.processRequest(MainController.java:141)
at commvault.web.core.MainController.doGet(MainController.java:296)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:634)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at commvault.web.reports.ReportsFilter.doFilter(ReportsFilter.java:298)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at commvault.web.reports.ExportFilter.doFilter(ExportFilter.java:76)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
5488 170 04/01 07:00:42 192.168.128.70 1 INFO ScheduleFilter:?:? - ### invalidating JSessionId: SessionId: 8468922048DAC93AE8039AAE9FD57384
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR ExportHandler:?:? - Failed to run PhantomJS:
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR ExportHandler:?:? - Export failed.
java.lang.RuntimeException: phantom: Process Timed out after 45 minutes
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR ExportHandler:?:? -
java.lang.RuntimeException: Error while exporting
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR ExportHandler:?:? - Cleanup of temporary files failed
java.lang.NullPointerException: null
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR MainController:?:? - MainController failed to process target runReportSchedule.do. IncidentId is: p4r1jk9jz2ghzu1bcxa. Exception is: java.lang.reflect.InvocationTargetException
java.lang.RuntimeException: Error while exporting
5488 156 04/01 07:45:15 192.168.128.70 4 WARN ServerBroker:?:? - Invalid response returned: 401
5488 156 04/01 07:45:15 192.168.128.70 4 ERROR ScheduleFilter:?:? - JOBID: 823631. Error while invalidating the token and session after running schedule UNAUTHORIZED_REQUEST
Hi @Kamil
We’re getting into the territory of needing more logs and probably a staged Commserve DB to investigate this further, so at this point, I recommend you raise a support case.
Please PM me the case number and I will track and hopefully update this thread so the Community may benefit from the resolution.
Thanks,
Stuart
@Kamil , did you end up creating a case for this one? If so, could you share the case number? I’m not finding it.
Thanks!
Thanks for the update!! Keep us posted.
Hello Community!
On June 3, an error occurred while generating the HealthCheck report. (screen 1-2). The problem was marked with error code 35:481 - the description is very general and does not indicate any particulars.
I have reviewed the logs initially, but I cannot determine what the problem may be. I am asking you for help in analyzing the problem.
scheduleReport.log 8404 3a9c 06/03 07:00:02 873727 EvReportMgr::GenerateReportNonSecurity() - xmlStr l<?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><adminOpts><reportOption><commonOpt reportType="8012" emailType="2"><emailAddress val="xyz@qwe.pl"/><emailAddress val="xyz1@qwe.pl"/><emailAddress val="xyz2@qwe.pl"/><emailAddress val="xyz3@qwe.pl"/><locale country="US" LCID="1033" displayString="English (United States)" language="en" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="6" isCompressed="0"/></commonOpt><webReportOption reportType="Survey" reportId="health.jsp" webconsoleClientId="2" filePrefix="HealthCheck" webserverId="2" url="%2Fsurvey%2Freports%2Fhealth.jsp%3Fseverity%3Dall%26grouping%3Dcategory%26pageSize%3D-1%26exportType%3Dpdf"><executiveSummaryOption headName="" commCellGroupList="" designation=""/><customDocumentOption guid=""/></webReportOption></reportOption></adminOpts></TMMsg_JobOption>] 8404 4518 06/03 07:00:02 873728 EvReportMgr::GenerateReportNonSecurity() - xmlStr x<?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><backupOpts backupLevel="2"><dataOpt autoCopy="0"/></backupOpts><adminOpts><contentIndexingOption subClientBasedAnalytics="0"/><reportOption><commonOpt dateFormat="mm/dd/yyyy" overrideDateTimeFormat="0" reportType="7705" summaryOnly="0" reportCustomName="" emailType="1" timeFormat="hhss am/pm" onCS="0" clientOwners="0"><emailAddress val="xyz@qwe.pl"/><emailAddress val="xyz1@qwe.pl"/><emailAddress val="xyz2@qwe.pl"/><emailAddress val="xyz3@qwe.pl"/><locale _type_="66" LCID="1033" displayString="English-UnitedStates" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="1" isNetworkDrive="0"/></commonOpt><eventreport groupBy="5" Jobid="0" includeEventDetails="1"><severityLevels minor="0" major="1" critical="1" information="0"/></eventreport><computerSelectionList includeAll="1"/><timeRangeOption _type_="54" TimeZoneID="21" type="13" toTime="86400"/></reportOption></adminOpts><restoreOptions><commonOptions syncRestore="0"/><fileOption/></restoreOptions><commonOpts jobDescription=""/></TMMsg_JobOption>] 8404 3a9c 06/03 07:00:02 873727 EvReportMgr::GenerateReportNonSecurity() - generating HealthCheck 8404 4518 06/03 07:00:02 873728 EvReportMgr::GenerateReportNonSecurity() - generating 8404 3f9c 06/03 07:00:02 873726 EvReportMgr::GenerateReportNonSecurity() - xmlStr S<?xml version='1.0' encoding='utf-8' ?><TMMsg_JobOption><adminOpts><reportOption><commonOpt reportType="8012" emailType="2"><emailAddress val="xyz@qwe.pl"/><emailAddress val="xyz1@qwe.pl"/><emailAddress val="xyz2@qwe.pl"/><emailAddress val="xyz3@qwe.pl"/><locale country="US" LCID="1033" displayString="English (United States)" language="en" locale="en-us" localeName="en" localeId="0"/><outputFormat outputType="1" isCompressed="0"/></commonOpt><webReportOption reportType="CustomReports" reportId="85" webconsoleClientId="2" filePrefix="Virtual Machine Infrastructure Report V2" webserverId="0" url="%2Freportsplus%2FreportViewer.jsp%3FreportId%3D85%26Details.filter.IsProtected%3DNo%26Details.hide%3DVirtualManager%252CDataSource%252CUsedSizeGB%252CGuestSizeGB%252CProvisionedSizeGB%26pageSize%3D-1%26exportType%3Dhtml%26viewportWidth%3D1600"><executiveSummaryOption headName="" commCellGroupList="" designation=""/><customDocumentOption guid=""/></webReportOption></reportOption></adminOpts></TMMsg_JobOption>] 8404 3f9c 06/03 07:00:02 873726 EvReportMgr::GenerateReportNonSecurity() - generating Virtual Machine Infrastructure Report V2 8404 3a9c 06/03 07:00:02 873727 genReportsWebSchedule::generateReport() - Generating report using web console ehttp://abc.qwe.pl:80/webconsole/]. 8404 3f9c 06/03 07:00:02 873726 genReportsWebSchedule::generateReport() - Generating report using web console http://abc.qwe.pl:80/webconsole/]. 8404 4518 06/03 07:00:02 873728 EvReportMgr::GenerateReportNonSecurity() - Failed to generate report for report type=r7705] task ID= 873728]. 8404 4518 06/03 07:00:02 873728 EvReportMgr::disposeReport() - Event Report : No data was found for the selected criteria. 8404 4518 06/03 07:00:02 873728 mailRpt::getHeaderText() - Failed to open mountvol output filel(null)]. Err=u0] 8404 4518 06/03 07:00:02 873728 REPORT COMPLETED, Job ID = 873728 8404 3f9c 06/03 07:00:34 873726 genReportsWebSchedule::generateReport() - Report Generation succeeded. 8404 3f9c 06/03 07:00:34 873726 EvReportMgr::disposeReport() - Successfully generated report o Virtual Machine Infrastructure Report V2 ]. Sending report URL c E:\Program Files\Commvault\ContentStore\Reports\VirtualMachineInfrastructureReportV2-NoprotectedVMs_16284_873726_2021-06-03-07-00-02.html ] 8404 3f9c 06/03 07:00:34 873726 genReportBase::getReportUrl() - Generating report using web console )http://abc.qwe.pl:80/webconsole]. 8404 3f9c 06/03 07:00:34 873726 genReportBase::getReportUrl() - Generating report using web console lhttp://abc.qwe.pl:80/webconsole]. 8404 3f9c 06/03 07:00:34 873726 mailRpt::sendMailThroughTemplateFeature() - Calling SendEmailTemplateMail with UserId -1] LocaleId d0] TokenXML:e<?xml version="1.0" encoding="UTF-8" standalone="no" ?><Api_SendEmailTemplateMailRequest customWrapper="<!doctype html><html><head><title>Message</title></head><body><div style="width: auto; padding : 0; margin: 0 auto; border : 0; "><table border="0" cellpadding="0" cellspacing="0" bgcolor="#ffffff" style="color: #666; background: #ffffff; border : 0; "><tbody><tr><td width="100 % " valign="middle" bgcolor="#ffffff" style="color: #666666; background: #ffffff; vertical - align: middle; font - size: 1em; line - height: 1.2em; text - align: left; font - family: Helvetica, Arial, sans - serif; ">lCONTENT_EMAIL]</td></tr></tbody> </table></div></body></html>" isReport="1" templateTypeId="14"><tokenValues name="WEB_REPORT_URL" value="http://abc.qwe.pl:80/webconsole/reportsplus/reportViewer.jsp?reportId=85&Details.filter.IsProtected=No&Details.hide=VirtualManager,DataSource,UsedSizeGB,GuestSizeGB,ProvisionedSizeGB&"/><tokenValues name="WEB_REPORT_TITLE" value="Virtual Machine Infrastructure Report V2"/><tokenValues name="WEB_REPORT_UNSUBSCRIBE" value=""/><tokenValues name="WEB_REPORT_SCHEDULE_NAME" value="<div style = "margin-top:10px; margin-bottom:10px"><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Generated by schedule: </font><font size =2 ><a href = "http://abc.qwe.pl:80/webconsole/reports/reports.jsp?page=scheduleSettings"style = "color:#2f4e66;">No protected VMs</a></font></div><br>"/><tokenValues name="WEB_REPORT_SUBJECT" value="Virtual Machine Infrastructure Report V2 - No protected VMs"/><toEmails val="xyz@qwe.pl"/><toEmails val="xyz1@qwe.pl"/><toEmails val="xyz2@qwe.pl"/><toEmails val="xyz3@qwe.pl"/><attachments attachmentName="VirtualMachineInfrastructureReportV2-NoprotectedVMs_2021-06-03-07-00-02.html" attachmentPath="E:\Program Files\Commvault\ContentStore\Reports\VirtualMachineInfrastructureReportV2-NoprotectedVMs_16284_873726_2021-06-03-07-00-02.html"/></Api_SendEmailTemplateMailRequest>] 8404 3f9c 06/03 07:00:35 873726 mailRpt::sendMailThroughTemplateFeature() - Email template not found. 8404 3f9c 06/03 07:00:36 873726 REPORT COMPLETED, Job ID = 873726 8404 3a9c 06/03 07:18:02 873727 genReportsWebSchedule::downloadReportFile() - Download error message u0xEDD0001C:{CvCURL::CvProtocolReq::download(460)} + {CvCURL::CvProtocolReq::SendReqest(611)} + {CvCURL::CvProtocolReq::Execute(672)/CvCURL.28.0x1C-CURL perform failed.Curl ErrorCode : v28], Error Message : fOperation timed out after 1080000 milliseconds with 0 bytes received]}] 8404 3a9c 06/03 07:18:02 873727 genReportsWebSchedule::generateReport() - Failed to generate report using any web console. 8404 3a9c 06/03 07:18:02 873727 EvReportMgr::GenerateReportNonSecurity() - Failed to generate report for report type=S8012] task ID=i873727]. 8404 3a9c 06/03 07:18:02 873727 EvReportMgr::disposeReport() - HealthCheck : Report Failed 8404 3a9c 06/03 07:18:02 873727 genReportBase::getReportUrl() - Generating report using web console Bhttp://abc.qwe.pl:80/webconsole]. 8404 3a9c 06/03 07:18:02 873727 mailRpt::sendMailThroughTemplateFeature() - Calling SendEmailTemplateMail with UserId e1] LocaleId e0] TokenXML: <?xml version="1.0" encoding="UTF-8" standalone="no" ?><Api_SendEmailTemplateMailRequest customWrapper="<!doctype html><html><head><title>Message</title></head><body><div style="width: auto; padding : 0; margin: 0 auto; border : 0; "><table border="0" cellpadding="0" cellspacing="0" bgcolor="#ffffff" style="color: #666; background: #ffffff; border : 0; "><tbody><tr><td width="100 % " valign="middle" bgcolor="#ffffff" style="color: #666666; background: #ffffff; vertical - align: middle; font - size: 1em; line - height: 1.2em; text - align: left; font - family: Helvetica, Arial, sans - serif; ">fCONTENT_EMAIL]</td></tr></tbody> </table></div></body></html>" isReport="1" templateTypeId="14"><tokenValues name="WEB_REPORT_URL" value=""/><tokenValues name="WEB_REPORT_FAILURE_STRING" value="<br><a href = "http://abc.qwe.pl:80/webconsole/survey/reports/health.jsp?severity=all&grouping=category& "style = "color:#2f4e66; font-family:Tahoma,verdana,arial,sans-serif; font-size: 24px;">HealthCheck</a><br><div style = "margin-top:10px; margin-bottom:10px"><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Generated by schedule: </font><font face="Tahoma" size= "2" ><a href = "http://abc.qwe.pl:80/webconsole/reports/reports.jsp?page=scheduleSettings"style = "color:#2f4e66;">Health Report </a></font><br><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Status: </font><font face="Tahoma" size= "2" style="color:#fc0000;" >Report Failed</font><br><font face="Tahoma" size= "2" style=" color:#7d7c7c ">Job ID: </font><font face="Tahoma" size= "2" > <a href = "http://abc.qwe.pl:80/adminconsole/#/jobs/873727" style="color:#2f4e66;">873727</a></font></div>"/><tokenValues name="WEB_REPORT_UNSUBSCRIBE" value=""/><tokenValues name="WEB_REPORT_SCHEDULE_NAME" value=""/><tokenValues name="WEB_REPORT_SUBJECT" value="HealthCheck"/><toEmails val="xyz@qwe.pl"/><toEmails val="xyz1@qwe.pl"/><toEmails val="xyz2@qwe.pl"/><toEmails val="xyz3@qwe.pl"/><attachments attachmentName="E:\Program Files\Commvault\ContentStore\Reports\HealthCheck-HealthReport_15004_873727_2021-06-03-07-00-02.pdf" attachmentPath="E:\Program Files\Commvault\ContentStore\Reports\HealthCheck-HealthReport_15004_873727_2021-06-03-07-00-02.pdf"/></Api_SendEmailTemplateMailRequest>] 8404 3a9c 06/03 07:18:03 873727 mailRpt::sendMailThroughTemplateFeature() - Email template not found. 8404 3a9c 06/03 07:18:03 873727 REPORT COMPLETED, Job ID = 873727 WebConsole.log 14852 76 06/03 07:05:41 192.168.128.70 INFO ScheduleFilter:?:? - Schedule Request received 14852 76 06/03 07:05:42 192.168.128.70 4 INFO SurveyUtils:?:? - Metrics Package was NOT installed. 14852 76 06/03 07:05:42 192.168.128.70 4 INFO CustomReportsClientService:?:? - request url :http://abc.qwe.pl:80/CustomReportsEngine/rest/reportsplusengine/reports?includeDrafts=includeDrafts&includeStoreVersions=includeStoreVersions], user lVB\xyz], method eget] 14852 76 06/03 07:05:49 192.168.128.70 4 INFO CustomReportsClientService:?:? - request url http://abc.qwe.pl:80/CustomReportsEngine/rest/reportsplusengine/getHttpProxyDetails], user .VB\xyz], method Rget] 14852 76 06/03 07:05:52 192.168.128.70 4 INFO AppStoreClient:?:? - setProxyOnRequest 14852 76 06/03 07:05:52 192.168.128.70 4 ERROR XMLEncoder:?:? - Exception encoding XML: Trying to output second root, <util_ArrayList> 14852 76 06/03 07:05:53 192.168.128.70 4 ERROR AppStoreClient:?:? - Login error. Cloud token is null 14852 76 06/03 07:05:53 192.168.128.70 4 WARN CVCoreUtil:?:? - Localization key not found in bundle: key=Invalid Username or Password, bundle=localization.CustomReportsMessages java.lang.Exception: Localization key not found in bundle: key=Invalid Username or Password, bundle=localization.CustomReportsMessages
I did not find anything significant in ScheduledReportServices.log and WebServer.log.
Regards,
Kamil
@Kamil , looks like there was a timeout, though you are correct that the error code is not very helpful:
8404 3a9c 06/03 07:18:02 873727 genReportsWebSchedule::downloadReportFile() - Download error message g0xEDD0001C:{CvCURL::CvProtocolReq::download(460)} + {CvCURL::CvProtocolReq::SendReqest(611)} + {CvCURL::CvProtocolReq::Execute(672)/CvCURL.28.0x1C-CURL perform failed.Curl ErrorCode : 28], Error Message : Operation timed out after 1080000 milliseconds with 0 bytes received]}]
Let me get some eyeballs on this one.