Summary
Following a deployment from Tech M/OSS updating the grabber config to include metaswitch config , the grabbers are now not fully working. The first step where files are grabbed and posted to SonusServer4 is working , but none of these files are then re-picked and processed. Grabbers have not been functioning at all since 11:00hrs on 14/09/2020 and has produced a backlog.
Â
N/A
Latest Update Investigations into the root cause are on going. We have idenfitied a change that was completed yesterday at the time the issue was reported (CRQ64505) and are in the process of reverting one of the 10 components (SONUS CDR grabber) to see if this restores service. Â
Latest Update Service has been restored following a rollback of one of the components (SONUS CDR Grabber) deployed under CRQ64505. Due to the back log it has been requested we pend the incident until tomorrow morning so we can ensure there have been no issues caused by the delays in processing the CDR records. Â
Latest Update The back log has been steadily processing and has reduced from est 4m records down to est 800k. We expect the back log to have cleared by the end of the work day. Â
Latest Update The back log of CDR is steadily processing. It is taking longer than originally thought and a revised ETA of 17:00 on the 17/09 has been provided. We will defer the incident and stand down once the back log has cleared. Â
Due 4¾ years ago (overdue)