Forum Home
PC World Chat
 
Thread ID: 106882 2010-01-26 23:03:00 XT down again wratterus (105) PC World Chat
Post ID Timestamp Content User
852313 2010-01-27 20:51:00 It's part of the new symbol's settling-in period.
Telecom users should just be glad about it all.
R2x1 (4628)
852314 2010-01-27 21:49:00 As much as I hate Telecom, it makes me laugh how people expect 100% up time with technology especially with something like a new cellular network. The media do love to sensationalise and stir emotions lol. Battleneter2 (9361)
852315 2010-01-27 22:16:00 XT= Xtremley Tenuous KarameaDave (15222)
852316 2010-01-27 23:05:00 Phone doesn't work? Go outside and enjoy the clouds or something, since you can't do anything about it anyway. Agent_24 (57)
852317 2010-01-28 04:07:00 They should be honest and come out and say what caused it and what caused the last big one.

Was it a staff error, an equipment / hardware failure, a design fault ? cost savings measures ?

Agreed - no technology can be up 100% of them time.

I'm with 2 degrees, but because I've just moved out into the country 2 degrees and vodabrislen don't get coverage (rather they don't give coverage) so I may be forced to get an XT phone ! (aaaah)
Digby (677)
852318 2010-01-28 04:22:00 As much as I hate Telecom, it makes me laugh how people expect 100% up time with technology especially with something like a new cellular network. The media do love to sensationalise and stir emotions lol.
I have been with Vodafone and before that Bell South for about 12 or 13 years and I don't ever remember the network being down.
mikebartnz (21)
852319 2010-01-28 05:09:00 Thank God I've got more than one cell phone on more than one network. Twelvevolts (5457)
852320 2010-01-28 22:34:00 Telecom promises no stone will be left unturned in a review of its failing XT network...
NZ Herald

Given the reputed cranial filler on the Telecom board, does this mean heads will roll?
R2x1 (4628)
852321 2010-01-28 22:59:00 Can Chill et al translate this for the rest of us?


Latest XT Mobile Network Situation Update



This is a further email to update you on the restoration of services for XT mobile users between Taupo and the bottom of the South Island in the last two days, and an update on the actions we are taking .



I am conscious that to date we have been giving you updates on the status of the outage, and I now want to start explaining the issues and to set out some of our commitments going forward .



To give an overview, we have a total of 986 cell sites nationwide, of which 453 are linked to our Christchurch XT Mobile RNC switch .



Since 10 . 30am yesterday (27 January), at times up to 54 cell sites have been out of service, and XT users will not have had access to voice, SMS or mobile broadband services . At the time of writing this update (approx 11 . 30pm, 28 January) we had successfully reduced the number of sites out of service to 38 and further work continues through the night which we will update in the morning .



The full list of impacted cell sites is included below . They are a small set of cell sites in the area from Taupo south, the majority in the lower South Island, including Dunedin, Invercargill, Timaru and Queenstown, as well as some parts of Wellington central, Taranaki and Ruapehu .



While the remaining 94% of our cell sites nationally have not been affected, traffic loading on the network may mean that a percentage of calls in the Taupo south area may not get through .



Our average statistics for call accessibility in the southern region and retention in the area have been above 90% in the last while .



Our absolute focus right now remains on restoring service in all these locations, and ensuring that restoration is sustained and that we deliver a stable and world class XT network as we know we can .



The intense level of focus and monitoring from the last few days will continue . We will continue our optimisation of XT to ensure the coverage, speed and capability is world class .



The root cause is now under extensive investigation, but is suspected to be within the physical and logical paths in the transport layer between the cell site and the Christchurch switch . This is a different issue to the one that caused a disruption of services in December . The technical teams are working through a range of possible causes for the failure .



The remedial action over the last two days has included:



- Rewrite of the MIB which requires an RNC reset to install .

- A reset of the UTRAN router to clear a path .

- Reset an interface .

- Lockout of the base stations connected to suspect links .

- Managing the registration “storms” resulting from mobile re-starts from these base stations .



Further work that will occur overnight includes analysis of traces on the suspect links to clear them so base stations can be unlocked and returned to service .



We cannot currently accurately forecast a time of full and final restore .



I wanted to comment on the questions I have received about the redundancy of the network and issues like the number of “RNC’s” .



Design of resiliency and redundancy of a mobile network is not only to do with RNC’s . In fact within the UTRAN there are several factors including the number of RNC’s, routers, TMU’s, links as well as the number of users and type of devices in use .



We have always expected we would increase the capacity of the XT network as we add more clients on the XT network, and we have seen a large number of clients move to XT in a relatively short space of time . However, more RNCs alone do not deliver greater redundancy – each RNC is equipped with its own hardware redundancy but more RNC’s will increase resiliency as we spread the load and that’s our plan .



The Telecom Tier 2 and 3 teams are currently heavily engaged with Alcatel-Lucent, including “24/7” support capability from China, Singapore, Germany, Netherlands, USA, Canada, and France . In addition, Alcatel-Lucent management at the highest level from around the world are engaged on this issue locally and in France, including the CEO of Alcatel-Lucent .



Our Gen-i client teams are continuing to work directly with affected clients today to support their business needs . Our immediate focus is on service restoration and we will look closely at claims for compensation once the service is restored .



We will also continue the open and honest communication on the event and our actions as we go forward . Tomorrow (Friday 29th January) at 12 . 30pm I will be leading a webcast for all our clients, and invitations to join me will be sent to you in the morning . I hope to see you there, and answer any questions you may have, and provide the latest update personally .



I am continuing to work with my Telecom Exec colleagues and our clients to resolve the issues and deliver the actions going forward . Once again, we apologise and deeply regret any inconvenience or problems you are experiencing due to the interruption of the XT service .



Alongside a design review by the R & D teams, Paul Reynolds has commissioned an urgent and independent review to ensure we have taken all steps to assure our XT client experience . Any feedback you have provided to me this week will be collated and added to that review .



In addition, we will be seeking your input to understand what further requirements will best meet your needs on the XT network . We will openly share the recommendations of the review with you .



Finally, I have been keen to communicate to all our clients and all New Zealanders on this issue, including those that are not using the XT mobile service . While the impact is not direct for other network users, a key part of why we update executive level clients whenever we have issues like this is to ensure that people trying to contact affected XT clients are aware of the issue . And it’s important to us that this issue is communicated directly by us .



We will continue to equip our client teams with information on the event and future actions . If you want to discuss this further with me, or any of the Gen-i team, please let us know .



Chris Quin

CEO Gen-i Australasia



Affected Sites



Site name
Location

St Clair
Dunedin City

Clinton
Clutha

Clyde Cell Site
Central Otago

Brighton
Dunedin City

New hospital
Invercargill

Carisbrook
Dunedin City

Invercargill State Ins .
Invercargill

Corstophine Radio
Dunedin City

Peninsula Hill
Queenstown

Gleniti
Timaru

Glencoe
Queenstown

Winton
Southland

Grantlea
Timaru

Mt Alford
Ashburton

Waikiwi
Invercargill

Surrey
Invercargill

Ardlui
Dunedin City

Cantec
Timaru

Signal Hill
Dunedin City

Oamaru
Waitaki

Dunedin Oval
Dunedin City

Mosgiel
Dunedin City

Majestic Tower
Wellington

Tennyson street
Dunedin City

Waldronville
Dunedin City

Mt Horrible
Timaru

Camp street
Queenstown

Swampy summit
Dunedin City

Timaru South
Timaru

Lake Hawea
Otago

Halfway Bush
Otago

Te Anau
Southland

Luggate
Otago

Otago Polytech
Otago

Waimate
Canterbury

Brothers Peak
Otago

Millers Flat
Otago

Waitati
Dunedin
nofam (9009)
852322 2010-01-28 23:01:00 Yup still down here in Timaz xyz823 (13649)
1 2 3 4