Rogers Outage Canada

Mon Jul 11 23:38:40 UTC 2022

Looks like new agreements might be put in place to prevent this from
happening again in the future.

https://www.ctvnews.ca/business/champagne-directs-major-telecoms-to-come-up-with-agreement-on-future-outages-1.5981800

-Josh
On Mon, Jul 11, 2022 at 7:35 PM Andrew Paolucci via NANOG <nanog at nanog.org>
wrote:

>
> Class action lawsuit has been filled in Quebec as well.
>
> https://lpclex.com/rogers/
>
>
> ------- Original Message -------
>
> On Monday, July 11th, 2022 at 3:45 PM, L F <liz.fazekas at gmail.com> wrote:
>
> 341,296 have signed. Let’s get to 500,000!
> At 500,000 signatures, this petition becomes one of the top signed on
> Change.org!
>
> On Mon, Jul 11, 2022 at 3:44 PM L F <liz.fazekas at gmail.com> wrote:
>
>> FYI --- this is now making email rounds and is available to view and sign
>> on CHANGE.ORG
>>
>>
>>
>> On Friday, Rogers experienced its second nationwide outage in as many
>> years. Hundreds of thousands of Canadians were unable to access internet
>> and cell services for hours, despite paying some of the highest fees in the
>> world. Petition starter Celina is calling on the CRTC to protect Canadians
>> from exorbitant cell and internet fees and more than 275,000 frustrated
>> Canadians have joined her. You can show your support by signing the
>> petition now.
>>
>> <https://click.e.change.org/f/a/apTbTnAR7N3DW6NYQSfVMw~~/AANj1QA~/RgRkruHwP4StAWh0dHBzOi8vd3d3LmNoYW5nZS5vcmcvcC9jdXRjZWxsY29zdHMtY2FuYWRpYW5zLWFyZS1iZWluZy1zY2FtbWVkLXRlbGwtdGhlLWNydGMtd2UtZGVtYW5kLWxvd2VyLWNlbGwtcGhvbmUtc2VydmljZS1jcnRjZW5nL3NpZ24_Y3NfdGs9QWp0bEtmZjYtX3hBU215WDFXSUFBWGljeXl2TnlRRUFCRjhCdkdKalZUd09fUklzdEFXSnBOV19PMVklM0QmcHQ9QVZCbGRHbDBhVzl1QU5WTDJRQUFBQUFBWXN4YzdJRG5PWWRqWkRkaU9URm1OQSUyNTNEJTI1M0Qmc291cmNlX2xvY2F0aW9uPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fY2FtcGFpZ249NjJiOWYzZDM2MzA0NGVhMWJhYWNmYmFkZDM2MjFiOTgmdXRtX2NvbnRlbnQ9aW5pdGlhbF92MF8wXzImdXRtX21lZGl1bT1lbWFpbCZ1dG1fc291cmNlPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fdGVybT1jc1cDc3BjQgpiu_VczGKYxTR0UhBkbnBjb25AZ21haWwuY29tWAQAAAAC>
>> *Canadians Are Being SCAMMED - Tell the CRTC We Demand Better Cell Phone
>> Service!
>> <https://click.e.change.org/f/a/apTbTnAR7N3DW6NYQSfVMw~~/AANj1QA~/RgRkruHwP4StAWh0dHBzOi8vd3d3LmNoYW5nZS5vcmcvcC9jdXRjZWxsY29zdHMtY2FuYWRpYW5zLWFyZS1iZWluZy1zY2FtbWVkLXRlbGwtdGhlLWNydGMtd2UtZGVtYW5kLWxvd2VyLWNlbGwtcGhvbmUtc2VydmljZS1jcnRjZW5nL3NpZ24_Y3NfdGs9QWp0bEtmZjYtX3hBU215WDFXSUFBWGljeXl2TnlRRUFCRjhCdkdKalZUd09fUklzdEFXSnBOV19PMVklM0QmcHQ9QVZCbGRHbDBhVzl1QU5WTDJRQUFBQUFBWXN4YzdJRG5PWWRqWkRkaU9URm1OQSUyNTNEJTI1M0Qmc291cmNlX2xvY2F0aW9uPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fY2FtcGFpZ249NjJiOWYzZDM2MzA0NGVhMWJhYWNmYmFkZDM2MjFiOTgmdXRtX2NvbnRlbnQ9aW5pdGlhbF92MF8wXzImdXRtX21lZGl1bT1lbWFpbCZ1dG1fc291cmNlPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fdGVybT1jc1cDc3BjQgpiu_VczGKYxTR0UhBkbnBjb25AZ21haWwuY29tWAQAAAAC>*
>>
>> *276,541 have signed* Celina London’s petition. Let’s get to 300,000!
>> Sign now with a click
>> <https://click.e.change.org/f/a/p3sYjweM2cnYRV3CmS3wvA~~/AANj1QA~/RgRkruHwP4SxAWh0dHBzOi8vd3d3LmNoYW5nZS5vcmcvcC9jdXRjZWxsY29zdHMtY2FuYWRpYW5zLWFyZS1iZWluZy1zY2FtbWVkLXRlbGwtdGhlLWNydGMtd2UtZGVtYW5kLWxvd2VyLWNlbGwtcGhvbmUtc2VydmljZS1jcnRjZW5nL3NpZ24tbm93P2NzX3RrPUFqdGxLZmY2LV94QVNteVgxV0lBQVhpY3l5dk55UUVBQkY4QnZHSmpWVHdPX1JJc3RBV0pwTldfTzFZJTNEJnB0PUFWQmxkR2wwYVc5dUFOVkwyUUFBQUFBQVlzeGM3SURuT1lkalpEZGlPVEZtTkElMjUzRCUyNTNEJnNvdXJjZV9sb2NhdGlvbj1hYV9hdWdtZW50ZWRfc2lnbl9hc2smdXRtX2NhbXBhaWduPTYyYjlmM2QzNjMwNDRlYTFiYWFjZmJhZGQzNjIxYjk4JnV0bV9jb250ZW50PWluaXRpYWxfdjBfMF8yJnV0bV9tZWRpdW09ZW1haWwmdXRtX3NvdXJjZT1hYV9hdWdtZW50ZWRfc2lnbl9hc2smdXRtX3Rlcm09Y3NXA3NwY0IKYrv1XMximMU0dFIQZG5wY29uQGdtYWlsLmNvbVgEAAAAAg~~>
>>
>> CANADIANS ARE BEING SCAMMED!
>>
>> Here in Canada we pay extremely high prices for our cell phones and cable
>> in comparison to countries like Australia, United Kingdom and United States
>> of America.
>>
>> As of August 2019, a plan with 30GB data from Australia’s Vodafone
>> network is $45. In Canada, major providers like Rogers and Telus charge $95
>> for 20GB at max speed.
>>
>> This is unethical and not okay. It’s time we stand up for our hard-earned
>> dollars and demand limitations be put in place to stop the wallet gouging
>> of hard-working Canadians. We must force our telecommunications companies
>> to provide Canadians better service for the astronomically high price
>> they’re forced to pay for what is a necessity to function in our high-tech
>> society in 2019.
>>
>> Please act now and sign your name below to show the CRTC (Canadian
>> Radio-Television and Telecommunications Commission) that we’ve had ENOUGH
>> and demand a change to our current telecommunications laws and regulations
>> to implement a limit on price and an immediate increase in service provided
>> for both existing and new customers.
>>
>> Once you’ve signed please take the time to share with your friends and
>> family as this affects us all and together we can make a big difference and
>> be heard!
>>
>> Thank you!
>>
>> Celina London - concerned and annoyed Canadian.
>>
>> Sign now with a click
>> <https://click.e.change.org/f/a/p3sYjweM2cnYRV3CmS3wvA~~/AANj1QA~/RgRkruHwP4SxAWh0dHBzOi8vd3d3LmNoYW5nZS5vcmcvcC9jdXRjZWxsY29zdHMtY2FuYWRpYW5zLWFyZS1iZWluZy1zY2FtbWVkLXRlbGwtdGhlLWNydGMtd2UtZGVtYW5kLWxvd2VyLWNlbGwtcGhvbmUtc2VydmljZS1jcnRjZW5nL3NpZ24tbm93P2NzX3RrPUFqdGxLZmY2LV94QVNteVgxV0lBQVhpY3l5dk55UUVBQkY4QnZHSmpWVHdPX1JJc3RBV0pwTldfTzFZJTNEJnB0PUFWQmxkR2wwYVc5dUFOVkwyUUFBQUFBQVlzeGM3SURuT1lkalpEZGlPVEZtTkElMjUzRCUyNTNEJnNvdXJjZV9sb2NhdGlvbj1hYV9hdWdtZW50ZWRfc2lnbl9hc2smdXRtX2NhbXBhaWduPTYyYjlmM2QzNjMwNDRlYTFiYWFjZmJhZGQzNjIxYjk4JnV0bV9jb250ZW50PWluaXRpYWxfdjBfMF8yJnV0bV9tZWRpdW09ZW1haWwmdXRtX3NvdXJjZT1hYV9hdWdtZW50ZWRfc2lnbl9hc2smdXRtX3Rlcm09Y3NXA3NwY0IKYrv1XMximMU0dFIQZG5wY29uQGdtYWlsLmNvbVgEAAAAAg~~>
>>
>> Visit petition page
>> <https://click.e.change.org/f/a/apTbTnAR7N3DW6NYQSfVMw~~/AANj1QA~/RgRkruHwP4StAWh0dHBzOi8vd3d3LmNoYW5nZS5vcmcvcC9jdXRjZWxsY29zdHMtY2FuYWRpYW5zLWFyZS1iZWluZy1zY2FtbWVkLXRlbGwtdGhlLWNydGMtd2UtZGVtYW5kLWxvd2VyLWNlbGwtcGhvbmUtc2VydmljZS1jcnRjZW5nL3NpZ24_Y3NfdGs9QWp0bEtmZjYtX3hBU215WDFXSUFBWGljeXl2TnlRRUFCRjhCdkdKalZUd09fUklzdEFXSnBOV19PMVklM0QmcHQ9QVZCbGRHbDBhVzl1QU5WTDJRQUFBQUFBWXN4YzdJRG5PWWRqWkRkaU9URm1OQSUyNTNEJTI1M0Qmc291cmNlX2xvY2F0aW9uPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fY2FtcGFpZ249NjJiOWYzZDM2MzA0NGVhMWJhYWNmYmFkZDM2MjFiOTgmdXRtX2NvbnRlbnQ9aW5pdGlhbF92MF8wXzImdXRtX21lZGl1bT1lbWFpbCZ1dG1fc291cmNlPWFhX2F1Z21lbnRlZF9zaWduX2FzayZ1dG1fdGVybT1jc1cDc3BjQgpiu_VczGKYxTR0UhBkbnBjb25AZ21haWwuY29tWAQAAAAC>
>>
>> *At Change.org, we believe in the voice of everyday people.* Is there
>> something that you want to change?
>> *Start a petition today
>> <https://click.e.change.org/f/a/pbTbHw7ifps5zEHVN4Z5sQ~~/AANj1QA~/RgRkruHwP0TzaHR0cHM6Ly93d3cuY2hhbmdlLm9yZy9zdGFydC1hLXBldGl0aW9uP2NzX3RrPUFqdGxLZmY2LV94QVNteVgxV0lBQVhpY3l5dk55UUVBQkY4QnZHSmpWVHdPX1JJc3RBV0pwTldfTzFZJTNEJnV0bV9jYW1wYWlnbj02MmI5ZjNkMzYzMDQ0ZWExYmFhY2ZiYWRkMzYyMWI5OCZ1dG1fY29udGVudD1pbml0aWFsX3YwXzBfMiZ1dG1fbWVkaXVtPWVtYWlsJnV0bV9zb3VyY2U9YWFfYXVnbWVudGVkX3NpZ25fYXNrJnV0bV90ZXJtPWNzVwNzcGNCCmK79VzMYpjFNHRSEGRucGNvbkBnbWFpbC5jb21YBAAAAAI~>*
>>
>> The person (or organization) who started this petition is not affiliated
>> with Change.org. Change.org did not create this petition and is not
>> responsible for the petition content.
>>
>> On Mon, Jul 11, 2022 at 5:40 AM Jon Sands <fohdeesha at gmail.com> wrote:
>>
>>> Given the outage was so bad it was disrupting select E911 services
>>> nationwide for something like 24+ hours, it's great to see such an in depth
>>> analysis and plan of action to prevent such things in the future. bravo
>>> rogers
>>>
>>> On 7/10/2022 2:55 PM, L F wrote:
>>>
>>> fyi - see BOLD.
>>>
>>> A Message from Rogers President and CEO
>>>
>>>
>>> Dear Valued Customer,
>>>
>>> As you know, we experienced a service outage across the Rogers, Fido,
>>> Chatr and Cityfone wireless networks on Friday.
>>>
>>> I am reaching out to share that our services have been restored, and our
>>> networks and systems are close to fully operational. Our technical teams
>>> are continuing to monitor for any remaining intermittent issues. I also
>>> want to outline an action plan we are putting in place to address what
>>> happened.
>>>
>>> I want to share what we know about what happened on Friday. We now
>>> believe *we’ve narrowed the cause to a network system failure following
>>> a maintenance update in our core network, which caused some of our routers
>>> to malfunction. We disconnected the specific equipment and redirected
>>> traffic,* which allowed our network and services to come back online
>>> over time as we managed traffic volumes returning to normal levels.
>>>
>>>
>>>
>>> On Sat, Jul 9, 2022 at 9:09 PM L F <liz.fazekas at gmail.com> wrote:
>>>
>>>>
>>>> Lest we ALL MOVE ON….
>>>>
>>>>
>>>> Yes he said
>>>>
>>>> “RETARD” =
>>>>
>>>> The delay in processing the current status of a Situation…
>>>>
>>>>
>>>> Lets move on to bigger n scarier Post mortems:
>>>>
>>>>
>>>> Was This or Was this NOT
>>>>
>>>> A CYBERATTACK ???
>>>>
>>>> Done.
>>>>
>>>> Lets deal with REAL threats not PC references.
>>>>
>>>> Time to evaluate n re eval Our NTS!!
>>>>
>>>> Veni vidi vici 2022
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jul 9, 2022 at 5:01 PM Eric Kuhnke <eric.kuhnke at gmail.com>
>>>> wrote:
>>>>
>>>>> Can we have a discussion with the list admins about a list member
>>>>> appending a threat of violence to their outbound emails? Whether serious or
>>>>> not.
>>>>>
>>>>> Does this person need directions to some local mental healthcare
>>>>> resources?
>>>>>
>>>>>
>>>>> On Sat, 9 Jul 2022 at 08:48, Keith Medcalf <kmedcalf at dessus.com>
>>>>> wrote:
>>>>>
>>>>>>
>>>>>> >I can't either, but the reality right now seems to be that 911 calls
>>>>>> are
>>>>>> >failing for anyone on a Rogers cellphone.
>>>>>>
>>>>>> This is par for the course. These people chose to deal with Rogers
>>>>>> despite knowing the consequences. It is like if you bought a Rogers
>>>>>> Snowblower and it did not work. That would mean that people who bought the
>>>>>> Rogers Snowblower will not be using it to get rid of the snow that is
>>>>>> preventing them from leaving their house.
>>>>>>
>>>>>> Mutatis mutandis when Rogers is down things that are Rogers dependent
>>>>>> will not work.
>>>>>>
>>>>>> Some people are so retarded it is astonishing!
>>>>>>
>>>>>> --
>>>>>> (CAUTION) You are advised that if you attack my person or property,
>>>>>> you will be put down in accordance with the provisions of section 34 & 35
>>>>>> of the Criminal Code respectively. If you are brandishing (or in
>>>>>> possession) of a weapon then lethal force will be applied to your person in
>>>>>> accordance with the law. This means that your misadventures may end in your
>>>>>> death. Consider yourself cautioned and govern your actions appropriately.
>>>>>>
>>>>>> >-----Original Message-----
>>>>>> >From: NANOG <nanog-bounces+kmedcalf=dessus.com at nanog.org> On Behalf
>>>>>> Of
>>>>>> >Eric Kuhnke
>>>>>> >Sent: Friday, 8 July, 2022 13:34
>>>>>> >To: jim deleskie <deleskie at gmail.com>
>>>>>> >Cc: NANOG list <nanog at nanog.org>
>>>>>> >Subject: Re: Rogers Outage Canada
>>>>>> >
>>>>>> >
>>>>>> >I have seen anecdotal reports that the mobile network is in a half
>>>>>> broken
>>>>>> >state that phones remain registered to, so a 911 call will attempt
>>>>>> and
>>>>>> >then fail.
>>>>>> >
>>>>>> >
>>>>>> >This is unlike what would happen if you had a US/Canada cellphone
>>>>>> with
>>>>>> >battery power but no SIM card in it that would search for any
>>>>>> available
>>>>>> >network in RF range for a 911 call if needed.
>>>>>> >
>>>>>> >
>>>>>> >On Fri, 8 Jul 2022 at 12:31, jim deleskie <deleskie at gmail.com
>>>>>> ><mailto:deleskie at gmail.com> > wrote:
>>>>>> >
>>>>>> >
>>>>>> > i cant see BGP taking out SS7.
>>>>>> >
>>>>>> > -jim
>>>>>> >
>>>>>> > On Fri, Jul 8, 2022 at 2:45 PM Snowmobile2004
>>>>>> ><greenjosh6499 at gmail.com <mailto:greenjosh6499 at gmail.com> > wrote:
>>>>>> >
>>>>>> >
>>>>>> > According to Cloudflare Radar
>>>>>> ><https://radar.cloudflare.com/asn/812?date_filter=last_24_hours> ,
>>>>>> Rogers
>>>>>> >BGP announcements spiked massively to levels 536,777% higher than
>>>>>> normal
>>>>>> >(343,601 vs 64 normally) just minutes before the outage. I would not
>>>>>> be
>>>>>> >surprised if this happened to be the culprit.
>>>>>> >
>>>>>> > Regards,
>>>>>> > Josh Green
>>>>>> >
>>>>>> > On Fri, Jul 8, 2022 at 2:19 PM Andrew Paolucci via NANOG
>>>>>> ><nanog at nanog.org <mailto:nanog at nanog.org> > wrote:
>>>>>> >
>>>>>> >
>>>>>> > In the early hours of the morning around 2-3am my modem
>>>>>> >got hit with a configuration update that caused a DHCP release that
>>>>>> >wasn't renewed for about two hours, after rollback the connection was
>>>>>> >fine for 3 hours before this network wide outage.
>>>>>> >
>>>>>> >
>>>>>> > Maybe a failed night time update was attempted again
>>>>>> >during office hours, I've heard daytime guys are still WFH and night
>>>>>> >shift is in building.
>>>>>> >
>>>>>> >
>>>>>> > I expect we'll never get a real explanation. Rogers is
>>>>>> >notorious for withholding any type of helpful or technical
>>>>>> information.
>>>>>> >
>>>>>> >
>>>>>> > Sent from my inoperable Rogers Mobile via emergency eSIM.
>>>>>> >
>>>>>> >
>>>>>> > Regards,
>>>>>> >
>>>>>> > Andrew Paolucci
>>>>>> > -------- Original Message --------
>>>>>> > On Jul. 8, 2022, 1:48 p.m., Jay Hennigan < jay at west.net
>>>>>> ><mailto:jay at west.net> > wrote:
>>>>>> >
>>>>>> >
>>>>>> > On 7/8/22 07:44, Robert DeVita wrote: > Does anyone
>>>>>> >have information on a widespread Rogers outage in Canada. I > have
>>>>>> >customers with multiple sites down. There's discussion on the Outages
>>>>>> >mailing list. Seems widespread, affecting all services, mobile,
>>>>>> voice,
>>>>>> >Internet. No cause or ETR posted yet. -- Jay Hennigan - jay at west.net
>>>>>> ><mailto:jay at west.net> Network Engineering - CCIE #7880 503 897-8550
>>>>>> -
>>>>>> >WB6RDV
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> > --
>>>>>> >
>>>>>> > Josh Green.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>
>>>
>>> --
>>> Jon Sands
>>> MFI Labshttps://fohdeesha.com/
>>>
>>>
>
> --
> Liz *******
> 416.660.5456
>
>
> --
*Josh Green.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nanog.org/pipermail/nanog/attachments/20220711/d50ed55f/attachment.html>