DMARC ViolationDKIM ViolationRe: Strange behavior on the Juniper MX240

Thu May 5 03:50:17 UTC 2022

Try setting "keep-none" on your BGP neighbor (s) not sure if it'll still need the cards rebooted equally you can also just accept a default route or wait for TAC to take over :) 

Regards 
Paschal Masha | Engineering 
Skype ID: paschal.masha 

From: "Nehul Patel" <nehul.patel at gmail.com> 
To: "Jordan" <jnh at vt11.net> 
Cc: "nanog" <nanog at nanog.org> 
Sent: Thursday, May 5, 2022 06:08:05 AM 
Subject: DMARC ViolationDKIM ViolationRe: Strange behavior on the Juniper MX240 

Ok, thank you all for the feedback we are going to start with the Junos OS upgrade first on it but have to open the ticket with JTAC since currently on the juniper support website they have the Junos 15.1 is available so not sure we can directly jump from 10.4 to 15.1 maybe we have to do step by step upgrade on it. Any other suggestions will be helpful as well 

By the way, the uptime on the Juniper MX chassis was 1589 Days on it. 

On Wed, May 4, 2022 at 7:11 PM Jordan < jnh at vt11.net > wrote: 

> Your line cards (not RE's) are running out of route-storage memory.
> As a short-term mitigation, you could try borrowing from segment 1,
> normally dedicated to filters,

> set chassis memory-enhanced route

> but this option may not exist in the version of JunOS you're
> running, which as already mentioned is very old.

> If the command is accepted, and it lets you commit, you'll then
> need to restart each of the FPC's, one at a time, by slot number,
> which will take each out of service for a few minutes, so you
> probably want to wait until a scheduled maintenance period, and
> start with less-important FPC slots first:

> request chassis fpc restart slot X

> On Wed, May 04, 2022 at 02:34:45PM -0700, Nehul Patel wrote:
> > Thank you Saku and the warren Here is the requested output

> > show route summary

> > inet.0: 879635 destinations, 879649 routes (879634 active, 0 holddown, 1
> > hidden)
> > Direct: 9 routes, 8 active
> > Local: 8 routes, 8 active
> > OSPF: 928 routes, 925 active
> > BGP: 878686 routes, 878678 active
> > Static: 2 routes, 2 active
> > Aggregate: 15 routes, 12 active

> > inet.3: 718 destinations, 718 routes (718 active, 0 holddown, 0 hidden)
> > LDP: 718 routes, 718 active

> > Test_VRF.inet.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
> > Local: 1 routes, 1 active

> > mpls.0: 390 destinations, 390 routes (390 active, 0 holddown, 0 hidden)
> > MPLS: 3 routes, 3 active
> > LDP: 387 routes, 387 active

> > inet6.0: 143065 destinations, 286099 routes (143065 active, 0 holddown, 0
> > hidden)
> > Direct: 13 routes, 9 active
> > Local: 10 routes, 10 active
> > OSPF3: 16 routes, 15 active
> > BGP: 286060 routes, 143030 active
> > Static: 1 routes, 1 active

> > show chassis fpc
> > Temp CPU Utilization (%) Memory Utilization (%)
> > Slot State (C) Total Interrupt DRAM (MB) Heap Buffer
> > 0 Online 31 11 0 1024 37 29
> > 1 Online 31 11 0 1024 45 29
> > 2 Online 30 4 0 1024 36 29

> > request pfe execute target fpc0 command "show jtree 0 memory extensive"
> > SENT: Ukern command: show jtree 0 memory extensive
> > GOT:
> > GOT: Jtree memory segment 0 (Context: 0x44817bb0)
> > GOT: -------------------------------------------
> > GOT: Memory Statistics:
> > GOT: 16777216 bytes total
> > GOT: 16715144 bytes used
> > GOT: 56880 bytes available (7168 bytes from free pages)
> > GOT: 3024 bytes wasted
> > GOT: 2168 bytes unusable
> > GOT: 32768 pages total
> > GOT: 32519 pages used (2568 pages used in page alloc)
> > GOT: 235 pages partially used
> > GOT: 14 pages free (max contiguous = 6)
> > GOT:
> > GOT: Partially Filled Pages (In bytes):-
> > GOT: Unit Avail Overhead
> > GOT: 8 26256 0
> > GOT: 16 14320 0
> > GOT: 24 8352 2040
> > GOT: 32 352 0
> > GOT: 48 432 128
> > GOT:
> > GOT: Free Page Lists(Pg Size = 512 bytes):-
> > GOT: Page Bucket Avail(Bytes)
> > GOT: 1-1 2560
> > GOT: 3-3 1536
> > GOT: 6-6 3072
> > GOT:
> > GOT: Fragmentation Index = 0.946, (largest free = 3072)
> > GOT: Counters:
> > GOT: 2643777 allocs (0 failed)
> > GOT: 0 releases(partial 0)
> > GOT: 1095040 frees
> > GOT: 0 holds
> > GOT: 7 pending frees(pending bytes 56)
> > GOT: 0 pending forced
> > GOT: 0 times free blocked
> > GOT: 0 sync writes
> > GOT: Error Counters:-
> > GOT: 0 bad params
> > GOT: 0 failed frees
> > GOT: 0 bad cookie
> > GOT:
> > GOT: Jtree memory segment 1 (Context: 0x448997f0)
> > GOT: -------------------------------------------
> > GOT: Memory Statistics:
> > GOT: 16777216 bytes total
> > GOT: 4589552 bytes used
> > GOT: 12185384 bytes available (12183552 bytes from free pages)
> > GOT: 2248 bytes wasted
> > GOT: 32 bytes unusable
> > GOT: 32768 pages total
> > GOT: 8967 pages used (8967 pages used in page alloc)
> > GOT: 5 pages partially used
> > GOT: 23796 pages free (max contiguous = 23793)
> > GOT:
> > GOT: Partially Filled Pages (In bytes):-
> > GOT: Unit Avail Overhead
> > GOT: 8 1416 0
> > GOT: 16 80 0
> > GOT: 48 336 32

> > request pfe execute target fpc1 command "show jtree 0 memory extensive"
> > SENT: Ukern command: show jtree 0 memory extensive
> > GOT:
> > GOT: Jtree memory segment 0 (Context: 0x447cc698)
> > GOT: -------------------------------------------
> > GOT: Memory Statistics:
> > GOT: 16777216 bytes total
> > GOT: 16715840 bytes used
> > GOT: 56184 bytes available (8192 bytes from free pages)
> > GOT: 3024 bytes wasted
> > GOT: 2168 bytes unusable
> > GOT: 32768 pages total
> > GOT: 32533 pages used (2568 pages used in page alloc)
> > GOT: 219 pages partially used
> > GOT: 16 pages free (max contiguous = 5)
> > GOT:
> > GOT: Partially Filled Pages (In bytes):-
> > GOT: Unit Avail Overhead
> > GOT: 8 25544 0
> > GOT: 16 13312 0
> > GOT: 24 8352 2040
> > GOT: 32 352 0
> > GOT: 48 432 128
> > GOT:
> > GOT: Free Page Lists(Pg Size = 512 bytes):-
> > GOT: Page Bucket Avail(Bytes)
> > GOT: 1-1 2048
> > GOT: 2-2 1024
> > GOT: 5-5 5120
> > GOT:
> > GOT: Fragmentation Index = 0.954, (largest free = 2560)
> > GOT: Counters:
> > GOT: 2645725 allocs (0 failed)
> > GOT: 2 releases(partial 0)
> > GOT: 1096891 frees
> > GOT: 0 holds
> > GOT: 0 pending frees(pending bytes 0)
> > GOT: 0 pending forced
> > GOT: 0 times free blocked
> > GOT: 0 sync writes
> > GOT: Error Counters:-
> > GOT: 0 bad params
> > GOT: 0 failed frees
> > GOT: 0 bad cookie
> > GOT:
> > GOT: Jtree memory segment 1 (Context: 0x4484e2d8)
> > GOT: -------------------------------------------
> > GOT: Memory Statistics:
> > GOT: 16777216 bytes total
> > GOT: 4589504 bytes used
> > GOT: 12185432 bytes available (12184576 bytes from free pages)
> > GOT: 2248 bytes wasted
> > GOT: 32 bytes unusable
> > GOT: 32768 pages total
> > GOT: 8967 pages used (8967 pages used in page alloc)
> > GOT: 3 pages partially used
> > GOT: 23798 pages free (max contiguous = 23798)
> > GOT:
> > GOT: Partially Filled Pages (In bytes):-
> > GOT: Unit Avail Overhead
> > GOT: 8 424 0
> > GOT: 16 96 0
> > GOT: 48 336 32
> > GOT:
> > GOT: Free Page Lists(Pg Size = 512 bytes):-
> > GOT: Page Bucket Avail(Bytes)
> > GOT: 27-32768 12184576
> > GOT:
> > GOT: Fragmentation Index = 0.000, (largest free = 12184576)
> > GOT: Counters:
> > GOT: 45 allocs (0 failed)
> > GOT: 0 releases(partial 0)
> > GOT: 0 frees
> > GOT: 0 holds

> --
> Jordan.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nanog.org/pipermail/nanog/attachments/20220505/85318f8c/attachment.html>