<div dir="ltr"><div>Thank you Saku and the warren Here is the requested output</div><div><br></div><div><br></div>show route summary<div><br></div><div>inet.0: 879635 destinations, 879649 routes (879634 active, 0 holddown, 1 hidden)<br> Direct: 9 routes, 8 active<br> Local: 8 routes, 8 active<br> OSPF: 928 routes, 925 active<br> BGP: 878686 routes, 878678 active<br> Static: 2 routes, 2 active<br> Aggregate: 15 routes, 12 active<br><br>inet.3: 718 destinations, 718 routes (718 active, 0 holddown, 0 hidden)<br> LDP: 718 routes, 718 active<br><br>Test_VRF.inet.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)<br> Local: 1 routes, 1 active<br><br>mpls.0: 390 destinations, 390 routes (390 active, 0 holddown, 0 hidden)<br> MPLS: 3 routes, 3 active<br> LDP: 387 routes, 387 active<br><br>inet6.0: 143065 destinations, 286099 routes (143065 active, 0 holddown, 0 hidden)<br> Direct: 13 routes, 9 active<br> Local: 10 routes, 10 active<br> OSPF3: 16 routes, 15 active<br> BGP: 286060 routes, 143030 active<br> Static: 1 routes, 1 active<br></div><div><br></div><div>show chassis fpc <br> Temp CPU Utilization (%) Memory Utilization (%)<br>Slot State (C) Total Interrupt DRAM (MB) Heap Buffer<br> 0 Online 31 11 0 1024 37 29<br> 1 Online 31 11 0 1024 45 29<br> 2 Online 30 4 0 1024 36 29<br></div><div><br></div><div>request pfe execute target fpc0 command "show jtree 0 memory extensive" <br>SENT: Ukern command: show jtree 0 memory extensive<br>GOT:<br>GOT: Jtree memory segment 0 (Context: 0x44817bb0)<br>GOT: -------------------------------------------<br>GOT: Memory Statistics:<br>GOT: 16777216 bytes total<br>GOT: 16715144 bytes used<br>GOT: 56880 bytes available (7168 bytes from free pages)<br>GOT: 3024 bytes wasted<br>GOT: 2168 bytes unusable<br>GOT: 32768 pages total<br>GOT: 32519 pages used (2568 pages used in page alloc)<br>GOT: 235 pages partially used<br>GOT: 14 pages free (max contiguous = 6)<br>GOT:<br>GOT: Partially Filled Pages (In bytes):-<br>GOT: Unit Avail Overhead<br>GOT: 8 26256 0<br>GOT: 16 14320 0<br>GOT: 24 8352 2040<br>GOT: 32 352 0<br>GOT: 48 432 128<br>GOT:<br>GOT: Free Page Lists(Pg Size = 512 bytes):-<br>GOT: Page Bucket Avail(Bytes)<br>GOT: 1-1 2560<br>GOT: 3-3 1536<br>GOT: 6-6 3072<br>GOT:<br>GOT: Fragmentation Index = 0.946, (largest free = 3072)<br>GOT: Counters:<br>GOT: 2643777 allocs (0 failed)<br>GOT: 0 releases(partial 0)<br>GOT: 1095040 frees<br>GOT: 0 holds<br>GOT: 7 pending frees(pending bytes 56)<br>GOT: 0 pending forced<br>GOT: 0 times free blocked<br>GOT: 0 sync writes<br>GOT: Error Counters:-<br>GOT: 0 bad params<br>GOT: 0 failed frees<br>GOT: 0 bad cookie<br>GOT:<br>GOT: Jtree memory segment 1 (Context: 0x448997f0)<br>GOT: -------------------------------------------<br>GOT: Memory Statistics:<br>GOT: 16777216 bytes total<br>GOT: 4589552 bytes used<br>GOT: 12185384 bytes available (12183552 bytes from free pages)<br>GOT: 2248 bytes wasted<br>GOT: 32 bytes unusable<br>GOT: 32768 pages total<br>GOT: 8967 pages used (8967 pages used in page alloc)<br>GOT: 5 pages partially used<br>GOT: 23796 pages free (max contiguous = 23793)<br>GOT:<br>GOT: Partially Filled Pages (In bytes):-<br>GOT: Unit Avail Overhead<br>GOT: 8 1416 0<br>GOT: 16 80 0<br>GOT: 48 336 32<br></div><div><br></div><div><br></div><div>request pfe execute target fpc1 command "show jtree 0 memory extensive" <br>SENT: Ukern command: show jtree 0 memory extensive<br>GOT:<br>GOT: Jtree memory segment 0 (Context: 0x447cc698)<br>GOT: -------------------------------------------<br>GOT: Memory Statistics:<br>GOT: 16777216 bytes total<br>GOT: 16715840 bytes used<br>GOT: 56184 bytes available (8192 bytes from free pages)<br>GOT: 3024 bytes wasted<br>GOT: 2168 bytes unusable<br>GOT: 32768 pages total<br>GOT: 32533 pages used (2568 pages used in page alloc)<br>GOT: 219 pages partially used<br>GOT: 16 pages free (max contiguous = 5)<br>GOT:<br>GOT: Partially Filled Pages (In bytes):-<br>GOT: Unit Avail Overhead<br>GOT: 8 25544 0<br>GOT: 16 13312 0<br>GOT: 24 8352 2040<br>GOT: 32 352 0<br>GOT: 48 432 128<br>GOT:<br>GOT: Free Page Lists(Pg Size = 512 bytes):-<br>GOT: Page Bucket Avail(Bytes)<br>GOT: 1-1 2048<br>GOT: 2-2 1024<br>GOT: 5-5 5120<br>GOT:<br>GOT: Fragmentation Index = 0.954, (largest free = 2560)<br>GOT: Counters:<br>GOT: 2645725 allocs (0 failed)<br>GOT: 2 releases(partial 0)<br>GOT: 1096891 frees<br>GOT: 0 holds<br>GOT: 0 pending frees(pending bytes 0)<br>GOT: 0 pending forced<br>GOT: 0 times free blocked<br>GOT: 0 sync writes<br>GOT: Error Counters:-<br>GOT: 0 bad params<br>GOT: 0 failed frees<br>GOT: 0 bad cookie<br>GOT:<br>GOT: Jtree memory segment 1 (Context: 0x4484e2d8)<br>GOT: -------------------------------------------<br>GOT: Memory Statistics:<br>GOT: 16777216 bytes total<br>GOT: 4589504 bytes used<br>GOT: 12185432 bytes available (12184576 bytes from free pages)<br>GOT: 2248 bytes wasted<br>GOT: 32 bytes unusable<br>GOT: 32768 pages total<br>GOT: 8967 pages used (8967 pages used in page alloc)<br>GOT: 3 pages partially used<br>GOT: 23798 pages free (max contiguous = 23798)<br>GOT:<br>GOT: Partially Filled Pages (In bytes):-<br>GOT: Unit Avail Overhead<br>GOT: 8 424 0<br>GOT: 16 96 0<br>GOT: 48 336 32<br>GOT:<br>GOT: Free Page Lists(Pg Size = 512 bytes):-<br>GOT: Page Bucket Avail(Bytes)<br>GOT: 27-32768 12184576<br>GOT:<br>GOT: Fragmentation Index = 0.000, (largest free = 12184576)<br>GOT: Counters:<br>GOT: 45 allocs (0 failed)<br>GOT: 0 releases(partial 0)<br>GOT: 0 frees<br>GOT: 0 holds<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, May 4, 2022 at 1:39 PM Saku Ytti <<a href="mailto:saku@ytti.fi">saku@ytti.fi</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">'show route summary'<br>
'start shell pfe network fpcX'<br>
'show jnh N pool summary'<br>
'show jnh N pool usage'<br>
<br>
On Wed, 4 May 2022 at 23:31, Nehul Patel <<a href="mailto:nehul.patel@gmail.com" target="_blank">nehul.patel@gmail.com</a>> wrote:<br>
><br>
><br>
> Hi NANOG,<br>
><br>
> We are seeing some strange behavior on our Juniper MX240 Chassis it is randomly dropping the routes to the certain destination IP address getting the following errors on the MX240 Chassis<br>
><br>
> If Someone has seen these errors before please suggest how to resolve it<br>
><br>
><br>
> May 4 12:42:00 cr01 newsyslog[44735]: logfile turned over due to size>1024K<br>
> May 4 12:42:01 /kernel: RT_PFE: RT msg op 1 (PREFIX ADD) failed, err 5 (Invalid)<br>
> May 4 12:42:01 /kernel: RT_PFE: RT msg op 3 (PREFIX CHANGE) failed, err 5 (Invalid)<br>
> May 4 12:42:01 last message repeated 4 times<br>
> May 4 12:42:01 fpc0 RT: IPv6:0 - 2600:40fc:1011::/48 (add rt entry into jtree failed)<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_entry_add_msg_proc,2028: rt_halp_vectors->rt_create failed<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_entry_add_msg_proc,2092: proto ipv6,len 48 prefix 2600:40fc:1011::/48 nh 1048576<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_msg_handler,540: route process failed<br>
> May 4 12:42:01 fpc0 RT: Failed prefix add IPv6 - 2001:67c:20fc::/48 (No memory) on FE 0<br>
> May 4 12:42:01 fpc0 RT: IPv6:0 - 2001:67c:20fc::/48 (add rt entry into jtree failed)<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_entry_add_msg_proc,2028: rt_halp_vectors->rt_create failed<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_entry_add_msg_proc,2092: proto ipv6,len 48 prefix 2001:67c:20fc::/48 nh 1048576<br>
> May 4 12:42:01 fpc0 RT-HAL,rt_msg_handler,540: route process failed<br>
> May 4 12:42:01 fpc0 RT: Failed prefix add IPv6 - 2606:2800:e004::/48 (No memory) on FE 0<br>
> May 4 12:42:01 fpc0 RT: Failed prefix add IPv6 - 2a05:3181:ffff::/48 (No memory) on FE 0<br>
> May 4 12:42:01 /kernel: RT_PFE: RT msg op 3 (PREFIX CHANGE) failed, err 5 (Invalid)<br>
> May 4 12:42:01 /kernel: RT_PFE: RT msg op 1 (PREFIX ADD) failed, err 5 (Invalid)<br>
> May 4 12:42:01 /kernel: RT_PFE: RT msg op 2 (PREFIX DELETE) failed, err 5 (Invalid)<br>
> May 4 12:42:02 fpc0 RT: Failed prefix add IPv4 - 79.120.22/24 (No memory) on FE 0<br>
> May 4 12:42:02 fpc0 RT: IPv4:0 - 79.120.22/24 (add rt entry into jtree failed)<br>
> May 4 12:42:02 fpc0 RT-HAL,rt_entry_add_msg_proc,2028: rt_halp_vectors->rt_create failed<br>
> May 4 12:42:02 fpc0 RT-HAL,rt_entry_add_msg_proc,2092: proto ipv4,len 24 prefix 79.120.22/24 nh 1048583<br>
> May 4 12:42:02 /kernel: RT_PFE: RT msg op 1 (PREFIX ADD) failed, err 5 (Invalid)<br>
> May 4 12:42:02 fpc0 RT-HAL,rt_msg_handler,540: route process failed<br>
><br>
> May 4 09:33:17 fpc0 RSMON: Resource Category:jtree Instance:jtree2-seg0 Type:free-pages Available:20 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:17 fpc0 RSMON: Resource Category:jtree Instance:jtree2-seg0 Type:free-dwords Available:1280 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc0 RSMON: Resource Category:jtree Instance:jtree3-seg0 Type:free-pages Available:19 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc0 RSMON: Resource Category:jtree Instance:jtree3-seg0 Type:free-dwords Available:1216 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc1 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-pages Available:16 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc1 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-dwords Available:1024 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc1 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-pages Available:15 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc1 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-dwords Available:960 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:18 fpc1 RSMON: Resource Category:jtree Instance:jtree2-seg0 Type:free-pages Available:19 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc1 RSMON: Resource Category:jtree Instance:jtree2-seg0 Type:free-dwords Available:1216 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc1 RSMON: Resource Category:jtree Instance:jtree3-seg0 Type:free-pages Available:17 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc1 RSMON: Resource Category:jtree Instance:jtree3-seg0 Type:free-dwords Available:1088 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc2 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-pages Available:15 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc2 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-dwords Available:960 is less than LWM limit:104857, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc2 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-pages Available:15 is less than LWM limit:1638, rsmon_syslog_limit()<br>
> May 4 09:33:19 fpc2 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-dwords Available:960 is less than LWM limit:104857, rsmon_syslog_limit()<br>
><br>
> Any suggestions will be helpful<br>
><br>
><br>
> Please do let me know if you have any questions.<br>
><br>
><br>
><br>
><br>
> Regards and thanks,<br>
> Nehul<br>
><br>
><br>
<br>
<br>
-- <br>
++ytti<br>
</blockquote></div>