Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF. The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static. Thomas Magill Network Engineer Office: (858) 909-3777 Cell: (858) 869-9685 mailto:tmagill@providecommerce.com <mailto:tmagill@providecommerce.com> provide-commerce 4840 Eastgate Mall San Diego, CA 92121 ProFlowers <http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
On 5/24/10 4:00 PM, "Thomas Magill" <tmagill@providecommerce.com> wrote:
Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF.
The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static.
Thomas Magill Network Engineer
Office: (858) 909-3777
Cell: (858) 869-9685 mailto:tmagill@providecommerce.com <mailto:tmagill@providecommerce.com>
provide-commerce 4840 Eastgate Mall
San Diego, CA 92121
ProFlowers <http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
I am using a few 1002's and I am not seeing that issue. I will get you the IOS train later.
using ASR1006 here, had 2 automatic reboots last friday which is not a good sign. System image file is "bootflash:/asr1000rp1-adventerprisek9.02.04.02.122-33.XND2.bin" Last reload reason: Critical software exception, check bootflash:crashinfo_RP_01_00_20100521-080244-XXX last thing i always see before boom, May 21 07:27:11.752 XXX: %BGP-6-BIGCHUNK: Big chunk pool request (252) for community. Replenishing with malloc i am starting to feel ASR1000 series' software is not yet ready for primetime, but there are newer software available, will try that first and if it still fails, then i'll cancel all ASR1000 orders. On Tue, May 25, 2010 at 8:05 AM, Elijah Savage III <esavage@digitalrage.org> wrote:
On 5/24/10 4:00 PM, "Thomas Magill" <tmagill@providecommerce.com> wrote:
Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF.
The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static.
Thomas Magill Network Engineer
Office: (858) 909-3777
Cell: (858) 869-9685 mailto:tmagill@providecommerce.com <mailto:tmagill@providecommerce.com>
provide-commerce 4840 Eastgate Mall
San Diego, CA 92121
ProFlowers <http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
I am using a few 1002's and I am not seeing that issue. I will get you the IOS train later.
for a few days ago, i just tested the ASR1006, i tested it for 2 weeks and it never reboot itself. i was using IOS: asr1000rp2-adventerprisek9.BLD_V122_33_XNE_ASR_RLS5_THROTTLE_LATEST_20090926_060026.bin i tested it for bgp propagation and pppoe. i think it enough good. #Anderson Lumbantobing CBN www.cbn.net.id On 5/26/2010 3:10 PM, Sherwin Ang wrote:
using ASR1006 here, had 2 automatic reboots last friday which is not a good sign.
System image file is "bootflash:/asr1000rp1-adventerprisek9.02.04.02.122-33.XND2.bin" Last reload reason: Critical software exception, check bootflash:crashinfo_RP_01_00_20100521-080244-XXX
last thing i always see before boom,
May 21 07:27:11.752 XXX: %BGP-6-BIGCHUNK: Big chunk pool request (252) for community. Replenishing with malloc
i am starting to feel ASR1000 series' software is not yet ready for primetime, but there are newer software available, will try that first and if it still fails, then i'll cancel all ASR1000 orders.
On Tue, May 25, 2010 at 8:05 AM, Elijah Savage III <esavage@digitalrage.org> wrote:
On 5/24/10 4:00 PM, "Thomas Magill"<tmagill@providecommerce.com> wrote:
Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF.
The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static.
Thomas Magill Network Engineer
Office: (858) 909-3777
Cell: (858) 869-9685 mailto:tmagill@providecommerce.com<mailto:tmagill@providecommerce.com>
provide-commerce 4840 Eastgate Mall
San Diego, CA 92121
ProFlowers<http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
I am using a few 1002's and I am not seeing that issue. I will get you the IOS train later.
Re guys, just to enforce the statement that the ASR is not really in the Kindergarten anymore: rt uptime is 22 weeks, 1 day, 17 hours, 33 minutes Uptime for this control processor is 22 weeks, 1 day, 17 hours, 34 minutes System returned to ROM by reload at 11:00:33 CET Mon Dec 21 2009 System restarted at 16:16:32 CET Mon Dec 21 2009 System image file is "bootflash:asr1000rp1-advipservicesk9.02.04.02.122-33.XND2.bin" [...] cisco ASR1002 (2RU) processor with 1759125K/6147K bytes of memory. 4 Gigabit Ethernet interfaces 32768K bytes of non-volatile configuration memory. 4194304K bytes of physical memory. 7798783K bytes of eUSB flash at bootflash:. Configuration register is 0x2102 -------------------------------------------------------------------------- Unfortunately, it is also correct that the box crashes with soft-reconfig enabled (it's my bug, actually). Cisco told me they could not reproduce it in the lab, so there's no fix yet. With soft-reconfig disabled, the system works and is stable and fast. CPU is almost zero (2%), with >150 v4 and >40 v6 BGP sessions active. Just to mention it - I'd have preferred an NPE-G2 with some hardware forwarding board. That system simply rocks. But well, I guess this is evolution... Elmar.
Sherwin, Let's move this specific crash/code question over to cisco-nsp@puck.nether.net. Try the 12.2(33)XNF1 release. If you would like to try and find the matching bug for what you are seeing before you upgrade email me offline with the crashinfo file and the full logs and I'll get someone to take a look at it with you. Thanks, Rodney On 5/26/10 4:10 AM, Sherwin Ang wrote:
using ASR1006 here, had 2 automatic reboots last friday which is not a good sign.
System image file is "bootflash:/asr1000rp1-adventerprisek9.02.04.02.122-33.XND2.bin" Last reload reason: Critical software exception, check bootflash:crashinfo_RP_01_00_20100521-080244-XXX
last thing i always see before boom,
May 21 07:27:11.752 XXX: %BGP-6-BIGCHUNK: Big chunk pool request (252) for community. Replenishing with malloc
i am starting to feel ASR1000 series' software is not yet ready for primetime, but there are newer software available, will try that first and if it still fails, then i'll cancel all ASR1000 orders.
On Tue, May 25, 2010 at 8:05 AM, Elijah Savage III <esavage@digitalrage.org> wrote:
On 5/24/10 4:00 PM, "Thomas Magill"<tmagill@providecommerce.com> wrote:
Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF.
The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static.
Thomas Magill Network Engineer
Office: (858) 909-3777
Cell: (858) 869-9685 mailto:tmagill@providecommerce.com<mailto:tmagill@providecommerce.com>
provide-commerce 4840 Eastgate Mall
San Diego, CA 92121
ProFlowers<http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
I am using a few 1002's and I am not seeing that issue. I will get you the IOS train later.
I've been running two asr1002's in production now on XND2 and so far (he knocks on wood) they've been stable. Very simple config on my end, OSPF, BGP with full routes, all interfaces are fixed, IOW, no add on SPAs. I can push well over 100k PPS on each interface and the boxes are asleep. My NPE-Gx's would fall over at that rate. All in all, I've been pleased with them. Now, if I could just jail break the ASR;s and load JUNOS.... ;) -b On Wed, May 26, 2010 at 4:32 AM, Rodney Dunn <rodunn@cisco.com> wrote:
Sherwin,
Let's move this specific crash/code question over to cisco-nsp@puck.nether.net.
Try the 12.2(33)XNF1 release.
If you would like to try and find the matching bug for what you are seeing before you upgrade email me offline with the crashinfo file and the full logs and I'll get someone to take a look at it with you.
Thanks, Rodney
On 5/26/10 4:10 AM, Sherwin Ang wrote:
using ASR1006 here, had 2 automatic reboots last friday which is not a good sign.
System image file is "bootflash:/asr1000rp1-adventerprisek9.02.04.02.122-33.XND2.bin" Last reload reason: Critical software exception, check bootflash:crashinfo_RP_01_00_20100521-080244-XXX
last thing i always see before boom,
May 21 07:27:11.752 XXX: %BGP-6-BIGCHUNK: Big chunk pool request (252) for community. Replenishing with malloc
i am starting to feel ASR1000 series' software is not yet ready for primetime, but there are newer software available, will try that first and if it still fails, then i'll cancel all ASR1000 orders.
On Tue, May 25, 2010 at 8:05 AM, Elijah Savage III <esavage@digitalrage.org> wrote:
On 5/24/10 4:00 PM, "Thomas Magill"<tmagill@providecommerce.com> wrote:
Anyone using ASRs? We are demoing one to possibly upgrade our 7206s. We are seeing what looks like a memory leak on the RP. Cisco is looking at it and says they haven't seen it before. I am wondering if anyone else has run across this. With the default 2G of memory the RP only had about 1% free memory, and the router was rebooting every 5 days or so when the RP ran out. We upgraded and now have about 60% free on the RP, but I still see the used memory incrementing at a pretty steady rate. We are running IOS-XE 12.2(33)XNF.
The router is currently not even routing traffic, just acting as a BGP peer so it has one set of full tables. It seems to be a process on the Linux OS side that has the leak as the IOS memory commands show everything staying pretty static.
Thomas Magill Network Engineer
Office: (858) 909-3777
Cell: (858) 869-9685 mailto:tmagill@providecommerce.com<mailto:tmagill@providecommerce.com>
provide-commerce 4840 Eastgate Mall
San Diego, CA 92121
ProFlowers<http://www.proflowers.com/> | redENVELOPE <http://www.redenvelope.com/> | Cherry Moon Farms <http://www.cherrymoonfarms.com/> | Shari's Berries <http://www.berries.com/>
I am using a few 1002's and I am not seeing that issue. I will get you the IOS train later.
-- Bill Blackford Network Engineer Logged into reality and abusing my sudo privileges.....
Could a Google Op get in touch with me off-list please? I have a fairly stupid situation.... --p
participants (8)
-
Anderson -
Bill Blackford -
Darden, Patrick S. -
Elijah Savage III -
Elmar K. Bins -
Rodney Dunn -
Sherwin Ang -
Thomas Magill