I'm pretty sure that the Juniper QFX5100 and the Juniper ACX5048 are some box with different Junos and features allowed/disallowed...somehow. (lookup pictures on google and juniper.net... pretty sure identical box) As I recall, the QFX5100 has more data-center-type things like virtual chass/mc-lag and less MPLS-edge-agg... As I recall (actually know from deploying 25 of them now), the ACX5048 has more MPLS-edge-agg and less data-center-type things like virtual chass/mc-lag -Aaron

Pretty sure I looked at the ciena 51xx and I found that it does not have mpls in it... pretty sure Erik needs mpls... -Aaron

Yes, stay well away from the Ciena MPLS code... based on my experience with the CN5100/3900 series... Tue, Apr 18, 2017 at 02:08:05AM +0100, Tom Hill wrote:

On 13/04/17 23:47, Aaron Gould wrote:

...

Pretty sure I looked at the ciena 51xx and I found that it does not have mpls in it... pretty sure Erik needs mpls...

The 5150 will 'do MPLS', which is pretty clear from their website. The references 5160, too.

I wouldn't recommend it personally, but it is there.

-- Patrick Cole <z@wwwires.com> Senior Network Specialist World Without Wires PO Box 869. Palm Beach, QLD, 4221 Ph: 0410 626 630

Aaron, The code is very green; the platform originally was inherited from Nortel and as such they invested heavily in PBB-TE first and foremost. To give you an idea they're currently at version 6.16 and the MPLS code was introduced in 6.10 (from memory). They support just enough OSPFv2 or IS-IS to implement basic MPLS TE functionality but it does not interop with any other vendor well at all from my testing. They only support protected active/standby LSP groups withI maximum 2 paths per group. Paths inside a group cannot be computed automatically and /must/ have EROs specified. They do not support Fast Reroute PLR/MP in any way and their product manager said they have no plans to do so in the future. They do support "signalling" desired FRR protection on an LSP, however, in my lab testing this is a moot point as they don't interop with our Cisco core gear. They seem to add GMPLS TLVs in to their PATH msgs with nil values even when you aren't using GMPLS, which Cisco doesn't like. I was able to get their gear to interop with our Brocade routers, but it was world of hurt of problems in production as they don't do make before break on LSPs or anything useful like that. Even when running only their gear in isolation, we had numerous extremely large service impacting problems with their software - things that as a software and network engineer by trade I can only put down to extremely badly written code. For example we had an issue where when BFD would flap on links rapidly through our network, the MPLS cross connect table would get misprogrammed with a bad value and then from that point onwards all transit LSPs would fail to signal through the node. Even further to this, the biggest issue I had is that their software was not written with enough easy-to-access diagnostic/debugging capability to be able to allow the vendor to triage and get to the root cause of issues. Most major issues never got solved because the things the vendor required you to troubleshoot were outragously inconvenient or massively service affecting in nature. Example; there was no way to send debugging via the network (syslog etc). In quite a few cases I had to break out in to the linux CLI and run their debug streaming program on all our nodes and use netcat to transport it back to our servers to capture it. They implement LDP signalled PWE and VPLS but the cli has a lot of really annoying nuances like, you can't change the LSP on a pseudowire without detaching it from its virtual switch (no make-before-break functionality exists either). We stuck with it for a while, hoping it would get better but every release seemed to bring different bugs, and the old ones never seemed to get fully fixed and would resurface in the future. I suspect they were dealing with race conditions in their code and they just never could seem to reproduce the conditions that would cause them in their lab. I think our microwave network tested their code in ways they never had before when storms rolled through. This might all be different on their larger packet optical devices I don't know - this all applies to the SA-OS on 39XX/51XX platform. We now use the ASR920 platform and comparatively it's night and day in terms of feature set and stability. Only thing I'm missing is lack of tunnel byte counters for use by auto-bw, but Cisco say this is coming in Everest... Regards, Patrick Wed, Apr 19, 2017 at 03:06:42PM -0500, Aaron Gould wrote:

Oh, ok... hmmm

So what was the issue with Ciena and MPLS Patrick ?

-Aaron

-- Patrick Cole <z@wwwires.com> Senior Network Specialist World Without Wires PO Box 869. Palm Beach, QLD, 4221 Ph: 0410 626 630

Thanks Tom... I might be wrong, I thought I remembered Ciena not having the MPLS routing capabilities I needed... I do see this on their website... so maybe it does more MPLS L2/L3VPN capabilities than I remembered... I might have to take another look at this and talk to my Ciena POC and VAR... Thanks again. http://www.ciena.com/products/5160/ RFC 2205, 3031, 3036, 3985 MPLS PWE3 Pseudowire Emulation Edge-to-Edge RFC 5654 MPLS-Transport Profile (TP) LSP Static provisioning 1:1 Tunnel protection LSP BFD via Gal/Gach MPLS Virtual Private Wire Service (VPWS) RFC 4762 VPLS (Virtual Private LAN Service) and Hierarchical VPLS (H-VPLS) Provider Edge (PE-s) Functionality for VPLS and H-VPLS VPLS with multiple VPLS Mesh Virtual Circuits H-VPLS with Hub and Spoke Virtual Circuits MTU-s Functionality for H-VPLS deployment MTU-s Multi-homing (redundant VCs to different PE-s switches) MPLS Virtual Circuit as H-VPLS spoke Virtual Circuit PBB-TE Service Instance as H-VPLS spoke Virtual Circuit Q-in-Q Ethernet Virtual Circuit as H-VPLS spoke Virtual Circuit MPLS Label Switch Path (LSP) Tunnel Groups MPLS Label Switch Path (LSP) Tunnel Redundancy Layer 2 Control Frame Tunneling over MPLS Virtual Circuits RFC 3209 RSVP-TE (for MPLS Tunnel Signaling) RFC 3630 OSPF-TE (for MPLS Tunnel Routes) RFC 3784 IS-IS-TE (for MPLS Tunnel Routes) RFC 3036 LDP & Targeted LDP (for VPLS VC signaling) RFC 4090 MPLS Fast ReRoute signaling LSP Ping & Traceroute -Aaron

I'd avoid the 7280R for this. Works great as a P router for cheap, fast label switching, but their VRF implementation is lacking with both route-leaking and MP-BGP address family (other than standard ipv4+ipv6) support being nonexistent. On Thu, Apr 13, 2017 at 3:12 PM, David Hubbard < dhubbard@dino.hostasaurus.com> wrote:

Would Arista 7280R work? Gets you 48+ 10gig and a couple QSFP ports even in the cheapest model. I believe it has the features you want. Haven’t done MPLS with it, but I’ve got some running OSPF/OSPFv3 with no issues.

On 4/13/17, 5:37 PM, "NANOG on behalf of Erik Sundberg" <nanog-bounces+ispcolohost=gmail.com@nanog.org on behalf of ESundberg@nitelusa.com> wrote:

Hey Nanog,

Looking for a new metroE Edge switch that has more that 10x 10G ports. I am having a hard time finding anything worthwhile without buying a full blown ASR9K Chassis or another vendor's chassis.

Requirements MEF compliant 1-2U small foot print 10G Ports will be used for ENNI's and UNI Ports Prefer MPLS support for L2VPN's (EoMPLS and VPLS) QOS per Sub interface\vlan on a ENNI Cost effect 10G Ports 100G Not required

Looking at the ASR920's - Great box for 1G but not enough 10G Ports Only 4 NCS5001/NCS5501 - New\unproven\probably buggy, Lacking some features & QOS issues :/ ASR900 - Looks good, but was hoping for a smaller foot print. If I remember right the 8x10G Cards can't go in every slot.

Any other platforms I should be looking at?

Ciena, Brocade, Juniper?

Thanks in advance!

-Erik

________________________________

CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.

Guys thanks for the feedback and direction. Some follow up to some of the questions\comments -MPLS support is preferreded. -Uplinks to the core would be LACP Bundles at Nx10G. The majority of the traffic on the customer facing 10G ENNI's will be 10-100M EVC's. We would configure 10G Port with 2G CIR on this device, just not full 10G UNI Ports they would be put on a different device. -MEF Required -Erik -----Original Message----- From: Aaron Gould [mailto:aaron1@gvtc.com] Sent: Thursday, April 13, 2017 5:41 PM To: Erik Sundberg; nanog@nanog.org Subject: RE: 10G MetroE 1-2U Switch Hi Eric, A year or 2 ago, I did a good bit of work looking at various MPLS-capable-PE boxes as I was looking to replace the investment of Cisco ME3600's that couldn't keep up the pace of our FTTH 10 gig link expansions... that ME3600 only had (2) 10 gig ports. Several links below are just a quick search I did on google to find some of this topics/discussions from the community. https://www.juniper.net/assets/kr/kr/local/pdf/case-studies/3520578-en.pdf https://lists.gt.net/nsp/juniper/54965 https://www.mail-archive.com/juniper-nsp@puck.nether.net/msg23974.html https://marc.info/?l=cisco-nsp&m=148839385119158&w=3 https://marc.info/?a=133372064700006&r=1&w=3 https://marc.info/?a=148839164700003&r=1&w=3 https://lists.gt.net/nsp/juniper/58182 https://puck.nether.net/pipermail/juniper-nsp/2015-October/031353.html https://lists.gt.net/nsp/juniper/58241 -----Original Message----- From: NANOG [mailto:nanog-bounces+aaron1=gvtc.com@nanog.org] On Behalf Of Erik Sundberg Sent: Thursday, April 13, 2017 4:37 PM To: nanog@nanog.org Subject: 10G MetroE 1-2U Switch Hey Nanog, Looking for a new metroE Edge switch that has more that 10x 10G ports. I am having a hard time finding anything worthwhile without buying a full blown ASR9K Chassis or another vendor's chassis. Requirements MEF compliant 1-2U small foot print 10G Ports will be used for ENNI's and UNI Ports Prefer MPLS support for L2VPN's (EoMPLS and VPLS) QOS per Sub interface\vlan on a ENNI Cost effect 10G Ports 100G Not required Looking at the ASR920's - Great box for 1G but not enough 10G Ports Only 4 NCS5001/NCS5501 - New\unproven\probably buggy, Lacking some features & QOS issues :/ ASR900 - Looks good, but was hoping for a smaller foot print. If I remember right the 8x10G Cards can't go in every slot. Any other platforms I should be looking at? Ciena, Brocade, Juniper? Thanks in advance! -Erik ________________________________ CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you. ________________________________ CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.

Aaron, Do you know if the ACS5048 has any QOS limitations on this platform? Is each EVC on a ENNI able to have a separate QOS policy or is it port based? Just wondering how it would compare to the Cisco NCS5001\NCS5501 Thanks Erik Erik Sundberg Sr. Network Engineering Network Engineering Department p: 773.661.5532 c: 708.710.7419 e: esundberg@nitelusa.com Main: 888.450.2100 NOC 24/7: 866.892.0915 350 North Orleans Street, Suite 1300N Chicago, IL 60654 www.nitelusa.com Managed Telecom Services MPLS | Ethernet | Private Line | Internet | Voice | Security -----Original Message----- From: Aaron Gould [mailto:aaron1@gvtc.com] Sent: Friday, April 14, 2017 7:40 AM To: Erik Sundberg; nanog@nanog.org Subject: RE: 10G MetroE 1-2U Switch Yw Erik, also, since I'm fond/familiar with my newly deployed Juniper ACX5048's.... here's the MEF info...it's on there. https://www.mef.net/certification/equipment_details?company=001U0000007RJ6dI AG - Aaron ________________________________ CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.

Hi Erik, as a follow-up to this email from back in April...previously I hadn't yet tested any qos things on the ACX5048. Now I have tested some policing and seems to be working thus far in the lab. I am policing at the unit (subinterface) level to I can accomplish per-vlan/per-unit policers. I have 5 policers like this.... {master:0} agould@eng-lab-5048-2> show configuration firewall | display set | grep policer set firewall policer test-policer-1000 if-exceeding bandwidth-limit 100k set firewall policer test-policer-1000 if-exceeding burst-size-limit 3125 set firewall policer test-policer-1000 then discard set firewall policer test-policer-1001 if-exceeding bandwidth-limit 100k set firewall policer test-policer-1001 if-exceeding burst-size-limit 3125 set firewall policer test-policer-1001 then discard set firewall policer test-policer-1002 if-exceeding bandwidth-limit 100k set firewall policer test-policer-1002 if-exceeding burst-size-limit 3125 set firewall policer test-policer-1002 then discard set firewall policer test-policer-1003 if-exceeding bandwidth-limit 100k set firewall policer test-policer-1003 if-exceeding burst-size-limit 3125 set firewall policer test-policer-1003 then discard set firewall policer test-policer-1004 if-exceeding bandwidth-limit 100k set firewall policer test-policer-1004 if-exceeding burst-size-limit 3125 set firewall policer test-policer-1004 then discard {master:0} agould@eng-lab-5048-2> show configuration interfaces ge-0/0/19 | display set set interfaces ge-0/0/19 flexible-vlan-tagging set interfaces ge-0/0/19 mtu 9216 set interfaces ge-0/0/19 encapsulation flexible-ethernet-services set interfaces ge-0/0/19 unit 1000 description "TEST att mtso - tower 98 Drain 1 - vlan 1000" set interfaces ge-0/0/19 unit 1000 encapsulation vlan-vpls set interfaces ge-0/0/19 unit 1000 vlan-id 1000 set interfaces ge-0/0/19 unit 1000 input-vlan-map pop set interfaces ge-0/0/19 unit 1000 output-vlan-map push set interfaces ge-0/0/19 unit 1000 statistics set interfaces ge-0/0/19 unit 1000 family vpls policer input test-policer-1000 set interfaces ge-0/0/19 unit 1001 description "TEST att mtso - tower 99 Drain 1 - vlan 1001" set interfaces ge-0/0/19 unit 1001 encapsulation vlan-vpls set interfaces ge-0/0/19 unit 1001 vlan-id 1001 set interfaces ge-0/0/19 unit 1001 input-vlan-map pop set interfaces ge-0/0/19 unit 1001 output-vlan-map push set interfaces ge-0/0/19 unit 1001 statistics set interfaces ge-0/0/19 unit 1001 family vpls policer input test-policer-1001 set interfaces ge-0/0/19 unit 1002 description "TEST att mtso - tower 100 Drain 1 - vlan 1002" set interfaces ge-0/0/19 unit 1002 encapsulation vlan-vpls set interfaces ge-0/0/19 unit 1002 vlan-id 1002 set interfaces ge-0/0/19 unit 1002 input-vlan-map pop set interfaces ge-0/0/19 unit 1002 output-vlan-map push set interfaces ge-0/0/19 unit 1002 statistics set interfaces ge-0/0/19 unit 1002 family vpls policer input test-policer-1002 set interfaces ge-0/0/19 unit 1003 description "TEST att mtso - tower 101 Drain 1 - vlan 1003" set interfaces ge-0/0/19 unit 1003 encapsulation vlan-vpls set interfaces ge-0/0/19 unit 1003 vlan-id 1003 set interfaces ge-0/0/19 unit 1003 input-vlan-map pop set interfaces ge-0/0/19 unit 1003 output-vlan-map push set interfaces ge-0/0/19 unit 1003 statistics set interfaces ge-0/0/19 unit 1003 family vpls policer input test-policer-1003 set interfaces ge-0/0/19 unit 1004 description "TEST att mtso - tower 102 Drain 1 - vlan 1004" set interfaces ge-0/0/19 unit 1004 encapsulation vlan-vpls set interfaces ge-0/0/19 unit 1004 vlan-id 1004 set interfaces ge-0/0/19 unit 1004 input-vlan-map pop set interfaces ge-0/0/19 unit 1004 output-vlan-map push set interfaces ge-0/0/19 unit 1004 statistics set interfaces ge-0/0/19 unit 1004 family vpls policer input test-policer-1004 -----Original Message----- From: Erik Sundberg [mailto:ESundberg@nitelusa.com] Sent: Friday, April 14, 2017 10:30 AM To: Aaron Gould <aaron1@gvtc.com>; nanog@nanog.org Subject: RE: 10G MetroE 1-2U Switch Aaron, Do you know if the ACS5048 has any QOS limitations on this platform? Is each EVC on a ENNI able to have a separate QOS policy or is it port based? Just wondering how it would compare to the Cisco NCS5001\NCS5501 Thanks Erik Erik Sundberg Sr. Network Engineering Network Engineering Department p: 773.661.5532 c: 708.710.7419 e: esundberg@nitelusa.com Main: 888.450.2100 NOC 24/7: 866.892.0915 350 North Orleans Street, Suite 1300N Chicago, IL 60654 www.nitelusa.com Managed Telecom Services MPLS | Ethernet | Private Line | Internet | Voice | Security

Wow, 10 gig and 40 gig, mpls, etc, etc for $3,000 ?! Who is ZTE ? I usually try to stay with big names...Juniper, Cisco, etc... is ZTE well-known and reputable ? -Aaron

They are well known ! Are they reputable ? :) Regards Ge Dupin

Le 14 avr. 2017 à 14:53, Mike Hammett <nanog@ics-il.net> a écrit :

https://en.wikipedia.org/wiki/ZTE

Almost $12B in revenue in 2014, so not small.

----- Mike Hammett Intelligent Computing Solutions http://www.ics-il.com

Midwest-IX http://www.midwest-ix.com

----- Original Message -----

From: "Aaron Gould" <aaron1@gvtc.com> To: "Baldur Norddahl" <baldur.norddahl@gmail.com>, nanog@nanog.org Sent: Friday, April 14, 2017 7:45:58 AM Subject: RE: 10G MetroE 1-2U Switch

Wow, 10 gig and 40 gig, mpls, etc, etc for $3,000 ?! Who is ZTE ? I usually try to stay with big names...Juniper, Cisco, etc... is ZTE well-known and reputable ?

-Aaron