FCoE Multihop

Hi all

I am fairly new to the world of storage and now I'm working on the FCoE multihop test laboratory. I have a few questions that need to be clarified and some examples of caonfiguration that need to be corrected. I've also attached the logical topology for my lab. Here is the information on my topology:

  • Blue = line ethernet
  • Red line = CF
  • Green = line FCoE
  • 2xN5K with NXOS v5.xx
  • 1xFI 6120 with UCSM v2.1
  • NetApp FAS2200
  • I activated fcoe and npiv pn my 2xN5K function

What I want to do done VSAN (VSAN 360 and 361 VSAN) NetApp 2 and connect it to CF link to my 2xN5K as FC and then continue downstream, it my FI and UCS blade via link FCoE. Here are some questions I want to ask questions on:

  1. From what I read, we must separate FCoE traffic ethernet traffic in this scenario, that's why I use 2 FCoE links separated beside 2 ethernet (on vPC configuration) link, from 2N5K to FI. Is this true?
  2. To activate the FCoE, we map the VLAN-VSAN, and from what I've read, there are separate VLANS for this VLAN mapping VSAN that carries the normal ethernet traffic. Is this true?
    NB: I have 2 VLAN on blade UCS (260 and 261) and for this FCoE connectivity, I create 2 VLAN more (360 and 361) map to VSAN 360 and 361.
  3. This question have a link with #2--> from what I've read, the traffic of VLAN than carry FCoE traffic can not pass vPC link Peer, that's why I created different VLAN so that on vPC Peer link I can filter FCoE VLAN (VLAN 360 and 361). Is this true?
  4. By N5K links that are connected to the FI must be configured in F mode, what links that connect directly to NetApp (Interface type = CF)? On which mode is it?

I think that's all for now, I hope that you guys can guide me in this world of storage. I await your response. Thanks in advance.

Best regards

IJE

IJE Hello,

(1) Yes, you must use the uplink dedicated for FCoE when you use vPC between FI and N5K. If you do use VPC (IE FI has <---->N5K-== directly via the mode), you can use rising unified (FCoE + LAN) on the same physical links.

(2) Yes. You will use same ID VLAN-VSAN on FI and N5K to be part of the same fabric.

(3) Yes, don't allow VLAN FCoE links counterparts vPC.

(4) type port N5K connection FI and Netapp would be F

Please refer to the following doc

FCoE 5000 Nexus with attached FCoE UCS (Multi-Hop FCoE) Configuration example

http://www.Cisco.com/en/us/products/ps9670/products_configuration_example09186a0080c13e92.shtml

HTH

Padma

Tags: Cisco DataCenter

Similar Questions

  • FCoE Multihop EMC VNX 5300 to Cisco UCS FI / Series Blade B

    Hi all

    Having a performance problem with FCoE multihop of UCS.

    The presentation is as follows:

    UCS 5108 chassis--> 6248UP FI--> pair of N5k (5548)--> 10gig FCoE EMC VNX 5300 2 x 2 port card

    Everything is functional - I can't ping from tissues to the pwwn EMC n5k cf.

    I can see the paths in vmware on the vhbas everything is in place and active. The VMware is set to round robin and the side EMC ALUA 4.

    I'm at a loss on how to solve it more. The SAN is connected to the fabric with om3 fiber LC + 10 GB SR SFP. UCS has a pair separated from fcoe port fabric channels k 5 down to YEW (the help of twinax cables). The data are separated on its OWN virtual machine. Essentially, I followed the guide from cisco on how to proceed:

    http://www.Cisco.com/en/us/products/ps9670/products_configuration_example09186a0080c13e92.shtml

    The hosts are not boot from SAN for now, they are started from storage USB flash on the blade.

    The show on the 5ks flogi shows all connected, and as I said before, I can see the LUNS on the blades. When howerver I try uplod a file ISO DIS 2.5 GB in size in a data store takes about 2 ½ hours.

    I have the most recent UC 2.1 (2) a firmware installed. The N5ks have NX - OS 6.x. The blades have ESXi 5.1 with the latest drivers enet and installed cisco fnic.

    The default qos for n5k is configured.

    Any ideas would be greatly appreciated!

    -Nick

    Hi Nick,

    Interesting observation. We have an IP hsrp in catalyst 4500 as a router for network management with ip redirects on a reason any. I have disabled ip forwarding as well and currently I do 30K iops with fabric RR double active path and no error in the CPNI on esxi logs.

    I'll have to do additional tests to see the weather, that it is a coincidence or a fix, by activating the ip redirects again. But it looks promising.

    As my e/s load is done with the network management of e/s generator (http://labs.vmware.com/flings/io-analyzer) should have no effect on the routed network FCOE...  He latest even came to my mind to check network Ethernet side.

    Thank you Nick for a great tip.

    concerning

    Mikko

  • Performance issue with multiple jumps of FCoE

    At at - it implemented FCoE multihop on the new firmware 2.1? I moved my UCS lab he and storage performance stagnated. Here's what I have in my lab.

    2 nexus 5500 s - used for LAN and FC switch

    EMC CX4-120 - connected to the 5500 s Nexus 2

    UCS 6120/FEX 2104 - Pre-FCoE to installation has been a port-channel 2 SAN ports in every tissue of the Nexus 5ks.

    6 servers B200 M1

    ESXi 5

    I wired to the top a twinax addition on a fabric of interconnection to 5548 Nexus in FC fabric

    I wired to the top a twinax addition on interconnection fabric Nexus 5548 FC fabric b B

    Configured interfaces such as FCoE uplink in UCS

    Placed the FCoE interfaces in the proper VSAN

    A tissue at the same time, I have disabled port-channel SAN FC to force the vHBAs to connect to the uplink of FCoE. Didn't have any problems with this and vHBAs appeared in the table flogi to the couple of 5ks on the interface correct vfc.

    Reloaded my ESXi (SAN boot) hosts and guests restarted very well using uplink of FCoE to Nexus 5ks.

    When I turned on a virtual machine, it took more than 20 minutes for it to start and he was to the point where it was usable.

    No drops or errors on the FCoE interfaces or the fabric of interconnections vfc and Nexus 5ks.

    As soon as I have reactivated the CF port-channel SAN using 4 GB SFP modules and disable the performance of uplink FCoE was fine again.

    I hope that it is something to do with the older hardware of the generation 1 6100 s and the IOM s 2100 and not a bug.

    I have 2 other servers HP rack mount with CNAs Qlogic FCoE on the VMFS LUNS even without any problem.

    Case ID: 624922297

    The Nexus switches as well as technical support UCSM are attached.

  • Trouble seeing vhba of UCS on Nexus 5 k

    I have UCS > 6100 (a/b) > nexus 5 k (a / b) > emc vnx 5300.  I have two installed VSAN and my switch can see two ports on my vnx5300 with show flogi. However, my 5ks don't see the vhba on the ucs system. I have two vhba configured, a tissue in one and the other for fabric b. From now the nexus is connected to the 6100 as a port channel. Ports-channel is configured as a trunk. Now, this makes me think that this is where the vsan communication is a failure. The connection to the 6100 and nexus needs to be something more than a simple trunk?

    Dennis

    Dennis,

    I hope that you give on the Fiber Channel uplinks to your N5K and not Eth/FCoE (there no FCOE Multihop yet).

    Assuming that you have your 6100's with CF logs to your N5Ks and the N5K "npiv' enabled, you should see the flogi to your host vHBAs.

    The CLI of 6100 you can also 'connect nxos' and 'show flogi npv' which will show you the CF sessions between your 6100 and N5K - I find where you problem.

    All of your SAN connections would travel on the module of Fibre Channel 6100, up to Channel N5K Fiber module, then to your table.  You can always trunk and channel ports SAN your rising FC.  Just to confirm that this is what you did and not using uplink Ethernet to your N5K waiting to work.

    Can you provide a diagram or a detail the exact topology (Eth, FC etc)

    Kind regards

    Robert

  • Intel X 710 Ncdb FCOE support?

    Hello world

    Now I am installing system for my customer with Dell blade, in my server blade have an intel x 710 ncdb map, I can not set up fcoe for her, when I in the bios does not display CF, I can show only ethernet. Can you help me check x 710 ncdb support FCOE.

    I just looked through the technical card for this map, and I can't mention FCOE anywhere.

    http://Dell.to/2awQMY5

  • Then a Force10 MXL blade handle no FCoE traffic?

    Hello.  I inherit a M1000e with few blades of the Force10 MXL switch installed.  The chassis has no other 10GBASE-T switches.  Since I have no plans on using FCoE, a Force10 MXL can be used for standard Ethernet (non-FCoE) traffic?  Or do I have to buy another switch?

    Thank you.

    Absolutely, to see the second page of the data sheet. It contains additional information about the available modules, how internal traffic is manipulated and external.

    http://Dell.to/1Q5fUo9

    The manuals are a great place to start. There is that a starter guide to help set up initial, and then a CLI and user guide to help configure additional features.

    http://Dell.to/1IIq8r2

    Let us know if you have any other questions.

  • Reference Dell blade Intel X 710 the Ncdb FCOE support

    Now, I'm installing system on dell blade for my client, but when I configure the Intel X 710 Ncdb not to see the CF can show only Ethernet, anyone knows this FCOE support or not? Please help me!.

    Hello

    I show that the network version of the 710 X daughter card supports FCOE. There are versions of expansion card the X 710 that support other protocols and mezzanine, but the NDC version for systems not converged ethernet.

    http://www.Dell.com/learn/us/en/04/business~large-business~en/documents~Intel-x710-dual-or-Quad-Port-10-GbE-BNDC-can.PDF

    Thank you

  • Start from the Port of FCoE storage

    If I directly attach an array of NetApp fabric using new storage interconnection FCoE ports, the blades allows SAN boot in this scenario?

    Simon,

    It shouldn't be a problem with that.  Assuming the initators can achieve the goal of direct attach, you should be able to SAN start your blades.  I did not set it up myself, but in theory there should be nothing preventing it.

    Kind regards

    Robert

  • Topology of Nexus 5 k / FCoE extending between 2 campus

    Hello

    I need help to answer the following questions related to the interconnection of 2 campuses (top and bottom in the attached diagram) using the ports of FCoE Nexus 5 K:

    Please check the attached topology.

    QUESTIONS RELATING TO THE:

    Multi-hop FCoE:

    ·         The link (10G, SFP +) between pairs of N5k, interconnecting 2 campuses, carry FCoE traffic (Ethernet and FC on the same link):

    ·         Can servers with the adapters of the ANC in the lower Campus, store access the CF in the upper Campus?

    ·         Can the server with HBA FC adapters in the lower Campus, store access the CF in the upper Campus?

    ·         Can expand us the tissue 2fc between the 2 sites using this link of FCoE?

    ·         This link can carry the traffic of Ethernet between 2 LANs (between Upper and Lower campus)

    Thank you.

    It is therefore 3km for FCoE traffic. "but in the case of traffic FC (via FCoE)(, ce que je veux dire si nous avons deles de serveurs avec deles de adaptateurs HBA FC dans le Campus inférieur, accès àle stockage FC dans le Campus supérieur) binding, is it always 3 km limitation? or less?

    -> 3 km, independent how the initiators and targets are connected. (Limitation is for a single jump of FCoe)

    About using the native CF option to extend this link (of course withouth ethernet), to go for an MDS switch? or module of the simple use of the CF to the Nexus 5 k 2?

    -> You can do it directly using CF Module if you run the N5K in switching mode (not in NPV Mode)

    do you have a referral link, mentioning these distances?

    -> Sorry I also had this information via Cisco SE

    Hubert

  • Connect FI two directly attach FCoE storage and SAN switches

    Nobody tells me if I can connect FI two directly attach FCoE and SAN storage switches also, as you can see in the diagram of connected network?

    If so, should I FC Switch function Mode? Any concerns should I consider?

    Or the best solution would be appreciated. Thanks in advance.

    The UCS will be in Switch Mode FC, which means that it has a default area.  We cannot make a Zone merge with Brocade because we have no control to set up specific items such as domain and other articles CF IDS that need to be changed when you connect a Cisco FC switch to a Brocade.

    Usually in this situation with a 5 k or a MDS you might be placed in mode of interoperability, which changes the default settings and we will talk to them together - in this case, you can't change these settings, so the only supported configuration is CF Cisco at Cisco.

    See you soon,.

    Greg Scarlett.

  • 6200 FCoE in the direction of the North

    I have a quick question that I have not been able to get a definitive right answer to (in literature)-regarding the new 6200 FI and FCoE in the direction of the North...

    Anyway, my question: with the function UP on the 6200 (with UCS 2.0) - can we now do FCoE in the north direction (in this case a nexus 5548UP)? Or do we still need out in separate eth and FC rising?

    I see of the configuration Guide, we can configure ports such as FCoE ports - and options for eth uplinks and CF uplinks are still there too. I was not able to determine if the FCoE port type can be used for uplink.

    Thanks in advance!

    Hi Daniel,.

    * You can always northbound FCoE connectivity of the UCS YEW which in your case, you can not uplink between 62xx FCoE and the 5548UP.

    * You must always have seprate FC rising and uplinks Eth.

    * The feature to have FCoE uplink will be available in a future release (on request at the end of the year).

    * the FCoE ports that you see are to use when you want to direct fix storage of FCoE for FI (limited support model).

    I hope this helps!

    . / Afonso

  • FCoE directly connect to VNX5300 with no switch zoning

    I was wondering if anyone has any experience with this unit or a similar facility. I find no decent documentation to help us decide if it is a legitimate set upward for a production of about 16 servers 3 chassis environment. Our expert Cisco has ever put up a UCS environment with a direct connection to the San via FCoE and intuitively is against it, as we do not expect to use a switch to zoning.  Is there a real risk in the present? It will support in the future?

    Hi Henry,.

    If you look at the following document:

    http://www.Cisco.com/en/us/docs/switches/Datacenter/MDS9000/interoperability/matrix/Matrix8.html

    See point number 3, the direct model to support tethering still requires a SDM or N5k upstream to provide this information.

    . / Afonso

  • FCoE storage direct connect in 1.4?

    Hi all

    I see the previous discussions that UCSM 1.4 should introduce support for stare directly into a Bay in the 6100 FC storage s. What is FCoE? A storage array with a frontal FCoE card (the new controller Compellent series 40 in particular) will be able to connect directly to the 6100 s?

    See you soon,.

    Simon

    Hi Simon,.

    Yes, in version 1.4, we will be able to connect FCoE targets to the Ethernet ports of the interconnection of fabric FC switch mode (61XX).

    Thank you

    ÖZDEN

  • FCOE-basic questions

    My understanding is that the traffic from the blades in the chassis or a rack of series C contains FCOE and Ethernet frames.

    But what about the traffic of a UTA Netapp? Glancing at the NExus switch configuration, it seems that all the ports in use are Ethernet ports. then we configure the FCOE ports on the Ethernet ports for FCOE traffic top. Like this:

    interface vfc7
    link interface Ethernet1/7
    no downtime

    interface vfc8
    link interface Ethernet1/8
    no downtime

    But what about traffic from UTA? It does not contain both types, and then only a single protocol to disappear on the port? Or what is happening here? I think I know a UTA 2 ports map can contain 2-port of FCOE and IP, IE. 4 ports altogether.

    Someone has a document explaining the UTA and FCOE?

    UTA will use FC IP addresses and at the same time that each port.  It's a similar logic to the way the N5K works for the last 5 years.

    Yes, a Nexus 5 K port can understand two FCoE & Ethernet at the same time.  This is the basis for the Consolidation of IO with the nexus platform.  On the side of 5 K, all Ethernet traffic is received and changed accordingly.  For FCoE, packets are received, the package of FCoE is encapsulated off and pure CF payload within the FCoE package framework is then logically received on the VFC interface associated with the physical interface of N5K.  FC traffic is so forward as usual on the switch.

    Robert

  • UCS/Nexus and FCoE Question

    Hi all:

    Can we connect a FCoE target directly to an interconnection of fabric or a Nexus 5xxx CWF in NPV mode and not connected to an FC switch for power and tissue services continue to have the initiator see the target and be able to supply storage as a result?

    Thus, the scenario would be the following:

    a server rack with an ANC connected to a Nexus 5xxx CWF in NPV mode

    OR

    a server blade a NON related to interconnection of UCS fabric (which is also a CWF) in VAN mode

    AND

    In the above cases, there is NO CONNECTION between the RTC and an FC switch.

    I will be able to have the ANC (FCoE initiator) see table of Strorage (FCoE target)?

    Thank you

    Hello

    Yes you are right. For the direct-attached storage work, you need the FI in FC switch mode. Your explanation is good and you can not storage direct-attached mode/npv end FC host mode. With FI in npv mode, it can just transfer CF applications to an NPIV switch and cannot process any request CF as FLOGI etc...

    In addition, in the UCS versions under 2.1 you need a SAN switch connected to a FI running in mode switching and storage directly connected to it, which can push the FI database zoning. Thanks to 2.1, you can have storage direct-attached without the need for any SAN switch upstream as we have zoning capabilities in UCS now.

    In short, for all direct-attached storage, you must have FI FC Switching mode.

    -Ganesh

Maybe you are looking for