Howard Goldstein Associates, Inc.

Business, Technology & Education.

Course Title: Storage Networking Fibre Channel Technologies & Topologies

 

Vendor: Howard Goldstein Associates, Inc.        

Email: Howard.Goldstein@HGAI.Com

 

Locations: Private classes available.                   Phone: 303-554-0755

 

Duration: 5-Days

 

Type: Lecture/Demo       Course URL: www.hgai.com

 

Course Description / Overview / Expected Outcome:

 

This course presents a complete examination of Fibre Channel Technologies and Topologies.  It begins with a look at server to storage high performance I/O interface environment and requirements and how Fibre Channel addresses those needs.  It describes in detail the Fibre Channel Architecture and Standards.  It explains the functions and features of Fibre Channel and the “Why’s and How’s” of this Storage Network technology.  It focuses on gigabit rates, extended distance and port consolidation opportunities.  This course presents the inner workings of the Host Bus and Storage Adaptors as well as the interconnection devices switches, directors, and gateways that help implement a SAN.  Fibre Channel is the most pervasive technology used in external and internal SANs finding a home as a basis for customer SANs connecting Servers and Storage Controllers as well as being deployed in disk arrays and tape controllers.

 

This course then presents a detailed look at the Fibre Channel Topologies.  It examines Point-to-Point Direct Attached Storage as well as Fibre Channel Arbitrated Loop and Fibre Channel Switched Fabric implementations.  It examines where these topologies are used and how they can be leveraged to provide maximum benefits and maximum utilization.  It describes in detail how Fibre Channel works in these environments.  The course brings you through Loop and Fabric concepts and protocols.  You will analyze traces and review helpful animations for Fibre Channel Technologies.

 

Course Objectives:

 

Identify what Fibre Channel is and how it relates to Storage Networking

 

Explore the many topologies and the underlying technologies and protocols that can be used in storage networks including Point-to-Point, Arbitrated Loop and Switched Fabric and the trade offs in cost/benefit where these topologies can be applied today.

 

Demystify the controversy surrounding Storage Networking’s protocol wars between Fibre Channel and IP-based storage and finally understand the differences between them and the vendor products.

 

Explore the Fibre Channel technology and understand the underlying concepts behind a Fibre Channel SAN

 

Define (or match with the correct definition) key Fibre Channel terms and terminology

 

Identify the five different functional levels of Fibre Channel and list the key functions associated with each level

 

Identify key Fibre Channel functional capabilities such as speed, distance, connectivity, etc.

 

Identify the key differences between optical fiber and electrical cabling

 

Identify the principal fields within the Fibre Channel frame header and define the main function(s) of each field

 

Describe (or identify) the Fibre Channel mechanisms used to manage operations and the transfer of information

 

Describe the Fibre Channel flow control mechanisms and state why flow control is important

 

Identify and describe the different Fibre Channel Classes-of-Service, list the principal characteristics of each, and identify which class-of-service is most widely used and why

 

State the differences between Fibre Channel Link Services and Upper-Level protocols and give at least one example of an operation associated with each

 

Examine a Fibre Channel trace of a SCSI command and identify each frame used during the command and key information present in each frame, including the CDB, data, and SCSI status byte

 

Locate additional resources to assist in further understanding the Fibre Channel technology

 

Understand key Fibre Channel terms and terminology

 

Identify key characteristics of the Point-to-Point, Arbitrated Loop, and Switched Fabric topologies and identify applications suitable for each topology from a list of different applications

 

Describe the difference between Public Loops and Private Loops and Public Loop Devices and Private Loop Devices. Identify at least three differences between Public Loop Devices and Private Loop Devices.

 

Identify and describe the operation and function of each of the Arbitrated Loop protocols including:

 

•Loop Initialization and Address assignment

•Arbitration and Access Fairness

•Opening and Closing loop circuits

•Buffer-to-Buffer flow control

 

Examine a Fibre Channel trace of Loop Initialization and identify the function and content of each of the Frames and Ordered Sets

 

Examine a Fibre Channel trace of normal Arbitrated Loop operations and identify and describe each of the loop protocols

 

Identify (or describe) the key factors affecting Arbitrated Loop performance such as the addition of more ports to the loop or the effect of longer interconnecting cables. Also identify factors within the design of an arbitrated loop port that may affect performance of the loop

 

Describe the function and applications of an Arbitrated Loop hub. Describe the difference between a hub and a switch

 

Describe strategies for making the loop suitable for high-availability environments

 

Locate additional resources to assist in further understanding the Fibre Channel Arbitrated Loop Topology

 

Define (or match with the correct definition) key Switched Fabric terms and terminology.

 

Identify key characteristics of the Point-to-Point, Arbitrated Loop, and Switched Fabric topologies and identify applications suitable for each topology from a list of different applications.

 

Identify and describe the operation and function of each of the Fibre Channel Switched Fabric protocols, including:

 

Switch Port Initialization

•Switch Port mode determination

•Principal Switch Selection

•Switch addressing and address assignment

•Fabric Shortest Path First (FSPF) protocol

•Path Computation and Selection

 

Identify key requirements placed on a switch by the different classes-of-service

 

Describe at least two implementations of switching constructs that can be used within a Fibre Channel Switch.

 

Describe how a switched fabric can preserve the delivery order of frames in a multi-switch environment.

 

Describe at least one strategy for distributing traffic across multiple equal-cost paths

 

Examine a Fibre Channel trace of an ISL initialization and identify the function and content of each of the Frames and Ordered Sets

 

Given a Fibre Channel trace of an operation using the Fibre Channel Common Transport (FC-CT) Protocol, identify and interpret key fields in the Fibre Channel frame header and FC-CT preamble

 

Identify and describe the primary functions of the Name Server and Management Server

 

Given a Fibre Channel trace of an operation involving the Name Server, identify and interpret the operation being performed

 

Identify other well-known services and describe where to find additional information about those services

 

Locate additional resources to assist in further understanding the Fibre Channel Switched Fabric Topology

 

Who Should Attend:

 

· This course is targeted towards anyone who designs, implements, manages, specifies or selects Storage Networking technologies.

· This includes IS/IT technical staff, product developers, systems integrators, systems engineers and technical marketing personnel.

· Anyone who wants to understand more about storage networking Fibre Channel Technologies and Topologies.

· This course is designed to provide technical IT staff a comprehensive understanding of Fibre Channel.

· Product and project teams that are involved with applications, systems, storage and end users will benefit from this course.

· Developers, integrators, engineers, administrators, managers, marketing personnel and others with a need for an understanding of Storage Networking will find this course extremely informative.

· Anyone involved in storage or data communications networking will understand the similarities and differences between these environments and will be in position to take on the challenges introduced by Storage Networking Fibre Channel.

 

Prerequisites:

 

An understanding of current computer interfaces or networks is desirable, although not absolutely necessary.

 

What’s exciting about it, why it’s important, where it’s going:

 

· It provides a one-of-a-kind tutorial with an industry subject matter expert who has real-world experience and superior presentation skills

· It provides a vendor-neutral view of storage networking with a focus leveraging your investment in network infrastructure, existing and future storage and server assets using Fibre Channel

· It separates the myth from reality of the various storage networking solutions and technologies

· It explains the technical differences between Fibre Channel and IP Storage and when to use these technologies

· It puts you in position to understand what Fibre Channel storage networks can and cannot do for you

· It will make you more knowledgeable in dealing with the plethora of vendors of storage networking Fibre Channel products and services

· It takes a “network” view of Fibre Channel storage networks yet identifies how Fibre Channel storage networks differ fundamentally from other data networks like the Internet

It takes complex Fibre Channel storage networking topics and breaks them down in a simple, easy-to-understand way

 

Course Outline Overview:

 

Fibre Channel Technologies

 

Storage Networking Overview

Fibre Channel (FC) Introduction

Fibre Channel Standards

FC Level 0 Physical Interface

· Fiber

· Copper

FC Speed Negotiation

FC Level 1

· 8B10B Encode/Decode

· Ordered Sets

· Link Level Control

1, 2, 4, 10 Gigabit Fibre Channel

Fibre Channel Level 2

· Sessions

· Exchanges

· Sequences

· Frames

· Flow Control

· Class of Service

· Error Policy

· Link Control Frames

· Acknowledgement

Error Detection & Recovery

Basic Link Services

Extended Link Service

Session Management

· Fabric Login FLOGI

· Port Login PLOGI

· Process Login PRLI

State Change Notification

Fibre Channel Names

· World-Wide Node Name WWNN

World-Wide Port Name WWPN

Fibre Channel Services

· Generic Services

· Well-Known Addresses

· Distributed Services

Name Services

Fibre Channel Topologies

· Point-to-Point

· Arbitrated Loop

· Fabric

Fibre Channel Addressing

FC Level 4

· SCSI-3 FCP2

· SCSI over FC

· Enhanced Recovery

IP over FC IPFC

 

 

Fibre Channel Topologies

 

Fibre Channel: Arbitrated Loop FC-AL

 

· Overview

· Concepts

· Ordered Sets

· Loop Port State Machine

· Loop Initialization

· ALPA

· LISM, LIFA, LIPA, LIHA, LISA, LILP, LIRP, Close

· States

o Monitoring

o Arbitration & Fairness

o Flow Control

o Open a Loop Circuit

o Closing a Loop Circuit

o Frame Transmission

o SCSI FCP Commands

o Loop Performance

o Errors

o Hubs and Switching Hubs (Loop Switches)

o High Availability Loops

PLDA Technical Reports

 

Fibre Channel Switched Fabric

 

· Fabric Introduction

· Fabric Concepts

· Fabric Addresses

· Fabric Internal Concepts

· Node Port Initialization

· Inter-Switch Link Initialization ISL

· Principal Switch Selection

· Fabric Shortest Path First FSPF

· Path Selection

· Switching Constructs

· Distributed Service

· Zoning

o Hard

o Soft

o VSANs

o Directory Services

o Management Services

o Fabric Design

o High Availability Fabrics

o Timers and Errors Conditions

o Beyond Campus Fabrics

Fabric Management

Fibre Channel Futures

Course Summary

 


Course Outline Detail:

 

Fibre Channel Technologies

 

A.  Fibre Channel Introduction

 

Direct Attach Storage (DAS)

Network Attached Storage (NAS)

Storage Area Network (SAN)

SAN Attached Storage

The Fibre Channel Network

Fibre Channel Node

Example Fibre Channel Network

Nodes

Device Ports

Switch Ports

World Wide (Port & Node) Names

Node Port (N_Port/NL_Port)

Fibre Channel Node Port

Node Port (N_Port/NL_Port)

Serial Data Transmission

Multiple Media Options

Session Management

Sessions - Login

Login Session

Fibre Channel Levels

Transaction Management

Fibre Channel Exchange

Exchange Multiplexing

Information Units

Sequence

Fibre Channel Sequence

Fibre Channel Frame

Addressing and Topologies

Fibre Channel Topologies

Fibre Channel Addressing

Fibre Channel Addressing: 121 to 332

Access Control

Fibre Channel Zoning

Authentication and Security

 
B.  Fibre Channel Standards

 

Fibre Channel Standards

FC Physical and Signaling

Protocol Mappings

Fibre Channel Topologies

Fibre Channel Generic Services

Fibre Channel Document Structure

 

C.  FC-0 Concepts

 

Fibre Channel Level 0 (FC-0)

FC-0 Physical Interface

Fibre Channel Campus Wiring

Common Physical Variants

Link Control Facility

Link Control Facility

Physical Variants

Physical Variant Identification

Gigabit Interface Connector (GBIC)

Small Form Factor Pluggable (SFP)

Media Interface Adapter (MIA)

Gigabit Link Module (GLM)

Signal Characteristics

Idealized Signal Characteristics

The "Eye" Diagram

Eye Diagram

Bit-Error Rate Reporting

Bit-Error Rate Measurement

 

Fiber Optic Links

 

Fiber Optic Links

Fiber Optic Data Transmission

Fiber Optic Data Transmission

Optical Fiber

Optical Transmitters

Single-Mode Fiber

Multimode Fiber

Modal Dispersion

Single-Mode vs. Multimode

Optical Connectors

Small Form Factor Connectors

Optical Connectors

Open Fiber Control (OFC)


Electrical Links

 

Electrical Links

Single-Ended Link

Differential Link

Coupling and Equalization

Electrical Connectors

Electrical Connectors

SCA-2 40-Pin Disk Connector

RFI and EMI


Speed Negotiation

 

Speed Negotiation Objectives

Signal Criteria

Signal Detection

Wait for Signal Flowchart

Wait for Signal Receive Sampling

Negotiate Master

Negotiate Master Flow

Negotiate Master

Negotiate Follow

Negotiate Follow Flowchart

Slow Wait

Slow Wait Procedure

Slow Wait Flowchart

 

D.  FC-1 Concepts

 

Fibre Channel Level 1 (FC-1)

FC-1 Functions

8b/10b Encoding

Ordered Sets

Link-Level Protocols

 

8b/10b Encoding and Decoding

 

Bits, Bytes, and Words

Bit, Byte, and Word Structure

Why Encode the Data?

Special Characters

8b/10b Notation

Running Disparity

Disparity Error Detection

Encoding and Decoding

8B/10B Encoder

Bit and Byte Transmission Order

SOF/EOF Problem

 

Ordered Sets

 

Transmission Words

Transmission Word Hierarchy

Frame Delimiters

Primitive Signals

Fill Words - IDLE

Clock Elasticity

Receiver Ready (R_RDY)

Loop Primitive Signals

Virtual Circuit Ready

Primitive Sequences

Loop Primitive Sequences

Transmission Word Trace


Port State Machine and Link Control Facility

 

Link Control Facility

Serializing the Data Stream

Port State Machine (PSM)

Port State Machine

Link Reset Protocol

Link Initialization Protocol

Link Failure Protocol

Link Error Status Block


10-Gigabit Fibre Channel

 

10GFC Highlights

10-Gigabit Fibre Channel Structure

Four-Lane Interfaces

Wavelength Division Multiplexing

Single-Lane Interfaces

64-Bit Block Scrambler

64-Bit Block Descrambler

10GFC Internal Interfaces

XGMII

XGMII Interface

XAUI

XGMII + XAUI Interface

XAUI Synchronization

XAUI Inter-Lane Skew

XAUI Inter-Lane Skew

XAUI Deskew Column Alignment

XAUI Clock Elasticity

Idle Stream Randomization

XAUI Idle Stream Randomizer

XAUI Primitives

XAUI Primitive Signal Transmission

XAUI Primitive Sequence Begin

XAUI Primitive Sequence Changes

XAUI Primitive Sequence Ends

 

E.  FC-2 Concepts

 

Fibre Channel Level 2 (FC-2)

FC-2 Scope

Exchange, Sequence, and Frame

Session Management

The Exchange

The Sequence

FC-2 Service Interface

Information Unit

The Frame

Flow Control

Levels of Flow Control

Flow Control

Classes of Service

 

Exchange Management

 

Exchange

Exchange Identification

Originator Exchange_ID

Responder Exchange_ID

Fibre Channel Exchange

Exchange Multiplexing

Exchange Multiplexing

OX_ID/RX_ID and Multiplexing

Exchange Origination

Sequence Initiative

Exchange Flow Diagram

Mixing Classes of Service

Error Recovery Boundary

Exchange Error Policies


Sequence Management

Segmentation/Reassembly

Segmentation and Reassembly

Sequence Identification

Frame Multiplexing

Sequence Count

Streamed Sequences

Frame Transmission Rules

Sequence Completion


Frame Structure

 

Frames

Fibre Channel Frame

Start-of-Frame Delimiter

Frame Header

Routing Control (R_CTL)

Addresses (D_ID/S_ID)

Class-Specific Control (CS_CTL)

Type Field

Frame Control (F_CTL)

Sequence_ID (SEQ_ID)

Data Field Control (DF_CTL)

Sequence Count (SEQ_CNT)

Exchange_ID (OX_ID, RX_ID)

Parameter Field (PARM)

Frame Data Field

Data Field Contents

Optional Headers

Network Header

Association Header

Process Associator

Operation Associator

Device Header

CRC

End-of-Frame

FC-2 Data Rate Calculation


Link Control Frames

 

Link Control Frames

Acknowledge (ACK)

ACK Policies

ACK_1 Operation

ACK_0 Operation

ACK Generation

Reject (P_RJT or F_RJT)

Fabric/Port Busy (F_BSY/P_BSY)

 

Flow Control

 

Transmit and Receive Buffers

Credit

Obtaining Credit

Credit and Frame Streaming

Credit and Long Links

Frame Transmission and Credit

Timing Example for Credit=1

Credit Computation

Buffer Memory Computation

Estimate Credit Procedure

Estimate Credit Procedure

Buffer-to-Buffer Flow Control

Topology Dependencies

Alternate BB_Credit

BB_Credit Recovery

Virtual Circuit Flow Control

End-to-End Credit

Flow Control

 

Classes of Service

 

Class of Service Comparison

Class-1

Class-1 Connection

Class-1 Connection Setup

Class-1 (continued)

Class-1 Service with Intermix

Class-1 Connection with Intermix

Stacked Connect Requests

Class-1 Stacked Connect Requests

Class-6

Class-1/6 Priority and Preemption

Class-2

Class-2/3 Frame Multiplexing

Class-2 (continued)

Class-2 Operation

Class-3

Class-3 (continued)

Class-3 Operation

Class-2/3 Priority and Preemption

Class-4

Class-4 Virtual Circuits

Class-4 (continued)

Class-4 Circuit Setup

Class-4 Virtual Circuit Setup

Circuit Deactivation/Removal

 

Error Detection and Recovery

 

Timers

FC-0/1 Errors

Link-Level Errors

FC-2 Sequence Errors

Invalid Frame Conditions

Sequence Errors

Exchange Error Policy

Class-3 Errors

Exchange Errors


F.  Link Services

 

Basic Link Services

 

Link Services

Basic Link Services

No Operation (NOP)

Abort Sequence (ABTS)

Abort Sequence-Last Sequence

Remove Connection (RMC)

Preempted (PRMT)


Extended Link Services

 

ELS Protocol

ELS Commands - General

ELS Commands - General

ELS Commands - Services


G.  Fibre Channel Session Management

 

Session Management

Fibre Channel Logins

Fabric Login (FLOGI)

N_Port Login (PLOGI)

Process Login (PRLI)

State Change Notification

H.  Fibre Channel Names

 

Name Uniqueness

IEEE 48-Bit MAC Address Format

IEEE Name (Format 1)

IEEE Extended Name (Format 2)

IEEE Registered Name (Format 5)

 

I.  Login Service Parameters

 

Service Parameters

Login Request and LS_ACC Reply

Common Service Parameters

Class-Specific Parameters

Class-Specific Service Parameters

 

Fabric Login Session Management

 

Fabric Login (FLOGI)

FLOGI Flowchart

Fabric Address Notification (FAN)

Fabric Discover (FDISC)


N_Port Login Session Management

 

N_Port Login (PLOGI)

PLOGI Flowchart

Logout (LOGO)

Port Discover (PDISC)


Process Login

 

Process Login (PRLI)

Process Logout (PRLO)

Test Process Login State (TPLS)

Third-Party Process Logout


Registered State Change Notification

 

State Change Notification

State Change Registration (SCR)

Registered State Change Notification

RSCN Formats (Formats 3, 2, 1)

RSCN Formats (Format 0)

Criteria to Receive RSCN (part 1)

Criteria to Receive RSCN (part 2)

 


J.  Fibre Channel Services

 

Generic Services

Well-Known Addresses

Distributed Services

Common Transport Protocol

Common Transport (FC-CT)

Broadcast

Fabric Login Server

Fabric Controller

Directory Server

Register FC-4 Types

Time Server

Management Server

Quality of Service Facilitator (QoSF)

Alias Server

Alias Server Create Group

Key Distribution Server

Clock Synchronization Server

Multicast Server

Reliable Multicast (Class-6)

 

K.  Topologies

 

Fibre Channel Topologies

Public Arbitrated Loop

Common Characteristics

Topology Comparison Table

Addressing

Address Assignment


Point-to-Point

 

Point-to-Point Topology

Two Point-to-Point Topologies

Point-to-Point Topology


Arbitrated Loop

 

Arbitrated Loop Topology

Arbitrated Loop Physical Address

Arbitrated Loop Protocols

Loop Port State Machine

Loop Initialization

Open Initialize State

Arbitration

Opening a Loop Circuit

Closing a Loop Circuit

Closing Protocol

Transfer

Access Fairness

Loop Availability

Arbitrated Loop Hubs

Arbitrated Loop with Hub


Fibre Channel Fabric

 

Fabric Topology

Fabric Port (F_Port/FL_Port)

Fabric Ports and Routing

Fabric Controller

Communication Modes

Connection-Oriented Modes

Connection-Oriented Modes

Dedicated Connection

Virtual Circuits

Connectionless Mode

Frame Multiplexing

Mixed-Mode Operation

Fabric Connection with Intermix

Frame Routing

Crossbar Switch

Eight-Ported Crossbar Switch

Crossbar Switch

Routing Through a Crossbar Switch

Multicast in a Crossbar Switch

 

                          Next Page