PCIe & NVMe and/or NVMe Over Fabrics Combination Seminar (4.5 Days)

Curley(126x152)$1,995 – PCIe (2 Day Endpoint Course) plus NVMe (1 Day) or NVMe Over Fabrics (1 Day) Combination Seminar (4 Days Total): This 4 Day seminar will include our PCIe 2 Day Endpoint course plus either NVMe or NVMe Over Fabrics. See descriptions below:

$1,795 –PCIe (2 Day Endpoint Course) plus NVMe: KnowledgeTek has enhanced and customized their PCI Express training course to meet your needs. Our 2-day Endpoint course covers the needs of people designing, manufacturing, testing, selling or servicing PCIe Endpoint or devices. System Level material has been removed and the Endpoint material expanded. Following a description of the operation, the subjects are shown instructor-led demonstrations.

$1,395 – NVMe (1.5 Day): NVMe has been designed from the ground up to match the advantage of SSD with the speed and availability of PCIe. It is built on the proven and efficient PCIe interface by engineers and architects familiar with both storage and PCIe. Sign-up today for a public or on-site seminar!

$1,395 – NVMe Over Fabrics (1 Day) – Included in this new course will be an Overview, information about RDMA, Ethernet with iWARP or RoCE, Infiniband, and Fibre Channel.

KnowledgeTek is pleased to announce that our NVMe includes the definitive textbook concerning this interface. This material is provided at no cost to the attendees. This book is in addition to the usual KnowledgeTek training manual and our PCIe/NVMe reference manual.

PCle OVERVIEW
PCI and PCI-X (why PCIe is designed as it is)
Speeds and Loads
Transaction Types
PCIe TerminologyADDRESSING
ID Routing
32-bit and 64-bit memory addressing
Implicit AddressingINTERRUPTS
Pin-based
MSI
MSI-X

CONFIGURATION SPACE
Header
Type 0 in-depth
Type 1 overview
Capability Structures
PCIe Extended Capability Structures

PCIe LAYERS
Transaction Layer
Packets (TLP)
Transactions
ARl
Atomic Operations
Processing Hints
Prefixes
Header Fields
End-to-End CRC
Data Link Layer Packets
Sequence Number
Link CRC

PHYSICAL LAYER
Transmitter Logic
8b/10b Encoding
K-Codes
Ordered Sets
Scrambling
128b/130b Encoding
Tokens
Ordered Sets
Lane Multiplexing
Lane De-skewing
Receive Logic
Clock Recovery
Elasticity Buffer

FLOW CONTROL
ACK/NAK Protocol
Errors
Malformed TLP
Poisoned TLP
Fatal Errors
Non-Fatal Errors
Correctable Errors

ENDPOINT RESET-

ENDPOINT INITIALIZATION

POWER MANAGEMENT

INITIALIZATION
Discovery
Enumeration

SR-IOV

PEER-TO-PEER TRANSFERS

BRIDGES, SWITCHES AND TYPE 1
CONIFURATION SPACE

QUALITY OF SERVICE
Virtual Channels and Traffic Classes
Relaxed Ordering
ID-Based Ordering

ADDRESS TRANSLATION SERVICES

ACCESS CONTROL

MULTI-CAST

_______________________________

NVMe (Regular 1 Day course)
NVMe OVERVIEW
What is NVMe
How NVMe works
Queues
Arbitration
Namespaces
Doorbell
Power States

PCIe BASICS
PCI/PCIe Concepts
Configurations Headers
Addressing
Topology Discovery and Enumeration
PCI Transactions
TLP
DLLP
Ordered Sets

NVMe REGISTERS
NVMe Registers
Creating Admin Queues

COMMAND/STATUS FORMATS
Common Command Fields
Scatter-Gather Lists
Physical Region Page
Status
Interrupts
MSI
MSI-X
INTx

ADMIN COMMANDS
Admin Command Format
I/O Queue Management
NVMe Identity Command
Get/Set Features
NVMe Specific Commands
Other Admin Commands

NVMe COMMANDS
NVMe Command Format
Write Command
Read Command

TRANSLATING SCSI COMMANDS
Mapping SCSI Commands
SCSI Read Command
SCSI Write Command
SCSI Request Sense Command
SCSI Inquiry Command
Vital Product Pages
Mapping SCSI Task Management Functions

_________________________________

 ORNVMe Over Fabrics (1 Day course)
Overview
What are Fabrics?
What is Mapping/Binding?
Why create NVMe over Fabrics?
What is Channel I/O vs. Memory I/O
Messages vs. Shared Memory
Differences & Similarities between
NVMe over PCIe & NVMe over Fabrics
Encapsulation
Fabrics Commands & Responses
Connection Parameters
Properties Definitions
Discovery Controller
Authentication
Transport Requirements specified by NVMe

RDMA
What is RDMA?
How RDMA operates
Benefits of RDMA
Zero Copy
OS Bypass
Detail of RDMA defined by IETF
Reliable/Unreliable Connection/Datagram
RDMA queue pairs with NVMe host & target
Verbs
RDMA operations

ETHERNET with iWARP or RoCE
Ethernet is ubiquitous and high-speed making it an idea
candidate for any new transport protocol. However, Ethernet is
not designed to use RDMA, so two competing protocols have
been developed to add RDMA to Ethernet. This presentation
will provide the attendee a non-biased understanding of
how they both work.

Overview of Ethernet
Addressing: Domain Name, IP, and MAC
Ethernet Layers: Levels 1 through 4
Packet Formats

iWARP to add RDMA
What is iWARP?
Solving Ethernet problems with iWARP
Commands & Responses via messages
Data via RDMA
iWARP layers added to TCP/IP
RDMAP, DDP, & MPA
L4 offload (TOE)
TCP packet with iWARP heaaders
Using DDP: differentiating between
Data Delivery & Data Placement

RoCE to add RDMA
What is Convergent Ethernet?
RoCE V1
RoCE V2
RoCE headers
RoCE vs. InfiniBand
RoCE vs. iWARP
Flow Control with RoCE
Soft RoCE>

InfiniBand
InfiniBand is an environment ideally suited for the speed and protocol of SSDs and NVMe. It is used primarily in High Performance Computing where the transfer of large files of data between computers or between computers and storage arrays is time critical. To this end InfiniBand was designed to use RDMA.

Outline
Where is InfiniBand used?
Requirements to operate in
High Performance Computing
Why RDMA is required
Detail of InfiniBand
Example Topology
Virtual Lanes
Send messages
RDMA writes & reads
InfiniBand Packet Format
InfiniBand Keys
Flow Control
Encoding: 8b/10b, 64b/66b, 256b/257b
Cable widths
Speeds: SDR, DDR, QDR, FDR, EDR, HDR, NDR
InfiniBand Discovery
Components
HCA
TCA
Routers & Gateways

Fibre Channel
Fibre Channel is a major transport for Storage Area Networks (SAN) in the
Enterprise market. Many of the required services for NVMe Over Fabrics Over FC
already exist e.g. Discovery (Name Server), Link Services, Process Login, Error
Recovery. Despite its wide acceptance, it does not support RDMA.

Overview of Fibre Channel
Topologies: Point-to-Point, Fabric
Switches & addressing
Login: Fabric, Port, & Process
Detail
Port types
Initialization
Discovery (Name Server)
Packets
Services
Transferring Commands, Data, & Response
FC-0:      Encoding: 8b/10b, 643b/66b, 256b/257b,Forward Error Correction
FC-1:      Transmission Word Synchonization
FC-2P:     FC Port, Link Speed Negotiation
FC2V:      Level Defining VN Ports (multiplexed PN ports)
FC-2M:    Multiplexer
FC-3:      Common Services
FC-4:      Mapping to Upper Level Protocol