Advances in Router Architecture: The CRS-1 and IOS-XR David Tsiang and David Ward mailto:[tsiang,dward]@cisco.com

Session Number Presentation_ID

1

© 2004 Cisco Systems, Inc. All rights reserved.

Agenda • The CRS-1 • IOS-XR

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WHAT WOULD YOU DO WITH 90 TERABITS PER SECOND?

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

2

Challenge: Massive scalability with extreme HA. Required a clean sheet design.

The CRS-1

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

3

WATERMARK

The CRS-1 • System Overview

WHAT WOULD YOU DO WITH 90 TERABITS PER SECOND?

• Control Plane • Line Card • Switch Fabric • Mechanicals • System Configurations

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

4

System Overview Linecards (1152)

40G

40G

Switch Fabric

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

Route Processor(s)

5

WATERMARK

System Overview Two main system building blocks Fabric Shelves Contains Fabric cards, System Controllers

Line Card Shelves (2 types) Contains Route Processors, Line cards, System controllers

Mid-plane design

Optical Back-plane design

8/16 LC slots 100m

24 Fabric cards

8/16 PLIM slots 2 RP slots

2 SC Cards

8 Fabric slots Shelf controller

Shelf controller Sys controller

Out of band GE control bus to all shelf controllers

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

6

System Scalability Phase

Max BW Tbps

LC chassis

Fabric Chassis

Max 40G slots

0-2

288

0-8

1152

1

11.5

(16 slot) 1-18

2

46

1-72

(92 Tbps FDX)

• 0.64 Tbps per LC chassis • 16 slots x 40Gbps • Switch fabric upgrades non-service affecting.

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

7

CONTROL PLANE

Presentation_ID

© 2003, Cisco Systems, Inc. All rights reserved.

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

8

RP Architecture (LC Chassis controller) LC FE Links

M I D P L A N E

CTL GE link CTL GE link

FE/GE Switch PCI

EIDE SPRAYER

SQUID SPONGE SPONGE

MEM CTL

CPU Aux & Console

Fabric Connection

Mgmt 10/100/GE link

FLASH

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

FLASH

9

WATERMARK

DRP Architecture (LC Chassis extended processing) FE Links

SP

M I D P L A N E

PCI Fabric Connection SPRAYER

SQUID

EIDE

MEM CTL

CPU

EIDE

SPONGE SPONGE

Aux & Console Mgmt GE link

SQUID

MEM CTL

CPU Aux & Console Mgmt GE link

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

10

LINE CARDS

Presentation_ID

11

© 2003, Cisco Systems, Inc. All rights reserved.

LC Architecture To Fabric

SPRAYER In Q/ Segmenter

SQUID GW

SPONGE SPONGE Reass. Reass.

RX SPP L3 Engine

M I D P L A N E

CPU

TX SPP L3 Engine

OC192 Framer

OC192 Optics

OC192 Framer

OC192 Optics

OC192 Framer

OC192 Optics

OC192 Framer

OC192 Optics

MOOSE PLIM I/F

SHARQ Out Q

From Fabric Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

12

CRS-1 Line Card Power Regulators Sharq

Egress Metro

Sponges

SP & Qlink Line Card CPU Ingress Metro Presentation_ID

Sprayer

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

13

CRS-1 Line Card Overview PLIM/LC Architecture – PLIM (OC768) PICTURE

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

14

CRS-1 Packet Flow SPP (Silicon Packet Processor) Architecture • 188 Packet Processing Engines (PPE)

PPE0

Packets evenly distributed across PPEs DISTRIB

MUX

…

Each PPE is a 32bit RISC processor

PPE2

Metro is implemented on both RX and TX sides

PPE187

TCAM

PLU

TLU

STATS

Prefix lookup Table lookup

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

15

Programmable Metro Forwarding Engine • 50,000 MIPS of processing power • 2500 IO HBGA • 96 Gbps input/output channels • Tree-bit map prefix look-up HW engine • Interface to off-chip SRAM and TCAM

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

16

SPP Feature List V4 unicast/multicast V6 unicast/multicast MPLS (up to 6 labels) L2/L3 Load Balancing ACL

Programmable ISE Functionality at 40Gbps

QOS Policing Shaping WRED Sampled Netflow RPF check PBR GRE/UTI tunneling

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

17

WATERMARK

CRS-1 Packet Flow Input queuing/shaping on the Sprayer WRED

Queues

Ports (Port/VLAN)

HP LP

MDRR/ Shaper

P1

LP

From Metro

MDRR/ Shaper

MDRR/ Shaper

Configurable Dynamic Mapping of Queues to ports Presentation_ID

Shaping Min/max BW

© 2004 Cisco Systems, Inc. All rights reserved.

P2

MDRR/ Aggregate Shaper

To fabric

P1023

Max BW

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

18

CRS-1 Packet Flow Output queuing/shaping on the Sharq WRED

Queues

Groups

Ports (Port/VLAN)

(VLAN/Tunnel)

HP LP

MDRR/ Shaper

G1 P1

LP MDRR/ Group

from Metro

MDRR/ Shaper

MDRR/ Shaper

Configurable Dynamic Mapping of Queues to groups and ports Presentation_ID

Shaping Min/max BW

© 2004 Cisco Systems, Inc. All rights reserved.

G2

MDRR/ Aggregate Group

To PLIM

GX

MDRR/ PX Group

Max BW WATERMARK

19

SWITCH FABRIC

Presentation_ID

© 2003, Cisco Systems, Inc. All rights reserved.

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

20

Packet flow -- LC to LC LINE CARD SHELF

FABRIC SHELF

• Packet flow between LCs: Sponge

Port to Sprayer

S3

S3 S3 S3 S3 S3 S3 S3 S1 S1 S1 S1 S1 S1 S1

Port

Via metro ASIC

Sprayer

Sprayer to S1

S1

Cells via backplane to 8 LC fabric cards

S2

S1 to S2

LINE CARD

S1 distributes cells to 36 S2 paths via fiber

S2 S2 S2 S2 S2 S2 S2

S2

Sponge

S3

S3 S3 S3 S3 S3 S3 S3 S1 S1 S1 S1 S1 S1 S1

Port

Via fiber

S1 Sprayer

S3 to Sponge Via backplane Sponge to Port Via metro and Sharq © 2004 Cisco Systems, Inc. All rights reserved.

S2

LINE CARD SHELF

S2 to S3

Presentation_ID

FABRIC CARD

LINE CARD

FABRIC CARD

21

WATERMARK

CRS-1 Switch Fabric Overview 40 Gbps -> Line Card 2 1

40 Gbps -> 8 of 8

8

8 2

2 of 8

Line Card

1

1 of 8

1296 x 1296 buffered non-blocking switch (distributed over 8 planes) 1:N redundancy providing non-stop operation under multiple fail conditions and for upgrade/replacement Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

22

CRS-1 Switch Fabric Overview 40 Gbps Line Card

Speedup Æ

136 Bytes cells 8 of 8

8

8

2

2 of 8

1

S1

1 of 8

S1 S1

S2 S2 S2

S1 2 Levels of priority HP Low latency path LP Best effort traffic

S1 S1

S3

2 1

S3 S3 S2

S2 S2

Line Card

S3 S3 S3

Native Multicast support

1296 x 1296 buffered non-blocking switch Multi-stage Interconnect – 3 Stage Benes topology (2) Actually 128Gbps total ~ 100 Gbps remain for data

(1) Actually 64Gbps total ~ 50 Gbps remain for data Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

23

WATERMARK

• 640Gpbs Standalone 3-stages of fabric in LC chassis – no optics

1st and 3rd stages distributed with Line Cards Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

•••

•• •

• 640Gpbs to 46Tbps centralized fabric

S1

S2

S3

S1

S2

S3

S1

S2

S3

S1

S2

S3

•••

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

All upgrade-able without service interruption

CRS-1 Fabric Configurations

24

MECHANICALS

Presentation_ID

CISCO CONFIDENTIAL - DO NOT DUPLICATE

© 2003, Cisco Systems, Inc. All rights reserved.

25

LC Chassis • 16 LC slots, 16 PLIM slots • 2 RP slots – on PLIM side in front of Fabric Cards

Power Supplies

Air Exhaust (r)

• 8 Fabric cards

PLIM PLIM PLIM PLIM

Fan\FABRIC(rear)

PLIM PLIM

PLIM PLIM

LC

RP/FABRIC(rear)

PLIM PLIM

PLIM PLIM

LC LC

24” W x 38.5*” D x 84” H

PLIM PLIM PLIM PLIM

• Midplane design 60.96 W x 96.52 D x 213.36H (cm)

• 13 KW • Approx. 1500 lbs (670 kg) fully configured. • For standalone Chassis Depth = 34.5” (no fabric chassis cable management)

Air Intake Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

26

Line Card Chassis

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

27

WATERMARK

Fabric Chassis • 24 Switch Fabric (SF) Boards

24” W x 36” D x 84” H 60.96 W x 91.44 D x 213.36H (cm)

Air Exhaust (r) 12xSF

SC

• Backplane design (cables blindmate to rear connector modules)

Power Supplies

12xSF

SC

Has both S2 ASICs and Optics

• 8 KW • 1500 lbs (670 Kg) fully configured

Air Exhaust (r) Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

28

Fabric Chassis Rear

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

Front

29

WATERMARK

SYSTEM CONFIGURATIONS

Presentation_ID

© 2003, Cisco Systems, Inc. All rights reserved.

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

CISCO CONFIDENTIAL - DO NOT DUPLICATE

30

0.64 Tbps System • Standalone LC chassis –16 LC and PLIM slots –2 RP slots –No Fabric chassis required –S1/2/3 Fabric Cards

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

31

3.84 Tbps System

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

32

11.5 Tbps System

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

33

WATERMARK

34

23 Tbps System

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

46 Tbps System

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

35

The Exciting Part: IOS-XR

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

36

ROUTER OS EVOLUTION

Presentation_ID

CISCO CONFIDENTIAL - DO NOT DUPLICATE

© 2003, Cisco Systems, Inc. All rights reserved.

37

Router OS Evolution Data Plane

Forward Infrastructure

SSH

Management Plane

Multicast IPC

SSH SSH

Alarm

Netflow

Per.fMgmt

CLI

SNMP

PFI

Management Plane Interface

Host Service

FIB

QoS

RIB

ACL

L2 Drivers

PIM

Checkpoint DB

Data Plane IGMP

Routing

RIP

ISIS

OSPF

Control Plane BGB

Network Stack System Infrastructure

HA Infrastructure

Forwarding Plane Applications

Management Plane

Data Plane

XML

Control Plane Control Plane

LPTS

Management Plane Applications

Control Plane Applications

System DB

Distributed Infrastructure

Scheduler

OS Scheduler

Synch. Services

IPC Mech

Memory Mgmt

Kernel System Services

New Router OS Architecture is required to deliver:

Monolithic Kernel Micro Kernel Continuous system operation Centralized •Infrastructure Distributed Infrastructure • Unparalleled Integrated Network stack scalability Independent Network Centralized •applications Flexible service delivery stack Distributed applications • Single unified system view

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

38

IOS XR Software Architecture Overview Picking The Correct OS To Meet CRS Software Requirements

Process Manager

TRUE Microkernel (Mach, QNX)

Filesystem

MMU with full protection Applications, drivers, and protocols are protected

d aine Cont rtable)

Application FAULT

ta (Res

tarta (Res

d aine FAULT Cont rtable) Application esta

Monolithic Kernel (BSD/Linux, NT)

FAULT Driver

d aine ) Cont ble

Application

(R

MMU with partial protection Applications are protected

Kernel

em Syst Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

C Wide

ption orruFilesystem

Network FAULT Driver

39

WATERMARK

IOS XR Kernel—Key Benefits Monolithic Kernel

Micro-Kernel

Preemptive scheduler with support for process priority

Yes

Yes

Protected memory architecture for application processes

Yes

Yes

Protected memory architecture for system processes

NO

Yes

Fault protection for application processes

Yes

Yes

Fault protection for Kernel processes

NO

Yes

Fault protection for Host Stack

NO

Yes

Fault protection for device drivers

NO

Yes

Fault protection for file system

NO

Yes

In Service SW Upgrade for application processes

Yes

Yes

In Service SW Upgrade for Infrastructure processes (IPC), kernel processes and device drivers

NO

Yes

POSIX API

Yes

Yes

FEATURE

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

40

DISTRIBUTED INFRASTRUCTURE

Presentation_ID

CISCO CONFIDENTIAL - DO NOT DUPLICATE

© 2003, Cisco Systems, Inc. All rights reserved.

41

Distributed In-Memory Database (IMDB) DRP

RP-A

Management Applications (CLI/XML?SNMP)

LocalDRP

• Reliable Multicast IPC improves scale and performance

Global Local-Ra

Global

Consolidated System View

IP

OSPF

Intf

ISIS

BGP

IP

Intf

Reliable Multicast and Unicast IPC

LCa

ARP Intf

Presentation_ID

ACL PPP

BGP

ISIS

• Distributed data management model improves performance and Scale • Single Consolidated view of the system eases maintenance

Local-LCa

IP

OSPF

QOS VLAN

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

42

Data Distribution Model

Shared

Local

Local

Local

Local

Local

Local

Local

LC

LC

DRP

RP

DRP

LC

LC

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

43

WATERMARK

Distributed Forwarding Infrastructure RP IP Stack

VLAN PPP

IM

Netflow

Drivers

Global Int. Mgr.

ARP

Global IDB & AIB

Egress AIB & IDB

CPU

LC

LC

Single stage forwarding • Single global Adjacency Information Base (AIB) distributed to all line cards • Single global Interface Management DB distributed to all line cards • Only Ingress FIB – forces forwarding features to be run in RP Presentation_ID

Egress FIB Switching Fabric

CPU

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

PPP

CPU

Ingress AIB & IDB

CPU Switching Fabric

VLAN

ARP HDLC Netflow

Ingress FIB

FIB

LC

LC-CPU

RP IM

LC

Two stage forwarding • Each line card has independent AIB only for local interfaces • Each line card has independent Interface DB for local interfaces • Both Ingress and Egress FIB – allows forwarding features to be independently run in LCs 44

High Availability Infrastructure Contained

Contained Hot BGP

OS

Process A

IS-IS

Warm

RIB

QoS

IP Stack

FIB

Check Distributed Middleware Point Server

Process B

OSPF PIM IGMP Process C Cold

ACL

Check Point Server

L2 Drivers

PFI

ACTIVE CARD

Process A XML Alarm

CLI

File System

Process B

Netflow SNMP Process SSH C

Inter Process Communication

STANDBY CARD Contained

• Distribution improves fault tolerance and recovery time by localizing the database and system management functionality to each node • Granular process restart allows for fast recovery from failures • IOS XR is designed to optimize the switch over between redundant hardware elements (RP, SC, PS, Fan C.) IOS XR is designed to route around fabric failure Line cards are protected by link bundling, APS, IPS, ECMP etc.

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

45

WATERMARK

IOS XR Modular Packaged Software RP

DRP

Manageability

LC

Manageability

Security

Multicast

GMPLS

Multicast

GMPLS

Security

Opt’l

Opt’l

Opt’l Multicast

GMPLS

RPL

BGP

RPL

BGP

OSPF

ISIS

OSPF

ISIS

Forwarding

Line Card Forwarding Mand Base OS

Forwarding Mand

Mand

Mand

Base

Base

Admin

OS

SC Base OS Admin

Mand

OS

• Upgrade specific packages/Composites Across Entire system Useful once a feature is qualified and you want to roll it without lot of commands Targeted Install to specific cards Useful while a feature is being qualified–reduces churn in the system to card boundary

• Point Fix for software faults Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

46

Distributed Control Plane BGP

BGP IS-IS

MPLS

Multi-cast

RP1

RP2

RP3

RP4

RESILLIENT SYSTEM PROCESS DISTRIBUTION

RPn

• Routing protocols and signaling protocols can run in one or more (D)RP • Each (D)RP can have redundancy support with standby (D)RP • Out of resources handling for proactive planning Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

47

WATERMARK

Distributed Control Plane RP

(D)RP Internet BGP Speaker

VPN—BGP Speaker

BGP RIB 1

FIB3

FIB2

RIB2

IGP

FIB1

RIB1

RIB3

FIB3

Multicast IPC/GSP

BGP RIB2

FIB2

FIB1

Multicast IPC/GSP

Fabric-based Multicast Repication

LC

LC

Multicast IPC/GSP FIB1

FIB2

FIB3

Multicast IPC/GSP FIB1

SPP Forwarding

FIB2

FIB3

SPP Forwarding

• Distributed BGP speakers in multiple RP and DRPs for load sharing • Unified FIB distribution • VPN aware FIB distribution for high scalability Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

48

Layered Protection

Signaling Access

Management Access

Dynamic Signaling

Applications

Flexible Infra

Next Generation ASIC

ATTACKS

Data Forwarding Access

ATTACKS

• Layered approach for security • Network/Service Protection: Filtering (ACL, uRPF, RPL), Netflow • Device Protection Management access security, Signaling access security, Forwarding access security Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

49

WATERMARK

Protection against DDOS • Layered Control Plane protection using multiple policers DOS Filter using L2 Congestion Control Mode Line rate ACL filtering Control Plane Session Validation using Pre-filter mechanisms

L2 Congestion Control ACL Pre-IFIB

IFIB CPU

Adjustable performance for trusted control plane session treatment Multiple Queues to CPU

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

50

APPLICATIONS ARCHITECTURE

Presentation_ID

CISCO CONFIDENTIAL - DO NOT DUPLICATE

© 2003, Cisco Systems, Inc. All rights reserved.

51

IOS XR Applications Architecture—Separate Planes Distributed Subsystems/Processes Data Plane

Multicast IPC

SSH SSH

Alarm

Per.fMgmt

XML

CLI

PFI

Management Plane Interface

LPTS

Host Service

FIB

QoS

ACL

L2 Drivers

RIB

PIM

Checkpoint DB

Data Plane

IGMP

OSPF

RS VP

RIP

ISIS

BGB

Control Plane

Management Plane SSH

Data Plane

SNMP

Control Plane

Management Plane

Netflow

Control Plane

System DB

Distributed Infrastructure

Scheduler

Synch. Services

IPC Mech

Memory Mgmt

Lightweight Micro Kernel

Kernel System Services Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

52

IOS XR Software Architecture—Physical View

XMK/Cobra, SNMP, HTTP,CLI

Security/AAA

Performance Agent Diagnostics

Unicast and Multicast Protocols

Policy Engine

Logical Router

Interface Mgr

RIBs

Config db

Stats Manager

GMPLS

DRP LPTS

FABRIC CARD

GSP

Alarm Manager

FGID Client

Kernel and Infrastructure Services Kernel and Kernel Services

Netflow

LINE CARD

LPTS

GSP

Topology Manager

Performance Agent

Platform Services

APS/IPS

Config db

IP IO Services

FIB Services

L2 Services

Multicast Group Manager

SHELF CONTROLLER

Redundancy Controller

Interface Manager

Connection Verifier Health Monitor

Kernel and Kernel Services

Kernel and Kernel Services

LINE CARD SHELF

FABRIC SHELF

• Every line card, RP, shelf controller, Fabric cards runs independent copy of Kernel and Infrastructure services • RP contains applications protocols, BGP, ISIS, OSPF • Line Card contains LC driver, FIB, NetFlow, ACL • Shelf Controller contains fabric management modules Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

53

WATERMARK

Modular Forwarding Architecture Netflow MA

Stats MA

QoS MA

ACL MA

RP

Silicon Packet Processor

Netflow EA

Stats EA

QoS EA

LC ACL EA

Stats EA

QoS EA

ACL EA

LC

Netflow EA

Multicast IPC Bus

Silicon Packet Processor

• Management Agent (MA) Single configuration view for network operators

• Execution Agent (EA) Forwarding are distributed to line cards such ACL, Netflow Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

54

Manageability Architecture “Industry Standard” Object Model

External EMS Fault

XML

Configuration

Accounting

Performance

Security

“Standards Derived” Object Model Craft Works Interface

CRS RP CLI Agent

SNMP Agent

XML Agent

XML

Object Request Broker

Inventory Agent

ACL, QoS, MPLS Agent

Routing Agent

IF Agent

Alarm and Log Agent

Perf and Accounting Agent

Test/ Diagnostic Agent

Common APIs to the rest of HFR S/W

DRP

RP/Shelf Control

Shelf Control

Fabric Card

Line Card Netflow

• Consistent data model independent of access schemes: CLI, SNMP or XML Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

55

Craft Works Interface (CWI) New Tool for Multi-shelf Systems • Graphical Configuration Desktop Interface Clone Protocols: BGP, ISIS, OSPF, TE

• Validation/2 stage configuration • Configuration Editor • Value-added SSH/Telnet • Inventory and Rack View • Integrated Alarm Views • Metadata for fast feature development

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

56

FLEXIBLE SERVICE CREATION ARCHITECTURE

Presentation_ID

CISCO CONFIDENTIAL - DO NOT DUPLICATE

© 2003, Cisco Systems, Inc. All rights reserved.

57

Logical, Virtual Routers and VRF • LOGICAL ROUTER A routing entity that emulates (via hardware based partitioning), multiple physical routing entities; this logical router shares all common chassis resources except RP and LCs

• VIRTUAL ROUTER A routing entity that emulates (via software based partitioning), multiple virtual routing entities; a virtual router shares all common chassis resources; can have dedicated / shared RP and LC

• VRF Multiple routing table and Multiple forwarding table instances

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

58

Logical, Virtual Routers and VRF

L C

L C

L C

F A N

F A N

C

C

L C

1 Logical Router Owner_LR

L C

R P

L C

R P

L C

L C

D R P

D R P

1 Logical Router A LR_A 1 Virtual Router VR Blue 1 Virtual Router VR Red

L C

L C

L C

L C

L C

L C

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

59

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

60

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

CRS-1 IOS XR Summary • Longevity Scale to 92Tbps Programmable Hardware

• Continuous System Operation No single point of failure Non Stop Forwarding In Service SW Upgrade

• Flexible Service Creation Architecture Logical Routers Virtual Routers VRF

• Single Unified System View

Presentation_ID

© 2004 Cisco Systems, Inc. All rights reserved.

WATERMARK

Copyright © 2001, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

61