Troubleshooting OSPF

BRKRST-3310

Patrick Viscosi
Network Engineer
Agenda

• LSA Overview
• Troubleshooting Commands
• Common Issues
• OSPF for NX-OS and IOS-XR
• Troubleshooting Enhancements

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
LSA Overview
LSA Type Review
Type LSA
1 Router

2 Network

3 Summary Network

4 Summary ASBR

5 External

6 Group Membership

7 NSSA

8 External Attributes

9–11 Opaque

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
Router LSA of R3 for Area 1
R3#show ip ospf database router 3.3.3.3
Router Link States (Area 1)
LS age: 0 Always 0 at origination DR
Options: (No TOS-capability) 192.1.1.4
LS type: Router Links This is a router LSA R4
Link State ID: 3.3.3.3 Router ID of R3
1 Area 0
192.1.1.3 18.10.0.5/30 6.6.6.6
Advertising Router: 3.3.3.3 Router ID of R3
LS Seq Number: 80000001 Initial Seq Number R3 2
8
R6
Checksum: 0x146B
192.1.4.0/24
Length: 48
Area Border Router bit B = 1
Number of links: 2
Link Connected to: a Transit Network
(Link ID) Designated Router address): 192.1.1.4
(Link Data) Router Interface address): 192.1.1.3
Number of TOS metrics: 0
TOS 0 Metric: 1
Link Connected to: a Stub Network
(Link ID) Network/subnet number: 192.1.4.0
(Link Data) Network Mask: 255.255.255.0
Number of TOS metrics = 0
TOS 0 Metric: 2
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Router LSA of R3 for Area 0 (Cont.)
Router Link States (Area 0)
LS age: 0 Always 0 at origination
Options: (No TOS-capability)
DR
LS type: Router Links This is a router LSA
192.1.1.4
Link State ID: 3.3.3.3 Router ID of R3 R4
Advertising Router: 3.3.3.3 Router ID of R3
1 Area 0
192.1.1.3 18.10.0.5/30 6.6.6.6
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0x146B 8
R3 2 R6
Length: 48
192.1.4.0/24
Area Border Router bit B = 1
Number of links: 2
Link Connected to: another Router (point-to-point)
(Link ID) Neighboring Router ID: 6.6.6.6
(Link Data) Router Interface address: 18.10.0.5
Number of TOS metrics: 0
TOS 0 Metric: 8
Link Connected to: a Stub Network
(Link ID) Network/subnet number: 18.10.0.4
(Link Data) Network Mask: 255.255.255.252
Number of TOS metrics = 0
TOS 0 Metric: 8

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Router Link Types Summary

Type Description Link ID Link Data

Point-to-Point Neighbor’s Interface IP

1
Numbered RID Address

Point-to-Point Neighbor’s MIB-II Ifindex

1 Unnumbered RID Value

IP Address Interface IP
2 Transit
of the DR Address

IP Network
3 Stub Subnet Mask
Number

Neighbor’s Interface IP
4 Virtual Link
RID Address

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Network LSA for 192.1.1.0

R3#show ip ospf database network 192.1.1.4

Network Link States (Area 1)
LS age: 948
Options: (No TOS Capability)
LS type: Network Links
Link State ID: 192.1.1.4 Interface address of DR
Advertising Router: 4.4.4.4 RID of DR
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0x9A84
4.4.4.4
Length: 40 DR
1.1.1.1
Network Mask: /24 192.1.1.4 8
R4
Attached Router: 4.4.4.4 R1 /24 Area 0
Attached Router: 3.3.3.3 2.2.2.2 1 192.1.1.3 6.6.6.6
8
Attached Router: 2.2.2.2
R3 2 18.10.0.4/32 R6
Attached Router: 1.1.1.1 R2
192.1.4.0/24

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
Type 3 Details
R4#show ip ospf database summary 192.1.2.0
Summary Net Link States (Area 0)
LS age: 1514
Options: (No TOS Capability)
LS type: Summary Links (Networks)
Link State ID: 192.1.2.0 (Summary Network Number)
Advertising Router: 4.4.4.4 RID of ABR
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0xFC68
Length: 28 O IA
Network Mask: /24 ABR 192.1.2.0/24
metric 4
TOS 0 Metric: 4 1.1.1.1
DR
192.1.2.0/24 192.1.1.4 8
3 R4
R1 /24
ABR Area 0
1 192.1.1.3 6.6.6.6
2.2.2.2
8

R2 R3 2 18.10.0.4 R6
192.1.4.0/24

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
 Type 4 Details
R4#show ip ospf database asbr-summary 7.7.7.7
Summary ASB Link States (Area 1)
LS age: 1548
Options: (No TOS Capability)
LS type: Summary Links (AS Boundary Router)
Link State ID: 7.7.7.7 (AS Boundary Router address)
Advertising Router: 4.4.4.4 RID of ABR
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0x93E2
Length: 28
Network Mask: /0 Type 4 Summary
TOS: 0 Metric: 16 1.1.1.1 DR External Route
3
192.1.1.4 140.10.0.0
8 8
R1 R4
192.1.2.0/24 /24
Area 0 RID ASBR
1 192.1.1.3
2.2.2.2 6.6.6.6 7.7.7.7
R3 2 18.10.0.4
R2 R6 R7
192.1.4.0/24
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Type 4 Details

R4#sh ip ospf border-routers

OSPF Router with ID (4.4.4.4) (Process ID 1)

Internal Router Routing Table

Codes: i - Intra-area route, I - Inter-area route

i 7.7.7.7 [16] via 115.115.115.2, Serial0/0, ASBR, Area 0, SPF 5

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
 Type 5 Details
R4#show ip ospf database external 140.10.0.0
LS age: 156
Options: (No TOS Capability)
LS type: AS External Link
Link State ID: 140.10.0.0 (External Network Number)
Advertising Router: 7.7.7.7 Router ID of ASBR
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0x93E2
Length: 36
Network Mask: /16
Metric Type: 2 bit E = 1 -> O E2 (Default)
Metric: 20
Forwarding address: 0.0.0.0 3
1.1.1.1 DR External Route
192.1.1.4 140.10.0.0
8 8
R1 R4
192.1.2.0/24 /24
Area 0 RID ASBR
1 192.1.1.3 4
2.2.2.2 6.6.6.6 7.7.7.7
R3 2 18.10.0.4
R2 R6 R7
192.1.4.0/24 External Type 5

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Forwarding address
Must be known via intra or inter area route

router ospf 1
redistribute bgp 1 subnets

BGP Gateway
ASBR Router
OSPF
Network

R1
OSPF is
running
on these 2
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
interfaces
 Type 7 Details
R7#show ip ospf database nssa-external 140.10.0.0

LS age: 156
Options: (No TOS Capability, Type 7/5 translation)
LS type: AS External Link
Link State ID: 140.10.0.0 (External Network Number)
Advertising Router: 7.7.7.7 Router ID of R7(ASBR)
LS Seq Number: 80000001 Initial Seq Number
Checksum: 0x01A6
Length: 36
Network Mask: /16
Metric Type: 2
Metric: 20 External Route
3 1.1.1.1 DR 140.10.0.0
Forwarding address: 0.0.0.0 192.1.1.4 8
R4
192.1.2.0/24 R1 /24 Area 0 RID ASBR
1 4
2.2.2.2
192.1.1.3 6.6.6.6 7.7.7.7
8 R7
R2 R3 2 18.10.0.4 Type 7 NSSA
192.1.4.0/24 R6

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
Troubleshooting Commands
What to look for in the output?
Show IP OSPF
R3# show ip ospf
Routing Process "ospf 1" with ID 3.3.3.3 and Domain ID 0.0.0.1
Supports only single TOS(TOS0) routes
Supports opaque LSA
It is an area border router
SPF schedule delay 5 secs, Hold time between two SPFs 10 secs
Minimum LSA interval 5 secs. Minimum LSA arrival 1 secs
Number of external LSA 1. Checksum Sum 0x3B57
Number of opaque AS LSA 0. Checksum Sum 0x0
Number of DCbitless external and opaque AS LSA 0
Number of DoNotAge external and opaque AS LSA 0
Number of areas in this router is 2. 2 normal 0 stub 0 nssa
External flood list length 0
Area BACKBONE(0)
Number of interfaces in this area is 2
Area has no authentication
SPF algorithm executed 2773 times
Area ranges are
Number of LSA 17. Checksum Sum 0x686B5
Number of opaque link LSA 0. Checksum Sum 0x0
Number of DCbitless LSA 0
Number of indication LSA 0
Number of DoNotAge LSA 9
Flood list length 0
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Show IP OSPF interface brief

R12# show ip ospf interface brief

Interface PID Area IP Address/Mask Cost State Nbrs F/C
Lo0 1 0 172.16.1.20/32 1 LOOP 0/0
Gi0/0 1 0 11.11.11.1/24 1 DR 1/1
Lo91 1 1 91.91.91.91/32 1 LOOP 0/0
Se2/0 1 1 172.17.17.1/30 48 P2P 1/1

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Show IP OSPF Database
R3# show ip ospf database

OSPF Router with ID (3.3.3.3) (Process ID 1)

Router Link States (Area 0)

Link ID ADV Router Age Seq# Checksum Link count

3.3.3.3 3.3.3.3 106 0x80000009 0xC3F1 3
...
Summary Net Link States (Area 0)

Link ID ADV Router Age Seq# Checksum

18.10.0.0 7.7.7.7 3 (DNA) 0x80000008 0x3DC2
18.10.0.0 8.8.8.8 1396 0x80000004 0x27D8
...
Router Link States (Area 1)

Link ID ADV Router Age Seq# Checksum Link count

1.1.1.1 1.1.1.1 671 0x80000016 0xE6CD 2
...

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
Show IP OSPF Database Database-Summary
R3# show ip ospf database database-summary

OSPF Router with ID (3.3.3.3) (Process ID 1)

Area 0 database summary

LSA Type Count Delete Maxage
Router 6 0 0
Network 4 0 0
Summary Net 10 0 0
Summary ASBR 0 0 0
Type-7 Ext 0 0 0
Opaque Link 0 0 0
Opaque Area 0 0 0
Subtotal 20 0 0

Area 1 database summary

LSA Type Count Delete Maxage
Router 4 0 0
Network 1 0 0
Summary Net 10 0 0
Summary ASBR 4 0 0
...
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Show IP route summary

R14# show ip route summary

Route Source Networks Subnets Overhead Memory (bytes)

connected 0 3 216 408
Static 0 0 0 0
ospf 1 0 4 288 544
Intra-area: 1 Inter-area: 0 External-1: 0 External-2: 3
NSSA External-1: 0 NSSA External-2: 0
…
R14#

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Show IP OSPF Neighbor

R3# show ip ospf neighbor

Neighbor ID Pri State Dead Time Address Interface

1.1.1.1 1 FULL/DROTHER 00:00:33 192.1.1.1 FastEthernet0/0
2.2.2.2 1 FULL/DROTHER 00:00:32 192.1.1.2 FastEthernet0/0
4.4.4.4 1 FULL/DR 00:00:39 192.1.1.4 FastEthernet0/0
6.6.6.6 1 FULL/ - 00:00:38 18.10.0.6 Serial0/0
R3#

4.4.4.4
DR
1.1.1.1
192.1.1.4
R4
R1 1
/24 Area 0
192.1.1.3 6.6.6.6
2.2.2.2 8

R3 2 18.10.0.4 R6
R2
192.1.4.0/24

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Show IP OSPF Neighbor Detail
R3# show ip ospf neighbor detail
Neighbor 1.1.1.1, interface address 192.1.1.1
In the area 1 via interface FastEthernet0/0
Neighbor priority is 1, State is 2WAY, 2 state changes
DR is 192.1.1.4 BDR is 192.1.1.2
Options is 0x2
Dead timer due in 00:00:39
Neighbor is up for 00:06:30
Index 0/0, retransmission queue length 0, number of retransmission 0
First 0x0(0)/0x0(0) Next 0x0(0)/0x0(0)
Last retransmission scan length is 0, maximum is 0
Last retransmission scan time is 0 msec, maximum is 0 msec
Neighbor 2.2.2.2, interface address 192.1.1.2
In the area 1 via interface FastEthernet0/0
Neighbor priority is 1, State is FULL, 6 state changes
DR is 192.1.1.4 BDR is 192.1.1.2
Options is 0x42
Dead timer due in 00:00:38
Neighbor is up for 00:06:31
Index 2/2, retransmission queue length 0, number of retransmission 0
First 0x0(0)/0x0(0) Next 0x0(0)/0x0(0)
Last retransmission scan length is 0, maximum is 0
Last retransmission scan time is 0 msec, maximum is 0 msec
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
Show IP OSPF Interface
R3# show ip ospf interface
FastEthernet0/0 is up, line protocol is up
Internet Address 192.1.1.3/24, Area 1
Process ID 1, Router ID 3.3.3.3, Network Type BROADCAST, Cost: 1
Transmit Delay is 1 sec, State DROTHER, Priority 1
Designated Router (ID) 4.4.4.4, Interface address 192.1.1.4
Backup Designated router (ID) 2.2.2.2, Interface address 192.1.1.2
Timer intervals configured, Hello 10, Dead 40, Wait 40, Retransmit 5
Hello due in 00:00:03
Index 1/1, flood queue length 0
Next 0x0(0)/0x0(0)
Last flood scan length is 0, maximum is 5
Last flood scan time is 0 msec, maximum is 0 msec
Neighbor Count is 3, Adjacent neighbor count is 2
Adjacent with neighbor 2.2.2.2 (Backup Designated Router)
Adjacent with neighbor 4.4.4.4 (Designated Router)
Suppress hello for 0 neighbor(s)

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
Show IP OSPF Virtual-Links
R3# show ip ospf virtual-links

Virtual Link OSPF_VL0 to router 4.4.4.4 is up

Run as demand circuit
DoNotAge LSA allowed.
Transit area 1, via interface FastEthernet0/0, Cost of using 1
Transmit Delay is 1 sec, State POINT_TO_POINT,
Timer intervals configured, Hello 10, Dead 40, Wait 40,
Retransmit 5
Hello due in 00:00:09
Adjacency State FULL (Hello suppressed)
Index 1/3, retransmission queue length 0, number of
retransmission 1
First 0x0(0)/0x0(0) Next 0x0(0)/0x0(0)
Last retransmission scan length is 1, maximum is 1
Last retransmission scan time is 0 msec, maximum is 0 msec
R3#

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
Show IP OSPF Stat Detail
R1# show ip ospf stat detail

OSPF process ID 1
------------------------------------------

Area 0: SPF algorithm executed 1 times

SPF 1 executed 1w0d ago, SPF type Full

SPF calculation time (in msec):
SPT Intra D-Intr Summ D-Summ Ext7 D-Ext7 Total
0 0 0 0 0 0 0 0
LSIDs processed R:1 N:0 Stub:1 SN:0 SA:0 X7:0
Change record R,
LSIDs changed 1
Last 10 LSIDs:
4.4.4.4(R)

Summary OSPF SPF statistic

SPF calculation time

Delta T Intra D-Intra Summ D-Summ Ext D-Ext Total Reason
1w0d 0 0 0 0 0 0 0 R,
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
Show IP OSPF Border-Routers

R3# show ip ospf border-routers

OSPF Process 1 internal Routing Table

Codes: i - Intra-area route, I - Inter-area route

i 4.4.4.4 [1] via 192.1.1.4, FastEthernet0/0, ABR, Area 0, SPF 42

i 4.4.4.4 [1] via 192.1.1.4, FastEthernet0/0, ABR, Area 1, SPF 38
i 8.8.8.8 [10] via 18.10.0.6, Serial0/0, ABR/ASBR, Area 0, SPF 42
i 7.7.7.7 [17] via 192.1.1.4, FastEthernet0/0, ABR/ASBR, Area 0, SPF 42

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
Other Show Commands
R3# show ip ospf database self-originate
OSPF Router with ID (3.3.3.3) (Process ID 1)
Router Link States (Area 0)
Link ID ADV Router Age Seq# Checksum Link count
3.3.3.3 3.3.3.3 1520 0x80000015 0xABFD 2
Summary Net Link States (Area 0)
Link ID ADV Router Age Seq# Checksum
192.1.1.0 3.3.3.3 1520 0x80000006 0x4E1A
192.1.2.0 3.3.3.3 1521 0x80000006 0x6103
...
Router Link States (Area 1)
Link ID ADV Router Age Seq# Checksum Link count
3.3.3.3 3.3.3.3 1536 0x80000028 0x612D 2
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
Other Show Commands (Cont.)
R3# show ip ospf database adv-router 7.7.7.7
OSPF Router with ID (3.3.3.3) (Process ID 1)
Router Link States (Area 0)
Link ID ADV Router Age Seq# Checksum Link count
7.7.7.7 7.7.7.7 871(DNA) 0x8000000D 0x8FE2 2
Summary Net Link States (Area 0)
Link ID ADV Router Age Seq# Checksum
20.10.0.0 7.7.7.7 871 (DNA) 0x8000000A 0x39C4
Type-5 AS External Link States
Link ID ADV Router Age Seq# Checksum Tag
140.100.0.0 7.7.7.7 1944 0x80000004 0x3759 0

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Look for input queue drops in show interface
R33# show interface gig0/0
GigabitEthernet0/0 is up, line protocol is up
Internet address is 33.33.33.2/24
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Keepalive set (10 sec)
Full Duplex, 1Gbps, link type is auto, media type is T
output flow-control is XON, input flow-control is XON
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 5/75/1032/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
30 second input rate 7259000 bits/sec, 602 packets/sec
30 second output rate 7258000 bits/sec, 602 packets/sec
771310 packets input, 149868367 bytes, 0 no buffer
Received 740151 broadcasts

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Try to inspect traffic in the input queue if you see
input queue drops incrementing
Malicious traffic destined for the interface of the router can cause legitimate OSPF
traffic to be dropped

R33# show buffer input-interface gig0/0 header

Buffer information for Big buffer at 0x2A5BEBF4

data_area 0xC49ED84, refcount 1, next 0x402CBA18, flags 0xA80
linktype 7 (IP), enctype 1 (ARPA), encsize 14, rxtype 1
if_input 0x401620E0 (GigabitEthernet0/0), if_output 0x0 (None)
inputtime 16w2d (elapsed 00:00:00.004)
outputtime 00:00:00.000 (elapsed never), oqnumber 65535
datagramstart 0xC49EDCA, datagramsize 1514, maximum size 1692
mac_start 0xC49EDCA, addr_start 0xC49EDCA, info_start 0x0
network_start 0xC49EDD8, transport_start 0xC49EDEC, caller_pc 0x211295A4

source: 33.33.33.1, destination: 33.33.33.2, id: 0x370F, ttl: 255, prot: 1

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Common Issues
Common things that can go wrong
Common Issues
• Adjacency is not coming up
• OSPF neighbor stuck in ? State
• Information is in the database but not in the routing table
• SPF running constantly
• NSSA ABR not translating Type 7 LSA
• GRE Tunnel OSPF adjacency is flapping

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Adjacency Is Not Coming Up
Useful commands to troubleshoot this problem:
• Show IP OSPF neighbor

• Show IP OSPF interface

• Debug IP OSPF adjacency

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Adjacency Is Not Coming Up
Layer 2 is down

R3# show ip ospf neighbor

R3#

R3# show ip ospf interface serial 2

Serial2 is down, line protocol is down
Internet Address 18.10.0.3/30, Area 0
Process ID 1, Router ID 3.3.3.3, Network Type POINT_TO_POINT,
Cost: 64
Transmit Delay is 1 sec, State DOWN,
Timer intervals configured, Hello 10, Dead 40, Wait 40, Retransmit 5

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Adjacency Is Not Coming Up
OSPF not enabled on the interface

R3# show ip ospf neighbor

R3#

R3# show ip ospf interface serial 2

Serial2 is up, line protocol is up
OSPF not enabled on this interface

In more recent IOS, we see:

R3# show ip ospf interface serial 2

%OSPF: OSPF not enabled on serial 2

Tip: Check for the wrong network statement; re-enter the network
statement
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Adjacency Is Not Coming Up
Interface is defined as passive

R3# show ip ospf neighbor

R3#

R3# show ip ospf interface e0

Ethernet0 is up, line protocol is up
Internet Address 192.1.1.3/24, Area 1
Process ID 1, Router ID 3.3.3.3, Network Type BROADCAST,
Cost: 10
Transmit Delay is 1 sec, State DR, Priority 1
Designated Router (ID) 3.3.3.3, Interface address 192.1.1.3
No backup designated router on this network
Timer intervals configured, Hello 10, Dead 40, Wait 40,
Retransmit 5
No Hellos (Passive interface)

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Adjacency Is Not Coming Up
Mismatched subnet mask

R3# show ip ospf neighbor

R3#

R3# debug ip ospf hello

OSPF hello debugging is on
R3#
OSPF: Mismatched hello parameters from 192.1.1.4
Dead R 40 C 40, Hello R 10 C 10 Mask R 255.255.255.192 C 255.255.255.0

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Adjacency Is Not Coming Up
Mismatched hello/dead interval
R3# show ip ospf neighbor
R3#

R3# debug ip ospf hello

OSPF hello debugging is on
R3#
OSPF: Mismatched hello parameters from 192.1.1.4
Dead R 40 C 40, Hello R 5 C 10 Mask R 255.255.255.0 C
255.255.255.0

R4(config-if)#interface ethernet 0
R4(config-if)#no ip ospf hello-interval 5

• Tip: Default is 10 seconds on LAN

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Adjacency Is Not Coming Up
Mismatched authentication key

R3# show ip ospf neighbor

R3#

R3# debug ip ospf adjacency

OSPF adjacency events debugging is on
R3#
OSPF: Rcv pkt from 192.1.1.4, Ethernet0 : Mismatch Authentication Key -
ClearText

• Tip: Watch for the “space” at the end of the authentication key

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Adjacency Is Not Coming Up
Mismatched authentication type -Neighbor is using MD5 encryption,
we are using clear text encryption
R14# show ip ospf neighbor
R14#

R14# debug ip ospf adjacency

OSPF adjacency events debugging is on
R14#
OSPF: Rcv pkt from 48.48.48.7 : Mismatched Authentication type. Input packet
specified type 2, we use type 1
14#

• Tip: Be sure encryption Type matches (i.e. MD5, ClearText)

• Authentication Type 2=MD5, Type 1=ClearText, Type 0=No Authentication

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Adjacency Is Not Coming Up
Mismatched area ID
R3# show ip ospf neighbor
R3#
Scenario 1 - Neighbor is in Area 2, but we are in Area 1:

R3# debug ip ospf adjacency

OSPF adjacency events debugging is on

OSPF: Rcv pkt from 192.1.1.4, Ethernet0, area 0.0.0.1 mismatch area 0.0.0.2 in
the header

Scenario 2 - Neighbor is in Area 0, but we are not:

%OSPF-4-ERRRCV: Received invalid packet: mismatch area ID, from

backbone area must be virtual-link but not found from 192.1.1.4, Ethernet0
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Adjacency Is Not Coming Up
Mismatched transit/stub/NSSA option

7.7.7.7 18.10.0.2 8.8.8.8

18.10.0.1
Area 2
Area 2
NSSA R8
R7

R7# show ip ospf neighbor

R7#

R7# debug ip ospf adjacency

OSPF adjacency events debugging is on
OSPF: Hello from 18.10.0.2 with mismatched Stub/Transit area option bit

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Options
Normal area: OSPF: Send DBD to 141.108.97.1 on Serial0 seq 0xBC4 opt 0x2 flag 0x3 len 492
E bit is 1, Allow externals, option: 0x2(HEX) = 00000010(Bin)

Stub area: OSPF: Send DBD to 141.108.97.1 on Serial0 seq 0x1866 opt 0x0 flag 0x3 len 372
E bit is 0, no external allowed, options: 0x0 = 00000000

NSSA: OSPF: Send DBD to 141.108.97.1 on Serial0 seq 0x118 opt 0x8 flag 0x3 len 372
N/P bit is on, options: 0x8 = 00001000

DC: OSPF: Send DBD to 141.108.97.1 on Serial0 seq 0x1A1E opt 0x20 flag 0x3 len 392
DC bit is negotiated, options: 0x20 = 00100000

O DC EA N/P MC E
* *
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
OSPF Neighbor Stuck In ? State

Useful commands for troubleshooting this problem:

• Show IP OSPF neighbor

• Debug IP OSPF adjacency

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
OSPF Adjacency States

ATTEMPT
INIT
2-WAY 3.3.3.3 6.6.6.6

EXSTART R3 R6
EXCHANGE
LOADING
FULL

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Stuck In ATTEMPT
3.3.3.3 6.6.6.6
NBMA
R3 R6

Hello
RID =3.3.3.3

Hello
RID =6.6.6.6
N = 3.3.3.3

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
Stuck In ATTEMPT
Reasons:
• Our hellos are getting lost in NBMA cloud
• Neighbor hellos are getting lost in NBMA cloud
• We received neighbor’s hello but reject it for some reason
• Misconfigured neighbor statement
• Broken Unicast

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Stuck In INIT
1.1.1.1 2.2.2.2

R1 R2
Hello
RID =1.1.1.1

Hello
RID =2.2.2.2

Hello
RID =1.1.1.1
N =2.2.2.2

Hello
RID =2.2.2.2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Stuck In INIT
Reasons:
• One side is blocking the hello packet with access-list

• One side is translating (NAT) OSPF hello

• One side multicast capability is broken (Layer 2)

• Dialer map or Frame Relay map is missing keyword ‘broadcast’

• LLS capability issue when Cisco IOS® is upgraded

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Verify IP Multicast control plane is working
We want to see a reply from the remote OSPF interface when we ping 224.0.0.5:

R11# show ip ospf neighbor

Neighbor ID Pri State Dead Time Address Interface
172.16.1.23 1 FULL/DR 00:00:33 31.31.31.1 GigabitEthernet0/1

R11# ping 224.0.0.5

Type escape sequence to abort.
Sending 1, 100-byte ICMP Echos to 224.0.0.5, timeout is 2 seconds:

Reply to request 0 from 31.31.31.1, 1 ms

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Stuck In 2-WAY
1.1.1.1 2.2.2.2

R1 R2

Hello
RID =1.1.1.1 P=0

Hello
RID =2.2.2.2 P=0

N =1.1.1.1

Hello
RID =1.1.1.1 P=0

N =2.2.2.2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
Stuck In 2-WAY
Reasons:
• This is normal in broadcast network types

• This is to reduce the amount of flooding on the wire

• Problem can happen if all the routers are configured with priority equal to ‘0’

• Only low-end routers should be configured with priority 0 so they don’t

participate in DR election

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Stuck In EXSTART/EXCHANGE
3.3.3.3 6.6.6.6

R3 R6
Hello
RID =3.3.3.3

Hello
RID =6.6.6.6
N =3.3.3.3

DBD
MTU = 1500 flag = 0x7
Seq = 1E55

DBD
MTU = 1500 flag = 0x7
Seq = 22AB

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
Stuck In EXSTART/EXCHANGE
• Useful in debugging, defines I, M and MS bits

– OSPF: Send DBD to 141.108.97.1 on Serial0 seq 0xBC4 opt 0x2 flag 0x3
len 492
– Flag 0x7 --> 111 means I(Initial) = 1, M = 1(More), MS = 1(Master)
– Flag 0x6 --> 110 not possible
– Flag 0x5 --> 101 not possible
– Flag 0x4 --> 100 not possible
– Flag 0x3 --> 011 means master has more data to send
– Flag 0x2 --> 010 means slave has more data to send
– Flag 0x1 --> 001 means master has no more data left to send
– Flag 0x0 --> 000 means slave has no more data left to send

0 0 0 0 0 I M MS

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Stuck In EXSTART/EXCHANGE
Reasons:
• MTU mismatch—EXCHANGE on one router and EXSTART on the other - can
configure ‘ip ospf mtu-ignore’
• Neighbor RID is same as ours—EXSTART
– Note: If Cisco IOS is > 12.0.7, it displays msg: %OSPF-3-DUP_RTRID and OSPF
neighbor list will be empty
• Unicast is broken—EXCHANGE
1. Wrong VC/DLCi mapping in frame/ATM environment in highly redundant network
2. MTU problem, can’t ping across with more than certain
length packet
3. Access-list blocking unicast; after two-way OSPF send unicast packet except p2p links
4. NAT is translating unicast packet

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
Use extended pings to verify link integrity
R11# show ip ospf neighbor
Neighbor ID Pri State Dead Time Address Interface
172.23.192.241 1 FULL/DR 00:00:38 3.3.3.1 GigabitEthernet0/1

R11# ping
Target IP address: 3.3.3.1
Repeat count [5]: 1
Extended commands [n]: y
Set DF bit in IP header? [no]: y
Validate reply data? [no]: y
Data pattern [0xABCD]:
Loose, Strict, Record, Timestamp, Verbose[V]:
Sweep range of sizes [n]: y
Sweep min size [36]:
Sweep max size [18024]: 1500
Sweep interval [1]:
Type escape sequence to abort.
Sending 1465, [36..1500]-byte ICMP Echos to 3.3.3.1, timeout is 2 seconds:
Packet sent with the DF bit set
Reply data will be validated
Reply to request 0 (4 ms) (size 36)
Reply to request 1 (1 ms) (size 37)
Reply to request 2 (1 ms) (size 38)

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
Stuck In LOADING
3.3.3.3 6.6.6.6

R3 R6

LS Req
LS Type

Link State ID

Advertising Router

LS Update
# LSAs
LSAs
...

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
Stuck In LOADING
Reasons:
• LS request is being made and neighbor is sending bad packet or memory
corruption exists
– a. Do show IP OSPF bad to see bad LSA
– b. Show log will show OSPF-4-BADLSATYPE message
• LS request is being made and neighbor is ignoring the request
• MTU mismatch problem (RFC 1583 and 2178 compatibility issue) CSCee23634.
OSPF should detect if the neighbor MTU is smaller than ours. Fixed in more
recent IOS

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Information is in the OSPF DB but not in the RT
Useful Commands for This Problem:

• Show IP OSPF interface <interface>

• Show IP OSPF database <x>
• Where ‘x’ can be router, network, summary, summary-asbr, external, NSSA

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
Information is in the OSPF DB but not in the RT
Mismatched Network Types
3.3.3.3 Area 0 6.6.6.6

R3 18.10.0.4/30 R6
R3# show ip ospf neighbor
Neighbor ID Pri State Dead Time Address Interface
6.6.6.6 1 FULL/ - 00:00:30 18.0.0.6 Serial0
R3# show ip ospf interface serial 0
Serial0 is up, line protocol is up
Internet Address 18.0.0.5/30, Area 0
Process ID 1, Router ID 3.3.3.3, Network Type POINT_TO_POINT, Cost: 64
R6# show ip ospf interface serial 0
Serial0 is up, line protocol is up
Internet Address 18.0.0.6/30, Area 0
Process ID 1, Router ID 6.6.6.6, Network Type BROADCAST, Cost: 64

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Information is in the OSPF DB but not in the RT
Mismatched Network Types (Cont.)

R3# show ip ospf database router 3.3.3.3

...
Link ID = 6.6.6.6 Router id of the neighbor
Link Data = 18.10.0.5 IP interface address 3.3.3.3 Area 0 6.6.6.6

Type = 1 This is a point-to-point link R3 18.10.0.4/30 R6

# TOS metrics = 0
metric = 8
...
R3# show ip ospf database router 6.6.6.6
...
Link ID = 18.10.0.6 IP address of the DR
Link Data = 18.10.0.6 Interface address
Type = 2 This is a transit link
# TOS metrics = 0
metric = 8
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
Information is in the OSPF DB but not in the RT
Different IP Subnet on P2P Links
3.3.3.3 6.6.6.6
Area 0
R3 19.10.0.5/30 18.10.0.6/30 R6

R3# show ip ospf neighbor

Neighbor ID Pri State Dead Time Address Interface
6.6.6.6 1 FULL/ - 00:00:30 18.0.0.6 Serial0

R3# show interface serial 0

Serial0 is up, line protocol is up
Internet address is 19.10.0.5/30
R6# show interface serial 0
Serial0 is up, line protocol is up
Internet address is 18.10.0.6/30
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
Information is in the OSPF DB but not in the RT
Different IP Subnet on P2P Links (Cont.)

R3# show ip ospf database router 3.3.3.3

...
Link ID = 6.6.6.6 Router id of the neighbor
Link Data = 19.10.0.5 Interface address
Type = 1 This is a point-to-point link
# TOS metrics = 0
metric = 8 3.3.3.3
Area 0 6.6.6.6
...
R3# show ip ospf database router 6.6.6.6 R3 19.10.0.5/30 18.10.0.6/30 R6
...
Link ID = 3.3.3.3 Router id of the neighbor
Link Data = 18.10.0.6 Interface address
Type = 1 This is a point-to-point link
# TOS metrics = 0
metric = 8
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
Information is in the OSPF DB but not in the RT
More recent IOS has a same network verification check for point-to-point
numbered interfaces (see next slide for more details)
R3# show interface serial 0
Serial0 is up, line protocol is up
Internet address is 19.10.0.5/30
R6# show interface serial 0 3.3.3.3 6.6.6.6
Serial0 is up, line protocol is up Area 0
Internet address is 18.10.0.6/30 R3 19.10.0.5/30 18.10.0.6/30 R6
R3# show ip ospf neighbor
R3#

R3# debug ip ospf adjacency

OSPF adjacency events debugging is on
R3#
OSPF: Rcv pkt from 18.10.0.6, Serial0, area 0.0.0.0 :
src not on the same network
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
More recent IOS has a network verification check
Feature Enhancement CSCdp51090

Release-note:
On numbered point-to-point OSPF interfaces, OSPF is able to form a full adjacency
even if neighbor's address is out of local subnet.

Prior to this enhancement:

On a Point-to-Point numbered OSPF interface, OSPF does not check the source address
upon receiving hello packet for consistency with address/mask of local interface. As a
result, OSPF adjacency will go to full state even if the neighbor is misconfigured with an
address out of its local subnet. Even though basic IP connectivity (ping) with the neighbor
is broken, OSPF is still able to form full adjacency. But, OSPF routes will not go into RT.

Behavior of code with this enhancement implemented:

OSPF adjacency will not form if both sides of the numbered point-to-point link are not
in the same subnet. Instead, an error message like this will be printed:
OSPF: Rcv pkt from 18.10.0.6, Serial0, area 0.0.0.0 : src not on the same network
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
Information is in the OSPF DB but not in the RT
Address Flipped on Dual Links
3.3.3.3 Area 0 6.6.6.6
S0
18.10.0.4/30
R3 S1
18.10.0.20/30 R6

R3# show ip ospf neighbor

Neighbor ID Pri State Dead Time Address Interface
6.6.6.6 1 FULL/ - 00:00:30 18.10.0.6 Serial0
6.6.6.6 1 FULL/ - 00:00:33 18.10.0.22 Serial1
R3# show interface serial 0
Serial0 is up, line protocol is up
Internet address is 18.10.0.21/30
* Fix for CSCdp51090 will now prevent this issue. Neither OSPF neighbor would form.
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Information is in the OSPF DB but not in the RT
Discontiguous Backbone

Area 0

Area 0 Area 0

R1 ABR1 Area 1 ABR2 R2

• R1 and R2 are not be able to see each other

• Summary LSA for inter-area routes must not be generated into
the backbone
• The solution is to create virtual link between ABR1 and ABR2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 1
Information is in the OSPF DB but not in the RT
Discontiguous Backbone

Area 0 Area 0

R1 ABR1 Area 1 ABR2 R2

• R1 and R2 are not be able to see each other

• Summary LSA for inter-area routes must not be generated into
the backbone
• The solution is to create virtual link between ABR1 and ABR2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 1
Information is in the OSPF DB but not in the RT
Discontiguous Backbone

Summary
LSA

Area 0 Area 0

R1 ABR1 Area 1 ABR2 R2

• R1 and R2 are not be able to see each other

• Summary LSA for inter-area routes must not be generated into
the backbone
• The solution is to create virtual link between ABR1 and ABR2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 1
Information is in the OSPF DB but not in the RT
Discontiguous Backbone

Summary Summary
LSA LSA

Area 0 Area 0

R1 ABR1 Area 1 ABR2 R2

• R1 and R2 are not be able to see each other

• Summary LSA for inter-area routes must not be generated into
the backbone
• The solution is to create virtual link between ABR1 and ABR2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 1
SPF Running Constantly
Useful commands for troubleshooting this problem:
• Show IP OSPF stat detail

• Show IP OSPF database

• Show IP OSPF neighbor <interface> detail

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
SPF Running Constantly
Reasons:
• LSA Flaps Due To:

– Duplicate Router ID/IP address

– Constant link flapping in an area

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
SPF Running Constantly
R1# show ip ospf stat detail

OSPF process ID 1
------------------------------------------

Area 0: SPF algorithm executed 1 times

SPF 1 executed 1w0d ago, SPF type Full

SPF calculation time (in msec):
SPT Intra D-Intr Summ D-Summ Ext7 D-Ext7 Total
0 0 0 0 0 0 0 0
LSIDs processed R:1 N:0 Stub:1 SN:0 SA:0 X7:0
Change record R,
LSIDs changed 1
Last 10 LSIDs:
4.4.4.4(R)

Summary OSPF SPF statistic

SPF calculation time

Delta T Intra D-Intra Summ D-Summ Ext D-Ext Total Reason
1w0d 0 0 0 0 0 0 0 R,
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
SPF Running Constantly

R3# debug ip ospf monitor

OSPF: Schedule SPF in area 1
Change in LS ID 1.1.1.1, LSA type R,
OSPF: schedule SPF: spf_time 0ms wait_interval 861421816s
OSPF: Begin SPF at 0x33585480ms, process time 752ms
spf_time 0ms, wait_interval 861421816s
OSPF: End SPF at 0x33585488ms, Total elapsed time 8ms
Intra: 4ms, Inter: 0ms, External: 0ms

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
SPF Running Constantly
R3# show ip ospf database

OSPF Router with ID (3.3.3.3) (Process ID 1)

Router Link States (Area 0)

Link ID ADV Router Age Seq# Checksum Link count

3.3.3.3 3.3.3.3 106 0x80000009 0xC3F1 3
...
Summary Net Link States (Area 0)

Link ID ADV Router Age Seq# Checksum

18.10.0.0 7.7.7.7 3 (DNA) 0x80000008 0x3DC2
18.10.0.0 8.8.8.8 1396 0x80000004 0x27D8
...
Router Link States (Area 1)

Link ID ADV Router Age Seq# Checksum Link count

1.1.1.1 1.1.1.1 2 0x80000016 0xE6CD 2
...
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
SPF Running Constantly
R3# show ip ospf neighbor gig0/1 detail
Neighbor 172.23.192.241, interface address 3.3.3.1
In the area 0 via interface GigabitEthernet0/1
Neighbor priority is 1, State is FULL, 6 state changes
DR is 3.3.3.2 BDR is 3.3.3.1
Options is 0x12 in Hello (E-bit, L-bit)
Options is 0x52 in DBD (E-bit, L-bit, O-bit)
LLS Options is 0x1 (LR)
Dead timer due in 00:00:03
Neighbor is up for 00:02:29
Index 1/1, retransmission queue length 0, number of
retransmission 0
First 0x0(0)/0x0(0) Next 0x0(0)/0x0(0)
Last retransmission scan length is 0, maximum is 0
Last retransmission scan time is 0 msec, maximum is 0 msec
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
NSSA ABR Not Translating Type 7 LSA
Only the NSSA ABR with the highest RID does the conversion

NSSA
ASBR Area 1 RID: 7.7.7.7
NSSA NSSA Area 0
Type 7
ABR
router ospf 1
network 10.10.10.10 0.0.0.0 area 0 No Type 7/5 Translation
R8 RID: 8.8.8.8

Type 7–5 Conversion

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
NSSA ABR Not Translating Type 7 LSA
Only NSSA ABR with the highest RID does the conversion

NSSA
ASBR Area 1 RID: 7.7.7.7
NSSA NSSA Area 0
Type 7
router ospf 1
ABR
network 10.10.10.10 0.0.0.0 area 0
Type 7–5 Conversion
R8 RID: 8.8.8.8

NSSA
ABR
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
New NSSA command to select NSSA translator
• In 15.2T and 15.2M IOS, you can now hardcode an NSSA LSA Translator:
• R7(config)#router ospf 1
• R7(config-router)#area 1 nssa translate type7 always

NSSA
ASBR Area 1 RID: 7.7.7.7
NSSA NSSA Area 0
Type 7
ABR
Type 7–5 Conversion
R8 RID: 8.8.8.8

R9 RID:
NSSA
9.9.9.9
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 81 ABR
GRE Tunnel OSPF Adjacency is going up and down
GRE Tunnel destination must not be learned via the Tunnel !

1.1.1.2 2.2.2.1 2.2.2.2

1.1.1.1
Area 0 Area 0 Area 0 Area 0
R2 R3
R1

R1# show run interface tunnel1

interface Tunnel1
ip address 7.7.7.1 255.255.255.252
ip ospf cost 1
tunnel source GigabitEthernet0/0
tunnel destination 2.2.2.2

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 82
Tunnel destination learned via Tunnel tears down
the Tunnel and the OSPF neighbor
R1# show ip ospf neighbor
Neighbor ID Pri State Dead Time Address Interface
3.3.3.3 0 FULL/ - 00:00:39 7.7.7.2 Tunnel1

R1# sh ip route | incl Tunnel1

O 2.2.2.0 [110/11] via 7.7.7.2, 00:00:01, Tunnel1

*May 15 18:00:26.375: %TUN-5-RECURDOWN: Tunnel1 temporarily disabled due to

recursive routing
*May 15 18:00:26.375: %OSPF-5-ADJCHG: Process 1, Nbr 7.7.7.2 on Tunnel1 from FULL to
DOWN, Neighbor Down: Interface down or detached
*May 15 18:00:26.379: %LINEPROTO-5-UPDOWN: Line protocol on Interface Tunnel1,
changed state to down

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
Cisco NX-OS
OSPF on the Nexus Platforms
Feature OSPF
• OSPF command-line interface (CLI) configuration and verification commands are not
available until you enable the OSPF feature with the feature ospf command.

Nexus(config)# feature ospf

The OSPF protocol requires the Enterprise Services license.

If you remove the feature ospf command, all relevant OSPF configuration information is
also removed.

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Quick view of ospf config
Nexus# show run ospf
version 6.1(3)
feature ospf
router ospf 100
router-id 5.5.5.5
log-adjacency-changes detail
auto-cost reference-bandwidth 100 Gbps
interface Ethernet5/2
ip router ospf 100 area 0.0.0.0
interface Ethernet5/3
ip router ospf 100 area 0.0.0.0
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
‘show ip route’ command has different look

Nexus# show ip route

IP Route Table for VRF "default”
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
1.1.1.1/32, ubest/mbest: 1/0
*via 9.9.9.2, Eth1/1, [110/41], 08:03:05, ospf-100, inter0
5.5.5.5/32, ubest/mbest: 1/0
*via 9.9.9.2, Eth1/1, [110/41], 05:43:23, ospf-100, intra

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
OSPF event-history feature

Nexus# show ip ospf event-history ?

adjacency Adjacency formation logs
cli Cli logs
event Internal event logs
flooding LSA flooding logs
ha HA and GR logs
lsa LSA generation and database logs
msgs IPC logs
redistribution Redistribution logs
spf SPF calculation logs
statistics Show the state and size of the buffers

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
Show tech ospf

Nexus# show tech-support ospf > show-tech-ospf

This will save a ‘show tech-support ospf’ to a file on the flash called ‘show-tech-ospf’

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
Cisco IOS-XR
OSPF on the IOS-XR Platforms
Cisco IOS-XR Comparison to IOS OSPF
• IOS-XR introduces a hierarchical CLI for ease of configuration

• IOS-XR uses CLI inheritance to simplify configuration

• Interface specific parameters are now configured under the area portion of the
OSPF configuration

• Show command CLI no longer uses the “IP” prefix. Example: show IP OSPF
neighbor becomes show OSPF neighbor

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
IOS-XR – Quick view of OSPF config
RP/0/RP0/CPU0:9K-Router# show run router ospf
router ospf 1
nsr
log adjacency changes detail
router-id 172.31.1.20
bfd minimum-interval 150
bfd fast-detect
bfd multiplier 8
auto-cost reference-bandwidth 10000
area 0
interface Loopback0
!
interface TenGigE0/0/0/0
authentication message-digest
message-digest-key 1 md5 encrypted B705450B102
!
interface TenGigE0/1/0/0
authentication message-digest
message-digest-key 1 md5 encrypted B705450B102

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
IOS-XR Show Commands
IOS-XR show commands are very similar to IOS

RP/0/RP0/CPU0:9K-Router# show ospf database ?

adv-router Advertising Router link states
asbr-summary ASBR summary link states
database-summary Summary of database
external External link states
network Network link states
nssa-external NSSA External link states
router Router link states
self-originate Self-originated link states
summary Network summary link states

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
IOS-XR Show Commands
Be aware of MTU versus MTU available to IP
RP/0/RSP0/CPU0:9K-Router# show run interface ten0/1/0/0
interface TenGigE0/1/0/0
mtu 1560
RP/0/RSP0/CPU0:9K-Router# show ip interface ten0/1/0/0
Sun Mar 23 14:05:04.278 EDT
TenGigE0/1/0/0 is Up, ipv4 protocol is Up
Vrf is default (vrfid 0x60000000)
Internet address is 172.31.16.239/27
MTU is 1560 (1546 is available to IP)
Multicast reserved groups joined:
224.0.0.5 224.0.0.6

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
Watch for MTU mismatch
• In Cisco IOS software, the mtu command and the corresponding show
commands do not include the L2 header.

• This is different from Cisco IOS XR software, where the mtu command includes
the L2 header (14 bytes for Ethernet or 4 bytes for PPP/HDLC).

• If a Cisco IOS router is configured with mtu x and is connected to a Cisco IOS
XR router, then the corresponding interface on the Cisco IOS XR router should
be configured with mtu x+14 for Ethernet interfaces, or mtu x+4 for serial
interfaces.

• On Ethernet Media with IOS-XR, default is MTU 1514 and 1500 available to IP

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
IOS-XR Show Commands
RP/0/RSP0/CPU0:9K-Router# show ospf interface ten0/1/0/0
TenGigE0/1/0/0 is up, line protocol is up
Internet Address 172.31.16.239/27, Area 0
Process ID 1, Router ID 172.31.1.20, Network Type BROADCAST, Cost: 1
Transmit Delay is 1 sec, State DROTHER, Priority 1, MTU 1546, MaxPktSz 1546
BFD enabled, BFD interval 150 msec, BFD multiplier 8
Designated Router (ID) 172.31.1.113, Interface address 172.31.16.226
Backup Designated router (ID) 172.31.1.102, Interface address 172.31.16.225
Timer intervals configured, Hello 10, Dead 40, Wait 40, Retransmit 5
Hello due in 00:00:06
Neighbor Count is 17, Adjacent neighbor count is 2
Adjacent with neighbor 172.31.1.102 (Backup Designated Router)
Adjacent with neighbor 172.31.1.113 (Designated Router)
Message digest authentication enabled
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
IOS-XR Show Commands

RP/0/RSP0/CPU0:9K-Router# show ospf our-address

Local Address Database for ospf 1 with ID 172.31.1.20

172.31.1.20 Loopback0
172.31.16.207 TenGigE0/0/0/0
172.31.16.239 TenGigE0/1/0/0

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
IOS-XR Show Commands

RP/0/RSP0/CPU0:9K-Router# show ospf interface brief

Interfaces for OSPF 1

Interface PID Area IP Address/Mask Cost State Nbrs F/C

Lo0 1 0 172.31.1.20/32 1 LOOP 0/0
Te0/0/0/0 1 0 172.31.16.207/27 1 DROTH 2/18
Te0/1/0/0 1 0 172.31.16.239/27 1 DROTH 2/17

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
IOS-XR Troubleshooting – Using Trace
IOS-XR incorporates a built-in debug called trace

RP/0/RP0/CPU0:9K-Router# show ospf trace

Trace Name Size Count Description

1. adj 8192 2963 adjacency

2. adj_cycle 8192 72484 dbd/flood events/pkts

3. config 2048 204 config events

4. errors 8192 1017 errors

5. events 4096 300 mda/rtrid/bfd/vrf

6. ha 8192 309 startup/HA/NSF

7. hello 2048 2852464 hello events/pkts

8. idb 8192 862 interface

9. pkt 2048 1453478 I/O packets

10. rib 8192 1927 rib batching

11. spf 8192 8848 spf/topology

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
IOS-XR Troubleshooting – Using Trace (Cont.)

IOS-XR incorporates a built-in debug called trace

RP/0/RSP0/CPU0:9K-Router# sh ospf trace ?

WORD name of trace buffer
all Dump all traces -- suggest redirecting to file
| Output Modifiers
<cr>

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 100
IOS-XR Troubleshooting – Using Trace (Cont.)
RP/0/RSP0/CPU0:9K-Router# sh ospf trace idb 5
Tue Apr 15 23:14:12.289 EDT
Traces for OSPF 1 (Tue Apr 15 23:14:12)
Traces returned/requested/available: 5/5/3233
Trace buffer: idb

1 Apr 12 22:38:25.728* ospf_elect_bdr: intf Te0/0/0/0 172.31.1.13(172.31.16.198)

2 Apr 12 22:38:25.728* ospf_elect_dr: intf Te0/0/0/0 172.31.1.113(172.31.16.194)
3 Apr 12 22:38:25.728* ospf_choose_dr: intf Te0/0/0/0 new DR: 172.31.1.113(172.31.16.194)
4 Apr 12 22:38:25.728* ospf_choose_dr: intf Te0/0/0/0 new BDR: 172.31.1.13(172.31.16.198)
5 Apr 12 22:38:25.784* ospf_build_rtr_lsa: no change in router LSA, area 0.0.0.0 rtrid 172.31.1.20

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
IOS-XR Troubleshooting – Show Tech

RP/0/RP0/CPU0:9K-Router# show tech routing ospf

• Output is extensive. Use the “file” keyword to save data on local media.

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
Troubleshooting Enhancements
Debugging made easier
Interface Scoped Debugging
• Enhancement in limiting the OSPF debug output to selected interfaces
• Example below will generate debug output for only two interfaces specified
below
– debug condition interface Ethernet 0/0
– debug condition interface Ethernet 1/0
– debug ip ospf hello
– debug ip ospf adjacency
Available starting in: 12.4(4)T, 12.2(30)S, 12.0(32)S
– debug ip ospf flood
Further enhancement to allow an access-list filter, and a “detail”
option
Available starting in: 12.4(4)T, 12.2(30)S, 12.0(32)S
– debug ip ospf packet
Available starting in: 12.4(10), 12.2(33)SXH, 12.2(33)SRB

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
OSPF Event Logging Feature
Built in ospf event history logging

R5# sh ip ospf
Routing Process "ospf 1" with ID 5.5.5.5
Supports only single TOS(TOS0) routes
Supports opaque LSA
Supports Link-local Signaling (LLS)
Supports area transit capability
Event-log enabled, Maximum number of events: 1000, Mode: cyclic

• Enabled by default
• Available in 15.x IOS code and later
• Can be tuned using ‘event-log’ keyword under OSPF process

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
OSPF Event Logging Feature cont.
Built in ospf event history logging

R5# sh ip ospf event ?

generic Generic Events
interface Interface State Change Events
lsa LSA Arrival and LSA Generation Events
neighbor Neighbor State Change Events
reverse Show Events in Reverse Order
rib RIB Update, Delete and Redistribution Events
spf SPF Scheduling and SPF Run Events
| Output modifiers
<cr>
BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
 OSPF Event Logging Feature cont.

R1# sh ip ospf event interface

OSPF Router with ID (1.1.1.1) (Process ID 1)

22 *May 15 19:26:26.114: Interface Tunnel1 state changes from POINT_TO_POINT to DOWN

72 *May 15 19:26:06.114: Interface Tunnel1 state changes from DOWN to POINT_TO_POINT
96 *May 15 19:25:05.998: Interface Tunnel1 state changes from POINT_TO_POINT to DOWN

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
Show tech-support ospf (for IOS)

R1# show tech-support ospf detail | redirect flash:show-tech-ospf

In the example above, the output from the ‘show tech-support ospf detail’ would be saved to
a file in flash called ‘show-tech-ospf’

To see the contents of the file, you can either copy the file up to a TFTP server or do this:

R1# term len 0

R1# more flash:show-tech-ospf

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
Summary
What Have We Learned?

• Overview of OSPF LSAs

• Different troubleshooting commands and what to look for in those commands
• Common issues in OSPF networks; e.g., adjacency problems, information in the
database but not in RT, SPF problems and NSSA problems and how to correct
those problems
• OSPF on Other Platforms
• OSPF Troubleshooting Enhancements

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
Call to Action
• Visit the World of Solutions for
– Cisco Campus
– Walk in Labs
– Technical Solution Clinics
• Meet the Engineer
• Lunch time Table Topics
• DevNet zone related labs and sessions
• Recommended Reading: for reading material and further resources for sessions,
please visit www.pearson-books.com/CLMilan2015

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
Complete Your Online Session Evaluation
• Please complete your online session
evaluations after each session.
Complete 4 session evaluations
& the Overall Conference Evaluation
(available from Thursday)
to receive your Cisco Live T-shirt.

• All surveys can be completed via

the Cisco Live Mobile App or the
Communication Stations

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 111
More Information
• White Papers
• Web and Mailers
• Cisco Press

CCO OSPF Page:

http://www.cisco.com/en/US/tech/tk365/tk480/tsd_technology_support_sub-protocol_home.html

BRKRST-3310 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 112