8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting

Products & Services Support Training How to Buy

Downloads Cases Contracts & Licenses Documentation & Tools Account Assistance MyJuniper

Keywords or Article ID...

[EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for
troubleshooting

[KB26813] Show Article Properties

Back to Knowledge Search

Printer Friendly
SUMMARY:
PR Search
Data Collection and Troubleshooting Guides can help with issue investigation as well as reducing resolution time. Each
issue might require a different set of data to collect. This article contains a list of data to collect, as well as pointers to Create a Support Case
Resolution Guides and references on how to collect the data.
All Security Advisories

Knowledge Center Feedback

SYMPTOMS:
On a EX Series Switch or a QFX Series Switch, what information should I collect to assist in troubleshooting, prior Report a Security Vulnerability
to opening a case?
Knowledge Search Help
The goal of this document is to reduce the time spent on initial data collection and reduce resolution time by providing a
comprehensive list of what to collect or gather to troubleshoot an issue.

Note: Your feedback is welcome on the format of the Data Collection Checklist. Use the feedback form on the right.

CAUSE:

SOLUTION:
This section contains the following:
Data to Collect for all configurations
Additional Data to Collect
References

Caveats and tips:

Traceoptions require additional system resources to gather and store data:
Please ensure you have enough disk space when enabling traceoptions
Gauge current system utilization before enabling traceoptions
"show chassis routing-engine"
Instead of using "flag all" you can flag specific areas of interest
Delete all traceoptions that are not needed for immediate debugging
Don't forget to remove traceoptions after data collection is completed
To deactivate paging (output stopping each page requiring you to press space bar) you can:
Run "set cli screen-length 0" for this to apply for all commands for your sessions
Add the "| no-more" option at the end of a command

Data to Collect for all configurations:

Regardless of configuration, all cases will benefit by attaching the session captures, request information output, and logs
when initially opening the case. If you need to investigate an intermittent concern (for example slow transfers at peak
hours) please be sure to collect this data at the time of the problem.

1. Provide all SSH / Telnet session captures

2. Provide any available topology information
Background
3. Summary of how the device is being used (production, lab system, co-location, etc)
information
4. Summary of device history (new install, production for X months/years, other recent cases, etc)
5. Summary of any recent changes in the network or on the device

1. Enter: request support information | save /var/log/rsi1.log

Request 2. Once step #1 completes, wait enough time to ensure that the condition you wish to address
All support info continues/appears before proceeding to the next step.
Configurations 3. Enter: request support information | save /var/log/rsi2.log

Archive the /var/log/ contents:

file archive compress source /var/log/* destination /var/tmp/CURRENT-

Logs DATE.tgz

To ensure the /var/log/ directory was properly archived, check the file size using the command: file
list /var/tmp/CURRENT-DATE.tgz detail

See References section for the following:

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 1/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting
How to gather the data
Resolution Guides
Technical Bulletins

Additional Data to Collect:

In addition, collect the data shown below for the following issues:
Jump to:

Aggregated - LACP
BFD
BGP
CoS
DHCP
dot1X
ERP (protection-group)
EX8200 Fabric Plane
Firewall Filters
High CPU
IPv6
ISIS
L2 VPN
L3 VPN
MPLS
Multicast
NTP
OAM
OSPF
PoE
RIP
SNMP
Spanning Tree
Virtual Chassis
VLAN
VRRP

show interfaces terse | match ae

show interfaces statistics
CLI show ethernet-switching table | match xx-x/x/x
commands: show lacp interfaces
show lacp statistics interfaces xx-x/x/x
show interface extensive
Aggregated Logs: /var/log/messages
link set protocols lacp traceoptions file lacp.tr
(LACP) set protocols lacp traceoptions file size 5m
Traceoptions:
set protocols lacp traceoptions file files 5
set protocols lacp traceoptions flag all
- What device is connected at the other end?
- Is link protection enabled?
Questions:
- What are the troubleshooting steps so far?
- Did the issue start after any kind of device or config change?
[Back to Top]

show bfd session brief

show bfd session
CLI show bfd session summary
commands: show bfd session detail
show bfd session discriminator brief
BFD show bfd session discriminator detail address
Logs: /var/log/messages
set protocols bfd traceoptions file bfd.tr
set protocols bfd traceoptions file size 5m
Traceoptions:
set protocols bfd traceoptions file files 5
set protocols bfd traceoptions flag all
[Back to Top]

BGP set cli timestamp

show bgp summary
show bgp group
show bgp neighbor
show route next-hop
show route protocol bgp all
Show show route receive-protocol bgp < peer address> extensive
commands: show route advertising-protocol bgp extensive
show route forwarding-table
show route resolution unresolved
show route community
show route damping [history|decayed|surpressed]
show route aspath-regex
monitor traffic interface XX-X/X/X size 4096 detail
Logs: /var/log/messages
Traceoptions: set protocols bgp traceoptions file bgp.tr
set protocols bgp traceoptions file size 5m
Caveats set protocols bgp traceoptions file files 5
set protocols bgp traceoptions flag all
set routing-instances bgp-ri protocols bgp traceoptions file bgp.tr
set routing-instances bgp-ri protocols bgp traceoptions file size 5m
set routing-instances bgp-ri protocols bgp traceoptions file files 5
set routing-instances bgp-ri protocols bgp traceoptions flag all
https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 2/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting
[Back to Top]

show interface xx-x/x/x detail

show interface queue xx-x/x/x both-ingress-egress
show interfaces XX-X/X/X extensive

show class-of-service interfaces XX-X/X/X

show class-of-service code-point-aliases
show class-of-service code-point-aliases dscp
show class-of-service code-point-aliases inet-prec
CLI
show class-of-service code-point-aliases exp
commands:
show class-of-service forwarding-class
show class-of-service classifier [name]
CoS show class-of-service scheduler-map
show class-of-service rewrite-rule
show class-of-service drop-profile
show class-of-service forwarding-table
show class-of-service forwarding-table classifier mapping
show class-of-service forwarding-table scheduler-map
Logs: /var/log/messages
set class-of-service traceoptions file class-of-service.tr
set class-of-service traceoptions file size 5m
Traceoptions:
set class-of-service traceoptions file files 5
set class-of-service traceoptions flag all
[Back to Top]

show configuration | display set | match dhcp

show system services dhcp binding detail
show system services dhcp client
CLI show system services dhcp pool detail
commands: show interfaces terse
show dhcp snooping binding vlan
show dhcp snooping binding interface xx-x/x/x
DHCP monitor traffic interface xx-x/x/x
Logs: /var/log/messages
Traceoptions: none
- Any troubleshooting steps so far?
- Confirm whether the discover packet is reaching the switch?
Questions:
- Is the switch replying with an offer packet?
- Any packet captures taken at the interface ends?
[Back to Top]

show dot1x authentication-bypassed-users

show dot1x authentication-failed-users
CLI show dot1x static-mac-address
commands: show dot1x statistics
show dot1x interface brief
dot1X show dot1x interface detail
Logs: /var/log/messages
set protocols dot1x traceoptions file dot1x.tr
set protocols dot1x traceoptions file size 5m
Traceoptions:
set protocols dot1x traceoptions file files 5
set protocols dot1x traceoptions flag all
[Back to Top]

show configuration protocols protection-group

show ethernet-switching interfaces xx-x/x/x
show protection-group ethernet-ring interface brief
CLI
show protection-group ethernet-ring interface detail
commands:
show protection-group ethernet-ring node-state
ERP show protection-group ethernet-ring statistics
(protection- show protection-group ethernet-ring configuration
group)
Logs: /var/log/messages
set protocols protection-group traceoptions file protection-group.tr
set protocols protection-group traceoptions file size 5m
Traceoptions:
set protocols protection-group traceoptions file files 5
set protocols protection-group traceoptions flag all
[Back to Top]

EX 8200 General:
Fabric show chassis environment cb
Plane show chassis alarms

Fabric related:
show chassis hardware
CLI show chassis fabric summary
commands: show chassis fabric map
show chassis fabric fpc
show chassis fabric plane
show class-of-service fabric statistics (take multiple outputs to see counters
incrementing)
show pfe statistics traffic (take multiple outputs to see counters incrementing)

show log messages

Logs:
show log chassisd
Hidden NOTE: These commands are not officially supported, and are hidden, albeit are good for
Commands: troubleshooting Fabric Plane issues.

Caveats Please exercise caution when executing this commands, as incorrect syntax may lead to
problems.

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 3/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting

show chassis fabric statistics detail

show chassis fabric asic-configuration plane

- Have the SCB's for which the alarms have generated had any previous history of any
issues?
- What kind of troubleshooting has already been done to mitigate the problem. Please
provide detailed steps.
Questions: - Were there any recent changes to the configuration?
- Were there any changes to the hardware setup, or was new hardware introduced?
- Were there any events that occurred just before the log message that may have triggered
it? This may include events such as routing engine switchover etc.
- Was a software upgrade/downgrade done recently?
[Back to Top]

show interfaces filters

show firewall
CLI
show firewall filter
Firewall commands:
show firewall log
Filters show policy conditions
Logs: /var/log/messages
Traceoptions: None
[Back to Top]

set cli timestamp

show chassis routing-engine (multiple snapshots, atleast 5)
show system processes extensive (multiple snapshots atleast 5)
show system users
show system connections
show system statistics
show task memory detail
CLI
show task memory summary
commands:
show task io
show task history
show task statistics
High CPU show task job
show task jobs
show krt queue
show krt state
Logs: /var/log/messages
user@router# show routing-options
traceoptions {
file routing-trace size 10m files 20 world-readable;
Traceoptions: flag task;
flag state;
flag timer;
}
[Back to Top]

show interface terse

CLI show route table inet6
commands: show ipv6 neighbor
IPv6 show interface lo0 extensive | display xml
Logs: /var/log/messages
Traceoptions: None
[Back to Top]

set cli timestamp

show isis adjacency
show isis adjacency extensive
show isis interface
show isis hostname
show isis spflog
Show
show isis statistics
commands:
show isis route
show route protocol isis
show isis database
show isis database detail
ISIS show bfd session
show route forwarding-table
Logs: /var/log/messages
set protocols isis traceoptions file rip.tr
set protocols isis traceoptions file size 5m
set protocols isis traceoptions file files 5
Traceoptions:
set protocols isis traceoptions flag all
set routing-instances isis-vr protocols isis traceoptions file isis.tr
Caveats
set routing-instances isis-vr protocols isis traceoptions file size 5m
set routing-instances isis-vr protocols isis traceoptions file files 5
set routing-instances isis-vr protocols isis traceoptions flag all
[Back to Top]

show l2vpn connections extensive

show route table
CLI show route advertising-protocol bgp x.x.x.x
commands: show route receive-protocol bgp x.x.x.x
L2 VPN show route table mpls.o
show route forwarding-table family mpls
Logs: /var/log/messages
Traceoptions: None

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 4/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting
[Back to Top]

show route table

show route table hidden
show route forwarding-table vpn

ping x.x.x.x routing-instance

traceroute x.x.x.x routing-instance
telnet x.x.x.x routing-instance
ping mpls l3vpn prefix
CLI
commands:
L3 VPN show route advertising-protocol bgp x.x.x.x
show route receive-protocol bgp x.x.x.x
show arp

OSPF VPN commands

show ospf interface instance
show ospf neighbor instance
show ospf database instance
Logs: /var/log/messages
Traceoptions: None
[Back to Top]

show mpls interface

show mpls lsp
show mpls lsp extensive
show mpls lsp ingress
show mpls lsp transit
show ted database
RSVP
show rsvp interface
Show show rsvp neighbor
commands: show rsvp session
show rsvp session ingress
show rsvp version
show route table mpls.0
show route table inet.3
MPLS LDP
show ldp neighbors
show ldp session
show ldp database [session peer]
Logs: /var/log/messages
set protocols mpls|ldp|rsvp traceoptions file mpls.tr
set protocols mpls|ldp|rsvp traceoptions file size 5m
set protocols mpls|ldp|rsvp traceoptions file files 5
Traceoptions: set protocols mpls|ldp|rsvp traceoptions flag all

Caveats set protocols mpls label-switched-path traceoptions file mpls-lsp.tr

set protocols mpls label-switched-path traceoptions file size 5m
set protocols mpls label-switched-path traceoptions file files 5
set protocols mpls label-switched-path traceoptions flag all
[Back to Top]

General
show multicast route
show multicast sessions
show multicast usage
show multicast interface
show multicast next-hops
show multicast rpf summary
show interface extensive
IGMP
show igmp group detail
show igmp statistics
Show
show igmp interface detail
commands:
PIM
show pim statistics
show pim neighbors
Multicast show pim rps detail
show pim join extensive
show pim bootstrap
show pim source detail
MSDP
show msdp source-active
show msdp detail
show msdp statistics
Logs: /var/log/messages
set protocols pim|igmp|msdp traceoptions file multicast-proto.tr
set protocols pim|igmp|msdp traceoptions file size 5m
Traceoptions:
set protocols pim|igmp|msdp traceoptions file files 5
set protocols pim|igmp|msdp traceoptions flag all
Caveats
enable traceoptions for either of PIM, IGMP, MSDP
[Back to Top]

show ntp associations

CLI show ntp status
commands: show version
NTP show system uptime
Logs: /var/log/messages
Traceoptions: none

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 5/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting
[Back to Top]

show configuration protocols oam

show oam ethernet link-fault-management brief
show oam ethernet link-fault-management detail
show oam ethernet link-fault-management vlan detail
CLI
commands:
show oam ethernet connectivity-fault-management adjacencies
show oam ethernet connectivity-fault-management interfaces brief
show oam ethernet connectivity-fault-management interfaces detail
show oam ethernet connectivity-fault-management interfaces vlan
Logs: /var/log/messages
set protocol oam ethernet link-fault-management traceoptions file link-
OAM fault.tr
set protocol oam ethernet link-fault-management traceoptions file size 5m
set protocol oam ethernet link-fault-management traceoptions file files 5
set protocol oam ethernet link-fault-management traceoptions flag all

set protocol oam ethernet connectivity-fault-management traceoptions file

Traceoptions:
connect-fault.tr
set protocol oam ethernet connectivity-fault-management traceoptions file
size 5m
set protocol oam ethernet connectivity-fault-management traceoptions file
files 5
set protocol oam ethernet connectivity-fault-management traceoptions flag
all
[Back to Top]

(If OSPF is running in a routing instance, specify which instance where applicable)
set cli timestamp
show ospf overview
show ospf database
show ospf neighbor detail
show ospf route
Show show ospf statistics
commands: show ospf interface (brief | detail | extensive)
show ospf log
show route protocol ospf
show route extensive
show ospf database summary
show ospf database extensive
show bfd session
OSPF
Logs: /var/log/messages
(use below for inet.0 default instance)
set protocols ospf traceoptions file ospf.tr
set protocols ospf traceoptions file size 5m
set protocols ospf traceoptions file files 5
set protocols ospf traceoptions flag all
Traceoptions:
(use below for routing instances)
Caveats
set routing-instances ospf-vr protocols ospf traceoptions file ospf-
vr.tr
set routing-instances ospf-vr protocols ospf traceoptions file size 5m
set routing-instances ospf-vr protocols ospf traceoptions file files 5
set routing-instances ospf-vr protocols ospf traceoptions flag all
Known
NA
Issues:
[Back to Top]

show configuration poe

show poe controller
CLI show poe interface
commands: show interfaces terse
show poe notification-control
PoE show poe telemetries interface xx-x/x/x all
Logs: /var/log/messages
- Did the device face any power outage?
Questions: - Are the poe devices currently connected? If so, which all ports?
- Details of the POE devices connected?
[Back to Top]

set cli timestamp

show rip neighbor
show route protocol rip
Show show route advertising-protocol rip extensive
commands: show route receive-protocol rip extensive
show rip statistics
show route forwarding-table
show route resolution unresolved
RIP Logs: /var/log/messages
set protocols rip traceoptions file rip.tr
set protocols rip traceoptions file size 5m
set protocols rip traceoptions file files 5
Traceoptions:
set protocols rip traceoptions flag all
set routing-instances rip-vr protocols rip traceoptions file rip.tr
Caveats
set routing-instances rip-vr protocols rip traceoptions file size 5m
set routing-instances rip-vr protocols rip traceoptions file files 5
set routing-instances rip-vr protocols rip traceoptions flag all

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 6/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting
[Back to Top]

set cli timestamp

show configuration snmp
show snmp statistics # Multiple time with polling activity.
show snmp mib walk
show interface lo0 extensive
show system processes extensive | no-more # Multiple time with polling
activity.
show chassis routing-engine | no-more # Multiple time with polling
CLI
activity.
commands:
show system commit | no-more
SNMP show system statistics # Multiple time with polling activity.
show system buffers # Multiple time with polling activity.
show system core-dumps
show route
ping source count 500 rapid
show pfe statistics traffic # Multiple time with polling activity.
show interface extensive | no-more
Logs: /var/log/messages
set snmp traceoptions file snmp files 10 size 50m
Traceoptions:
set snmp traceoptions flag all
[Back to Top]

show configuration protocols

show spanning-tree bridge brief
CLI show spanning-tree bridge detail
commands: show spanning-tree statistics
show spanning-tree interface
show ethernet-switching mac-learning-log
STP Logs: /var/log/messages
(Spanning set protocols stp traceoptions file stp.tr
Tree set protocols stp traceoptions file size 5m
Protocol) Traceoptions:
set protocols stp traceoptions file files 5
set protocols stp traceoptions flag all
- What kind of spanning tree flavour is running?
- Is the customer using other vendor device with in the same spanning tree ?
- Is the customer using same spanning tree flavour on all the switches?
Questions:
- Any recent configuration changes related to cost, bridge priority, storm control, BPDU
block?
- Is there any hub connected to any of the switches?
[Back to Top]

show configuration vlans

show vlans brief
CLI
show vlans
commands:
show vlans summary
show interfaces terse | match in
VLAN
Logs: /var/log/messages
Traceoptions: none
Did the issue start after any configuration/ device change?
Questions:
What are the devices connected?
[Back to Top]

show configuration protocols vrrp

show vrrp brief
CLI show vrrp detail
commands: show vrrp interface xx-x/x/x
show vrrp track summary
show vrrp track detail
Logs: /var/log/messages
VRRP set protocol vrrp traceoptions file vrrp.tr
set protocol vrrp traceoptions file size 5m
Traceoptions:
set protocol vrrp traceoptions file files 5
set protocol vrrp traceoptions flag all
- Any new device was added in to the network?
- What are the troubleshooting steps so far?
Questions: - Any recent configuration changes?
- Any spannning tree relates issues ?
- Are the hello packets are being recieved on the other end?
[Back to Top]

show version
show configuration virtual-chassis
show virtual-chassis status
CLI
show virtual-chassis vc-port all-members
commands:
show virtual-chassis mode
show virtual-chassis protocol interface
show virtual-chassis protocol statistics
Virtual Logs: /var/log/messages
Chassis
set virtual-chassis traceoptions file virtual-chassis.tr
set virtual-chassis traceoptions file size 5m
Traceoptions:
set virtual-chassis traceoptions file files 5
set virtual-chassis traceoptions flag all
- Any troubleshooting steps so far?
Questions: - Did the issue begin after any device or config change?
- Is the issue happening again and again?

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 7/8
8/10/2017 Juniper Networks - [EX Series / QFX Series] Data Collection Checklist - Logs/data to collect for troubleshooting

[Back to Top]

References:
How to:
Tar / Zip / Archive data collection -
KB17228 - [Junos] How to collect /var/log files from Routing Engine (RE)
KB20569 - Collecting Logs from EX series devices using the 'file archive' command

Upload collected data:

Files smaller than 10MB can be attached to the case
Files greater than 10MB, refer to KB23337 - How to upload large files to a JTAC Case

Resolution Guides: KB9936 - JTAC Certified step-by-step troubleshooting flowcharts and articles

Technical Bulletins: EX Series (login to see more)

For more information on Technical Bulletins, see KB9890 - How do I subscribe to a technical bulletin so I can I get email
alerts regarding product issues, new product release announcements and security or safety issues?.

RELATED LINKS:
How to Contact Support

https://kb.juniper.net/InfoCenter/index?page=content&id=KB26813&actp=METADATA 8/8