You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 21:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Apr 14, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21337991918,1cyclictest65850irq/126-lan11:39:401
21337991817,1cyclictest65850irq/126-lan10:50:211
21337991817,1cyclictest65850irq/126-lan07:45:151
21337991717,0cyclictest65850irq/126-lan08:50:091
21337991717,0cyclictest65850irq/126-lan08:05:121
21337991717,0cyclictest65850irq/126-lan07:35:221
21337991717,0cyclictest65850irq/126-lan07:33:591
21337991717,0cyclictest65850irq/126-lan07:25:181
21337991716,1cyclictest65850irq/126-lan11:45:151
21337991716,1cyclictest65850irq/126-lan11:00:181
21337991716,1cyclictest65850irq/126-lan10:15:171
21337991716,1cyclictest65850irq/126-lan08:20:131
21337991616,0cyclictest65850irq/126-lan10:40:201
21337991616,0cyclictest65850irq/126-lan10:35:121
21337991616,0cyclictest65850irq/126-lan07:56:051
21337991615,1cyclictest65850irq/126-lan12:09:241
21337991615,1cyclictest65850irq/126-lan10:10:121
21337991615,1cyclictest65850irq/126-lan10:00:201
21337991615,1cyclictest65850irq/126-lan09:15:221
21337991615,1cyclictest65850irq/126-lan08:40:211
21337991615,1cyclictest65850irq/126-lan08:40:211
21337991615,1cyclictest65850irq/126-lan08:35:171
21337991615,1cyclictest65850irq/126-lan08:25:151
21337991515,0cyclictest65850irq/126-lan12:39:421
21337991515,0cyclictest65850irq/126-lan12:00:091
21337991515,0cyclictest65850irq/126-lan10:55:131
21337991515,0cyclictest65850irq/126-lan09:55:121
21337991515,0cyclictest65850irq/126-lan09:49:151
21337991515,0cyclictest65850irq/126-lan09:23:081
21337991515,0cyclictest65850irq/126-lan07:10:201
21337991514,1cyclictest65850irq/126-lan11:50:131
21337991514,1cyclictest65850irq/126-lan11:15:171
21337991514,1cyclictest65850irq/126-lan10:20:171
21337991514,1cyclictest65850irq/126-lan09:35:221
21337991514,1cyclictest65850irq/126-lan09:34:181
21337991514,1cyclictest65850irq/126-lan08:00:121
21337991414,0cyclictest65850irq/126-lan12:13:461
21337991414,0cyclictest65850irq/126-lan07:20:131
21337991413,1cyclictest65850irq/126-lan12:30:191
21337991413,1cyclictest65850irq/126-lan12:20:171
21337991413,1cyclictest65850irq/126-lan12:15:131
21337991413,1cyclictest65850irq/126-lan11:55:121
21337991413,1cyclictest65850irq/126-lan11:05:161
21337991413,1cyclictest65850irq/126-lan10:25:201
21337991413,1cyclictest65850irq/126-lan09:10:201
21337991413,1cyclictest65850irq/126-lan09:05:161
21337991413,1cyclictest65850irq/126-lan08:30:221
21337991413,1cyclictest65850irq/126-lan07:40:131
21337991313,0cyclictest65850irq/126-lan12:25:131
21337991313,0cyclictest65850irq/126-lan09:50:171
21337991313,0cyclictest65850irq/126-lan09:40:181
21337991312,1cyclictest65850irq/126-lan11:30:121
21337991312,1cyclictest65850irq/126-lan11:20:181
21337991312,1cyclictest65850irq/126-lan11:10:181
21337991312,1cyclictest65850irq/126-lan10:05:111
21337991212,0cyclictest65850irq/126-lan11:25:191
21337991212,0cyclictest65850irq/126-lan08:10:211
21337991212,0cyclictest65850irq/126-lan07:55:001
21337991211,1cyclictest65850irq/126-lan09:25:121
21337991211,1cyclictest65850irq/126-lan08:55:151
21337991110,1cyclictest65850irq/126-lan10:30:181
2133799109,1cyclictest65850irq/126-lan11:40:181
21337991010,0cyclictest65850irq/126-lan08:15:131
213449998,1cyclictest743-21snmpd08:01:113
213449998,1cyclictest743-21snmpd07:49:343
213449998,1cyclictest741-21lldpd08:48:353
213449996,3cyclictest717-21ntpd12:12:583
213409998,1cyclictest743-21snmpd10:53:042
213379999,0cyclictest65850irq/126-lan09:00:131
213379999,0cyclictest65850irq/126-lan07:15:131
213379998,1cyclictest65850irq/126-lan10:45:001
213339998,1cyclictest743-21snmpd12:13:420
213339998,1cyclictest743-21snmpd10:26:190
213449988,0cyclictest743-21snmpd12:25:073
213449988,0cyclictest743-21snmpd11:25:423
213449988,0cyclictest741-21lldpd10:06:233
213449988,0cyclictest741-21lldpd09:42:373
213449987,1cyclictest743-21snmpd10:27:183
213449987,1cyclictest743-21snmpd09:20:013
213449987,1cyclictest741-21lldpd08:35:403
213449986,2cyclictest717-21ntpd12:16:363
213449986,2cyclictest717-21ntpd12:05:343
213449986,2cyclictest717-21ntpd11:46:143
213449986,2cyclictest717-21ntpd11:30:503
213449986,2cyclictest717-21ntpd10:51:053
213449986,2cyclictest717-21ntpd10:45:413
213449986,2cyclictest717-21ntpd10:40:073
213449986,2cyclictest717-21ntpd10:36:253
213449986,2cyclictest717-21ntpd10:31:233
213449986,2cyclictest717-21ntpd09:51:253
213449986,2cyclictest717-21ntpd09:45:323
213449986,2cyclictest717-21ntpd09:39:133
213449986,2cyclictest717-21ntpd09:31:563
213449986,2cyclictest717-21ntpd09:27:343
213449986,2cyclictest717-21ntpd07:35:403
213449986,2cyclictest717-21ntpd07:32:043
213449986,2cyclictest717-21ntpd07:28:423
213449985,3cyclictest717-21ntpd08:25:293
213409988,0cyclictest743-21snmpd10:57:262
213409988,0cyclictest743-21snmpd09:36:352
213409988,0cyclictest743-21snmpd09:25:342
213409988,0cyclictest741-21lldpd07:11:072
213409987,1cyclictest743-21snmpd11:43:112
213409987,1cyclictest743-21snmpd07:47:342
213409986,2cyclictest743-21snmpd12:24:072
213409986,2cyclictest743-21snmpd11:31:052
213409986,2cyclictest743-21snmpd11:17:012
213409986,2cyclictest743-21snmpd10:45:332
213409986,2cyclictest743-21snmpd08:27:232
213409986,2cyclictest717-21ntpd12:25:012
213409986,2cyclictest717-21ntpd09:45:002
213409986,2cyclictest717-21ntpd09:40:202
213409986,2cyclictest717-21ntpd08:20:232
213409986,2cyclictest717-21ntpd07:50:132
213409984,3cyclictest16216-21find12:10:172
213339988,0cyclictest743-21snmpd11:52:360
213339988,0cyclictest743-21snmpd09:08:580
213339988,0cyclictest743-21snmpd07:15:300
213339988,0cyclictest741-21lldpd10:01:300
213339987,1cyclictest743-21snmpd12:08:120
213339987,1cyclictest743-21snmpd11:26:470
213339987,1cyclictest743-21snmpd11:17:550
213339987,1cyclictest741-21lldpd09:02:290
213339987,1cyclictest522-21avahi-daemon07:21:220
213339986,2cyclictest743-21snmpd11:55:060
213339986,2cyclictest743-21snmpd10:35:420
213339986,2cyclictest743-21snmpd09:53:140
213449977,0cyclictest743-21snmpd11:53:123
213449976,1cyclictest743-21snmpd10:24:033
213449976,1cyclictest573-21in:imuxsock11:57:353
213449975,2cyclictest743-21snmpd11:14:593
213449975,2cyclictest717-21ntpd09:55:423
213449975,2cyclictest26000-21cat07:20:143
213449972,4cyclictest7867-21cat09:15:003
213449972,4cyclictest22922-21cat11:10:003
213409977,0cyclictest743-21snmpd09:10:072
213409977,0cyclictest741-21lldpd12:37:502
213409977,0cyclictest741-21lldpd10:33:362
213409977,0cyclictest741-21lldpd10:11:322
213409977,0cyclictest741-21lldpd09:05:022
213409977,0cyclictest741-21lldpd09:04:192
213409977,0cyclictest741-21lldpd08:52:552
213409977,0cyclictest741-21lldpd07:38:072
213409977,0cyclictest741-21lldpd07:34:112
213409976,1cyclictest743-21snmpd09:55:442
213409976,1cyclictest717-21ntpd10:20:172
213409976,1cyclictest717-21ntpd08:00:142
213409976,1cyclictest32740-21gltestperf08:55:152
213409976,1cyclictest14673-21cat08:10:152
213409975,2cyclictest9580-21cat11:55:132
213409975,2cyclictest743-21snmpd07:27:192
213409975,2cyclictest717-21ntpd11:20:222
213409975,2cyclictest717-21ntpd08:05:012
213409975,2cyclictest717-21ntpd07:55:202
213409974,3cyclictest524-21dbus-daemon12:18:092
213409973,3cyclictest28547-21diskstats08:45:122
213339977,0cyclictest743-21snmpd10:20:170
213339977,0cyclictest743-21snmpd10:08:560
213339977,0cyclictest743-21snmpd08:31:480
213339977,0cyclictest743-21snmpd07:32:040
213339977,0cyclictest741-21lldpd07:52:020
213339977,0cyclictest741-21lldpd07:27:070
213339976,1cyclictest743-21snmpd12:23:040
213339976,1cyclictest743-21snmpd12:00:040
213339976,1cyclictest743-21snmpd09:44:430
213339976,1cyclictest741-21lldpd10:18:320
213339976,1cyclictest741-21lldpd08:15:080
213339976,1cyclictest24013-21needreboot11:10:160
213339975,2cyclictest743-21snmpd12:29:580
213339975,2cyclictest743-21snmpd11:48:030
213339975,2cyclictest743-21snmpd11:22:350
213339975,2cyclictest743-21snmpd11:06:160
213339975,2cyclictest743-21snmpd09:22:220
213339975,2cyclictest743-21snmpd08:35:450
213339975,2cyclictest743-21snmpd07:12:180
213449966,0cyclictest741-21lldpd12:04:553
213449966,0cyclictest741-21lldpd11:42:283
213449965,1cyclictest24148-21needreboot07:15:133
213449964,2cyclictest743-21snmpd11:24:503
213449964,2cyclictest743-21snmpd11:02:583
213449964,2cyclictest743-21snmpd10:56:203
213449964,2cyclictest743-21snmpd10:17:443
213449964,2cyclictest743-21snmpd08:32:063
213449962,4cyclictest557-21NetworkManager12:22:013
213449962,4cyclictest557-21NetworkManager10:11:253
213449962,3cyclictest2335-21fw_forwarded_lo09:00:123
213409966,0cyclictest741-21lldpd07:17:432
213409966,0cyclictest522-21avahi-daemon10:29:252
213409965,1cyclictest743-21snmpd11:49:472
213409965,1cyclictest741-21lldpd10:05:402
213409965,1cyclictest741-21lldpd07:43:462
213409965,1cyclictest24517-21fschecks_count08:35:142
213409964,2cyclictest743-21snmpd11:09:522
213409962,3cyclictest26356-21find08:40:112
213409962,3cyclictest26356-21find08:40:112
213379966,0cyclictest65850irq/126-lan08:45:111
213339966,0cyclictest743-21snmpd10:30:030
213339966,0cyclictest743-21snmpd09:55:200
213339966,0cyclictest522-21avahi-daemon11:39:040
213339966,0cyclictest522-21avahi-daemon11:33:350
213339966,0cyclictest522-21avahi-daemon08:12:110
213339964,2cyclictest8615-21cat07:55:140
213339964,2cyclictest743-21snmpd12:18:500
213339964,2cyclictest743-21snmpd10:53:580
213339964,2cyclictest743-21snmpd09:36:100
213339964,2cyclictest743-21snmpd09:12:460
213339963,3cyclictest31590-21smartctl10:10:190
213449955,0cyclictest741-21lldpd08:14:103
213449953,2cyclictest743-21snmpd10:02:293
213449953,2cyclictest717-21ntpd11:35:083
213449953,2cyclictest26795-21cat08:40:143
213449953,2cyclictest26795-21cat08:40:143
213449952,3cyclictest7505-21apt07:55:003
213449952,3cyclictest557-21NetworkManager09:06:363
213449952,2cyclictest24475-21ntpq12:30:183
213449952,2cyclictest18616-21grep08:20:143
213449952,2cyclictest10055-21latency_hist09:20:003
213449951,3cyclictest2018-21fw_forwarded_lo07:40:133
213409953,2cyclictest717-21ntpd10:00:342
213409953,2cyclictest717-21ntpd09:15:082
213409952,3cyclictest743-21snmpd09:30:522
213409952,3cyclictest743-21snmpd08:15:082
213409952,3cyclictest557-21NetworkManager07:23:102
213409952,3cyclictest10160-21grep10:35:212
213409952,2cyclictest8354-21sed11:50:202
213409952,2cyclictest29420-21sshd11:25:092
213409951,3cyclictest23948-21memory11:10:162
213409951,3cyclictest23493-21cat08:30:222
213409951,3cyclictest13758-21memory12:05:162
213339955,0cyclictest743-21snmpd12:35:130
213339955,0cyclictest522-21avahi-daemon11:41:380
213339955,0cyclictest522-21avahi-daemon08:57:520
213339954,1cyclictest743-21snmpd12:34:410
213339954,1cyclictest743-21snmpd09:46:350
213339954,1cyclictest741-21lldpd11:04:400
213339954,1cyclictest522-21avahi-daemon08:41:140
213339954,1cyclictest522-21avahi-daemon08:41:130
213339954,1cyclictest171ktimers/010:45:160
213339953,2cyclictest743-21snmpd09:18:070
213339953,2cyclictest743-21snmpd08:26:390
213339953,2cyclictest3699-21sshd07:45:050
213339953,2cyclictest0-21swapper/010:55:280
213339952,3cyclictest557-21NetworkManager08:53:280
213339952,3cyclictest12373-21sshd10:42:090
213339952,2cyclictest575-21rs:main0
213339952,2cyclictest244-20systemd-journal09:33:140
213449943,1cyclictest511ktimers/308:58:203
213449942,2cyclictest31522-21sed08:50:213
213449942,2cyclictest12451-21grep08:05:143
213449941,3cyclictest26048-21tail12:35:153
213449941,2cyclictest22076-21cut07:10:143
213449940,4cyclictest16961-21ntpq08:15:173
213449940,3cyclictest8190-21/usr/sbin/munin07:55:123
213449940,3cyclictest26261-21ntp_states11:15:233
213409943,1cyclictest10307-21fschecks_count09:20:152
213409943,1cyclictest0-21swapper/211:35:152
213409941,3cyclictest11147-21date12:00:002
213409941,2cyclictest24911-21cat12:30:232
213409941,2cyclictest19242-21expr11:00:132
213409941,2cyclictest11154-21grep10:40:152
213409940,4cyclictest22937-21ntpq09:50:162
213409940,4cyclictest1070-21ntpq10:15:162
213339943,1cyclictest31926-21apt-config07:35:010
213339942,2cyclictest19016-21ntpq08:20:170
213339941,2cyclictest29413-21mailstats08:45:190
213339941,2cyclictest1705-21cat07:40:110
213339941,2cyclictest13099-21cut09:25:190
213339940,4cyclictest10297-21cpuspeed_turbos08:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional