You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Mar 27, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29674991918,1cyclictest65850irq/126-lan20:50:193
29674991817,1cyclictest65850irq/126-lan23:30:133
29674991817,1cyclictest65850irq/126-lan22:00:113
29674991817,1cyclictest65850irq/126-lan21:20:153
29674991817,1cyclictest65850irq/126-lan00:15:153
29674991816,2cyclictest65850irq/126-lan23:15:213
29674991816,2cyclictest65850irq/126-lan21:12:253
29674991816,2cyclictest65850irq/126-lan19:45:133
29674991717,0cyclictest65850irq/126-lan23:37:253
29674991716,1cyclictest65850irq/126-lan23:10:173
29674991716,1cyclictest65850irq/126-lan22:30:193
29674991716,1cyclictest65850irq/126-lan20:07:373
29674991716,1cyclictest65850irq/126-lan19:40:113
29674991716,1cyclictest65850irq/126-lan19:30:203
29674991715,2cyclictest65850irq/126-lan21:55:003
29674991616,0cyclictest65850irq/126-lan23:25:103
29674991616,0cyclictest65850irq/126-lan19:16:523
29674991615,1cyclictest65850irq/126-lan21:35:113
29674991615,1cyclictest65850irq/126-lan20:45:163
29674991614,2cyclictest65850irq/126-lan22:40:133
29674991614,2cyclictest65850irq/126-lan20:15:173
29674991614,2cyclictest65850irq/126-lan00:30:163
29674991515,0cyclictest65850irq/126-lan23:55:163
29674991515,0cyclictest65850irq/126-lan22:13:153
29674991514,1cyclictest65850irq/126-lan22:45:113
29674991514,1cyclictest65850irq/126-lan22:39:553
29674991514,1cyclictest65850irq/126-lan22:20:233
29674991514,1cyclictest65850irq/126-lan20:00:203
29674991514,1cyclictest65850irq/126-lan20:00:003
29674991513,2cyclictest65850irq/126-lan23:20:193
29674991513,2cyclictest65850irq/126-lan21:25:183
29674991414,0cyclictest65850irq/126-lan23:00:123
29674991414,0cyclictest65850irq/126-lan20:37:153
29674991414,0cyclictest65850irq/126-lan20:30:133
29674991414,0cyclictest65850irq/126-lan00:25:123
29674991414,0cyclictest65850irq/126-lan00:10:113
29674991413,1cyclictest65850irq/126-lan20:40:163
29674991413,1cyclictest65850irq/126-lan19:51:113
29674991413,1cyclictest65850irq/126-lan00:35:133
29674991412,2cyclictest65850irq/126-lan21:40:203
29674991412,2cyclictest65850irq/126-lan19:35:123
29674991313,0cyclictest65850irq/126-lan00:23:273
29674991312,1cyclictest65850irq/126-lan23:45:123
29674991312,1cyclictest65850irq/126-lan21:00:183
29674991312,1cyclictest65850irq/126-lan20:22:253
29674991212,0cyclictest65850irq/126-lan22:50:143
29674991212,0cyclictest65850irq/126-lan22:15:153
29674991212,0cyclictest65850irq/126-lan20:10:123
29674991211,1cyclictest65850irq/126-lan23:05:003
29674991211,1cyclictest65850irq/126-lan22:55:143
29674991211,1cyclictest65850irq/126-lan19:10:133
29674991211,1cyclictest65850irq/126-lan00:05:223
29674991211,1cyclictest65850irq/126-lan00:01:263
29674991210,2cyclictest65850irq/126-lan20:55:153
29674991111,0cyclictest65850irq/126-lan22:25:123
29674991111,0cyclictest65850irq/126-lan21:30:143
29674991111,0cyclictest65850irq/126-lan21:05:113
29674991111,0cyclictest65850irq/126-lan19:22:253
29674991110,1cyclictest65850irq/126-lan21:15:183
2967499109,1cyclictest65850irq/126-lan23:40:193
29674991010,0cyclictest65850irq/126-lan23:50:143
296749998,1cyclictest65850irq/126-lan22:00:003
296699998,1cyclictest743-21snmpd22:43:412
296699998,1cyclictest743-21snmpd19:17:332
296699998,1cyclictest743-21snmpd19:14:092
296699998,1cyclictest741-21lldpd20:59:122
296699998,1cyclictest741-21lldpd20:49:422
296659998,1cyclictest743-21snmpd23:41:241
296659998,1cyclictest743-21snmpd20:49:211
296579998,1cyclictest743-21snmpd22:01:000
296749986,2cyclictest65850irq/126-lan20:25:123
296699988,0cyclictest743-21snmpd20:41:182
296699988,0cyclictest741-21lldpd21:27:522
296699987,1cyclictest743-21snmpd21:51:352
296699987,1cyclictest743-21snmpd21:10:372
296699986,2cyclictest743-21snmpd22:27:012
296699986,2cyclictest743-21snmpd19:33:192
296699986,2cyclictest717-21ntpd19:23:062
296699982,3cyclictest13369-21cat19:49:552
296659988,0cyclictest743-21snmpd19:20:031
296659988,0cyclictest741-21lldpd00:25:371
296659987,1cyclictest8353-21grep23:50:151
296659987,1cyclictest743-21snmpd23:22:051
296659987,1cyclictest743-21snmpd23:14:531
296659987,1cyclictest743-21snmpd23:01:471
296659987,1cyclictest743-21snmpd21:35:291
296659987,1cyclictest743-21snmpd20:50:061
296659987,1cyclictest743-21snmpd20:25:551
296659987,1cyclictest743-21snmpd19:36:581
296659987,1cyclictest741-21lldpd22:32:411
296659987,1cyclictest741-21lldpd00:16:061
296659987,1cyclictest15895-21fschecks_time19:55:111
296659986,2cyclictest743-21snmpd22:42:041
296659986,2cyclictest743-21snmpd22:18:271
296659986,2cyclictest743-21snmpd22:06:301
296659986,2cyclictest743-21snmpd21:24:101
296659986,2cyclictest743-21snmpd20:57:571
296579988,0cyclictest743-21snmpd22:51:220
296579988,0cyclictest741-21lldpd23:50:440
296579988,0cyclictest741-21lldpd23:16:270
296579988,0cyclictest741-21lldpd22:38:090
296579987,1cyclictest743-21snmpd23:45:010
296579987,1cyclictest743-21snmpd23:39:570
296579987,1cyclictest743-21snmpd23:09:170
296579987,1cyclictest743-21snmpd22:57:470
296579987,1cyclictest743-21snmpd22:17:000
296579987,1cyclictest743-21snmpd20:33:540
296579987,1cyclictest743-21snmpd00:30:590
296579986,2cyclictest743-21snmpd21:44:380
296579986,2cyclictest743-21snmpd21:35:320
296579986,2cyclictest743-21snmpd20:56:060
296579986,2cyclictest22576-21cat20:10:130
296749973,0cyclictest0-21swapper/321:50:003
296749973,0cyclictest0-21swapper/321:50:003
296749970,3cyclictest4227-21grep19:25:143
296699977,0cyclictest743-21snmpd23:07:532
296699977,0cyclictest743-21snmpd21:49:502
296699977,0cyclictest743-21snmpd21:49:502
296699977,0cyclictest743-21snmpd00:33:082
296699977,0cyclictest741-21lldpd23:33:542
296699976,1cyclictest8135-21cat23:50:142
296699976,1cyclictest743-21snmpd22:38:132
296699976,1cyclictest743-21snmpd22:16:272
296699976,1cyclictest743-21snmpd22:09:092
296699976,1cyclictest743-21snmpd21:36:082
296699976,1cyclictest743-21snmpd20:36:002
296699976,1cyclictest743-21snmpd19:56:492
296699976,1cyclictest717-21ntpd20:50:522
296699976,1cyclictest522-21avahi-daemon20:18:282
296699976,1cyclictest22814-21grep20:10:152
296699975,2cyclictest743-21snmpd20:32:392
296659977,0cyclictest743-21snmpd23:45:071
296659977,0cyclictest743-21snmpd21:19:371
296659977,0cyclictest743-21snmpd20:44:241
296659977,0cyclictest743-21snmpd00:05:281
296659977,0cyclictest741-21lldpd23:19:221
296659977,0cyclictest741-21lldpd21:50:521
296659977,0cyclictest741-21lldpd19:27:341
296659977,0cyclictest741-21lldpd00:35:511
296659977,0cyclictest522-21avahi-daemon20:17:201
296659976,1cyclictest743-21snmpd23:29:001
296659976,1cyclictest743-21snmpd22:13:551
296659976,1cyclictest743-21snmpd21:26:521
296659976,1cyclictest743-21snmpd20:39:301
296659976,1cyclictest743-21snmpd20:14:171
296659976,1cyclictest743-21snmpd00:13:071
296659976,1cyclictest741-21lldpd21:00:381
296659976,1cyclictest21597-21cut00:25:001
296659975,2cyclictest743-21snmpd21:55:021
296659975,2cyclictest743-21snmpd21:49:471
296659975,2cyclictest743-21snmpd21:49:471
296579977,0cyclictest743-21snmpd21:32:470
296579977,0cyclictest741-21lldpd21:25:120
296579976,1cyclictest7969-21gltestperf19:35:150
296579976,1cyclictest743-21snmpd19:44:160
296579976,1cyclictest13955-21gltestperf19:50:140
296579975,2cyclictest743-21snmpd23:20:350
296579975,2cyclictest743-21snmpd22:30:310
296579975,2cyclictest743-21snmpd22:24:510
296579975,2cyclictest743-21snmpd00:20:500
296749960,3cyclictest1083-21chrt22:07:003
296699966,0cyclictest743-21snmpd22:46:012
296699966,0cyclictest743-21snmpd21:17:282
296699966,0cyclictest741-21lldpd23:14:542
296699966,0cyclictest741-21lldpd19:42:272
296699966,0cyclictest741-21lldpd00:37:532
296699966,0cyclictest522-21avahi-daemon00:14:432
296699965,1cyclictest743-21snmpd23:38:122
296699965,1cyclictest743-21snmpd19:35:012
296699965,1cyclictest506-21systemd-resolve23:55:172
296699964,2cyclictest743-21snmpd21:07:012
296699964,2cyclictest743-21snmpd19:50:192
296699964,2cyclictest743-21snmpd00:19:452
296699963,3cyclictest11887-21sed21:05:002
296699963,2cyclictest17842-21dpkg20:00:002
296699962,3cyclictest557-21NetworkManager23:15:092
296659966,0cyclictest743-21snmpd21:12:521
296659966,0cyclictest743-21snmpd19:46:281
296659966,0cyclictest741-21lldpd22:48:571
296659966,0cyclictest741-21lldpd22:28:571
296659966,0cyclictest741-21lldpd20:31:151
296659966,0cyclictest741-21lldpd20:07:551
296659965,1cyclictest741-21lldpd19:16:241
296659964,2cyclictest743-21snmpd19:52:311
296659964,2cyclictest743-21snmpd19:43:131
296659964,2cyclictest32437-21cat23:30:141
296659962,3cyclictest12541-21ld00:00:201
296579966,0cyclictest743-21snmpd20:20:530
296579966,0cyclictest741-21lldpd23:00:550
296579965,1cyclictest743-21snmpd23:25:450
296579965,1cyclictest743-21snmpd23:10:230
296579965,1cyclictest743-21snmpd21:19:100
296579965,1cyclictest743-21snmpd19:26:210
296579965,1cyclictest743-21snmpd00:07:190
296579965,1cyclictest6011-21cat19:30:140
296579965,1cyclictest522-21avahi-daemon21:59:410
296579965,1cyclictest20216-21cpuspeed_turbos20:05:150
296579965,1cyclictest16083-21gltestperf00:10:120
296579964,2cyclictest743-21snmpd22:27:090
296579964,2cyclictest743-21snmpd20:51:000
296579964,2cyclictest743-21snmpd19:20:480
296579964,2cyclictest743-21snmpd19:17:510
296579963,3cyclictest13139-21df22:45:120
296579963,2cyclictest26430-21memory00:35:160
296579960,5cyclictest11707-21systemd00:00:070
296699955,0cyclictest743-21snmpd22:03:302
296699955,0cyclictest741-21lldpd22:52:372
296699955,0cyclictest741-21lldpd21:30:202
296699954,1cyclictest22141-21fw_conntrack00:25:142
296699953,2cyclictest557-21NetworkManager00:05:132
296699952,2cyclictest7075-21seq23:45:472
296699952,2cyclictest575-21rs:main2
296699952,2cyclictest29676-21seq23:24:262
296699952,2cyclictest21772-21seq20:08:452
296699952,2cyclictest17721-21ld22:55:172
296699951,4cyclictest557-21NetworkManager00:20:482
296699950,4cyclictest30911-21seq21:58:162
296659954,1cyclictest6013-21cat19:30:141
296659954,1cyclictest27469-21cpuspeed_turbos21:40:101
296659953,2cyclictest743-21snmpd22:36:251
296659953,2cyclictest743-21snmpd21:05:371
296659952,3cyclictest3260-21sed22:20:171
296659952,3cyclictest22336-21ntp_states23:05:171
296659951,3cyclictest18929-21ld20:00:161
296659950,5cyclictest557-21NetworkManager23:35:011
296659950,4cyclictest10460-21ntpq23:55:191
296579955,0cyclictest743-21snmpd19:11:420
296579955,0cyclictest743-21snmpd00:17:520
296579955,0cyclictest741-21lldpd21:53:080
296579955,0cyclictest741-21lldpd21:47:100
296579955,0cyclictest741-21lldpd21:47:100
296579955,0cyclictest741-21lldpd21:21:520
296579955,0cyclictest741-21lldpd21:14:360
296579954,1cyclictest522-21avahi-daemon20:41:120
296579953,2cyclictest743-21snmpd20:45:090
296579953,2cyclictest0-21swapper/020:01:230
296579952,2cyclictest12082-21awk22:40:200
296579952,2cyclictest11990-21cut19:45:130
296579951,3cyclictest32306-21fw_packets23:30:140
296579951,3cyclictest24898-21ld20:15:180
296579951,3cyclictest10121-21df21:00:120
296699942,2cyclictest743-21snmpd22:12:302
296699942,2cyclictest7216-21fw_conntrack22:30:142
296699942,2cyclictest557-21NetworkManager23:25:112
296699941,2cyclictest28265-21gcc21:40:162
296699941,2cyclictest20140-21grep21:20:212
296699941,2cyclictest19731-21tune2fs23:00:132
296699940,3cyclictest4227-21memory23:40:152
296699940,3cyclictest3075-21diskstats22:20:152
296699940,3cyclictest28510-21fw_forwarded_lo20:25:132
296699940,3cyclictest26655-21interrupts20:20:152
296699940,2cyclictest3778-21sort19:25:122
296659944,0cyclictest17380-21gltestperf22:55:141
296659941,2cyclictest31739-21smartctl22:00:131
296659941,2cyclictest30065-21grep19:10:121
296659940,4cyclictest557-21NetworkManager20:20:121
296579942,2cyclictest743-21snmpd22:06:060
296579942,2cyclictest29055-21ntp_states20:25:180
296579942,2cyclictest22147-21gltestperf00:25:150
296579940,3cyclictest9998-21fw_conntrack23:55:150
296579940,3cyclictest3835-21diskstats23:40:120
296579940,3cyclictest32421-21diskstats20:35:130
296579940,3cyclictest15827-21/usr/sbin/munin19:55:100
296579940,3cyclictest12424-21/usr/sbin/munin21:05:130
296659931,2cyclictest24226-21expr00:30:151
296659931,2cyclictest15221-21tune2fs22:50:121
296659930,3cyclictest22925-21grep21:30:111
296579930,3cyclictest721-21sshd22:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional