You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 23:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Sat Mar 21, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306932240163,24sleep20-21swapper/207:05:582
308962238162,24sleep10-21swapper/107:08:391
306792228151,25sleep00-21swapper/007:05:480
290422201163,25sleep30-21swapper/307:05:063
3110199113104,3cyclictest0-21swapper/312:33:573
3110199106104,1cyclictest0-21swapper/307:25:503
31101998380,2cyclictest0-21swapper/308:29:193
31101997774,2cyclictest0-21swapper/310:27:333
209032620,2sleep13109199cyclictest10:25:151
122622590,7sleep230-21rcuc/211:20:022
31101995855,2cyclictest0-21swapper/307:34:183
279782540,4sleep230-21rcuc/210:40:172
182792540,1sleep00-21swapper/007:50:220
106842530,5sleep011-21rcuc/007:35:100
112502520,1sleep10-21swapper/112:30:161
31101994844,3cyclictest0-21swapper/307:45:523
196382430,1sleep10-21swapper/107:55:141
121412410,1sleep20-21swapper/210:05:132
31101993936,2cyclictest0-21swapper/310:42:113
3108399369,3cyclictest23189-21users08:00:260
31101993532,2cyclictest0-21swapper/307:41:113
3109199347,21cyclictest0-21swapper/109:32:151
3109199347,21cyclictest0-21swapper/109:32:151
3108399348,12cyclictest11005-21munin-run08:50:010
3108399338,3cyclictest11412-21cstates08:50:130
3108399335,13cyclictest888-21idleruntime-cro07:15:000
3108399331,13cyclictest0-21swapper/009:45:270
3108399321,11cyclictest0-21swapper/009:34:590
3108399321,11cyclictest0-21swapper/009:34:590
3109199311,15cyclictest15152-21/usr/sbin/munin10:10:211
3109199311,11cyclictest0-21swapper/111:30:181
3108399316,3cyclictest0-21swapper/011:21:470
3108399316,11cyclictest0-21swapper/008:00:000
3108399315,3cyclictest0-21swapper/008:37:220
31083993117,8cyclictest0-21swapper/010:55:220
3108399311,11cyclictest0-21swapper/010:00:490
3108399311,10cyclictest0-21swapper/011:06:500
3109199307,3cyclictest0-21swapper/108:28:231
31091993010,3cyclictest8514-21ntp_states09:55:231
3108399305,3cyclictest0-21swapper/011:55:430
3108399305,3cyclictest0-21swapper/011:36:030
3108399301,12cyclictest0-21swapper/007:28:070
31083993011,16cyclictest18843-21munin-run11:35:010
3108399301,10cyclictest0-21swapper/009:14:190
3109199291,11cyclictest0-21swapper/112:21:071
3109199291,10cyclictest0-21swapper/110:53:391
3108399296,3cyclictest0-21swapper/007:21:110
3108399295,3cyclictest0-21swapper/008:40:540
3108399294,3cyclictest0-21swapper/008:15:100
3108399293,3cyclictest0-21swapper/008:11:580
3108399293,3cyclictest0-21swapper/007:49:400
3108399291,12cyclictest4485-21cstates12:15:110
3108399291,11cyclictest0-21swapper/008:56:150
3109199289,2cyclictest0-21swapper/109:04:541
3109199286,3cyclictest0-21swapper/108:44:301
3109199281,22cyclictest0-21swapper/112:12:311
3109199281,14cyclictest16264-21vmstat11:25:261
3109199281,12cyclictest0-21swapper/111:35:141
3109199281,10cyclictest0-21swapper/110:49:431
3109199281,10cyclictest0-21swapper/110:49:431
3109199281,10cyclictest0-21swapper/109:18:071
3109199281,10cyclictest0-21swapper/109:12:341
3109199281,10cyclictest0-21swapper/107:27:351
3108399288,3cyclictest0-21swapper/010:07:500
3108399287,3cyclictest0-21swapper/010:26:020
3108399286,3cyclictest0-21swapper/008:31:220
3108399285,3cyclictest0-21swapper/009:04:430
3108399285,3cyclictest0-21swapper/008:29:100
3108399281,16cyclictest0-21swapper/009:52:310
3108399281,12cyclictest22256-21strings11:40:190
3108399280,13cyclictest0-21swapper/007:15:020
3109699271,10cyclictest0-21swapper/208:50:072
3109199276,3cyclictest0-21swapper/108:46:021
3109199276,3cyclictest0-21swapper/107:45:071
3109199275,3cyclictest0-21swapper/108:09:471
3109199275,3cyclictest0-21swapper/107:39:071
3109199274,3cyclictest0-21swapper/112:03:351
3109199271,9cyclictest0-21swapper/110:56:061
3109199271,14cyclictest13189-21grep07:40:151
3109199271,10cyclictest0-21swapper/112:28:191
3108399278,16cyclictest8472-21munin-run12:25:020
3108399277,3cyclictest0-21swapper/009:21:390
3108399274,3cyclictest0-21swapper/008:06:060
3108399271,14cyclictest0-21swapper/010:52:380
3108399271,10cyclictest0-21swapper/010:41:540
34012261,21sleep23421-21forks09:45:152
3110199266,7cyclictest5312-40dnf11:00:583
3109199269,3cyclictest6886-21sshd09:50:511
3109199266,3cyclictest0-21swapper/112:36:511
3109199266,3cyclictest0-21swapper/111:10:461
3109199266,3cyclictest0-21swapper/108:31:431
3109199266,3cyclictest0-21swapper/108:22:511
3109199266,3cyclictest0-21swapper/108:01:071
3109199266,3cyclictest0-21swapper/107:52:111
3109199266,3cyclictest0-21swapper/107:18:261
3109199261,12cyclictest0-21swapper/110:40:111
31091992611,2cyclictest0-21swapper/109:49:391
3109199261,10cyclictest0-21swapper/110:33:391
3109199261,10cyclictest0-21swapper/110:23:151
3109199261,10cyclictest0-21swapper/108:50:261
3109199260,15cyclictest0-21swapper/111:50:121
3108399269,4cyclictest0-21swapper/009:55:230
3108399268,3cyclictest0-21swapper/012:31:030
3108399267,3cyclictest0-21swapper/010:19:380
3108399265,3cyclictest0-21swapper/009:16:470
3108399262,3cyclictest0-21swapper/009:07:110
3108399261,23cyclictest0-21swapper/012:12:310
3108399261,10cyclictest0-21swapper/009:41:030
3109199256,3cyclictest0-21swapper/109:05:461
3109199255,3cyclictest0-21swapper/111:06:581
3108399259,8cyclictest0-21swapper/009:26:150
3108399257,3cyclictest0-21swapper/011:12:110
3108399256,3cyclictest0-21swapper/010:33:460
3108399255,3cyclictest0-21swapper/012:03:190
3108399251,9cyclictest19797-21diskmemload11:27:110
3108399251,11cyclictest0-21swapper/011:17:070
3108399251,10cyclictest0-21swapper/007:40:510
31083992510,3cyclictest30013-21gltestperf10:45:140
31083992510,3cyclictest30013-21gltestperf10:45:140
270272250,2sleep339-21rcuc/311:50:253
3110199241,6cyclictest0-21swapper/309:17:503
3110199241,5cyclictest0-21swapper/311:55:353
3109699241,4cyclictest0-21swapper/210:00:272
3109199248,3cyclictest0-21swapper/111:57:271
3109199247,3cyclictest0-21swapper/109:24:311
3109199245,3cyclictest0-21swapper/107:22:541
3109199244,3cyclictest0-21swapper/107:32:511
3109199243,3cyclictest0-21swapper/108:11:191
3109199241,8cyclictest0-21swapper/109:28:391
31091992415,2cyclictest0-21swapper/108:15:191
3109199241,4cyclictest11089-21irqstats11:15:171
3108399249,3cyclictest0-21swapper/008:20:380
3108399248,3cyclictest0-21swapper/010:36:460
3108399244,3cyclictest0-21swapper/011:53:430
3108399244,3cyclictest0-21swapper/011:00:500
3108399241,7cyclictest0-21swapper/010:24:180
3108399241,10cyclictest0-21swapper/012:28:550
3108399241,10cyclictest0-21swapper/012:05:510
3108399241,10cyclictest0-21swapper/009:37:310
3110199238,4cyclictest0-21swapper/309:49:233
3110199236,5cyclictest0-21swapper/312:25:143
3110199232,3cyclictest86550irq/126-enp1s0-10:30:173
3110199231,3cyclictest13440-21users10:05:253
3110199231,11cyclictest20027-21/usr/sbin/munin09:10:143
3110199230,5cyclictest0-21swapper/309:33:503
3110199230,5cyclictest0-21swapper/309:33:503
3109699233,5cyclictest0-21swapper/211:20:122
3109699232,5cyclictest0-21swapper/210:54:102
3109199235,3cyclictest0-21swapper/110:05:031
3109199234,3cyclictest0-21swapper/111:21:501
3109199234,3cyclictest0-21swapper/111:01:501
3109199234,3cyclictest0-21swapper/110:15:031
3109199233,3cyclictest0-21swapper/110:38:151
3109199231,7cyclictest0-21swapper/110:03:311
3109199231,7cyclictest0-21swapper/109:42:471
3109199231,11cyclictest0-21swapper/107:11:551
3108399237,3cyclictest0-21swapper/012:36:510
3110199223,8cyclictest19797-21diskmemload10:45:183
3110199223,8cyclictest19797-21diskmemload10:45:183
3110199222,12cyclictest0-21swapper/309:40:173
3110199221,11cyclictest26005-21/usr/sbin/munin08:10:203
3110199221,10cyclictest5702-21ntp_states08:35:223
3110199221,10cyclictest28198-21/usr/sbin/munin08:15:143
3110199220,9cyclictest0-21swapper/312:07:443
3110199220,9cyclictest0-21swapper/309:51:583
3110199220,8cyclictest0-21swapper/311:22:093
3110199220,8cyclictest0-21swapper/309:26:223
3110199220,10cyclictest5507-21kworker/u8:211:10:223
3109699221,5cyclictest0-21swapper/210:18:102
3109199225,2cyclictest858-21needreboot12:05:191
3109199224,3cyclictest0-21swapper/112:19:471
3109199221,19cyclictest0-21swapper/111:45:121
3108399225,3cyclictest0-21swapper/010:13:300
3110199219,4cyclictest0-21swapper/310:54:193
3110199216,5cyclictest0-21swapper/311:15:103
3110199212,8cyclictest8364-1kworker/u9:111:34:593
3110199211,11cyclictest0-21swapper/311:26:433
3110199210,9cyclictest0-21swapper/309:55:273
3110199210,8cyclictest0-21swapper/311:46:153
3110199210,8cyclictest0-21swapper/310:38:023
3110199210,8cyclictest0-21swapper/310:20:103
3110199210,3cyclictest0-21swapper/312:16:593
3110199210,10cyclictest0-21swapper/311:37:243
3109699215,12cyclictest86550irq/126-enp1s0-09:41:172
3109699211,8cyclictest2940-21grep10:55:272
3109699211,6cyclictest19797-21diskmemload11:45:122
3109699211,4cyclictest0-21swapper/209:18:562
31096992110,9cyclictest19797-21diskmemload10:30:262
3109199217,3cyclictest0-21swapper/108:57:381
3109199211,18cyclictest0-21swapper/109:37:561
3108399214,3cyclictest0-21swapper/007:30:110
3110199206,4cyclictest0-21swapper/310:18:503
3110199205,4cyclictest0-21swapper/310:12:563
3110199204,5cyclictest19797-21diskmemload11:05:223
3110199204,10cyclictest812-21snmpd07:59:583
3110199202,10cyclictest31292-21/usr/sbin/munin07:10:253
3110199201,9cyclictest0-21swapper/311:41:503
3110199201,9cyclictest0-21swapper/308:46:093
3110199201,12cyclictest0-21swapper/308:00:173
3110199201,11cyclictest11612-21grep08:50:153
3110199201,10cyclictest4660-21kworker/u8:110:00:253
3110199201,10cyclictest0-21swapper/312:20:263
3109699205,11cyclictest86550irq/126-enp1s0-11:28:572
3109699204,5cyclictest21348-40dnf07:59:592
3109699201,5cyclictest6986-21/usr/sbin/munin11:05:222
31096992015,3cyclictest31941-21cut07:10:162
3109699201,4cyclictest0-21swapper/211:54:052
3109699201,16cyclictest2433-21cstates12:10:132
3109699200,3cyclictest0-21swapper/212:15:172
3109199202,15cyclictest22915-21systemd-journal11:41:021
3108399201,7cyclictest0-21swapper/011:47:590
3110199198,3cyclictest23808-21/usr/sbin/munin08:05:153
3110199196,5cyclictest0-21swapper/312:10:153
3110199196,3cyclictest86550irq/126-enp1s0-10:55:263
3110199196,3cyclictest31433-21tune2fs09:35:133
3110199195,4cyclictest31127-21ntp_states12:00:213
3110199191,9cyclictest14379-21switchtime12:35:223
31101991913,3cyclictest4683-21gltestperf07:20:153
31101991913,3cyclictest3107-21cut08:30:153
31101991912,4cyclictest19347-21grep09:05:253
3110199191,11cyclictest0-21swapper/307:50:193
3110199191,10cyclictest13421-21/usr/sbin/munin08:55:173
3110199191,10cyclictest0-21swapper/309:21:223
3109699196,4cyclictest25677-21/usr/sbin/munin09:20:222
3109699194,4cyclictest9128-21/usr/sbin/munin11:10:212
3109699194,3cyclictest0-21swapper/209:35:422
3109699193,5cyclictest20863-21cut09:10:172
3109699193,4cyclictest9-21rcu_preempt10:25:202
3109699193,3cyclictest0-21swapper/209:50:162
3109699191,8cyclictest0-21swapper/211:02:452
3109699191,7cyclictest0-21swapper/210:45:112
3109699191,7cyclictest0-21swapper/210:45:112
3109699191,3cyclictest0-21swapper/212:00:202
3109699191,3cyclictest0-21swapper/211:40:362
3109199195,3cyclictest0-21swapper/108:37:221
3110199188,2cyclictest1827-21/usr/sbin/munin07:15:183
3110199187,3cyclictest812-21snmpd07:37:453
3110199185,3cyclictest8782-21sshd08:44:553
3110199181,10cyclictest812-21snmpd08:22:563
3109699188,3cyclictest32417-21cpuspeed_turbos12:05:112
3109699186,6cyclictest1559-21kworker/u8:112:26:322
3109699185,3cyclictest86550irq/126-enp1s0-12:20:172
3109699184,5cyclictest14181-21if_enp2s008:55:162
3109699184,4cyclictest29039-21kernelversion08:15:172
3109699184,4cyclictest20419-21ls11:35:242
3109699183,6cyclictest0-21swapper/210:39:532
3109699182,9cyclictest28204-21runrttasks11:55:132
3109699182,8cyclictest13209-21grep12:35:122
3109699182,7cyclictest30-21rcuc/209:55:252
3109699182,5cyclictest30-21rcuc/207:40:202
3109699181,9cyclictest0-21swapper/209:25:532
3109699181,6cyclictest0-21swapper/210:11:192
3109699181,2cyclictest0-21swapper/208:45:152
3109699181,15cyclictest0-21swapper/207:17:332
3109699178,6cyclictest16240-21wc07:45:232
3109699176,3cyclictest10341-21kworker/u8:212:30:332
3109699173,5cyclictest30-21rcuc/208:20:252
3109699173,4cyclictest771-21rngd09:33:362
3109699173,4cyclictest771-21rngd09:33:362
3109699173,4cyclictest7269-21ntpq07:25:202
3109699173,4cyclictest17932-21ntp_states11:30:192
3109699173,2cyclictest86750irq/128-enp1s0-08:30:142
3109699172,7cyclictest23329-21sshd08:01:562
3109699172,4cyclictest27978-21munin-run08:15:012
3109699171,7cyclictest4021-21/usr/sbin/munin07:20:202
3109699171,3cyclictest0-21swapper/210:20:242
3109699171,14cyclictest0-21swapper/208:06:212
31096991711,3cyclictest461-21expr08:25:142
31096991711,3cyclictest18648-21cut09:05:172
31096991711,3cyclictest11373-21mii-tool07:35:152
3110199161,8cyclictest0-21swapper/309:00:153
3109699163,3cyclictest8601-21cstates07:30:132
31096991612,3cyclictest0-21swapper/208:35:212
31096991611,3cyclictest7518-21hostname08:40:172
31096991611,3cyclictest17205-21/usr/sbin/munin07:50:222
3109699160,10cyclictest0-21swapper/209:00:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional