You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 14:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Jun 04, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10725991054,24cyclictest0-21swapper/010:39:160
10730999921,29cyclictest26730-21missed_timers11:59:071
1073099975,44cyclictest0-21swapper/111:19:051
10725999713,12cyclictest0-21swapper/012:04:170
1073099935,15cyclictest0-21swapper/109:14:051
1072599914,80cyclictest0-21swapper/011:54:110
1072599914,80cyclictest0-21swapper/011:54:110
1072599914,79cyclictest0-21swapper/009:14:050
1072599913,82cyclictest0-21swapper/010:14:210
1072599913,24cyclictest0-21swapper/010:23:530
1072599903,24cyclictest0-21swapper/011:59:140
10725999022,8cyclictest1381-21ssh10:34:070
10725999020,13cyclictest0-21swapper/007:39:100
10725999020,13cyclictest0-21swapper/007:39:100
10732998937,27cyclictest21049-21cpuspeed_turbos11:03:573
10732998933,32cyclictest32507-21timerwakeupswit11:19:153
1072599894,77cyclictest25744-21munin-run10:23:450
10732998832,30cyclictest0-21swapper/307:29:233
1072599883,78cyclictest0-21swapper/010:13:450
1072599883,24cyclictest10686-21munin-node12:23:540
10725998822,7cyclictest15780-21ssh12:30:460
1072599874,77cyclictest0-21swapper/011:29:020
1072599874,26cyclictest0-21swapper/011:23:590
10725998720,7cyclictest3464-21diskmemload12:13:450
1072599865,74cyclictest0-21swapper/009:59:220
1072599864,74cyclictest0-21swapper/008:34:200
1072599863,76cyclictest0-21swapper/011:23:330
1072599863,76cyclictest0-21swapper/011:16:120
1072599863,76cyclictest0-21swapper/011:16:120
1072599863,7cyclictest5490-21crond09:53:470
1072599863,7cyclictest5490-21crond09:53:470
10725998626,52cyclictest26074-21grep07:34:120
10725998622,8cyclictest1124-21snmpd11:07:060
10725998611,8cyclictest15088-21kworker/0:012:08:530
1072599854,74cyclictest0-21swapper/009:31:250
1072599854,72cyclictest0-21swapper/009:39:090
1072599854,72cyclictest0-21swapper/009:25:240
1072599854,22cyclictest0-21swapper/009:47:300
1072599853,76cyclictest0-21swapper/011:41:490
1072599853,27cyclictest0-21swapper/011:35:300
10725998517,12cyclictest0-21swapper/011:10:320
10725998510,7cyclictest0-21swapper/009:19:030
10732998431,45cyclictest0-21swapper/310:38:453
10732998428,25cyclictest2605-21ls09:49:003
10732998428,25cyclictest2605-21ls09:49:003
1072599844,73cyclictest0-21swapper/011:00:400
1072599844,73cyclictest0-21swapper/010:29:130
10732998331,26cyclictest19662-21cstates10:13:593
1072599834,72cyclictest0-21swapper/012:20:100
1072599834,72cyclictest0-21swapper/011:44:110
10725998330,46cyclictest26538-21aten_r1power_po08:44:010
1072599833,73cyclictest0-21swapper/009:09:120
1072599833,73cyclictest0-21swapper/009:09:120
1072599833,72cyclictest0-21swapper/010:46:470
10725998328,48cyclictest20139-21ssh11:49:100
10725998326,50cyclictest14679-21grep07:09:220
10725998323,54cyclictest0-21swapper/009:57:450
10725998323,54cyclictest0-21swapper/009:57:450
10725998314,8cyclictest31188-21munin-node08:54:040
10725998313,64cyclictest27646-21crond09:38:470
10732998234,29cyclictest12555-21head10:03:573
1072599827,11cyclictest0-21swapper/010:55:210
1072599824,71cyclictest0-21swapper/010:53:000
1072599824,21cyclictest0-21swapper/009:08:100
10725998227,48cyclictest9049-21unixbench_multi08:04:240
10725998224,51cyclictest0-21swapper/010:04:070
10732998137,28cyclictest29046-21ls09:39:113
10732998136,37cyclictest23325-21missed_timers11:54:063
10732998136,37cyclictest23325-21missed_timers11:54:063
10732998136,28cyclictest14695-21ssh11:42:113
10732998134,29cyclictest21835-21sort09:29:053
10732998127,46cyclictest18211-21gltestperf10:59:033
10732998125,48cyclictest0-21swapper/310:29:143
1072599814,11cyclictest0-21swapper/008:19:460
10725998133,42cyclictest1794-21grep07:49:250
10725998124,9cyclictest18165-21telnet07:19:040
10732998037,27cyclictest16574-21crond12:33:403
10732998026,46cyclictest0-21swapper/309:14:583
10732998026,31cyclictest0-21swapper/310:23:563
10732998025,48cyclictest0-21swapper/309:35:593
1072599804,69cyclictest0-21swapper/007:14:130
10725998020,10cyclictest17569-21fschecks_time08:24:070
10732997934,28cyclictest1124-21snmpd11:10:053
10732997931,41cyclictest31294-21munin-node09:43:573
10732997926,46cyclictest0-21swapper/309:25:103
10725997926,46cyclictest1499-21grep08:59:020
10725997922,9cyclictest2549-21aten2.4-expect07:54:040
10725997914,12cyclictest0-21swapper/007:44:170
10725997914,12cyclictest0-21swapper/007:44:170
10732997835,27cyclictest5155-21unixbench_multi12:14:153
10732997834,35cyclictest7887-21ssh12:19:033
10732997830,32cyclictest0-21swapper/311:38:053
1072599783,28cyclictest1227-21runrttasks08:33:410
1072599783,28cyclictest1227-21runrttasks08:33:410
10732997738,32cyclictest11936-21open_files10:49:113
10732997729,30cyclictest0-21swapper/309:19:043
10732997728,40cyclictest0-21swapper/308:19:243
10732997728,32cyclictest3464-21diskmemload11:50:543
10732997728,32cyclictest1227-21runrttasks11:28:573
10732997727,42cyclictest31769-21ssh12:07:523
10725997721,8cyclictest6136-21tail07:59:160
10725997719,12cyclictest0-21swapper/007:24:120
10732997636,28cyclictest26727-21missed_timers11:59:073
10732997634,26cyclictest5012-21ssh09:04:153
10732997628,41cyclictest0-21swapper/310:39:553
10732997627,42cyclictest0-21swapper/308:59:033
10732997625,44cyclictest0-21swapper/310:56:003
1072599763,30cyclictest29668-21gltestperf08:49:080
10732997533,34cyclictest0-21swapper/307:41:243
10732997533,34cyclictest0-21swapper/307:41:243
10732997532,14cyclictest0-21swapper/310:23:463
10732997531,37cyclictest21508-21date08:33:513
10732997531,37cyclictest21508-21date08:33:513
10732997530,38cyclictest2503-21diskstats11:24:003
10732997530,36cyclictest1227-21runrttasks07:14:153
10732997528,13cyclictest0-21swapper/310:10:213
10732997527,41cyclictest0-21swapper/311:17:223
10732997527,41cyclictest0-21swapper/311:17:223
1072599754,64cyclictest0-21swapper/008:14:080
1072599754,25cyclictest0-21swapper/007:29:070
99892749,17sleep20-21swapper/206:59:212
10732997434,33cyclictest6196-21munin-node09:54:013
10732997434,33cyclictest6196-21munin-node09:54:013
10732997432,17cyclictest9502-21cut09:59:003
10732997429,39cyclictest25117-21ls08:39:123
10732997429,37cyclictest30788-21fschecks_time07:44:093
10732997429,37cyclictest30788-21fschecks_time07:44:093
10732997428,39cyclictest0-21swapper/309:10:083
10732997428,39cyclictest0-21swapper/309:10:083
10732997426,42cyclictest0-21swapper/310:44:183
10732997425,41cyclictest0-21swapper/312:23:593
10732997425,41cyclictest0-21swapper/311:43:553
1072599743,31cyclictest0-21swapper/008:39:030
10732997332,22cyclictest0-21swapper/308:54:143
10732997327,39cyclictest0-21swapper/312:10:523
1072599734,28cyclictest0-21swapper/008:13:510
219499720,6rtkit-daemon0-21swapper/107:04:100
10732997248,16cyclictest0-21swapper/307:58:513
10732997234,32cyclictest12266-21wc08:14:033
10732997228,25cyclictest14351-21iostat_ios07:09:153
10732997128,37cyclictest0-21swapper/308:03:463
10732997124,25cyclictest28571-21munin-run08:48:493
10732997117,45cyclictest0-21swapper/307:23:043
1072599713,26cyclictest0-21swapper/007:03:540
10732996926,34cyclictest10729-21iostat_ios08:09:123
10732996842,18cyclictest2131-21runrttasks07:52:273
10732996823,38cyclictest30364-21timerandwakeup08:49:203
219499670,6rtkit-daemon17416-21grep07:14:241
10732996735,15cyclictest22670-21grep08:34:113
10732996723,36cyclictest21744-21munin-node07:24:193
118322663,8sleep211836-21ssh10:02:142
10732996634,25cyclictest18412-21ls08:24:213
10732996630,18cyclictest1555-21nscd07:38:523
10732996540,17cyclictest13093-21crond07:08:533
10732996435,22cyclictest0-21swapper/308:05:383
10731996337,8cyclictest22642-21ssh10:18:562
46042623,53sleep10-21swapper/109:50:361
46042623,53sleep10-21swapper/109:50:361
219499620,7rtkit-daemon0-21swapper/007:49:081
69472610,14sleep21073199cyclictest09:08:442
10730996126,30cyclictest0-21swapper/111:49:051
219499600,6rtkit-daemon0-21swapper/007:30:541
213532604,9sleep221356-21ssh10:15:042
119862603,11sleep20-21swapper/209:14:132
10730996022,31cyclictest24669-21df_abs11:08:581
164842583,47sleep216490-21ssh12:33:222
10732995825,18cyclictest0-21swapper/307:03:543
1073199587,35cyclictest107550irq/46-eth010:23:512
10731995820,22cyclictest15171-21runrttasks07:09:552
1073199574,45cyclictest0-21swapper/211:53:532
1073199574,45cyclictest0-21swapper/211:53:532
1073099574,46cyclictest0-21swapper/112:04:161
85342564,12sleep20-21swapper/209:57:312
85342564,12sleep20-21swapper/209:57:312
272672563,45sleep20-21swapper/209:37:272
261772564,13sleep20-21swapper/208:43:502
1073199564,44cyclictest1227-21runrttasks10:43:512
1073199564,44cyclictest0-21swapper/210:04:212
10730995632,15cyclictest0-21swapper/110:42:321
10730995629,12cyclictest0-21swapper/109:37:061
10730995623,17cyclictest0-21swapper/111:03:041
10730995612,27cyclictest0-21swapper/111:14:101
10730995612,27cyclictest0-21swapper/111:14:101
95382557,10sleep10-21swapper/109:10:381
95382557,10sleep10-21swapper/109:10:381
69312553,45sleep17003-21needreboot09:54:111
69312553,45sleep17003-21needreboot09:54:111
280082556,11sleep10-21swapper/110:24:471
273272553,43sleep20-21swapper/211:13:452
273272553,43sleep20-21swapper/211:13:452
219499550,4rtkit-daemon2193-21rtkit-daemon11:03:531
1073199556,23cyclictest5813-21gltestperf07:59:112
1073099555,32cyclictest0-21swapper/110:02:221
10730995523,26cyclictest0-21swapper/112:13:581
10730995522,27cyclictest0-21swapper/109:44:431
219499540,6rtkit-daemon2193-21rtkit-daemon08:12:301
219499540,5rtkit-daemon2193-21rtkit-daemon12:09:131
201342542,10sleep20-21swapper/211:02:372
130632543,12sleep10-21swapper/112:28:091
1073199544,34cyclictest0-21swapper/209:11:052
1073199544,34cyclictest0-21swapper/209:11:052
1073199543,46cyclictest0-21swapper/209:51:222
1073199543,46cyclictest0-21swapper/209:51:222
1073199542,32cyclictest0-21swapper/207:22:272
10731995418,21cyclictest0-21swapper/209:22:262
10731995411,25cyclictest0-21swapper/212:13:002
1073099545,28cyclictest26545-21ntp_states07:34:201
10730995426,9cyclictest0-21swapper/112:23:411
24172533,11sleep10-21swapper/110:34:381
225802533,8sleep122654-21iostat08:34:101
219499530,5rtkit-daemon2193-21rtkit-daemon10:46:011
219499530,5rtkit-daemon2193-21rtkit-daemon08:14:141
160932533,11sleep10-21swapper/112:31:561
10731995333,14cyclictest0-21swapper/210:58:412
1073199533,42cyclictest0-21swapper/211:28:532
10731995311,24cyclictest12453-21ssh10:49:182
1073099535,29cyclictest0-21swapper/107:41:331
1073099535,29cyclictest0-21swapper/107:41:331
10730995322,13cyclictest0-21swapper/110:48:591
10730995314,19cyclictest0-21swapper/110:13:581
320702523,10sleep10-21swapper/107:47:221
320702523,10sleep10-21swapper/107:47:221
207762523,41sleep20-21swapper/211:49:452
173722523,42sleep20-21swapper/210:09:162
1073199524,42cyclictest0-21swapper/211:23:582
1073199524,30cyclictest0-21swapper/212:19:102
1073199523,43cyclictest23481-21ssh09:30:572
1073199523,34cyclictest0-21swapper/210:31:352
10731995215,30cyclictest21051-21cpuspeed_turbos11:03:572
10731995214,14cyclictest0-21swapper/211:44:212
10731995213,32cyclictest1547-21nscd11:09:002
1073099525,29cyclictest0-21swapper/109:24:151
1073099525,29cyclictest0-21swapper/108:49:191
10730995236,9cyclictest5261-21tr07:59:051
10730995222,13cyclictest0-21swapper/109:05:331
10730995221,13cyclictest0-21swapper/111:29:171
32642513,11sleep10-21swapper/109:01:231
295472512,9sleep20-21swapper/207:40:422
295472512,9sleep20-21swapper/207:40:422
129402512,9sleep20-21swapper/207:06:572
1073199515,27cyclictest0-21swapper/209:03:492
1073199514,29cyclictest0-21swapper/212:04:122
10731995112,21cyclictest10282-21timerandwakeup11:34:162
1073099515,28cyclictest0-21swapper/110:04:201
1073099515,28cyclictest0-21swapper/107:54:141
1073099514,40cyclictest0-21swapper/109:38:581
1073099514,31cyclictest0-21swapper/110:57:251
1073099514,29cyclictest0-21swapper/108:24:101
1073099514,28cyclictest0-21swapper/111:24:201
1073099514,27cyclictest0-21swapper/110:19:281
10730995134,11cyclictest31311-21head08:54:001
10730995131,15cyclictest0-21swapper/111:44:191
10730995121,14cyclictest0-21swapper/111:43:261
10730995115,29cyclictest0-21swapper/111:37:061
250032503,41sleep125006-21ssh11:57:501
250032503,41sleep125006-21ssh11:57:501
1073199504,29cyclictest0-21swapper/207:24:122
10731995033,10cyclictest4169-21cpuspeed_turbos10:38:592
10731995032,11cyclictest25266-21munin-node07:34:132
10731995019,13cyclictest0-21swapper/209:43:572
1073099505,26cyclictest0-21swapper/110:33:251
1073099505,26cyclictest0-21swapper/109:29:041
1073099504,39cyclictest0-21swapper/109:19:101
1073099504,28cyclictest0-21swapper/110:09:061
1073099504,28cyclictest0-21swapper/107:24:121
1073199497,37cyclictest0-21swapper/212:13:562
1073199495,26cyclictest0-21swapper/211:59:052
1073199494,28cyclictest0-21swapper/211:18:592
1073199494,28cyclictest0-21swapper/209:24:172
1073199494,28cyclictest0-21swapper/208:24:062
1073199494,28cyclictest0-21swapper/208:19:162
1073199494,28cyclictest0-21swapper/208:09:142
1073199494,28cyclictest0-21swapper/207:54:222
1073199494,27cyclictest0-21swapper/207:49:072
1073199494,26cyclictest0-21swapper/207:14:142
10731994933,10cyclictest28280-21grep09:39:012
1073199493,32cyclictest0-21swapper/207:29:232
10731994928,14cyclictest0-21swapper/211:42:182
1073099494,27cyclictest0-21swapper/108:08:181
127752483,11sleep10-21swapper/107:04:461
1073199484,27cyclictest0-21swapper/212:24:062
1073199484,27cyclictest0-21swapper/210:34:212
1073199484,27cyclictest0-21swapper/208:44:152
1073199484,27cyclictest0-21swapper/208:29:052
1073199484,27cyclictest0-21swapper/208:29:052
1073199484,27cyclictest0-21swapper/208:14:142
1073099483,27cyclictest0-21swapper/108:44:191
10730994820,8cyclictest26184-21latency_hist08:43:511
293942473,37sleep20-21swapper/208:49:062
10730994729,12cyclictest18939-21gltestperf07:19:121
1073199464,28cyclictest0-21swapper/208:34:012
1073199464,27cyclictest0-21swapper/208:04:022
10731994619,11cyclictest0-21swapper/207:44:172
10731994619,11cyclictest0-21swapper/207:44:172
1073099465,34cyclictest1227-21runrttasks07:09:051
1073099463,23cyclictest14484-21munin-node08:19:011
1073099453,24cyclictest0-21swapper/108:29:171
1073099453,24cyclictest0-21swapper/108:29:171
1073199434,12cyclictest0-21swapper/208:54:152
1073099343,11cyclictest0-21swapper/107:03:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional