You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 23:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 23, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222472950,5sleep222252-21crond08:37:442
222472950,5sleep222252-21crond08:37:442
286402720,3sleep041ktimersoftd/009:34:250
16028997240,25cyclictest0-21swapper/209:12:562
16028997240,25cyclictest0-21swapper/209:12:562
1602799716,57cyclictest0-21swapper/110:32:581
1602799716,57cyclictest0-21swapper/110:32:581
1602799706,55cyclictest0-21swapper/110:47:511
1602799683,57cyclictest19217-21yum-updatesd-he10:58:111
266652673,10sleep00-21swapper/010:22:110
1602799665,53cyclictest0-21swapper/109:18:031
1602799664,54cyclictest0-21swapper/108:28:181
1602799653,54cyclictest0-21swapper/107:23:111
1602799644,53cyclictest0-21swapper/111:17:501
1602799643,53cyclictest0-21swapper/110:23:071
219499630,5rtkit-daemon0-21swapper/308:42:592
1602799634,51cyclictest7080-21unixbench_singl11:28:121
1602799634,51cyclictest20340-21needreboot08:33:101
1602799634,51cyclictest20340-21needreboot08:33:101
1602799634,51cyclictest0-21swapper/108:58:141
1602799634,50cyclictest0-21swapper/110:27:531
1602399633,22cyclictest6606-21munin-node08:13:070
231292624,50sleep00-21swapper/011:03:510
164302624,51sleep00-21swapper/006:18:030
1602799623,50cyclictest0-21swapper/109:28:011
62322613,50sleep10-21swapper/110:38:121
1602999615,47cyclictest361ktimersoftd/309:20:213
1602799613,50cyclictest0-21swapper/107:13:041
1602799613,50cyclictest0-21swapper/107:13:041
16023996119,10cyclictest2762-21runrttasks08:56:030
243082603,48sleep224311-21crond07:42:462
1602999604,47cyclictest0-21swapper/309:58:273
1602799605,47cyclictest0-21swapper/111:12:391
1602799604,49cyclictest0-21swapper/111:07:381
1602799604,48cyclictest0-21swapper/110:07:061
16023996018,10cyclictest24284-21ssh09:28:040
301472594,13sleep00-21swapper/008:48:060
1602999594,47cyclictest0-21swapper/311:23:113
16029995912,27cyclictest30175-21gltestperf07:53:043
16029995912,27cyclictest30175-21gltestperf07:53:043
16028995939,12cyclictest0-21swapper/210:08:052
16028995938,15cyclictest0-21swapper/209:27:582
16028995938,14cyclictest0-21swapper/208:21:392
1602799593,49cyclictest15119-21grep09:13:141
1602799593,49cyclictest15119-21grep09:13:141
219499580,4rtkit-daemon2193-21rtkit-daemon10:27:540
1602999587,31cyclictest30485-21fschecks_time09:38:003
16028995836,11cyclictest0-21swapper/211:30:252
1602799585,45cyclictest0-21swapper/109:26:301
16027995821,20cyclictest27254-21proc_pri08:43:121
1602399589,21cyclictest0-21swapper/010:52:240
16023995825,11cyclictest12426-21ssh09:58:140
16023995820,33cyclictest11575-21idleruntime-cro11:37:370
1602999577,19cyclictest0-21swapper/306:37:493
1602999574,36cyclictest0-21swapper/311:00:133
1602999573,46cyclictest0-21swapper/310:07:063
16029995713,26cyclictest20600-21munin-node08:33:153
16029995713,26cyclictest20600-21munin-node08:33:153
16029995712,21cyclictest31909-21switchtime10:28:133
1602899574,45cyclictest0-21swapper/209:38:052
16028995718,24cyclictest0-21swapper/209:00:072
1602799573,9cyclictest17241-21aten2.4-expect10:07:521
1602399573,28cyclictest0-21swapper/008:32:130
16023995720,13cyclictest0-21swapper/010:58:120
322072563,47sleep00-21swapper/009:40:310
176002563,45sleep017664-21df10:07:560
1602999564,33cyclictest0-21swapper/311:12:593
1602999564,33cyclictest0-21swapper/311:12:593
1602899564,36cyclictest0-21swapper/208:42:332
1602899563,36cyclictest0-21swapper/207:03:052
16028995628,12cyclictest0-21swapper/209:23:002
16028995627,13cyclictest0-21swapper/211:13:032
16028995627,13cyclictest0-21swapper/211:13:032
1602799564,25cyclictest0-21swapper/111:27:311
1602799563,46cyclictest9572-21wc10:43:131
1602799563,46cyclictest0-21swapper/109:32:551
1602799563,40cyclictest0-21swapper/108:57:101
1602399569,25cyclictest0-21swapper/011:22:550
1602399564,24cyclictest0-21swapper/007:27:580
1602399564,23cyclictest13625-21ssh08:23:150
16023995636,13cyclictest31756-21sort11:17:570
16023995614,22cyclictest0-21swapper/007:17:590
97742553,12sleep20-21swapper/209:07:432
96022553,11sleep00-21swapper/008:18:030
249802553,9sleep00-21swapper/008:40:280
1602999554,43cyclictest0-21swapper/310:07:543
1602999554,43cyclictest0-21swapper/307:23:033
16029995538,11cyclictest1376-21gltestperf06:53:093
16029995518,19cyclictest0-21swapper/310:23:103
1602899554,35cyclictest0-21swapper/211:02:412
1602899554,29cyclictest0-21swapper/210:19:522
1602899553,46cyclictest0-21swapper/210:53:012
1602799554,45cyclictest30706-21munin-node09:38:021
1602799554,45cyclictest0-21swapper/106:53:011
1602799554,44cyclictest0-21swapper/110:18:181
1602799554,11cyclictest0-21swapper/111:36:211
1602799554,10cyclictest0-21swapper/109:09:531
16027995538,10cyclictest20091-21tr07:33:011
1602799553,9cyclictest10050-21iostat_ios08:18:071
1602799553,46cyclictest0-21swapper/111:16:261
1602799553,46cyclictest0-21swapper/111:16:261
1602799553,45cyclictest22555-21aten_r1power_cu08:37:561
1602399556,32cyclictest0-21swapper/010:36:450
1602399556,32cyclictest0-21swapper/010:36:450
1602399556,28cyclictest0-21swapper/009:00:520
1602399555,29cyclictest0-21swapper/007:08:040
1602399554,30cyclictest0-21swapper/010:02:590
1602399554,29cyclictest0-21swapper/008:42:560
1602399554,26cyclictest0-21swapper/009:42:520
1602399554,26cyclictest0-21swapper/009:02:560
16023995527,11cyclictest0-21swapper/009:15:390
16023995527,11cyclictest0-21swapper/009:15:390
16023995522,14cyclictest0-21swapper/007:53:210
16023995522,14cyclictest0-21swapper/007:53:210
16023995522,13cyclictest0-21swapper/011:07:500
16023995512,26cyclictest0-21swapper/009:52:000
103042553,12sleep20-21swapper/210:45:112
1602999549,38cyclictest13659-21unixbench_singl11:38:103
1602999549,27cyclictest0-21swapper/311:08:033
1602999549,24cyclictest0-21swapper/309:45:223
1602999544,43cyclictest0-21swapper/308:42:583
16029995435,12cyclictest19504-21cut06:23:103
16029995414,20cyclictest10886-21ssh08:18:303
16029995412,17cyclictest23909-21proc_pri08:38:133
16028995423,13cyclictest0-21swapper/207:28:022
16028995422,13cyclictest0-21swapper/206:58:082
1602399547,28cyclictest0-21swapper/007:03:000
1602399545,29cyclictest0-21swapper/009:53:140
1602399545,29cyclictest0-21swapper/009:53:140
1602399545,28cyclictest0-21swapper/010:23:070
1602399545,28cyclictest0-21swapper/006:37:500
1602399544,42cyclictest0-21swapper/009:12:440
1602399544,29cyclictest0-21swapper/008:03:080
1602399544,26cyclictest0-21swapper/007:43:110
1602399544,24cyclictest13656-21grep11:38:100
1602399543,28cyclictest0-21swapper/006:57:480
1602399543,27cyclictest0-21swapper/010:55:500
16023995421,14cyclictest0-21swapper/011:42:470
16023995421,13cyclictest0-21swapper/006:23:080
16023995418,12cyclictest28036-21tr11:12:540
16023995418,12cyclictest28036-21tr11:12:540
16023995417,12cyclictest0-21swapper/007:58:200
1602999534,37cyclictest0-21swapper/307:58:193
1602999534,26cyclictest0-21swapper/311:05:173
1602999534,25cyclictest0-21swapper/310:48:063
16029995336,10cyclictest8796-21grep10:42:593
16029995311,25cyclictest0-21swapper/307:13:203
16029995311,25cyclictest0-21swapper/307:13:203
1602899534,41cyclictest0-21swapper/209:42:552
1602899534,29cyclictest0-21swapper/209:53:402
1602899534,29cyclictest0-21swapper/209:53:402
1602899533,34cyclictest0-21swapper/209:11:232
16028995324,12cyclictest0-21swapper/211:43:042
16028995323,13cyclictest0-21swapper/206:18:112
16028995322,13cyclictest0-21swapper/210:32:392
1602799534,43cyclictest0-21swapper/109:04:141
1602799534,12cyclictest0-21swapper/110:56:231
1602799533,44cyclictest0-21swapper/106:18:051
1602399535,28cyclictest0-21swapper/010:37:500
1602399535,28cyclictest0-21swapper/010:13:000
1602399535,27cyclictest0-21swapper/011:28:030
1602399534,28cyclictest0-21swapper/009:24:560
1602399534,27cyclictest8057-21aten_r1power_po10:42:520
1602399534,26cyclictest0-21swapper/006:28:020
1602399534,26cyclictest0-21swapper/006:28:020
16023995319,29cyclictest17716-21kernelversion09:18:060
16023995319,10cyclictest20840-21grep08:33:180
16023995319,10cyclictest20840-21grep08:33:180
215272524,12sleep30-21swapper/306:28:063
215272524,12sleep30-21swapper/306:28:063
1602999526,25cyclictest0-21swapper/311:22:263
1602999525,40cyclictest0-21swapper/309:03:133
1602999525,28cyclictest0-21swapper/308:57:433
1602999524,40cyclictest0-21swapper/310:33:073
1602999524,40cyclictest0-21swapper/310:33:073
1602999524,34cyclictest0-21swapper/310:21:533
1602999524,29cyclictest0-21swapper/308:58:253
16029995233,13cyclictest20632-21gltestperf07:33:063
16029995210,24cyclictest0-21swapper/309:51:023
1602899527,27cyclictest0-21swapper/208:48:052
1602899525,29cyclictest0-21swapper/207:58:032
1602899524,41cyclictest0-21swapper/210:48:082
1602899524,29cyclictest0-21swapper/209:33:022
1602899524,22cyclictest0-21swapper/209:18:042
1602899523,25cyclictest10054-21python11:33:072
16028995225,12cyclictest0-21swapper/206:23:242
16028995223,13cyclictest0-21swapper/208:13:122
16028995222,13cyclictest0-21swapper/211:20:482
16028995221,13cyclictest0-21swapper/210:57:442
16028995221,13cyclictest0-21swapper/208:28:332
16028995215,10cyclictest21011-21df_abs10:12:572
16028995210,24cyclictest2112-21rm10:32:592
16028995210,24cyclictest2112-21rm10:32:592
1602799524,43cyclictest0-21swapper/110:00:381
1602799524,43cyclictest0-21swapper/109:50:301
1602799524,43cyclictest0-21swapper/107:32:471
1602799524,12cyclictest0-21swapper/109:43:061
1602799524,11cyclictest0-21swapper/110:17:231
1602799523,43cyclictest26497-21sshd07:45:111
1602799523,43cyclictest13304-21iostat08:23:091
1602799523,42cyclictest28164-21sshd06:42:541
1602799522,45cyclictest0-21swapper/107:22:481
1602399525,28cyclictest0-21swapper/008:08:140
1602399524,27cyclictest0-21swapper/006:58:020
1602399524,27cyclictest0-21swapper/006:48:000
1602399524,26cyclictest0-21swapper/007:17:480
1602399524,26cyclictest0-21swapper/007:17:480
16023995221,11cyclictest28337-21runrttasks07:48:150
16023995219,12cyclictest0-21swapper/006:43:070
1602999516,38cyclictest17115-21gltestperf06:18:093
1602999515,28cyclictest0-21swapper/311:30:413
1602999515,28cyclictest0-21swapper/306:58:093
1602999514,33cyclictest0-21swapper/309:30:283
1602999514,33cyclictest0-21swapper/308:25:393
1602999514,28cyclictest0-21swapper/311:32:553
1602999514,28cyclictest0-21swapper/307:08:243
1602999514,14cyclictest0-21swapper/308:49:343
16029995130,14cyclictest0-21swapper/309:55:063
16029995130,14cyclictest0-21swapper/309:55:063
1602999513,40cyclictest0-21swapper/309:33:173
16029995118,13cyclictest0-21swapper/307:22:473
16029995115,16cyclictest6003-21open_inodes10:38:073
16029995113,23cyclictest0-21swapper/309:11:413
16029995111,22cyclictest0-21swapper/310:13:073
1602899516,27cyclictest0-21swapper/210:23:032
1602899514,41cyclictest0-21swapper/207:18:132
1602899514,34cyclictest0-21swapper/210:38:592
1602899514,29cyclictest0-21swapper/210:02:562
1602899514,29cyclictest0-21swapper/206:43:082
1602899514,28cyclictest0-21swapper/207:48:012
1602899513,41cyclictest0-21swapper/211:37:592
1602899513,29cyclictest0-21swapper/211:07:522
16028995123,12cyclictest0-21swapper/206:52:482
16028995114,21cyclictest0-21swapper/209:58:572
16028995113,22cyclictest0-21swapper/208:25:122
1602799513,11cyclictest0-21swapper/108:49:261
16027995123,10cyclictest6675-21aten_r1power_fr08:12:571
1602399515,26cyclictest0-21swapper/006:38:130
1602399514,28cyclictest0-21swapper/007:38:100
1602399514,28cyclictest0-21swapper/007:25:380
1602399513,26cyclictest0-21swapper/007:33:170
1602999509,22cyclictest5128-21cut08:08:063
1602999507,25cyclictest0-21swapper/311:42:513
1602999505,29cyclictest0-21swapper/307:03:133
1602999504,28cyclictest0-21swapper/310:53:013
1602999504,28cyclictest0-21swapper/308:28:083
16029995030,11cyclictest1227-21runrttasks07:42:133
1602999503,34cyclictest0-21swapper/309:16:083
1602999503,34cyclictest0-21swapper/309:16:083
16029995015,27cyclictest0-21swapper/309:23:103
1602899505,38cyclictest0-21swapper/206:53:062
1602899504,29cyclictest0-21swapper/206:33:132
1602899504,28cyclictest0-21swapper/211:22:492
1602899504,28cyclictest0-21swapper/209:48:132
1602899504,28cyclictest0-21swapper/207:08:152
16028995023,12cyclictest0-21swapper/208:52:562
1602799503,7cyclictest7848-21aten2.4-expect07:07:571
1602799503,13cyclictest0-21swapper/109:55:331
1602799503,13cyclictest0-21swapper/109:55:331
1602999494,23cyclictest0-21swapper/308:12:563
16029994915,25cyclictest0-21swapper/308:02:593
1602899494,38cyclictest0-21swapper/207:13:102
1602899494,38cyclictest0-21swapper/207:13:102
1602899494,28cyclictest0-21swapper/208:08:062
1602899494,28cyclictest0-21swapper/206:28:192
1602899494,28cyclictest0-21swapper/206:28:192
1602899494,27cyclictest2671-21grep08:03:072
1602899494,27cyclictest0-21swapper/207:52:572
1602899494,27cyclictest0-21swapper/207:52:572
1602899494,27cyclictest0-21swapper/207:27:482
1602799494,40cyclictest0-21swapper/111:44:331
1602799494,39cyclictest0-21swapper/107:01:131
16027994932,10cyclictest30065-21grep07:53:031
16027994932,10cyclictest30065-21grep07:53:031
1602799493,40cyclictest21069-21hostname06:28:011
1602799493,40cyclictest21069-21hostname06:28:011
1602799493,40cyclictest13779-21ssh11:38:271
1602799493,12cyclictest0-21swapper/106:23:261
16029994818,13cyclictest0-21swapper/306:38:033
1602899484,24cyclictest0-21swapper/207:32:592
16028994819,11cyclictest0-21swapper/207:45:412
16028994818,12cyclictest0-21swapper/206:38:292
1602799484,11cyclictest0-21swapper/107:58:001
254512472,38sleep10-21swapper/106:36:381
1602999475,25cyclictest0-21swapper/307:42:593
16029994728,13cyclictest0-21swapper/306:52:483
1602899474,25cyclictest0-21swapper/206:17:502
1602799474,13cyclictest0-21swapper/108:08:191
1602799473,13cyclictest0-21swapper/106:38:011
36232462,38sleep10-21swapper/108:03:251
1602999465,33cyclictest0-21swapper/307:47:583
1602799464,12cyclictest0-21swapper/107:48:201
1602799463,13cyclictest0-21swapper/107:37:581
1602399464,13cyclictest0-21swapper/006:17:490
1602799454,11cyclictest0-21swapper/107:03:001
1602999447,31cyclictest0-21swapper/307:28:033
1602999444,33cyclictest0-21swapper/306:43:143
325482432,34sleep10-21swapper/106:50:491
1602799423,26cyclictest0-21swapper/106:17:501
157522414,30sleep30-21swapper/306:14:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional