You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 19:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 11, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991190,14rtkit-daemon0-21swapper/110:08:061
142919910416,13cyclictest0-21swapper/007:47:170
14296991025,28cyclictest0-21swapper/210:22:192
14291991023,12cyclictest0-21swapper/006:04:510
14291991023,12cyclictest0-21swapper/006:04:510
14296991014,48cyclictest7033-21diskmemload10:02:082
142919910140,54cyclictest0-21swapper/008:12:250
334921000,10sleep11429499cyclictest07:37:161
14296991004,28cyclictest0-21swapper/211:12:152
142919910040,54cyclictest0-21swapper/009:58:240
1429199995,86cyclictest0-21swapper/009:56:510
1429699983,47cyclictest9028-21kworker/2:108:47:142
1429199985,26cyclictest0-21swapper/011:08:300
1429199985,10cyclictest31997-21df08:22:110
14291999842,49cyclictest0-21swapper/010:17:070
14291999842,49cyclictest0-21swapper/010:17:070
1429699974,46cyclictest0-21swapper/208:37:402
14291999732,13cyclictest14063-21aten_r1power_cu09:32:040
14291999732,13cyclictest14063-21aten_r1power_cu09:32:040
1429199973,11cyclictest1735-21strings09:12:190
1429699965,47cyclictest0-21swapper/210:18:022
1429699965,47cyclictest0-21swapper/210:18:022
1429699964,51cyclictest0-21swapper/210:51:502
1429699963,53cyclictest25417-21strings09:47:172
1429199966,27cyclictest0-21swapper/010:11:180
1429199963,43cyclictest0-21swapper/007:53:170
1429699954,51cyclictest0-21swapper/208:27:222
14294999530,50cyclictest7033-21diskmemload11:16:091
1429199955,26cyclictest0-21swapper/011:13:030
1429199955,23cyclictest0-21swapper/010:47:060
14291999538,12cyclictest0-21swapper/009:06:450
1429199953,47cyclictest0-21swapper/008:17:500
1429699944,52cyclictest0-21swapper/210:37:072
1429699944,51cyclictest0-21swapper/210:01:512
1429699944,18cyclictest0-21swapper/210:45:312
14291999442,11cyclictest19431-21munin-node08:52:260
14291999442,11cyclictest19431-21munin-node08:52:260
1429199944,28cyclictest0-21swapper/011:05:060
1429199944,12cyclictest0-21swapper/008:57:060
1429699934,51cyclictest0-21swapper/209:41:182
1429699934,51cyclictest0-21swapper/209:41:182
1429699934,47cyclictest0-21swapper/207:47:272
1429699933,49cyclictest13276-21yum-updatesd-he09:30:202
14291999344,42cyclictest1419-21runrttasks08:02:110
1429199934,38cyclictest0-21swapper/008:01:570
1429199933,49cyclictest0-21swapper/008:39:320
1429199933,44cyclictest0-21swapper/009:23:080
1429699924,50cyclictest0-21swapper/210:12:162
1429199926,38cyclictest0-21swapper/010:30:190
1429199925,20cyclictest0-21swapper/009:07:150
1429199923,45cyclictest0-21swapper/005:58:200
1429199923,28cyclictest0-21swapper/009:42:270
203372910,2sleep2281ktimersoftd/210:27:242
1429799917,76cyclictest0-21swapper/311:00:253
1429799914,55cyclictest0-21swapper/309:54:453
1429799913,80cyclictest0-21swapper/309:02:183
1429699914,48cyclictest0-21swapper/209:17:052
1429199914,26cyclictest0-21swapper/008:45:130
1429199914,26cyclictest0-21swapper/007:20:160
14291999138,8cyclictest4107-21python08:27:250
14291999119,15cyclictest0-21swapper/006:07:140
14291999119,15cyclictest0-21swapper/006:07:140
1429499904,25cyclictest0-21swapper/110:57:011
1429199904,26cyclictest0-21swapper/009:47:190
1429699894,50cyclictest0-21swapper/206:32:002
1429499895,21cyclictest0-21swapper/109:02:251
1429199896,25cyclictest0-21swapper/009:29:150
1429199896,12cyclictest1419-21runrttasks09:37:580
1429199896,12cyclictest1419-21runrttasks09:37:580
1429199895,26cyclictest0-21swapper/010:38:250
1429199894,30cyclictest0-21swapper/008:09:350
1429199894,26cyclictest0-21swapper/010:32:080
1429199894,25cyclictest1247-21lldpd07:35:110
1429199894,25cyclictest1247-21lldpd07:35:110
1429199894,23cyclictest17827-21turbostat.cron07:01:590
14291998936,12cyclictest0-21swapper/009:18:530
1429199893,80cyclictest0-21swapper/010:43:140
1429199893,27cyclictest0-21swapper/010:13:480
14291998910,23cyclictest0-21swapper/008:51:020
1429799884,76cyclictest931-21unixbench_singl08:22:303
1429799884,75cyclictest0-21swapper/308:06:333
1429799883,76cyclictest0-21swapper/308:21:253
1429499884,76cyclictest0-21swapper/108:56:541
1429499884,76cyclictest0-21swapper/108:56:541
1429499883,77cyclictest25420-21fschecks_count08:12:121
14294998820,7cyclictest1916-21ssh08:25:511
1429199884,22cyclictest4293-21ssh10:04:050
1429199883,47cyclictest0-21swapper/010:25:480
1429799874,76cyclictest0-21swapper/310:32:093
1429699875,14cyclictest1419-21runrttasks07:56:262
1429699874,45cyclictest0-21swapper/208:21:532
1429699874,37cyclictest0-21swapper/209:54:312
1429499874,75cyclictest29915-21iostat10:42:111
14294998728,35cyclictest15328-21ssh08:45:121
14294998714,13cyclictest0-21swapper/109:07:111
1429799864,75cyclictest0-21swapper/310:12:233
1429799864,75cyclictest0-21swapper/309:22:113
1429799864,74cyclictest0-21swapper/311:10:583
1429799864,67cyclictest0-21swapper/307:57:213
1429799864,56cyclictest0-21swapper/307:52:333
1429799863,75cyclictest27130-21taskset08:14:063
1429799863,74cyclictest0-21swapper/310:47:013
1429699864,47cyclictest0-21swapper/211:11:002
1429499863,8cyclictest19420-21fschecks_count10:27:101
1429199863,49cyclictest0-21swapper/008:34:040
1429799854,74cyclictest0-21swapper/309:28:273
1429799854,73cyclictest0-21swapper/308:34:353
1429799854,61cyclictest0-21swapper/309:44:283
1429799853,65cyclictest0-21swapper/310:29:103
1429799853,52cyclictest0-21swapper/310:10:363
1429499855,72cyclictest20987-21sh09:42:071
1429499854,73cyclictest6523-21df06:37:141
1429499853,23cyclictest25786-21df_inode07:17:131
14294998528,50cyclictest20470-21aten_r1power_cu07:07:081
1429799846,71cyclictest0-21swapper/310:03:243
1429799843,74cyclictest0-21swapper/309:16:403
1429799843,72cyclictest26015-21latency_hist09:01:553
1429799843,68cyclictest1419-21runrttasks08:43:373
1429799843,67cyclictest10656-21munin-run06:46:593
1429799843,49cyclictest0-21swapper/310:56:433
14294998430,36cyclictest12170-21ssh08:40:581
1429499843,9cyclictest17867-21aten_r1power_po08:02:091
1429499843,73cyclictest3989-21ssh10:02:571
1429499843,73cyclictest21679-21munin-node06:02:201
1429499843,73cyclictest21679-21munin-node06:02:201
1429499843,26cyclictest0-21swapper/109:27:041
14294998415,13cyclictest0-21swapper/110:32:221
1429199844,27cyclictest0-21swapper/007:37:130
1429199844,26cyclictest0-21swapper/007:06:590
1429199843,75cyclictest0-21swapper/007:22:090
1429799838,59cyclictest0-21swapper/309:33:313
1429799838,59cyclictest0-21swapper/309:33:313
1429799834,71cyclictest0-21swapper/310:37:043
1429799834,71cyclictest0-21swapper/307:37:143
1429799834,47cyclictest0-21swapper/309:39:043
1429799834,47cyclictest0-21swapper/309:39:043
1429799833,73cyclictest29795-21http_loadtime10:42:093
1429799833,68cyclictest4862-21gltestperf09:17:123
1429499833,73cyclictest0-21swapper/110:12:591
1429499833,23cyclictest19301-21runrttasks09:37:271
1429499833,23cyclictest19301-21runrttasks09:37:271
14294998329,34cyclictest8762-21ssh08:35:501
14294998322,55cyclictest0-21swapper/110:47:191
1429199833,44cyclictest0-21swapper/007:42:240
1429199833,43cyclictest0-21swapper/010:59:310
1429799829,55cyclictest0-21swapper/310:22:523
1429799824,71cyclictest0-21swapper/308:27:453
14297998213,60cyclictest0-21swapper/311:02:323
1429699826,31cyclictest0-21swapper/209:09:302
1429699825,15cyclictest0-21swapper/208:07:542
1429499824,71cyclictest0-21swapper/108:57:091
1429499824,69cyclictest0-21swapper/110:22:241
1429499824,14cyclictest0-21swapper/108:17:091
1429499823,28cyclictest0-21swapper/108:48:391
14294998224,51cyclictest30075-21aten_r1power_fr07:27:081
14294998223,9cyclictest15006-21fschecks_time07:57:141
14294998221,45cyclictest0-21swapper/110:53:101
1429199825,25cyclictest0-21swapper/006:37:000
1429199823,46cyclictest0-21swapper/006:12:120
1429799819,50cyclictest0-21swapper/308:47:053
1429799814,69cyclictest25337-21munin-node09:47:163
1429499818,19cyclictest121850irq/46-eth008:30:281
1429499815,68cyclictest23419-21ssh08:08:291
1429499814,69cyclictest28859-21cut06:17:121
1429499814,69cyclictest0-21swapper/109:22:121
1429499813,71cyclictest0-21swapper/107:36:581
1429499813,71cyclictest0-21swapper/107:36:581
14294998129,46cyclictest28788-21head09:52:191
1429199813,43cyclictest0-21swapper/010:54:470
1429799807,59cyclictest0-21swapper/310:21:033
1429799807,59cyclictest0-21swapper/310:21:033
1429799805,67cyclictest0-21swapper/307:27:073
1429699803,47cyclictest0-21swapper/210:59:102
1429499809,12cyclictest0-21swapper/109:34:131
1429499809,12cyclictest0-21swapper/109:34:131
1429499809,11cyclictest0-21swapper/107:50:391
1429499804,69cyclictest0-21swapper/111:02:011
1429499803,68cyclictest434-21cut09:12:051
1429499803,27cyclictest27181-21rm09:51:361
14294998027,47cyclictest0-21swapper/110:17:481
14294998027,47cyclictest0-21swapper/110:17:481
14294998017,8cyclictest1419-21runrttasks06:35:341
14294998017,13cyclictest0-21swapper/109:21:301
1429199805,25cyclictest0-21swapper/006:37:160
1429799794,67cyclictest2128-21crond07:36:573
1429799794,67cyclictest2128-21crond07:36:573
1429799794,67cyclictest0-21swapper/306:13:423
1429799794,58cyclictest18631-21diskstats07:02:133
1429799794,57cyclictest0-21swapper/308:07:223
1429799793,69cyclictest0-21swapper/309:07:023
1429799793,69cyclictest0-21swapper/306:27:183
1429799793,68cyclictest0-21swapper/311:12:213
1429799793,68cyclictest0-21swapper/309:57:173
1429799793,67cyclictest0-21swapper/306:36:593
1429799793,60cyclictest0-21swapper/306:52:263
1429499794,7cyclictest32425-21ssh09:57:231
1429499793,9cyclictest17740-21gltestperf05:52:201
1429499793,69cyclictest0-21swapper/107:42:211
14294997924,9cyclictest1650-21df_abs06:27:151
14294997915,13cyclictest0-21swapper/110:39:341
1429799783,68cyclictest23541-21fschecks_time07:12:163
1429799783,67cyclictest0-21swapper/307:47:513
1429499784,27cyclictest0-21swapper/106:51:101
1429499784,27cyclictest0-21swapper/106:51:101
14294997822,10cyclictest15031-21unixbench_singl06:52:311
14294997821,9cyclictest13569-21ssh11:06:591
14294997820,9cyclictest19144-21latency07:02:201
14294997818,8cyclictest1419-21runrttasks06:59:441
1429799777,57cyclictest0-21swapper/308:39:093
1429799774,65cyclictest0-21swapper/307:11:593
1429499774,12cyclictest0-21swapper/107:55:291
14294997733,38cyclictest16679-21munin-run05:52:011
1429499773,23cyclictest0-21swapper/106:45:101
14294997719,7cyclictest25769-21unixbench_multi06:07:331
14294997719,7cyclictest25769-21unixbench_multi06:07:331
1429799763,67cyclictest0-21swapper/305:52:133
1429799762,68cyclictest0-21swapper/308:51:573
1429799762,68cyclictest0-21swapper/308:51:573
1429799754,63cyclictest6848-21fschecks_time06:37:183
1429799753,64cyclictest29194-21tr06:17:153
1429499753,27cyclictest0-21swapper/105:58:071
14294997524,9cyclictest27752-21aten_r1power_vo07:22:101
1429499752,9cyclictest32133-21munin-node06:22:181
14294997518,10cyclictest26770-21cut06:12:151
14294997510,16cyclictest0-21swapper/107:12:311
1429799744,62cyclictest0-21swapper/306:02:163
1429799744,62cyclictest0-21swapper/306:02:163
1429799743,63cyclictest27954-21tr07:22:113
1429799743,63cyclictest0-21swapper/307:42:353
1429799743,50cyclictest10885-21munin-node06:47:253
1429799743,50cyclictest10885-21munin-node06:47:253
1429799733,48cyclictest0-21swapper/306:57:183
1429799729,46cyclictest19868-21diskstats05:57:183
1429799723,60cyclictest26876-21sed07:17:303
1429799723,47cyclictest121850irq/46-eth005:47:163
1429799714,60cyclictest0-21swapper/306:22:153
1429799712,49cyclictest0-21swapper/306:11:003
1429799712,49cyclictest0-21swapper/306:11:003
14294996814,9cyclictest14358-21latency_hist05:47:021
1429799673,56cyclictest0-21swapper/305:47:023
1429699674,22cyclictest0-21swapper/209:44:492
248599640,5rtkit-daemon2484-21rtkit-daemon09:16:532
204682640,2chrt0-21swapper/007:07:080
1429699635,16cyclictest0-21swapper/210:33:062
1429699635,14cyclictest0-21swapper/208:22:272
1429699624,50cyclictest0-21swapper/209:21:582
1429699623,52cyclictest0-21swapper/208:34:082
1429699614,49cyclictest0-21swapper/208:02:322
1429699614,49cyclictest0-21swapper/206:47:192
1429699614,49cyclictest0-21swapper/206:47:192
1429699604,49cyclictest0-21swapper/208:43:272
1429699594,48cyclictest0-21swapper/210:07:512
1429699594,47cyclictest0-21swapper/210:54:582
14291995926,27cyclictest23683-21gltestperf07:12:180
1429699584,47cyclictest0-21swapper/207:57:292
1429699584,46cyclictest0-21swapper/209:03:382
1429699584,28cyclictest0-21swapper/206:21:022
1429699574,46cyclictest0-21swapper/211:02:402
1429699574,28cyclictest0-21swapper/208:56:592
1429699574,28cyclictest0-21swapper/205:57:242
1429699565,46cyclictest0-21swapper/208:15:482
1429699565,26cyclictest0-21swapper/209:33:392
1429699565,26cyclictest0-21swapper/209:33:392
1429699564,47cyclictest0-21swapper/207:37:172
1429699564,28cyclictest0-21swapper/208:52:052
1429699564,28cyclictest0-21swapper/208:52:052
1429699564,28cyclictest0-21swapper/207:22:142
14296995615,25cyclictest0-21swapper/206:57:142
1429699554,45cyclictest0-21swapper/207:07:282
1429699554,28cyclictest0-21swapper/207:31:142
1429699554,28cyclictest0-21swapper/206:22:142
1429699554,27cyclictest0-21swapper/207:46:582
1429699554,27cyclictest0-21swapper/206:52:112
14296995522,14cyclictest0-21swapper/206:37:212
1429199553,46cyclictest0-21swapper/005:47:130
305532544,42sleep00-21swapper/007:27:130
1429699545,41cyclictest0-21swapper/206:07:162
1429699545,41cyclictest0-21swapper/206:07:162
1429699544,28cyclictest0-21swapper/206:32:182
1429699544,27cyclictest0-21swapper/206:42:202
14296995437,11cyclictest1247-21lldpd07:19:272
14296995435,10cyclictest18767-21tune2fs07:02:152
1429199545,42cyclictest0-21swapper/006:47:170
1429199545,42cyclictest0-21swapper/006:47:170
1429699535,27cyclictest0-21swapper/206:16:012
1429699533,27cyclictest0-21swapper/205:54:062
14296995322,13cyclictest0-21swapper/207:32:312
14296995322,13cyclictest0-21swapper/207:32:312
1429199533,27cyclictest0-21swapper/006:17:110
1429699524,40cyclictest0-21swapper/205:52:022
14291995225,12cyclictest0-21swapper/005:52:360
33322514,41sleep00-21swapper/006:30:140
1429699515,29cyclictest0-21swapper/207:12:242
1429199514,28cyclictest0-21swapper/006:52:110
1429199513,28cyclictest0-21swapper/005:47:020
1429699505,37cyclictest14283-21munin-run05:47:012
1429699504,27cyclictest0-21swapper/206:02:252
1429699504,27cyclictest0-21swapper/206:02:252
1429199494,26cyclictest0-21swapper/006:26:030
1429199464,36cyclictest0-21swapper/006:42:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional