You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 12:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jul 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991100,5rtkit-daemon2193-21rtkit-daemon23:26:410
7398991006,46cyclictest0-21swapper/222:22:152
739599974,12cyclictest0-21swapper/021:42:070
739899964,50cyclictest0-21swapper/220:37:112
739599954,80cyclictest0-21swapper/023:40:240
7395999512,68cyclictest0-21swapper/021:27:530
7399999432,11cyclictest9077-21tr19:32:153
739999934,42cyclictest0-21swapper/322:48:163
7399999327,13cyclictest0-21swapper/320:49:393
739599935,80cyclictest0-21swapper/022:32:130
739599935,80cyclictest0-21swapper/022:32:130
739599934,67cyclictest0-21swapper/021:37:230
739599925,73cyclictest0-21swapper/021:22:200
739599923,70cyclictest27090-21runrttasks20:57:290
739599923,11cyclictest0-21swapper/023:06:520
739599923,10cyclictest0-21swapper/022:43:000
739599915,78cyclictest0-21swapper/020:52:410
739599914,64cyclictest0-21swapper/022:02:220
739599913,11cyclictest5106-21needreboot20:27:270
7395999116,52cyclictest1547-21nscd20:47:100
739599909,55cyclictest0-21swapper/020:42:290
739599904,70cyclictest0-21swapper/022:12:200
739599904,14cyclictest0-21swapper/021:33:270
739599904,12cyclictest0-21swapper/023:17:030
81412890,6sleep38143-21unixbench_singl19:27:333
739599896,11cyclictest29922-21yum-updatesd-he21:02:150
739599895,14cyclictest0-21swapper/021:15:390
739599894,77cyclictest0-21swapper/023:42:510
739599894,77cyclictest0-21swapper/022:47:070
739599894,77cyclictest0-21swapper/022:09:010
739599894,77cyclictest0-21swapper/019:42:160
739599894,77cyclictest0-21swapper/019:42:160
739599894,69cyclictest0-21swapper/018:42:220
739599894,14cyclictest0-21swapper/020:37:200
739599893,8cyclictest107550irq/46-eth022:28:250
739599893,64cyclictest0-21swapper/020:32:220
739599893,10cyclictest30173-21tr21:47:100
739599893,10cyclictest30173-21tr21:47:100
739999884,39cyclictest0-21swapper/322:42:353
739599885,72cyclictest0-21swapper/023:07:150
739599885,64cyclictest0-21swapper/019:47:170
739599884,65cyclictest0-21swapper/022:17:080
739599883,68cyclictest0-21swapper/019:02:290
739599882,9cyclictest0-21swapper/022:01:110
739599875,66cyclictest0-21swapper/023:15:080
739599875,66cyclictest0-21swapper/023:15:080
739599874,9cyclictest2319-21perl22:37:120
739599874,59cyclictest0-21swapper/023:32:040
739599874,11cyclictest0-21swapper/020:22:300
739599874,11cyclictest0-21swapper/020:22:300
739599873,76cyclictest0-21swapper/021:10:190
739599873,76cyclictest0-21swapper/021:10:190
7395998713,44cyclictest107550irq/46-eth022:22:220
739599865,59cyclictest0-21swapper/020:02:280
739599865,54cyclictest0-21swapper/022:58:030
739599864,14cyclictest0-21swapper/021:17:090
739599863,8cyclictest24385-21basename18:57:150
7399998529,12cyclictest0-21swapper/320:37:213
7399998528,12cyclictest0-21swapper/323:39:263
739599854,8cyclictest20368-21kworker/0:023:47:250
739599854,63cyclictest0-21swapper/022:52:080
739599854,13cyclictest0-21swapper/023:30:080
739599853,63cyclictest324141diskmemload21:52:010
739599853,63cyclictest324141diskmemload21:52:010
739999844,39cyclictest0-21swapper/320:52:183
739599845,72cyclictest0-21swapper/019:22:010
739599834,12cyclictest0-21swapper/019:58:120
739599834,12cyclictest0-21swapper/019:37:160
739599834,12cyclictest0-21swapper/019:37:160
7399998220,27cyclictest8279-21fschecks_time20:32:173
739599825,66cyclictest0-21swapper/018:22:190
739599824,52cyclictest0-21swapper/019:52:280
7395998217,46cyclictest19540-21munin-node18:47:310
739599814,12cyclictest0-21swapper/020:08:500
739599814,12cyclictest0-21swapper/019:27:150
739599805,68cyclictest0-21swapper/019:16:580
739599804,58cyclictest0-21swapper/019:32:130
739599803,57cyclictest0-21swapper/018:32:140
95942790,3sleep2281ktimersoftd/220:33:132
739599795,13cyclictest0-21swapper/018:37:270
739599794,12cyclictest0-21swapper/018:27:390
739599784,66cyclictest0-21swapper/019:11:150
739599774,66cyclictest0-21swapper/018:52:350
739599774,66cyclictest0-21swapper/018:52:350
739599774,59cyclictest0-21swapper/019:22:250
739599762,12cyclictest30263-21munin-node20:17:320
739599743,9cyclictest0-21swapper/020:16:580
323992740,4sleep3361ktimersoftd/323:17:253
60942708,15sleep20-21swapper/218:17:212
739599695,57cyclictest0-21swapper/018:22:040
117412663,11sleep20-21swapper/223:34:012
739699633,41cyclictest0-21swapper/122:52:251
88372623,51sleep30-21swapper/323:31:163
739999613,51cyclictest0-21swapper/322:12:203
7396996143,11cyclictest9329-21unixbench_multi18:22:361
131372616,47sleep20-21swapper/221:22:282
739899605,48cyclictest0-21swapper/221:57:252
739899604,48cyclictest0-21swapper/220:57:322
7396996042,11cyclictest1444-21gltestperf21:07:171
7396996042,11cyclictest1444-21gltestperf21:07:171
7396996040,12cyclictest26016-21tr20:57:141
219499600,4rtkit-daemon2193-21rtkit-daemon19:03:363
739899595,47cyclictest0-21swapper/218:57:342
739899594,48cyclictest30148-21tr21:47:102
739899594,48cyclictest30148-21tr21:47:102
739899594,48cyclictest0-21swapper/218:27:282
739899594,47cyclictest0-21swapper/221:27:062
739999584,46cyclictest0-21swapper/322:54:303
739999584,28cyclictest0-21swapper/321:02:253
739899585,46cyclictest0-21swapper/221:07:122
739899585,46cyclictest0-21swapper/221:07:122
739899585,45cyclictest10761-21users22:47:302
7398995823,29cyclictest19983-21forks22:17:132
7396995830,13cyclictest0-21swapper/121:42:281
739899575,45cyclictest14027-21python22:52:242
739899575,45cyclictest0-21swapper/223:44:332
739899575,45cyclictest0-21swapper/220:52:082
739899575,45cyclictest0-21swapper/220:45:542
739899574,46cyclictest1124-21snmpd23:12:262
739899574,46cyclictest1124-21snmpd23:12:262
739699575,30cyclictest0-21swapper/123:07:151
739699575,15cyclictest0-21swapper/120:35:061
7396995739,10cyclictest26319-21cut20:07:181
219499570,6rtkit-daemon2193-21rtkit-daemon22:22:213
7399995629,12cyclictest0-21swapper/322:32:223
7399995629,12cyclictest0-21swapper/322:32:223
7399995629,12cyclictest0-21swapper/321:17:153
7399995611,38cyclictest24152-21fschecks_time23:07:113
739899565,44cyclictest0-21swapper/221:42:192
739899565,12cyclictest9613-21ssh22:02:212
7398995640,11cyclictest0-21swapper/220:27:262
739899564,46cyclictest0-21swapper/221:52:122
739899564,46cyclictest0-21swapper/221:52:122
739899564,46cyclictest0-21swapper/221:39:032
739899564,46cyclictest0-21swapper/220:48:322
739899564,45cyclictest31128-21tail22:32:152
739899564,45cyclictest31128-21tail22:32:152
739899564,45cyclictest29922-21yum-updatesd-he21:02:272
739699565,15cyclictest0-21swapper/121:51:301
739699565,15cyclictest0-21swapper/121:51:301
739699565,15cyclictest0-21swapper/120:40:111
739699565,15cyclictest0-21swapper/120:24:071
739699565,15cyclictest0-21swapper/120:24:071
739699565,14cyclictest0-21swapper/122:04:421
739699564,25cyclictest1227-21runrttasks23:27:021
7396995639,10cyclictest1361-21cut21:52:081
7396995639,10cyclictest1361-21cut21:52:081
7396995621,10cyclictest6606-21ssh21:13:381
236652563,11sleep10-21swapper/120:02:181
219499560,6rtkit-daemon2193-21rtkit-daemon19:37:353
219499560,6rtkit-daemon2193-21rtkit-daemon19:37:353
219499560,6rtkit-daemon2193-21rtkit-daemon19:07:213
166192563,8sleep116712-21awk23:42:031
739899555,44cyclictest0-21swapper/222:42:012
739899554,46cyclictest0-21swapper/223:27:082
739899554,45cyclictest0-21swapper/223:24:142
739899554,45cyclictest0-21swapper/223:18:442
739899554,45cyclictest0-21swapper/223:02:132
739899554,45cyclictest0-21swapper/222:38:512
739899554,44cyclictest0-21swapper/221:34:482
739899554,44cyclictest0-21swapper/219:37:342
739899554,44cyclictest0-21swapper/219:37:342
7398995520,8cyclictest0-21swapper/220:22:172
7398995520,8cyclictest0-21swapper/220:22:172
739699555,29cyclictest0-21swapper/119:02:211
739699555,15cyclictest0-21swapper/123:26:441
739699555,14cyclictest0-21swapper/122:50:181
739699555,14cyclictest0-21swapper/121:38:141
219499550,5rtkit-daemon2193-21rtkit-daemon19:17:513
75692543,10sleep20-21swapper/221:16:362
739899544,45cyclictest0-21swapper/223:41:372
739899544,44cyclictest0-21swapper/223:47:242
739899544,44cyclictest0-21swapper/221:17:522
739699545,30cyclictest0-21swapper/122:37:211
739699545,14cyclictest0-21swapper/123:38:341
739699545,14cyclictest0-21swapper/121:33:001
739699544,27cyclictest0-21swapper/119:49:101
739699544,27cyclictest0-21swapper/119:12:221
7396995439,9cyclictest31988-21unixbench-2d22:32:281
7396995439,9cyclictest31988-21unixbench-2d22:32:281
7396995423,11cyclictest20377-21yum-updatesd-he23:02:241
250172543,44sleep10-21swapper/120:55:511
219499540,6rtkit-daemon2193-21rtkit-daemon20:27:333
219499540,4rtkit-daemon2193-21rtkit-daemon23:48:473
142982542,13sleep10-21swapper/121:24:571
7399995337,9cyclictest24358-21unixbench_singl21:37:303
7399995327,13cyclictest0-21swapper/321:30:323
7399995325,13cyclictest0-21swapper/321:12:123
7399995319,21cyclictest0-21swapper/323:16:163
7399995319,21cyclictest0-21swapper/323:16:163
739899534,44cyclictest0-21swapper/222:28:022
7398995328,8cyclictest32414-21diskmemload23:11:292
7398995324,13cyclictest0-21swapper/223:01:142
739699535,28cyclictest0-21swapper/119:37:271
739699535,28cyclictest0-21swapper/119:37:271
739699535,14cyclictest0-21swapper/122:17:311
739699535,14cyclictest0-21swapper/121:18:281
739699535,14cyclictest0-21swapper/120:43:281
739699535,13cyclictest0-21swapper/121:06:441
739699534,28cyclictest0-21swapper/123:21:531
739699534,14cyclictest0-21swapper/122:07:321
7396995335,11cyclictest22856-21sed18:52:221
7396995335,11cyclictest22856-21sed18:52:221
7396995332,13cyclictest17087-21unixbench_singl21:27:271
7396995314,13cyclictest0-21swapper/122:42:551
219499530,6rtkit-daemon2193-21rtkit-daemon19:12:213
219499530,5rtkit-daemon2193-21rtkit-daemon23:01:043
219499530,5rtkit-daemon2193-21rtkit-daemon21:07:093
219499530,5rtkit-daemon2193-21rtkit-daemon21:07:093
219499530,5rtkit-daemon2193-21rtkit-daemon18:39:523
739899524,42cyclictest0-21swapper/222:07:202
739699525,28cyclictest0-21swapper/119:52:321
739699524,29cyclictest0-21swapper/123:12:241
739699524,29cyclictest0-21swapper/123:12:241
739699524,29cyclictest0-21swapper/122:57:181
739699524,29cyclictest0-21swapper/122:27:191
739699524,29cyclictest0-21swapper/121:57:071
739699524,29cyclictest0-21swapper/120:27:081
739699524,29cyclictest0-21swapper/118:47:321
739699524,11cyclictest0-21swapper/123:46:531
7396995234,10cyclictest13212-21grep18:32:221
7396995232,13cyclictest0-21swapper/123:35:161
259302524,11sleep10-21swapper/122:25:441
226152522,11sleep10-21swapper/119:59:031
219499520,5rtkit-daemon2193-21rtkit-daemon22:37:133
219499520,5rtkit-daemon2193-21rtkit-daemon20:57:323
219499520,5rtkit-daemon2193-21rtkit-daemon20:46:023
107162523,42sleep10-21swapper/119:34:291
739999514,40cyclictest0-21swapper/321:35:533
739999514,38cyclictest0-21swapper/321:52:213
739999514,38cyclictest0-21swapper/321:52:213
739899514,13cyclictest0-21swapper/222:12:312
739699514,29cyclictest0-21swapper/120:47:251
739699514,28cyclictest0-21swapper/120:21:591
739699514,26cyclictest0-21swapper/122:16:381
739699513,29cyclictest0-21swapper/119:07:251
219499510,5rtkit-daemon2193-21rtkit-daemon23:42:033
219499510,5rtkit-daemon2193-21rtkit-daemon23:34:333
219499510,5rtkit-daemon2193-21rtkit-daemon20:02:343
739999503,40cyclictest0-21swapper/322:03:073
739899505,28cyclictest0-21swapper/219:43:462
739899505,28cyclictest0-21swapper/219:43:462
739899505,28cyclictest0-21swapper/218:32:292
7398995021,9cyclictest6142-21latency_hist19:27:022
739699504,28cyclictest0-21swapper/119:28:431
739699504,28cyclictest0-21swapper/118:42:371
739699504,27cyclictest0-21swapper/119:42:241
739699504,27cyclictest0-21swapper/119:42:241
739699504,26cyclictest0-21swapper/119:23:431
7396995018,12cyclictest0-21swapper/120:12:261
239092504,9sleep30-21swapper/318:54:533
239092504,9sleep30-21swapper/318:54:533
219499500,5rtkit-daemon2193-21rtkit-daemon22:27:063
219499500,5rtkit-daemon2193-21rtkit-daemon21:24:533
7399994910,29cyclictest19450-21hostname22:17:073
7398994933,9cyclictest7126-21cut19:27:182
7398994922,10cyclictest9765-21latency_hist18:27:042
739699494,29cyclictest0-21swapper/118:38:341
23142493,40sleep12390-21fw_packets19:17:201
204242492,40sleep20-21swapper/219:56:352
190432493,9sleep20-21swapper/218:43:402
739999484,37cyclictest0-21swapper/318:47:023
739999484,36cyclictest0-21swapper/322:07:223
739999483,39cyclictest2846-21perl23:22:113
739999483,38cyclictest0-21swapper/323:02:253
739999482,42cyclictest0-21swapper/321:50:243
739999482,42cyclictest0-21swapper/321:50:243
7399994818,12cyclictest0-21swapper/320:02:003
739899485,37cyclictest0-21swapper/220:02:302
739899485,27cyclictest0-21swapper/219:32:292
7398994822,8cyclictest30030-21latency_hist20:17:002
7396994820,7cyclictest12147-21latency_hist18:32:031
263742484,11sleep10-21swapper/119:00:521
7399994712,30cyclictest26709-21df_abs21:42:113
739899474,36cyclictest22020-21head18:52:132
739899474,36cyclictest22020-21head18:52:132
739899473,39cyclictest0-21swapper/219:47:232
7398994728,14cyclictest0-21swapper/220:17:262
70862474,37sleep30-21swapper/321:58:453
219499470,5rtkit-daemon2193-21rtkit-daemon19:52:043
123792472,38sleep30-21swapper/318:32:123
7399994631,9cyclictest29575-21sed20:12:333
739899465,35cyclictest0-21swapper/219:07:122
739899464,26cyclictest0-21swapper/218:47:202
739899464,12cyclictest0-21swapper/220:07:202
7398994629,12cyclictest0-21swapper/219:12:212
243052465,9sleep30-21swapper/318:57:073
739999453,35cyclictest1109-21gltestperf20:22:193
739999453,35cyclictest1109-21gltestperf20:22:193
7399994518,23cyclictest0-21swapper/318:48:363
7399994518,11cyclictest0-21swapper/319:42:323
7399994518,11cyclictest0-21swapper/319:42:323
739899445,33cyclictest0-21swapper/218:37:232
266952442,35sleep20-21swapper/219:02:062
739999434,33cyclictest10560-21df_abs18:27:203
739999434,32cyclictest0-21swapper/319:22:153
739999432,37cyclictest0-21swapper/319:47:403
739899434,34cyclictest0-21swapper/219:57:312
7398994225,12cyclictest0-21swapper/219:17:322
219499420,4rtkit-daemon2193-21rtkit-daemon20:17:263
219499420,4rtkit-daemon2193-21rtkit-daemon20:07:113
739999413,32cyclictest0-21swapper/318:27:043
7399993713,9cyclictest7585-21cat18:22:053
7396993420,8cyclictest7539-21latency_hist18:22:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional