You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 01:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue May 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991120,5rtkit-daemon2484-21rtkit-daemon21:30:390
296789910326,70cyclictest20272-21gltestperf20:26:011
296789910321,29cyclictest32140-21fschecks_count19:56:021
2967899943,44cyclictest0-21swapper/121:11:101
2968199924,68cyclictest0-21swapper/218:41:112
39342910,8sleep32346-21munin-node17:06:243
29678999133,7cyclictest4858-21rm21:39:331
2968199884,67cyclictest0-21swapper/221:16:082
2968199884,65cyclictest0-21swapper/221:00:562
2968199884,65cyclictest0-21swapper/221:00:562
2968199884,65cyclictest0-21swapper/219:11:222
2968199884,65cyclictest0-21swapper/219:01:032
2968199884,65cyclictest0-21swapper/219:01:032
2968199884,61cyclictest29006-21sed19:51:052
2968199883,77cyclictest0-21swapper/221:10:232
2968199875,62cyclictest0-21swapper/221:25:412
2968199875,61cyclictest0-21swapper/221:46:042
2968199874,74cyclictest0-21swapper/220:33:392
2968199874,65cyclictest0-21swapper/221:55:512
2968199874,62cyclictest0-21swapper/220:58:202
2968199874,47cyclictest715-21kworker/2:219:20:472
2968199873,77cyclictest12719-21chrt20:15:552
2968199864,63cyclictest0-21swapper/219:06:032
2968199862,65cyclictest0-21swapper/220:04:492
2968199854,74cyclictest0-21swapper/219:48:122
2968199854,65cyclictest0-21swapper/218:21:102
2968199854,65cyclictest0-21swapper/218:21:102
2968199854,63cyclictest0-21swapper/218:36:022
2968199854,62cyclictest0-21swapper/222:16:232
2968199854,62cyclictest0-21swapper/220:12:492
2968199854,56cyclictest0-21swapper/221:13:162
2968199853,65cyclictest20505-21yum-updatesd-he17:41:232
2968199844,73cyclictest0-21swapper/220:06:082
2968199844,73cyclictest0-21swapper/219:31:352
2968199844,72cyclictest5340-21ssh20:51:122
2968199844,71cyclictest1287-21snmpd20:49:132
2968199844,59cyclictest0-21swapper/222:01:022
2968199844,58cyclictest0-21swapper/216:56:122
2968199843,74cyclictest22426-21diskmemload20:27:212
2968199843,74cyclictest0-21swapper/218:11:222
2968199843,65cyclictest31689-21fschecks_time21:30:592
2968199843,64cyclictest0-21swapper/221:55:262
2968199843,62cyclictest0-21swapper/219:28:242
2968199842,74cyclictest32474-21munin-node22:20:562
2968199842,74cyclictest32474-21munin-node22:20:562
29681998412,63cyclictest0-21swapper/219:56:132
2968199834,72cyclictest0-21swapper/221:41:132
2968199834,72cyclictest0-21swapper/221:41:132
2968199834,72cyclictest0-21swapper/220:21:132
2968199834,72cyclictest0-21swapper/217:46:042
2968199834,72cyclictest0-21swapper/217:01:072
2968199834,64cyclictest0-21swapper/220:45:422
2968199834,63cyclictest0-21swapper/219:25:192
2968199833,72cyclictest0-21swapper/219:39:042
2968199832,73cyclictest0-21swapper/220:38:522
29678998324,29cyclictest0-21swapper/117:00:171
2968199824,71cyclictest0-21swapper/221:36:012
2968199824,70cyclictest0-21swapper/222:13:432
2968199814,70cyclictest0-21swapper/218:16:142
2968199814,61cyclictest0-21swapper/217:06:092
2968199813,65cyclictest22426-21diskmemload18:59:532
2968199813,63cyclictest0-21swapper/219:42:282
2968199813,63cyclictest0-21swapper/219:42:282
2968199813,61cyclictest27929-21grep21:25:552
2968199813,57cyclictest1287-21snmpd17:56:162
2968199804,68cyclictest0-21swapper/217:51:022
2968199804,46cyclictest0-21swapper/217:31:122
2968199794,69cyclictest0-21swapper/218:50:472
2968199793,59cyclictest23519-21sshd22:06:022
2968199784,67cyclictest0-21swapper/217:11:132
2968199773,66cyclictest16872-21cpu17:36:042
2968199773,66cyclictest16872-21cpu17:36:042
2968199744,58cyclictest0-21swapper/218:31:042
2968199744,55cyclictest0-21swapper/218:26:182
2968199743,62cyclictest22223-21sshd18:53:212
2968199743,59cyclictest0-21swapper/218:06:152
2968199734,63cyclictest0-21swapper/217:26:212
2968199714,49cyclictest0-21swapper/217:21:232
2968199714,43cyclictest0-21swapper/217:16:222
2968199675,55cyclictest28682-21telnet18:01:012
29682996546,12cyclictest21756-21gltestperf21:16:013
442326419,38sleep00-21swapper/021:38:010
260282643,10sleep326033-21idleruntime-cro17:55:503
29673996218,13cyclictest24046-21timerwakeupswit22:06:100
2968199603,49cyclictest29812-21ls16:55:532
2968199603,49cyclictest29812-21ls16:55:532
196712593,49sleep00-21swapper/017:41:080
2967399584,45cyclictest0-21swapper/020:45:530
276642583,48sleep30-21swapper/320:36:163
29682995737,12cyclictest12295-21tr17:26:043
2968299573,46cyclictest0-21swapper/320:11:003
29682995718,20cyclictest12185-21processes21:01:113
29682995718,20cyclictest12185-21processes21:01:113
2967399575,46cyclictest7282-21unixbench_singl21:41:140
2967399575,46cyclictest7282-21unixbench_singl21:41:140
2967399574,28cyclictest0-21swapper/018:51:130
29673995731,21cyclictest0-21swapper/020:03:020
171362573,12sleep30-21swapper/321:10:273
66062569,8sleep11676-21nscd17:11:511
311782563,12sleep00-21swapper/018:06:020
2968299564,20cyclictest0-21swapper/320:06:183
2968299554,30cyclictest0-21swapper/321:51:073
2967899554,45cyclictest0-21swapper/121:06:051
29673995536,13cyclictest0-21swapper/021:46:000
29673995536,13cyclictest0-21swapper/021:01:010
29673995536,13cyclictest0-21swapper/021:01:010
248599550,5rtkit-daemon2484-21rtkit-daemon21:00:551
248599550,5rtkit-daemon2484-21rtkit-daemon21:00:551
74572543,45sleep37460-21ssh21:41:473
74572543,45sleep37460-21ssh21:41:473
37612543,45sleep33766-21ssh19:14:493
2968299544,30cyclictest0-21swapper/319:21:123
2968299544,25cyclictest0-21swapper/320:27:573
29682995423,25cyclictest30898-21unixbench_multi22:16:133
29682995414,23cyclictest22738-21cstates22:05:523
2967899543,45cyclictest0-21swapper/120:39:581
2967399545,43cyclictest0-21swapper/019:05:520
2967399544,43cyclictest15068-21sed19:31:000
29673995434,14cyclictest0-21swapper/020:56:110
29673995424,24cyclictest0-21swapper/022:05:180
248599540,5rtkit-daemon2484-21rtkit-daemon20:41:191
248599540,5rtkit-daemon2484-21rtkit-daemon17:41:261
153682544,12sleep30-21swapper/320:19:193
103192543,10sleep00-21swapper/018:29:040
83692533,43sleep00-21swapper/017:16:170
43752533,44sleep34468-21tail19:15:583
314892533,12sleep00-21swapper/020:41:370
310162533,43sleep331074-21missed_timers16:56:173
29992533,10sleep00-21swapper/018:11:590
2968299534,29cyclictest0-21swapper/318:46:093
2968299534,28cyclictest0-21swapper/318:41:183
2968299534,12cyclictest0-21swapper/318:31:063
2968299534,11cyclictest3109-21iostat21:36:023
2968299533,42cyclictest0-21swapper/319:57:313
2968299533,27cyclictest0-21swapper/319:06:023
2967899534,43cyclictest0-21swapper/121:30:121
29678995311,34cyclictest0-21swapper/119:00:591
29678995311,34cyclictest0-21swapper/119:00:591
2967399534,23cyclictest0-21swapper/020:36:170
29673995334,13cyclictest0-21swapper/020:11:150
2967399533,24cyclictest0-21swapper/021:05:550
29673995323,12cyclictest0-21swapper/020:23:570
29673995322,11cyclictest0-21swapper/018:36:220
28692533,7sleep32872-21ssh20:47:373
248599530,5rtkit-daemon2484-21rtkit-daemon20:51:031
248599530,5rtkit-daemon2484-21rtkit-daemon20:20:571
248599530,5rtkit-daemon2484-21rtkit-daemon20:15:571
2968299525,28cyclictest0-21swapper/320:21:093
2968299525,24cyclictest0-21swapper/321:30:533
2968299524,27cyclictest0-21swapper/317:42:103
2968299524,26cyclictest18550-21iostat_ios21:11:063
29682995233,11cyclictest4552-21sed20:51:013
29682995232,13cyclictest25640-21cut19:46:063
2968299523,28cyclictest0-21swapper/317:11:123
29682995229,14cyclictest34-21rcuc/321:00:433
29682995220,14cyclictest0-21swapper/318:11:243
29682995220,13cyclictest0-21swapper/321:21:063
29682995219,13cyclictest0-21swapper/318:36:063
2967899523,44cyclictest0-21swapper/121:52:111
2967899522,12cyclictest0-21swapper/122:04:001
29673995233,14cyclictest0-21swapper/020:10:440
29673995227,8cyclictest1694-21munin-node19:11:070
29673995226,13cyclictest0-21swapper/018:56:190
29673995226,11cyclictest0-21swapper/021:51:220
273262525,40sleep327451-21cat22:11:133
248599520,5rtkit-daemon2484-21rtkit-daemon19:53:281
248599520,5rtkit-daemon2484-21rtkit-daemon19:21:071
248599520,5rtkit-daemon2484-21rtkit-daemon19:14:371
248599520,5rtkit-daemon2484-21rtkit-daemon18:30:241
248599520,5rtkit-daemon2484-21rtkit-daemon17:21:041
248599520,4rtkit-daemon2484-21rtkit-daemon18:36:381
244872523,10sleep10-21swapper/122:07:081
225592523,7sleep022610-21strings19:41:110
225592523,7sleep022610-21strings19:41:110
210642523,43sleep00-21swapper/019:40:430
140072522,43sleep10-21swapper/119:29:311
67712513,9sleep00-21swapper/017:13:590
299652513,41sleep330109-21df_inode20:41:003
2968299515,13cyclictest0-21swapper/320:04:253
2968299514,30cyclictest0-21swapper/321:45:543
2968299514,29cyclictest0-21swapper/319:26:163
2968299514,28cyclictest0-21swapper/321:56:053
2968299514,28cyclictest0-21swapper/318:21:143
2968299514,28cyclictest0-21swapper/318:21:143
2968299514,28cyclictest0-21swapper/318:06:003
2968299514,27cyclictest27128-21gltestperf17:56:083
2968299514,24cyclictest0-21swapper/318:26:003
2968299514,13cyclictest0-21swapper/321:30:163
2968299514,13cyclictest0-21swapper/320:33:573
2968299514,13cyclictest0-21swapper/319:32:253
29682995121,11cyclictest22818-21yum-updatesd-he19:41:213
29682995121,11cyclictest22818-21yum-updatesd-he19:41:213
29682995120,13cyclictest0-21swapper/319:03:323
29682995120,13cyclictest0-21swapper/319:03:323
29682995120,13cyclictest0-21swapper/317:46:083
29682995119,13cyclictest0-21swapper/317:16:023
29678995131,8cyclictest26194-21kworker/1:019:44:011
29678995131,8cyclictest26194-21kworker/1:019:44:011
2967899513,43cyclictest0-21swapper/120:04:251
2967399515,40cyclictest0-21swapper/020:26:160
2967399514,23cyclictest0-21swapper/019:51:160
29673995133,14cyclictest0-21swapper/021:56:090
29673995133,13cyclictest0-21swapper/020:00:220
29673995132,13cyclictest0-21swapper/022:23:000
29673995132,13cyclictest0-21swapper/022:23:000
29673995124,13cyclictest0-21swapper/022:15:550
29673995122,10cyclictest27844-21latency_hist19:50:460
280842513,9sleep00-21swapper/019:01:280
280842513,9sleep00-21swapper/019:01:280
27762512,42sleep10-21swapper/122:23:491
27762512,42sleep10-21swapper/122:23:491
248599510,5rtkit-daemon2484-21rtkit-daemon17:31:181
248599510,5rtkit-daemon2484-21rtkit-daemon17:08:341
248599510,4rtkit-daemon2484-21rtkit-daemon19:48:511
235902513,7sleep123594-21rm21:19:231
17572512,10sleep30-21swapper/317:02:263
2968299504,28cyclictest0-21swapper/318:05:493
2968299504,26cyclictest1100-21iostat_ios22:21:013
2968299504,26cyclictest1100-21iostat_ios22:21:013
29682995030,12cyclictest0-21swapper/322:00:543
29682995021,6cyclictest28100-21ssh19:50:543
29682995020,10cyclictest19029-21awk19:36:073
2967899506,39cyclictest0-21swapper/121:33:121
2967899504,12cyclictest0-21swapper/121:41:171
2967899504,12cyclictest0-21swapper/121:41:171
2967899503,42cyclictest0-21swapper/119:10:471
2967899503,41cyclictest0-21swapper/120:58:111
2967399505,40cyclictest0-21swapper/020:18:120
2967399504,41cyclictest0-21swapper/020:51:010
2967399504,40cyclictest0-21swapper/019:16:190
29673995032,11cyclictest0-21swapper/019:23:110
29673995031,14cyclictest0-21swapper/021:31:170
29673995031,13cyclictest0-21swapper/021:21:040
2967399503,11cyclictest0-21swapper/021:11:100
248599500,5rtkit-daemon2484-21rtkit-daemon19:16:141
248599500,5rtkit-daemon2484-21rtkit-daemon17:48:101
206892502,41sleep10-21swapper/119:39:181
2968299494,26cyclictest0-21swapper/317:31:223
29678994916,28cyclictest9189-21cpuspeed_turbos21:45:551
2967399495,38cyclictest0-21swapper/018:41:180
2967399495,26cyclictest0-21swapper/017:31:100
2967399494,28cyclictest0-21swapper/021:15:580
29673994920,12cyclictest0-21swapper/017:46:030
248599490,5rtkit-daemon2484-21rtkit-daemon17:51:031
248599490,5rtkit-daemon2484-21rtkit-daemon17:26:041
248172493,40sleep324823-21ssh18:57:163
79592483,10sleep00-21swapper/018:24:240
79592483,10sleep00-21swapper/018:24:240
29682994817,13cyclictest0-21swapper/318:16:073
29682994817,13cyclictest0-21swapper/317:21:023
2967899484,11cyclictest0-21swapper/120:06:191
29678994829,7cyclictest31496-21ssh22:18:041
2967399484,27cyclictest0-21swapper/017:01:230
2967399484,26cyclictest0-21swapper/020:31:160
2967399484,26cyclictest0-21swapper/017:06:240
2967399484,25cyclictest0-21swapper/022:10:580
29673994823,12cyclictest0-21swapper/019:26:130
276832482,40sleep10-21swapper/122:11:321
267722482,39sleep10-21swapper/121:23:431
248599480,5rtkit-daemon2484-21rtkit-daemon20:30:561
248599480,5rtkit-daemon2484-21rtkit-daemon18:41:011
202532482,9sleep30-21swapper/318:50:513
176712482,9sleep10-21swapper/119:35:361
112782482,38sleep10-21swapper/120:11:431
2968299474,24cyclictest17827-21load17:36:153
2968299474,24cyclictest17827-21load17:36:153
29678994725,7cyclictest3940-21date20:50:441
29673994733,9cyclictest27711-21taskset17:56:180
29673994712,30cyclictest10438-21http_loadtime17:21:110
32852466,10sleep10-21swapper/118:15:431
2967899463,11cyclictest0-21swapper/118:57:301
29678994621,7cyclictest18698-21latency_hist22:00:411
29673994633,8cyclictest30414-21grep18:01:230
295432464,36sleep00-21swapper/016:54:330
295432464,36sleep00-21swapper/016:54:330
18852463,10sleep10-21swapper/117:04:051
140702463,38sleep00-21swapper/017:30:480
6952454,9sleep10-21swapper/118:10:191
2967399455,33cyclictest0-21swapper/016:56:190
2967399454,35cyclictest0-21swapper/017:51:010
2967399453,26cyclictest0-21swapper/018:30:590
199242453,10sleep10-21swapper/118:49:281
2967899443,37cyclictest0-21swapper/117:56:191
29678994425,13cyclictest0-21swapper/118:25:481
29678994425,13cyclictest0-21swapper/118:25:481
29673994430,9cyclictest3973-21sed18:16:030
91382433,10sleep10-21swapper/117:18:441
2967899434,33cyclictest0-21swapper/118:16:061
2967899433,34cyclictest0-21swapper/118:31:211
2967399433,34cyclictest0-21swapper/017:36:220
2967399433,34cyclictest0-21swapper/017:36:220
248599430,5rtkit-daemon2484-21rtkit-daemon17:36:111
248599430,5rtkit-daemon2484-21rtkit-daemon17:36:111
2967899423,33cyclictest0-21swapper/118:51:081
2967399424,33cyclictest0-21swapper/018:46:130
248599420,4rtkit-daemon2484-21rtkit-daemon18:02:101
2968299392,23cyclictest0-21swapper/316:55:533
2968299392,23cyclictest0-21swapper/316:55:533
29678992916,8cyclictest29651-21latency_hist16:55:521
29678992916,8cyclictest29651-21latency_hist16:55:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional