You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 08:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 15, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991050,6rtkit-daemon0-21swapper/021:47:000
2194991050,6rtkit-daemon0-21swapper/021:47:000
2594599974,40cyclictest0-21swapper/022:21:420
2594599964,35cyclictest18547-21grep00:04:050
2594599954,39cyclictest0-21swapper/021:09:290
2594599952,36cyclictest0-21swapper/022:08:570
2594599944,41cyclictest0-21swapper/023:59:090
25945999422,13cyclictest0-21swapper/023:54:140
2594599935,36cyclictest0-21swapper/023:24:040
2594599934,26cyclictest0-21swapper/022:34:200
25945999330,13cyclictest0-21swapper/023:44:250
2594599924,39cyclictest0-21swapper/022:58:050
2594599915,39cyclictest0-21swapper/022:24:130
2594599915,39cyclictest0-21swapper/022:24:130
2594599914,27cyclictest0-21swapper/023:09:180
2594599905,35cyclictest0-21swapper/023:03:510
2594599904,38cyclictest0-21swapper/023:51:400
2594599904,38cyclictest0-21swapper/023:51:400
2594599904,36cyclictest21469-21yum-updatesd-he22:33:030
2594599904,36cyclictest0-21swapper/021:19:190
25945999030,11cyclictest564-21gltestperf22:49:130
102222900,7sleep00-21swapper/021:28:520
25945998934,11cyclictest9087-21cut19:24:190
2594599886,38cyclictest0-21swapper/021:34:300
2594599885,37cyclictest0-21swapper/000:14:090
2594599884,39cyclictest0-21swapper/022:03:540
2594599875,36cyclictest0-21swapper/021:03:570
2594599874,42cyclictest814-21ssh21:14:140
2594599874,26cyclictest0-21swapper/023:14:020
134092860,4sleep3361ktimersoftd/322:19:223
219499850,30rtkit-daemon24179-21rm20:59:390
25950998427,27cyclictest0-21swapper/122:24:321
25950998427,27cyclictest0-21swapper/122:24:321
25950998342,33cyclictest32027-21sshd23:34:251
25950998325,51cyclictest0-21swapper/121:34:211
25950998235,38cyclictest18194-21munin-node20:49:311
25950998234,26cyclictest26063-21runrttasks23:27:001
25950998232,42cyclictest0-21swapper/121:29:321
2594599824,28cyclictest0-21swapper/019:43:590
25945998231,13cyclictest0-21swapper/023:34:240
25945998228,14cyclictest0-21swapper/000:09:130
219499820,8rtkit-daemon0-21swapper/223:19:110
219499820,27rtkit-daemon4226-21gltestperf19:14:210
219499820,26rtkit-daemon23521-21if_eth019:54:190
25950998129,25cyclictest25035-21kworker/1:000:14:231
2594599815,27cyclictest0-21swapper/022:39:560
219499810,28rtkit-daemon25721-21perl19:59:190
219499810,27rtkit-daemon9527-21aten_r1power_vo20:34:100
219499810,27rtkit-daemon8918-21munin-node20:15:410
25950998034,39cyclictest30769-21munin-node21:09:301
25950998033,41cyclictest0-21swapper/123:23:511
25950998032,39cyclictest24901-21ssh21:49:151
219499800,7rtkit-daemon0-21swapper/322:17:593
25950997931,29cyclictest19536-21open_files00:04:191
25950997930,31cyclictest2902-21ssh22:53:371
25950997928,45cyclictest0-21swapper/123:33:501
25950997927,45cyclictest0-21swapper/123:53:551
219499790,5rtkit-daemon0-21swapper/322:53:053
219499790,26rtkit-daemon12642-21smartctl20:39:170
219499790,24rtkit-daemon2480-21python19:09:290
25950997835,37cyclictest0-21swapper/122:44:071
25950997834,37cyclictest32248-21munin-node21:59:251
25950997834,37cyclictest22748-21df_abs20:59:121
25950997834,36cyclictest21994-21df00:09:051
25950997833,36cyclictest16824-21rm23:59:521
25950997832,39cyclictest7944-21ntpdc22:59:191
25950997832,27cyclictest14071-21cat20:43:581
25950997832,19cyclictest0-21swapper/121:16:291
25950997830,41cyclictest12983-21ssh22:19:151
2594599784,11cyclictest0-21swapper/022:05:320
25950997735,36cyclictest4430-21sh22:07:061
25950997734,36cyclictest4216-21fschecks_time19:14:201
25950997733,12cyclictest6454-21cut22:58:521
25950997730,38cyclictest18694-21diskmemload22:09:581
219499770,23rtkit-daemon0-21swapper/223:18:493
25950997635,34cyclictest28448-21aten_r1power_vo00:19:011
25950997635,34cyclictest10357-21latency_hist19:29:001
25950997634,34cyclictest18628-21ssh22:28:551
25950997629,18cyclictest0-21swapper/120:13:581
25950997628,28cyclictest0-21swapper/120:48:271
25950997535,33cyclictest13915-21diskstats23:09:071
25950997535,32cyclictest6007-21ntp_states23:44:191
25950997534,34cyclictest3387-21ssh23:40:111
25950997533,35cyclictest19019-21chrt23:16:001
25950997531,36cyclictest108522chrt23:52:411
25950997531,36cyclictest108522chrt23:52:411
25950997530,15cyclictest0-21swapper/121:58:001
25950997527,30cyclictest0-21swapper/121:47:081
25950997527,30cyclictest0-21swapper/121:47:081
25950997525,29cyclictest0-21swapper/122:17:391
25950997522,47cyclictest0-21swapper/122:34:061
219499750,24rtkit-daemon0-21swapper/120:44:170
219499750,22rtkit-daemon0-21swapper/223:18:563
219499750,18rtkit-daemon0-21swapper/121:29:160
25950997450,18cyclictest1227-21runrttasks20:25:541
25950997437,12cyclictest3781-21aten_r1power_cu21:19:071
25950997432,26cyclictest27542-21unixbench_singl21:04:291
25950997430,29cyclictest0-21swapper/121:28:131
25950997428,15cyclictest0-21swapper/122:41:521
219499740,25rtkit-daemon0-21swapper/120:31:400
219499740,25rtkit-daemon0-21swapper/120:31:400
25950997334,32cyclictest1227-21runrttasks20:22:271
25950997333,32cyclictest10131-21cpu23:04:041
25950997330,15cyclictest0-21swapper/121:43:371
219499730,18rtkit-daemon17331-21munin-node20:49:170
219499730,18rtkit-daemon0-21swapper/120:25:260
25950997228,38cyclictest19483-21munin-node20:54:121
219499720,19rtkit-daemon0-21swapper/121:57:590
219499720,19rtkit-daemon0-21swapper/120:10:190
25950997133,32cyclictest1227-21runrttasks20:06:051
25950997130,33cyclictest32329-21cpuspeed20:14:111
219499710,18rtkit-daemon0-21swapper/121:52:150
219499710,18rtkit-daemon0-21swapper/120:07:260
25950997035,28cyclictest1227-21runrttasks20:33:151
25950997035,28cyclictest1227-21runrttasks20:33:151
25950997031,32cyclictest0-21swapper/119:44:201
25950997030,15cyclictest1227-21runrttasks19:20:021
219499700,5rtkit-daemon20118-21rm21:43:070
219499700,19rtkit-daemon0-21swapper/120:58:240
219499700,18rtkit-daemon0-21swapper/119:46:350
219499700,18rtkit-daemon0-21swapper/118:57:060
219499700,18rtkit-daemon0-21swapper/100:22:460
219499690,18rtkit-daemon0-21swapper/119:50:340
25950996832,10cyclictest26927-21taskset20:01:581
219499680,7rtkit-daemon0-21swapper/119:55:571
219499680,6rtkit-daemon0-21swapper/119:52:571
219499680,5rtkit-daemon0-21swapper/119:04:291
219499680,5rtkit-daemon0-21swapper/119:04:291
219499680,5rtkit-daemon0-21swapper/118:58:441
25950996735,25cyclictest2932-21runrttasks19:10:431
25950996731,30cyclictest30323-21unixbench_singl18:59:351
219499670,6rtkit-daemon0-21swapper/120:34:031
219499670,5rtkit-daemon2193-21rtkit-daemon22:42:353
2595399668,32cyclictest0-21swapper/300:09:253
25950996626,33cyclictest0-21swapper/119:29:131
25950996538,19cyclictest1227-21runrttasks19:39:101
2595299644,31cyclictest0-21swapper/222:19:132
219499630,8rtkit-daemon2193-21rtkit-daemon22:38:503
219499620,9rtkit-daemon0-21swapper/323:04:343
219499620,9rtkit-daemon0-21swapper/323:01:273
25950996143,10cyclictest25935-21munin-run18:54:011
219499610,9rtkit-daemon0-21swapper/323:09:273
219499610,7rtkit-daemon0-21swapper/322:54:423
219499610,6rtkit-daemon0-21swapper/322:44:433
219499610,6rtkit-daemon0-21swapper/322:24:433
219499610,6rtkit-daemon0-21swapper/322:24:433
68942603,49sleep20-21swapper/223:45:382
25953996010,24cyclictest34-21rcuc/321:09:243
2595299604,39cyclictest0-21swapper/222:40:582
219499600,6rtkit-daemon0-21swapper/322:29:433
219499600,6rtkit-daemon0-21swapper/019:34:131
143102603,13sleep20-21swapper/221:34:112
313332590,5sleep331341-21entropy21:59:123
2595299583,48cyclictest0-21swapper/200:07:462
2595299583,39cyclictest0-21swapper/223:39:222
25952995812,26cyclictest0-21swapper/200:03:512
168102583,11sleep20-21swapper/219:39:312
25953995741,10cyclictest1164-21gltestperf21:14:173
2595299574,47cyclictest0-21swapper/200:22:552
25952995739,11cyclictest31006-21unixbench_singl21:09:322
2595299573,46cyclictest0-21swapper/222:34:242
2595299573,37cyclictest0-21swapper/223:56:332
25952995724,13cyclictest0-21swapper/221:24:172
25945995734,10cyclictest0-21swapper/023:07:390
212082573,47sleep321343-21perl21:44:123
212082573,47sleep321343-21perl21:44:123
191262574,12sleep30-21swapper/321:39:323
2595299563,34cyclictest0-21swapper/223:37:172
25952995611,27cyclictest0-21swapper/222:49:182
304262553,12sleep20-21swapper/221:58:462
25953995536,12cyclictest12614-21cut20:39:173
25953995520,19cyclictest28090-21needreboot23:29:173
25953995513,24cyclictest18698-21awk20:53:563
2595299553,45cyclictest0-21swapper/222:29:182
168082552,10sleep30-21swapper/321:38:243
315892542,46sleep05416-21nscd22:47:460
2595399545,14cyclictest0-21swapper/321:49:163
2595399544,27cyclictest0-21swapper/319:59:323
25953995434,11cyclictest11444-21sed19:29:203
2595299544,30cyclictest0-21swapper/219:59:292
25952995438,10cyclictest5041-21grep22:54:252
25952995410,26cyclictest0-21swapper/222:24:152
25952995410,26cyclictest0-21swapper/222:24:152
2594599544,30cyclictest0-21swapper/022:14:130
2594599544,12cyclictest0-21swapper/023:39:240
2594599543,39cyclictest0-21swapper/023:31:080
133102544,43sleep30-21swapper/321:32:513
118232544,43sleep20-21swapper/219:29:282
2595399533,23cyclictest7875-21cut21:24:143
25953995320,13cyclictest0-21swapper/319:19:353
2595299539,12cyclictest0-21swapper/222:46:392
2595299534,40cyclictest0-21swapper/200:09:022
2595299533,44cyclictest27705-21gltestperf23:29:112
2595299533,43cyclictest0-21swapper/221:02:302
2595299533,33cyclictest2318-21ssh21:14:442
2595299533,12cyclictest0-21swapper/221:04:222
25952995322,12cyclictest0-21swapper/221:19:182
224422533,7sleep222446-21ssh23:21:102
126482532,9sleep20-21swapper/221:30:282
2595399528,38cyclictest0-21swapper/323:59:223
2595399526,28cyclictest0-21swapper/319:04:123
2595399526,28cyclictest0-21swapper/319:04:123
2595399524,34cyclictest0-21swapper/300:15:003
2595399524,30cyclictest0-21swapper/319:44:123
2595399524,30cyclictest0-21swapper/319:38:063
2595399524,28cyclictest0-21swapper/320:54:203
2595399524,25cyclictest14257-21aten2.4-expect20:44:103
25953995235,10cyclictest3066-21cut20:19:193
25953995230,14cyclictest5006-21cut23:44:053
25953995228,10cyclictest26217-21df_abs21:04:103
2595399522,44cyclictest0-21swapper/322:08:583
25953995218,19cyclictest18589-21ls00:04:053
2595299524,41cyclictest0-21swapper/223:13:522
2595299524,38cyclictest0-21swapper/223:51:192
2595299524,38cyclictest0-21swapper/223:51:192
2595299523,33cyclictest25174-21sshd23:24:252
2595399514,29cyclictest0-21swapper/320:34:213
2595399514,29cyclictest0-21swapper/320:09:293
25953995135,10cyclictest22598-21tr20:59:113
25953995120,13cyclictest0-21swapper/320:04:143
25953995118,20cyclictest0-21swapper/323:37:033
2595299514,41cyclictest0-21swapper/221:51:492
2595299514,28cyclictest0-21swapper/222:14:302
2595299514,28cyclictest0-21swapper/221:41:012
2595299514,27cyclictest0-21swapper/220:09:152
2595299513,42cyclictest0-21swapper/221:46:482
2595299513,42cyclictest0-21swapper/221:46:482
2595299513,41cyclictest0-21swapper/223:17:032
2595299513,31cyclictest6735-21latency_hist20:28:592
25945995120,13cyclictest0-21swapper/020:19:190
25945995117,26cyclictest12745-21crond19:33:590
244442517,34sleep20-21swapper/218:49:182
219499510,5rtkit-daemon2193-21rtkit-daemon18:49:290
3032502,41sleep00-21swapper/019:04:550
3032502,41sleep00-21swapper/019:04:550
2595399505,27cyclictest0-21swapper/319:54:103
2595399505,27cyclictest0-21swapper/319:09:113
2595399505,12cyclictest0-21swapper/323:49:143
2595399505,12cyclictest0-21swapper/323:49:143
2595399504,28cyclictest0-21swapper/319:04:013
2595399504,28cyclictest0-21swapper/318:54:233
2595399504,12cyclictest0-21swapper/321:54:083
25953995032,11cyclictest4570-21nscd19:53:593
2595399503,28cyclictest18694-21diskmemload23:54:233
25953995024,18cyclictest16289-21hwlatdetect19:39:213
25953995019,13cyclictest0-21swapper/323:39:053
25953995015,28cyclictest3606-21unixbench_multi22:04:283
2595299504,39cyclictest0-21swapper/220:58:052
2595299504,29cyclictest0-21swapper/200:14:102
2595299504,28cyclictest0-21swapper/220:04:212
2595299504,28cyclictest0-21swapper/219:54:152
2595299504,28cyclictest0-21swapper/219:44:282
2595299504,28cyclictest0-21swapper/219:04:132
2595299504,28cyclictest0-21swapper/219:04:132
2595299503,30cyclictest0-21swapper/222:04:232
101292508,35sleep20-21swapper/219:26:052
2595399495,26cyclictest0-21swapper/323:24:043
2595399494,28cyclictest0-21swapper/319:24:113
2595399494,27cyclictest0-21swapper/320:24:213
2595399494,26cyclictest0-21swapper/321:20:353
2595399494,26cyclictest0-21swapper/319:16:033
2595399494,26cyclictest0-21swapper/300:20:493
25953994919,12cyclictest0-21swapper/320:14:113
2595299498,24cyclictest0-21swapper/222:59:032
2595299494,28cyclictest0-21swapper/223:04:042
2595299494,27cyclictest0-21swapper/220:49:262
2595299494,27cyclictest0-21swapper/219:49:172
2595299494,27cyclictest0-21swapper/219:34:342
2595299494,27cyclictest0-21swapper/219:19:202
25952994935,8cyclictest31506-21ssh21:59:132
2595299493,28cyclictest0-21swapper/222:09:052
2595299484,28cyclictest0-21swapper/220:29:242
2595299484,28cyclictest0-21swapper/220:29:242
2595299484,27cyclictest0-21swapper/220:39:302
2595299484,27cyclictest0-21swapper/220:14:302
25945994819,12cyclictest0-21swapper/018:59:350
2595299474,26cyclictest0-21swapper/220:34:082
2595299474,25cyclictest0-21swapper/219:09:182
2594599474,27cyclictest0-21swapper/019:19:370
281622462,9sleep20-21swapper/218:57:032
2595399464,34cyclictest0-21swapper/320:29:263
2595399464,34cyclictest0-21swapper/320:29:263
2595299463,26cyclictest0-21swapper/219:16:032
2595299463,25cyclictest29094-21df_abs18:59:172
2594599464,34cyclictest0-21swapper/019:34:160
2595299453,25cyclictest0-21swapper/220:44:282
25952994430,8cyclictest2513-21tr20:19:132
2595399365,25cyclictest0-21swapper/318:54:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional