You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 04:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Aug 06, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1313121080,5sleep213134-21sed22:40:292
100162960,4sleep010014-21ssh22:35:350
12976999426,10cyclictest22982-21aten_r1power_vo20:30:153
12976999425,12cyclictest0-21swapper/321:30:273
12976999420,10cyclictest30949-21sshd20:40:343
1297699935,29cyclictest0-21swapper/322:10:023
1297699934,18cyclictest0-21swapper/323:05:273
1297699934,15cyclictest0-21swapper/322:05:173
12976999320,9cyclictest16299-21ssh21:56:423
277502920,7sleep027748-21ls19:40:350
1297699928,9cyclictest0-21swapper/322:33:183
12976999232,42cyclictest0-21swapper/321:15:173
1297699919,32cyclictest0-21swapper/321:00:133
12976999119,11cyclictest8722-21diskstats22:35:153
12976999026,13cyclictest0-21swapper/320:15:453
12976999026,13cyclictest0-21swapper/320:15:453
12976999023,8cyclictest793-21munin-node21:35:263
1297699895,22cyclictest0-21swapper/321:06:303
1297699893,21cyclictest0-21swapper/322:21:103
12976998924,10cyclictest0-21swapper/320:47:333
1297699886,29cyclictest1227-21runrttasks21:13:183
1297699885,23cyclictest0-21swapper/320:35:143
1297699884,24cyclictest0-21swapper/321:54:163
1297699883,22cyclictest11454-21seq23:28:413
12976998823,12cyclictest0-21swapper/323:24:523
1297699875,24cyclictest0-21swapper/320:55:323
1297699875,24cyclictest0-21swapper/320:55:323
1297699875,23cyclictest0-21swapper/322:58:373
1297699875,22cyclictest0-21swapper/322:29:183
1297699875,21cyclictest0-21swapper/320:13:573
1297699875,13cyclictest0-21swapper/322:41:323
1297699874,22cyclictest0-21swapper/323:32:193
12976998729,48cyclictest0-21swapper/320:50:293
12976998722,11cyclictest0-21swapper/320:05:343
12976998719,10cyclictest15071-21cpuspeed_turbos22:45:113
1297699865,23cyclictest0-21swapper/322:51:153
1297699865,12cyclictest0-21swapper/321:47:383
1297699864,25cyclictest0-21swapper/322:16:053
1297699864,25cyclictest0-21swapper/322:16:053
1297699864,13cyclictest0-21swapper/322:01:203
12976998614,12cyclictest1761-21Xorg23:10:543
12976998614,12cyclictest0-21swapper/321:26:273
219499850,43rtkit-daemon2193-21rtkit-daemon20:20:180
1297699855,24cyclictest0-21swapper/323:16:033
1297699855,22cyclictest0-21swapper/320:22:383
1297699855,14cyclictest26457-21munin-run21:25:003
1297699854,29cyclictest24734-21munin-node23:00:133
1297699854,29cyclictest24734-21munin-node23:00:133
1297699854,27cyclictest0-21swapper/320:30:043
1297699854,14cyclictest0-21swapper/321:44:153
12976998524,10cyclictest5249-21unixbench_multi20:00:383
1297699844,33cyclictest8063-21gltestperf19:00:293
1297699844,28cyclictest0-21swapper/319:30:333
1297699844,28cyclictest0-21swapper/319:30:333
1297699844,24cyclictest0-21swapper/319:25:163
12976998425,12cyclictest0-21swapper/319:15:063
12976998421,10cyclictest23587-21gltestperf18:25:263
109362840,11sleep00-21swapper/021:50:120
1297699835,32cyclictest0-21swapper/319:50:243
1297699834,12cyclictest0-21swapper/318:41:113
1297699833,30cyclictest0-21swapper/318:56:503
12976998316,12cyclictest0-21swapper/319:56:243
12976998220,12cyclictest0-21swapper/319:35:353
1297699817,20cyclictest0-21swapper/319:40:153
1297699814,36cyclictest0-21swapper/319:17:483
1297699813,32cyclictest0-21swapper/319:10:063
1297699805,30cyclictest0-21swapper/319:20:393
12976998015,11cyclictest0-21swapper/318:45:433
12976998015,11cyclictest0-21swapper/318:45:433
1297699795,31cyclictest0-21swapper/318:05:423
12976997921,10cyclictest28989-21sort18:35:423
1297699787,18cyclictest0-21swapper/319:46:083
12975997720,30cyclictest6408-21ssh20:05:192
1297699754,13cyclictest0-21swapper/318:10:343
12975997225,26cyclictest1227-21runrttasks20:20:302
12975997121,32cyclictest13563-21tr18:05:222
12975997021,41cyclictest31275-21ssh20:40:372
12975997021,32cyclictest1227-21runrttasks23:11:232
12975997012,50cyclictest0-21swapper/222:30:152
12975996922,26cyclictest1034-21tune2fs20:45:212
12975996920,42cyclictest22812-21basename18:25:182
12975996919,42cyclictest20448-21kworker/2:222:55:302
12975996914,47cyclictest0-21swapper/222:01:502
12975996912,46cyclictest0-21swapper/221:51:052
12975996826,25cyclictest12641-21cut19:10:242
12975996819,33cyclictest0-21swapper/221:20:142
12975996812,48cyclictest0-21swapper/221:55:452
12975996810,48cyclictest0-21swapper/222:08:502
12975996720,30cyclictest1124-21snmpd21:30:152
12975996718,41cyclictest0-21swapper/223:25:002
12975996717,29cyclictest0-21swapper/223:23:102
12975996717,17cyclictest0-21swapper/221:36:292
12975996716,33cyclictest0-21swapper/220:15:192
12975996716,33cyclictest0-21swapper/220:15:192
12975996713,46cyclictest0-21swapper/220:27:082
12975996712,47cyclictest0-21swapper/221:48:292
1297599668,52cyclictest0-21swapper/223:31:352
12975996620,31cyclictest0-21swapper/223:03:532
12975996620,31cyclictest0-21swapper/223:03:532
12975996619,29cyclictest6145-21ssh21:40:362
12975996617,33cyclictest0-21swapper/221:12:522
12975996617,32cyclictest0-21swapper/223:05:142
12975996616,33cyclictest0-21swapper/221:00:182
1297599657,51cyclictest20448-21kworker/2:222:46:092
12975996527,11cyclictest32267-21unixbench-2d22:20:312
12975996520,37cyclictest1227-21runrttasks19:40:182
12975996520,28cyclictest2059-21df_abs22:25:142
12975996519,40cyclictest0-21swapper/221:15:142
12975996518,32cyclictest0-21swapper/220:11:362
12975996515,34cyclictest0-21swapper/221:06:442
12975996512,46cyclictest0-21swapper/222:53:352
12975996512,45cyclictest0-21swapper/223:17:032
12975996512,45cyclictest0-21swapper/220:32:152
12975996416,32cyclictest9467-21open_files22:35:272
12975996414,43cyclictest0-21swapper/222:17:382
12975996414,43cyclictest0-21swapper/222:17:382
12975996410,47cyclictest0-21swapper/220:52:202
12975996410,32cyclictest0-21swapper/220:55:132
12975996410,32cyclictest0-21swapper/220:55:132
12975996320,35cyclictest25195-21basename18:30:172
12975996319,29cyclictest27648-21python20:35:342
12975996218,29cyclictest1547-21nscd18:45:062
12975996213,28cyclictest0-21swapper/218:50:252
1297599616,34cyclictest0-21swapper/219:00:172
12975996119,26cyclictest16646-21ls19:20:062
12975996112,42cyclictest0-21swapper/222:10:552
219499600,4rtkit-daemon2193-21rtkit-daemon20:20:030
219499600,4rtkit-daemon2193-21rtkit-daemon20:20:030
12975996015,37cyclictest27540-21aten2.4-expect18:35:222
12975996011,33cyclictest0-21swapper/221:28:322
12975995910,42cyclictest0-21swapper/219:51:232
229682583,10sleep023065-21timerandwakeup19:30:360
229682583,10sleep023065-21timerandwakeup19:30:360
219499580,6rtkit-daemon2193-21rtkit-daemon20:00:330
12975995814,37cyclictest0-21swapper/219:30:232
12975995814,37cyclictest0-21swapper/219:30:232
12975995811,31cyclictest0-21swapper/218:22:522
1297399584,14cyclictest0-21swapper/022:26:470
1297399583,50cyclictest0-21swapper/022:32:470
1297399583,49cyclictest18691-21head21:10:340
1297599576,33cyclictest0-21swapper/218:10:222
12975995717,20cyclictest0-21swapper/218:46:122
12975995717,20cyclictest0-21swapper/218:46:122
12975995714,28cyclictest0-21swapper/219:35:192
1297399574,47cyclictest0-21swapper/022:46:170
1297399574,45cyclictest0-21swapper/020:25:280
1297399572,49cyclictest0-21swapper/023:22:280
219499560,6rtkit-daemon2193-21rtkit-daemon22:45:121
219499560,6rtkit-daemon2193-21rtkit-daemon18:05:081
219499560,6rtkit-daemon2193-21rtkit-daemon18:05:081
219499560,5rtkit-daemon2193-21rtkit-daemon19:55:340
219499560,5rtkit-daemon2193-21rtkit-daemon19:35:340
202532566,12sleep10-21swapper/122:52:021
1297599566,43cyclictest0-21swapper/219:45:222
12975995624,25cyclictest1373-21cpuspeed_turbos19:55:172
12975995616,25cyclictest17964-21munin-node18:15:392
12975995611,37cyclictest0-21swapper/220:00:282
1297499564,10cyclictest1138-21crond22:24:581
1297399565,11cyclictest23180-21cpuspeed_turbos20:30:160
278552553,12sleep00-21swapper/022:15:160
278552553,12sleep00-21swapper/022:15:160
1297599558,30cyclictest0-21swapper/219:25:262
1297399555,43cyclictest0-21swapper/021:40:150
1297399554,44cyclictest0-21swapper/021:45:180
1297399554,44cyclictest0-21swapper/020:50:380
1297399554,44cyclictest0-21swapper/020:46:140
125082552,10sleep00-21swapper/021:01:590
44272543,9sleep00-21swapper/023:17:000
179882542,45sleep00-21swapper/022:50:070
1297599544,44cyclictest0-21swapper/219:05:312
12975995415,32cyclictest18874-21taskset19:25:022
12974995438,9cyclictest28148-21gltestperf22:15:181
12974995438,9cyclictest28148-21gltestperf22:15:181
1297499543,46cyclictest0-21swapper/123:02:111
1297499543,46cyclictest0-21swapper/123:02:111
1297499543,32cyclictest0-21swapper/122:36:471
1297399546,12cyclictest0-21swapper/021:55:180
1297399543,33cyclictest0-21swapper/018:51:560
90952533,9sleep00-21swapper/019:02:070
268702533,42sleep00-21swapper/022:14:360
219499530,5rtkit-daemon2193-21rtkit-daemon23:28:481
219499530,5rtkit-daemon2193-21rtkit-daemon23:15:111
219499530,5rtkit-daemon2193-21rtkit-daemon22:14:281
219499530,5rtkit-daemon2193-21rtkit-daemon19:55:040
219499530,5rtkit-daemon2193-21rtkit-daemon18:05:381
164672533,10sleep00-21swapper/021:09:330
1297499533,40cyclictest23838-21munin-node20:30:241
1297499532,45cyclictest26304-21rm21:24:291
1297399533,43cyclictest23216-21ssh22:55:480
1297399533,43cyclictest10009-21latency_hist21:00:020
1297399533,43cyclictest10009-21latency_hist21:00:020
1297399533,42cyclictest11952-21munin-node19:10:170
70032523,41sleep00-21swapper/020:05:270
31342522,43sleep00-21swapper/021:36:420
275282522,9sleep00-21swapper/023:04:390
275282522,9sleep00-21swapper/023:04:390
219499520,5rtkit-daemon2193-21rtkit-daemon22:31:501
219499520,5rtkit-daemon2193-21rtkit-daemon21:58:361
219499520,5rtkit-daemon2193-21rtkit-daemon20:15:030
12976995223,13cyclictest0-21swapper/318:15:263
1297499523,43cyclictest6390-21rm21:41:321
1297499523,34cyclictest0-21swapper/120:23:371
1297499522,45cyclictest0-21swapper/122:07:131
12974995212,34cyclictest201ktimersoftd/121:10:181
1297399524,42cyclictest0-21swapper/021:15:200
1297399524,40cyclictest0-21swapper/023:05:180
1297399523,42cyclictest0-21swapper/021:25:130
1297399523,12cyclictest0-21swapper/020:38:440
128872524,42sleep00-21swapper/018:04:310
128872524,42sleep00-21swapper/018:04:310
106732522,7sleep110726-21missed_timers19:05:301
67412512,43sleep10-21swapper/118:57:321
299542512,42sleep10-21swapper/121:30:061
223292513,41sleep10-21swapper/118:22:581
219499510,5rtkit-daemon2193-21rtkit-daemon21:53:141
139172512,10sleep10-21swapper/119:12:401
1297699514,29cyclictest0-21swapper/318:30:233
12976995120,13cyclictest0-21swapper/318:20:313
12975995118,26cyclictest0-21swapper/218:55:292
1297499513,44cyclictest0-21swapper/120:47:171
1297499513,41cyclictest14963-21rm20:17:101
1297499513,41cyclictest14963-21rm20:17:101
12974995110,35cyclictest0-21swapper/118:45:271
12974995110,35cyclictest0-21swapper/118:45:271
1297399515,28cyclictest0-21swapper/023:28:140
1297399515,28cyclictest0-21swapper/022:23:140
1297399515,28cyclictest0-21swapper/021:21:310
1297399513,43cyclictest0-21swapper/022:01:090
1297399513,42cyclictest5716-21diskmemload22:41:050
70482503,40sleep10-21swapper/120:55:151
70482503,40sleep10-21swapper/120:55:151
55222503,39sleep10-21swapper/120:02:421
219499500,6rtkit-daemon2193-21rtkit-daemon22:40:201
167312502,40sleep00-21swapper/019:20:160
132522503,10sleep10-21swapper/121:04:501
1297699504,24cyclictest2478-21tail18:50:183
1297499504,39cyclictest0-21swapper/123:14:501
1297499504,39cyclictest0-21swapper/122:55:101
1297499503,43cyclictest0-21swapper/120:29:131
1297499503,42cyclictest0-21swapper/121:45:441
1297499503,41cyclictest5716-21diskmemload21:07:381
1297499503,40cyclictest20036-21ssh22:03:281
1297499503,40cyclictest0-21swapper/120:40:181
1297499503,39cyclictest29866-21ssh23:05:571
1297499503,29cyclictest0-21swapper/118:40:081
1297499502,42cyclictest5716-21diskmemload20:38:331
1297499502,40cyclictest19096-21cat19:25:061
1297399503,43cyclictest0-21swapper/023:30:250
1297399503,42cyclictest0-21swapper/022:07:360
1297399503,26cyclictest0-21swapper/018:05:280
12973995022,8cyclictest6945-21latency_hist19:00:070
12974994933,11cyclictest6571-21cut20:05:211
1297499493,40cyclictest6218-21tune2fs23:20:131
1297499493,39cyclictest0-21swapper/119:50:041
1297499493,38cyclictest0-21swapper/120:50:391
1297499492,41cyclictest11837-21rm20:13:211
1297399494,40cyclictest0-21swapper/023:10:110
12973994936,8cyclictest21204-21gltestperf18:20:270
12973994935,9cyclictest30854-21cut21:30:200
12973994932,13cyclictest0-21swapper/018:46:150
12973994932,13cyclictest0-21swapper/018:46:150
1297399493,40cyclictest32006-21taskset18:44:400
212492482,10sleep00-21swapper/019:29:520
210962483,10sleep10-21swapper/121:15:231
191102483,39sleep10-21swapper/119:25:091
176332483,39sleep00-21swapper/018:13:580
161982483,10sleep00-21swapper/019:16:130
1297499482,41cyclictest0-21swapper/121:26:481
12974994817,14cyclictest0-21swapper/123:30:021
1297399483,41cyclictest0-21swapper/019:06:020
1297399483,41cyclictest0-21swapper/018:38:270
1297399483,41cyclictest0-21swapper/018:34:480
1297399483,40cyclictest0-21swapper/019:45:240
1297399483,40cyclictest0-21swapper/018:15:560
12973994829,13cyclictest0-21swapper/020:40:340
235392473,9sleep10-21swapper/119:33:401
235392473,9sleep10-21swapper/119:33:401
12976994720,12cyclictest0-21swapper/318:05:093
12976994720,12cyclictest0-21swapper/318:05:093
1297499473,38cyclictest0-21swapper/119:50:211
1297499473,35cyclictest23890-21munin-node19:35:211
1297499473,25cyclictest0-21swapper/118:50:191
12974994716,13cyclictest0-21swapper/122:26:461
298812463,9sleep10-21swapper/118:40:111
246032463,37sleep00-21swapper/018:26:270
161892463,9sleep10-21swapper/119:16:061
12974994624,16cyclictest0-21swapper/121:35:121
1297499462,37cyclictest15674-21telnet18:10:221
1297499453,27cyclictest0-21swapper/119:45:051
219499440,5rtkit-daemon2193-21rtkit-daemon18:30:071
1297499443,37cyclictest0-21swapper/119:00:241
1297499443,35cyclictest0-21swapper/118:30:171
219499430,4rtkit-daemon2193-21rtkit-daemon18:15:301
1297499423,11cyclictest0-21swapper/119:55:181
12975994116,19cyclictest0-21swapper/218:05:092
127452404,29sleep20-21swapper/218:02:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional