You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 10:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jun 14, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29980992929,0cyclictest0-21swapper/123:37:201
29990992726,1cyclictest34-21ksoftirqd/323:37:203
29980992624,1cyclictest0-21swapper/122:50:521
2999099250,24cyclictest29812-21ssh22:48:063
2998099252,22cyclictest607-21in:imuxsock22:40:001
2998099250,24cyclictest0-21swapper/100:32:441
2998099250,1cyclictest0-21swapper/123:32:561
29976992524,1cyclictest62550irq/127-eno100:20:070
2997699250,24cyclictest23610-21diskmemload00:10:120
2997699250,23cyclictest23610-21diskmemload22:14:230
29990992423,1cyclictest12068-21ssh00:32:443
29990992423,1cyclictest0-21swapper/323:32:563
29990992422,1cyclictest23610-21diskmemload21:39:523
2999099240,24cyclictest0-21swapper/322:18:293
2999099240,23cyclictest27788-21ssh23:15:333
2999099240,23cyclictest10851-21ssh21:29:363
29986992423,1cyclictest0-21swapper/222:19:392
29986992422,1cyclictest0-21swapper/200:07:172
29986992421,2cyclictest3405-21/usr/sbin/munin23:24:492
29986992420,4cyclictest0-21swapper/222:54:152
29986992419,4cyclictest0-21swapper/200:27:472
2998699240,23cyclictest0-21swapper/223:46:322
2998699240,23cyclictest0-21swapper/222:34:392
2998699240,23cyclictest0-21swapper/200:10:182
2998699240,0cyclictest0-21swapper/222:47:422
2998099240,23cyclictest6410-21awk20:35:011
2998099240,23cyclictest23610-21diskmemload23:14:451
2998099240,23cyclictest23610-21diskmemload22:30:441
2998099240,1cyclictest29567-21ssh21:45:321
2998099240,0cyclictest0-21swapper/123:21:301
2997699240,23cyclictest23610-21diskmemload23:51:380
2997699240,23cyclictest23610-21diskmemload23:35:590
2997699240,1cyclictest6375-21ssh22:25:000
29990992323,0cyclictest0-21swapper/322:35:453
29990992323,0cyclictest0-21swapper/321:46:443
29990992321,1cyclictest0-21swapper/323:29:423
29990992320,2cyclictest24307-21ssh21:10:363
29990992320,2cyclictest14239-21sh22:02:133
2999099230,23cyclictest25678-21ssh00:14:473
2999099230,23cyclictest0-21swapper/323:04:583
2999099230,23cyclictest0-21swapper/300:39:263
2999099230,23cyclictest0-21swapper/300:27:533
2999099230,22cyclictest7536-21ssh22:57:243
2999099230,22cyclictest2450-21rm21:50:263
2999099230,22cyclictest13496-21ssh00:04:243
2999099230,22cyclictest1039-21sh00:21:593
2999099230,22cyclictest0-21swapper/322:26:343
2999099230,20cyclictest0-21swapper/323:06:543
2999099230,1cyclictest29182-21munin-run20:15:003
2999099230,0cyclictest23610-21diskmemload23:23:273
2999099230,0cyclictest0-21swapper/322:42:233
2999099230,0cyclictest0-21swapper/321:57:063
2999099230,0cyclictest0-21swapper/321:40:173
29986992323,0cyclictest0-21swapper/223:37:382
29986992323,0cyclictest0-21swapper/223:26:262
29986992323,0cyclictest0-21swapper/223:15:282
29986992323,0cyclictest0-21swapper/222:59:002
29986992323,0cyclictest0-21swapper/222:13:042
29986992323,0cyclictest0-21swapper/200:33:102
29986992323,0cyclictest0-21swapper/200:00:082
29986992322,1cyclictest23610-21diskmemload22:04:132
29986992322,1cyclictest23610-21diskmemload21:55:372
29986992321,1cyclictest31603-21perf20:20:002
29986992321,1cyclictest0-21swapper/219:15:012
29986992320,3cyclictest0-21swapper/221:19:522
2998699230,2cyclictest5914-21sh22:24:472
2998699230,23cyclictest0-21swapper/222:28:192
2998699230,23cyclictest0-21swapper/221:31:572
2998699230,23cyclictest0-21swapper/221:25:202
2998699230,23cyclictest0-21swapper/221:20:492
2998699230,22cyclictest6211-21kworker/u8:123:30:302
2998699230,22cyclictest0-21swapper/221:12:592
2998699230,1cyclictest0-21swapper/223:13:442
2998699230,1cyclictest0-21swapper/222:07:242
2998699230,0cyclictest0-21swapper/200:19:132
29980992323,0cyclictest0-21swapper/123:26:001
29980992323,0cyclictest0-21swapper/123:05:171
29980992323,0cyclictest0-21swapper/122:55:581
29980992323,0cyclictest0-21swapper/122:42:331
29980992323,0cyclictest0-21swapper/122:13:181
29980992323,0cyclictest0-21swapper/122:00:231
29980992323,0cyclictest0-21swapper/121:24:011
29980992321,1cyclictest23610-21diskmemload23:50:521
29980992321,1cyclictest0-21swapper/121:51:141
29980992321,1cyclictest0-21swapper/121:25:551
29980992321,1cyclictest0-21swapper/120:40:011
29980992321,1cyclictest0-21swapper/100:15:541
2998099230,2cyclictest1432-21sh22:20:061
2998099230,23cyclictest0-21swapper/123:15:581
2998099230,23cyclictest0-21swapper/100:36:081
2998099230,22cyclictest372-21ssh00:21:051
2998099230,22cyclictest21089-21apt-get22:09:371
2998099230,22cyclictest0-21swapper/121:40:511
2998099230,21cyclictest313-21systemd-journal00:00:011
2998099230,0cyclictest0-21swapper/123:45:201
29976992323,0cyclictest23610-21diskmemload23:46:410
29976992323,0cyclictest23610-21diskmemload00:30:450
29976992323,0cyclictest0-21swapper/022:58:410
29976992323,0cyclictest0-21swapper/021:56:210
29976992323,0cyclictest0-21swapper/021:34:570
29976992323,0cyclictest0-21swapper/000:06:460
29976992323,0cyclictest0-21swapper/000:01:490
29976992322,1cyclictest0-21swapper/000:25:420
29976992321,1cyclictest868-21ssh22:50:230
29976992321,1cyclictest7586-21munin-run21:25:010
29976992320,2cyclictest29998-21sh21:46:080
2997699230,23cyclictest0-21swapper/023:58:220
2997699230,23cyclictest0-21swapper/023:30:050
2997699230,22cyclictest3205-21ssh21:51:300
2997699230,22cyclictest23905-21rm21:10:040
2997699230,22cyclictest21944-21sendmail20:00:010
2997699230,22cyclictest21099-21rm22:09:370
2997699230,22cyclictest19456-21sh23:09:310
2997699230,22cyclictest14015-21cron20:50:010
2997699230,22cyclictest0-21swapper/023:44:020
2997699230,22cyclictest0-21swapper/023:19:140
2997699230,22cyclictest0-21swapper/021:42:370
2997699230,1cyclictest0-21swapper/022:45:120
2997699230,0cyclictest23610-21diskmemload23:28:110
29990992222,0cyclictest0-21swapper/322:05:483
29990992221,1cyclictest1217-21sh22:50:523
29990992220,1cyclictest606-21dbus-daemon20:35:013
29990992220,1cyclictest27013-21ssh00:15:513
29990992220,1cyclictest26885-21ssh23:45:123
2999099220,21cyclictest4914-21ssh23:55:023
2999099220,21cyclictest29788-21apt-get20:19:403
2999099220,21cyclictest23262-21sh22:10:013
2999099220,21cyclictest22600-21sh23:10:423
2999099220,21cyclictest0-21swapper/323:41:013
2999099220,21cyclictest0-21swapper/321:04:403
2999099220,21cyclictest0-21swapper/300:06:163
2999099220,1cyclictest23610-21diskmemload21:24:323
2999099220,1cyclictest15031-21apt-get22:34:393
29986992222,0cyclictest23610-21diskmemload23:51:282
29986992222,0cyclictest23610-21diskmemload00:22:532
29986992222,0cyclictest0-21swapper/221:53:462
29986992220,1cyclictest0-21swapper/223:00:522
29986992220,1cyclictest0-21swapper/222:35:142
29986992220,1cyclictest0-21swapper/221:05:002
2998699220,21cyclictest23610-21diskmemload23:55:052
2998699220,21cyclictest0-21swapper/221:42:252
2998699220,21cyclictest0-21swapper/220:24:402
2998699220,1cyclictest0-21swapper/221:45:462
2998699220,0cyclictest23610-21diskmemload23:42:172
2998699220,0cyclictest0-21swapper/220:59:402
29980992222,0cyclictest0-21swapper/122:48:121
29980992221,1cyclictest0-21swapper/121:19:011
29980992221,0cyclictest0-21swapper/122:15:431
29980992220,1cyclictest23610-21diskmemload23:44:411
29980992220,1cyclictest23610-21diskmemload21:30:591
29980992220,1cyclictest1586-21munin-run20:25:001
29980992220,1cyclictest0-21swapper/100:10:031
29980992220,1cyclictest0-21swapper/100:05:091
2998099220,22cyclictest0-21swapper/100:26:461
2998099220,21cyclictest0-21swapper/123:00:051
2998099220,21cyclictest0-21swapper/121:55:241
2998099220,21cyclictest0-21swapper/121:36:021
2998099220,21cyclictest0-21swapper/121:10:221
2998099220,1cyclictest29788-21apt-get20:19:401
29976992222,0cyclictest23610-21diskmemload23:01:050
29976992222,0cyclictest0-21swapper/023:14:250
29976992221,1cyclictest12713-21ssh22:31:060
29976992220,1cyclictest18613-21ssh21:35:290
2997699220,21cyclictest32327-21perf19:15:010
2997699220,21cyclictest23610-21diskmemload22:35:050
2997699220,21cyclictest23610-21diskmemload21:15:040
2997699220,21cyclictest13246-21sh22:00:420
2997699220,21cyclictest0-21swapper/020:04:390
2997699220,1cyclictest8106-21ssh22:27:130
2997699220,1cyclictest29130-21rm22:15:520
2997699220,1cyclictest26893-21sh00:15:410
2997699220,0cyclictest23610-21diskmemload21:25:030
29990992121,0cyclictest0-21swapper/322:20:043
29990992118,2cyclictest8819-21cron20:40:013
2999099210,21cyclictest0-21swapper/323:51:243
2999099210,20cyclictest2997-21apt-get19:24:373
2999099210,1cyclictest13579-21ssh21:30:433
2999099210,0cyclictest23610-21diskmemload21:15:313
29986992120,1cyclictest0-21swapper/220:50:012
29986992119,1cyclictest16275-21sh00:35:252
29986992119,1cyclictest0-21swapper/220:00:012
2998699210,21cyclictest0-21swapper/221:35:222
2998699210,20cyclictest0-21swapper/220:39:402
2998699210,20cyclictest0-21swapper/220:34:392
2998699210,1cyclictest22972-21ssh22:40:432
2998699210,1cyclictest0-21swapper/220:09:382
29980992121,0cyclictest2997-21apt-get19:24:381
29980992121,0cyclictest0-21swapper/119:34:391
29980992119,1cyclictest2375-21basename19:20:001
2998099210,21cyclictest0-21swapper/122:25:191
2998099210,20cyclictest0-21swapper/120:29:381
29976992119,1cyclictest21218-21awk21:05:000
2997699210,21cyclictest0-21swapper/023:20:430
2997699210,20cyclictest23610-21diskmemload00:35:060
2997699210,20cyclictest0-21swapper/019:54:390
2997699210,0cyclictest0-21swapper/021:09:400
29990992020,0cyclictest30542-21apt-get19:14:383
29990992020,0cyclictest20181-21apt-get19:59:373
29990992020,0cyclictest0-21swapper/319:44:393
29990992019,1cyclictest0-21swapper/320:59:403
2999099200,20cyclictest0-21swapper/320:09:383
2999099200,0cyclictest2244-21apt-get20:29:383
2999099200,0cyclictest0-21swapper/319:54:393
29986992020,0cyclictest0-21swapper/219:19:382
2998699200,19cyclictest24385-21awk20:05:012
29980992020,0cyclictest0-21swapper/120:45:021
29980992020,0cyclictest0-21swapper/120:04:401
29980992020,0cyclictest0-21swapper/119:44:391
29980992020,0cyclictest0-21swapper/119:39:381
29980992019,0cyclictest5789-21apt-get19:29:391
29976992020,0cyclictest0-21swapper/020:59:400
29976992020,0cyclictest0-21swapper/019:34:390
29976992018,1cyclictest26789-21munin-run20:10:000
2997699200,0cyclictest0-21swapper/019:44:390
29990991918,1cyclictest0-21swapper/319:34:393
29990991918,0cyclictest22601-21apt-get20:04:403
29990991917,1cyclictest0-21swapper/320:25:003
29986991919,0cyclictest0-21swapper/220:54:402
29986991919,0cyclictest0-21swapper/219:29:392
29986991917,1cyclictest27388-21apt-get20:14:382
29980991919,0cyclictest0-21swapper/121:09:401
29976991919,0cyclictest477-21apt-get19:19:380
29976991919,0cyclictest0-21swapper/020:44:380
29976991919,0cyclictest0-21swapper/019:49:410
29976991917,1cyclictest1577-21perf20:25:000
29990991818,0cyclictest0-21swapper/320:44:383
29990991818,0cyclictest0-21swapper/319:39:383
29986991818,0cyclictest0-21swapper/221:09:402
29986991818,0cyclictest0-21swapper/220:44:382
29986991817,1cyclictest12999-21apt-get19:44:392
29980991818,0cyclictest0-21swapper/120:09:381
29980991816,1cyclictest1649-21cron21:05:001
29990991717,0cyclictest0-21swapper/320:45:023
29990991716,1cyclictest2355-21idleruntime-cro19:20:003
29990991716,0cyclictest0-21swapper/319:29:393
29980991717,0cyclictest0-21swapper/119:59:361
29980991716,0cyclictest0-21swapper/119:54:391
29990991616,0cyclictest0-21swapper/321:09:403
29980991616,0cyclictest0-21swapper/120:59:401
29980991615,0cyclictest0-21swapper/119:14:381
29976991616,0cyclictest0-21swapper/020:34:390
29986991515,0cyclictest8188-21apt-get19:34:392
29980991514,1cyclictest14646-21apt-get20:54:401
2997699157,8cyclictest22871-21munin-node19:36:460
29976991515,0cyclictest4781-21apt-get19:25:020
29976991515,0cyclictest0-21swapper/020:54:400
29976991515,0cyclictest0-21swapper/020:19:400
2999099140,14cyclictest0-21swapper/320:50:083
2999099140,14cyclictest0-21swapper/319:45:353
2998699140,14cyclictest0-21swapper/220:26:442
2998699140,14cyclictest0-21swapper/219:50:242
2998699140,14cyclictest0-21swapper/219:45:242
2998699140,14cyclictest0-21swapper/219:20:182
2998699140,0cyclictest0-21swapper/219:35:232
2998099140,14cyclictest0-21swapper/120:40:011
2998099140,14cyclictest0-21swapper/119:45:291
2998099140,0cyclictest0-21swapper/120:10:431
29976991414,0cyclictest0-21swapper/020:25:280
2997699140,14cyclictest0-21swapper/019:21:430
2997699140,0cyclictest0-21swapper/020:35:190
2997699140,0cyclictest0-21swapper/020:10:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional