You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 05, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2886699270,23cyclictest0-21swapper/109:22:491
28866992623,3cyclictest29333-21ssh12:24:491
2886699260,25cyclictest0-21swapper/109:18:501
2886699260,22cyclictest30919-21sh10:20:311
2887199250,24cyclictest0-21swapper/310:41:453
2886799250,24cyclictest11947-21ssh12:39:242
2886799250,1cyclictest0-21swapper/211:57:332
28866992522,3cyclictest0-21swapper/112:01:261
2886699250,21cyclictest0-21swapper/111:29:261
2886199250,24cyclictest23019-21diskmemload11:59:480
2887199243,1cyclictest21427-21sh10:11:393
2887199243,1cyclictest21427-21sh10:11:393
28871992423,1cyclictest0-21swapper/310:20:063
2887199240,23cyclictest25917-21ssh11:49:423
2887199240,23cyclictest23019-21diskmemload11:52:303
2887199240,23cyclictest23019-21diskmemload09:35:513
2887199240,23cyclictest0-21swapper/312:18:123
2887199240,1cyclictest23019-21diskmemload09:41:083
2887199240,1cyclictest0-21swapper/309:46:423
28867992422,1cyclictest0-21swapper/209:28:462
28867992420,0cyclictest0-21swapper/210:42:332
2886799240,23cyclictest23019-21diskmemload10:37:062
2886799240,23cyclictest23019-21diskmemload09:16:082
2886799240,23cyclictest21190-21ssh11:45:022
2886799240,23cyclictest0-21swapper/212:04:502
2886799240,23cyclictest0-21swapper/211:06:052
2886799240,1cyclictest0-21swapper/209:48:032
28866992422,1cyclictest3872-21diskmemload12:32:291
28866992421,3cyclictest0-21swapper/111:56:531
28866992421,3cyclictest0-21swapper/108:23:491
28866992421,2cyclictest20675-21ssh10:43:231
2886699240,23cyclictest18392-21munin-run10:40:001
2886699240,23cyclictest0-21swapper/111:40:021
2886699240,21cyclictest23019-21diskmemload09:12:141
2886699240,20cyclictest0-21swapper/109:40:351
2886699240,0cyclictest0-21swapper/110:13:461
2886699240,0cyclictest0-21swapper/110:13:461
2886699240,0cyclictest0-21swapper/110:09:171
2886699240,0cyclictest0-21swapper/109:50:491
28861992423,1cyclictest18272-21ssh10:39:540
28861992423,1cyclictest13213-21ssh11:06:330
28861992422,1cyclictest0-21swapper/011:20:530
28861992422,1cyclictest0-21swapper/010:18:200
28861992421,2cyclictest16452-21sh09:35:050
28861992420,3cyclictest3661-21cpuspeed_turbos09:23:500
2886199240,24cyclictest23019-21diskmemload10:03:300
2886199240,24cyclictest0-21swapper/011:46:210
2886199240,0cyclictest23019-21diskmemload12:36:300
2886199240,0cyclictest0-21swapper/009:14:370
28871992323,0cyclictest0-21swapper/312:39:103
28871992323,0cyclictest0-21swapper/311:25:343
28871992323,0cyclictest0-21swapper/309:52:473
28871992320,2cyclictest26200-21ptp4l11:18:553
2887199230,2cyclictest28685-21munin-run10:50:003
2887199230,23cyclictest23019-21diskmemload11:43:413
2887199230,22cyclictest23999-21ssh09:11:123
2887199230,22cyclictest23019-21diskmemload10:37:493
2887199230,22cyclictest14894-21ssh12:10:543
2887199230,0cyclictest23019-21diskmemload10:53:313
2887199230,0cyclictest11453-21ssh09:30:123
2887199230,0cyclictest0-21swapper/311:13:493
28867992323,0cyclictest0-21swapper/211:34:092
28867992323,0cyclictest0-21swapper/209:54:392
28867992322,1cyclictest23019-21diskmemload11:00:312
28867992322,1cyclictest0-21swapper/210:34:522
28867992321,1cyclictest0-21swapper/210:02:312
28867992321,1cyclictest0-21swapper/209:13:032
28867992321,0cyclictest0-21swapper/212:25:092
28867992318,4cyclictest0-21swapper/210:45:062
28867992318,4cyclictest0-21swapper/209:24:332
2886799230,2cyclictest8421-21latency_hist07:35:002
2886799230,23cyclictest23019-21diskmemload11:27:172
2886799230,23cyclictest0-21swapper/211:19:272
2886799230,23cyclictest0-21swapper/209:32:452
2886799230,22cyclictest18762-21chrt09:38:472
2886799230,22cyclictest0-21swapper/209:59:182
2886799230,20cyclictest23019-21diskmemload12:10:232
2886799230,0cyclictest23019-21diskmemload10:26:002
2886799230,0cyclictest0-21swapper/212:31:422
2886799230,0cyclictest0-21swapper/212:17:462
2886799230,0cyclictest0-21swapper/211:36:362
2886799230,0cyclictest0-21swapper/211:21:472
28866992323,0cyclictest0-21swapper/112:19:201
28866992323,0cyclictest0-21swapper/112:08:361
28866992323,0cyclictest0-21swapper/111:36:361
28866992323,0cyclictest0-21swapper/110:47:011
28866992323,0cyclictest0-21swapper/110:03:141
28866992321,2cyclictest0-21swapper/111:24:571
28866992320,2cyclictest23019-21diskmemload10:55:411
2886699230,22cyclictest6650-21sh09:25:461
2886699230,22cyclictest4862-21sh10:27:281
2886699230,22cyclictest27443-21ssh11:51:491
2886699230,22cyclictest22008-21sh11:46:101
2886699230,0cyclictest17347-21ssh09:36:311
2886699230,0cyclictest0-21swapper/112:35:251
2886699230,0cyclictest0-21swapper/112:26:051
2886699230,0cyclictest0-21swapper/111:05:191
2886699230,0cyclictest0-21swapper/110:50:181
2886699230,0cyclictest0-21swapper/109:59:131
28861992323,0cyclictest0-21swapper/010:05:200
28861992320,2cyclictest606-21dbus-daemon07:40:000
28861992320,2cyclictest29905-21ssh12:25:180
28861992320,2cyclictest25920-21sh10:48:250
2886199230,23cyclictest0-21swapper/012:21:020
2886199230,23cyclictest0-21swapper/009:25:150
2886199230,22cyclictest8060-21ssh11:01:360
2886199230,22cyclictest5743-21ssh09:56:130
2886199230,22cyclictest30099-21sh10:51:550
2886199230,22cyclictest23019-21diskmemload12:15:540
2886199230,22cyclictest22381-21sh10:13:130
2886199230,22cyclictest22381-21sh10:13:130
2886199230,22cyclictest0-21swapper/009:17:270
2886199230,1cyclictest0-21swapper/012:03:510
2886199230,0cyclictest0-21swapper/011:27:090
2886199230,0cyclictest0-21swapper/011:15:120
28871992222,0cyclictest0-21swapper/309:24:563
28871992220,1cyclictest29013-21sh09:16:033
28871992220,1cyclictest23040-21perf09:10:003
28871992220,1cyclictest23019-21diskmemload12:05:203
28871992220,1cyclictest16948-21sh10:07:463
28871992220,1cyclictest0-21swapper/310:55:453
2887199220,22cyclictest0-21swapper/310:02:143
2887199220,21cyclictest23019-21diskmemload12:32:563
2887199220,21cyclictest23019-21diskmemload12:20:313
2887199220,21cyclictest23019-21diskmemload11:05:153
2887199220,21cyclictest23019-21diskmemload11:00:283
2887199220,21cyclictest11500-21apt-get07:43:503
2887199220,21cyclictest0-21swapper/311:56:093
2887199220,1cyclictest9871-21dump-pmu-power10:00:003
2887199220,1cyclictest0-21swapper/312:26:103
2887199220,1cyclictest0-21swapper/311:32:453
2887199220,1cyclictest0-21swapper/310:17:343
2887199220,1cyclictest0-21swapper/307:33:513
2887199220,0cyclictest0-21swapper/309:29:403
28867992222,0cyclictest0-21swapper/212:20:102
28867992222,0cyclictest0-21swapper/211:10:402
28867992222,0cyclictest0-21swapper/210:05:572
28867992220,1cyclictest26810-21sh11:50:522
28867992220,1cyclictest22380-21ssh09:40:342
28867992220,1cyclictest0-21swapper/210:16:592
2886799220,22cyclictest16387-21ssh11:40:192
2886799220,21cyclictest9148-21apt-get08:43:502
2886799220,21cyclictest20556-21munin-run08:00:012
2886799220,21cyclictest0-21swapper/212:08:532
2886799220,1cyclictest0-21swapper/210:52:502
2886799220,1cyclictest0-21swapper/207:40:012
2886799220,0cyclictest0-21swapper/210:13:452
2886799220,0cyclictest0-21swapper/210:13:452
28866992222,0cyclictest0-21swapper/111:13:081
28866992221,1cyclictest28846-21ssh09:47:461
28866992220,2cyclictest0-21swapper/111:30:551
2886699220,22cyclictest26848-21sh11:19:111
2886699220,22cyclictest0-21swapper/111:01:121
2886699220,21cyclictest0-21swapper/110:30:131
2886699220,21cyclictest0-21swapper/110:16:181
2886699220,1cyclictest313-21systemd-journal08:10:001
28861992222,0cyclictest13110-21ssh11:38:170
28861992222,0cyclictest0-21swapper/012:31:580
28861992222,0cyclictest0-21swapper/012:11:540
28861992221,1cyclictest31784-21apt07:18:500
28861992221,1cyclictest0-21swapper/011:44:010
28861992221,1cyclictest0-21swapper/009:50:010
28861992221,0cyclictest0-21swapper/008:25:020
28861992220,1cyclictest0-21swapper/011:50:050
28861992220,1cyclictest0-21swapper/009:32:200
28861992220,1cyclictest0-21swapper/008:05:000
2886199220,21cyclictest6029-21apt07:30:000
2886199220,21cyclictest31242-21sh10:20:590
2886199220,21cyclictest23019-21diskmemload12:05:270
2886199220,21cyclictest0-21swapper/010:25:350
2886199220,21cyclictest0-21swapper/007:53:500
2886199220,21cyclictest0-21swapper/007:33:500
2886199220,21cyclictest0-21swapper/007:13:500
2886199220,1cyclictest605-21avahi-daemon08:50:010
2886199220,1cyclictest19604-21ssh11:13:420
2886199220,1cyclictest19210-21sh10:41:030
2886199220,0cyclictest0-21swapper/010:33:300
28871992121,0cyclictest0-21swapper/311:20:363
28871992119,1cyclictest565-21turbostat08:25:003
28871992119,1cyclictest22993-21turbostat08:05:003
2887199210,20cyclictest0-21swapper/308:53:503
2887199210,0cyclictest23019-21diskmemload10:31:253
28867992120,1cyclictest3388-21perf08:30:012
2886799210,21cyclictest0-21swapper/210:55:412
2886799210,21cyclictest0-21swapper/210:20:572
2886799210,20cyclictest0-21swapper/208:38:502
28866992121,0cyclictest0-21swapper/112:10:111
2886699210,20cyclictest0-21swapper/107:43:501
2886699210,20cyclictest0-21swapper/107:28:501
28861992121,0cyclictest0-21swapper/011:30:020
28861992119,1cyclictest0-21swapper/010:55:030
2886199210,21cyclictest0-21swapper/009:40:240
28871992020,0cyclictest0-21swapper/307:23:493
28871992019,0cyclictest0-21swapper/307:18:493
2887199200,20cyclictest0-21swapper/311:35:573
2887199200,20cyclictest0-21swapper/308:58:513
2887199200,0cyclictest0-21swapper/307:38:493
28867992020,0cyclictest0-21swapper/208:53:502
28867992020,0cyclictest0-21swapper/207:23:502
28866992020,0cyclictest0-21swapper/109:08:481
28866992020,0cyclictest0-21swapper/107:13:501
2886699200,20cyclictest0-21swapper/108:18:491
2886699200,0cyclictest0-21swapper/108:25:021
28861992020,0cyclictest0-21swapper/007:48:500
2886199200,0cyclictest0-21swapper/008:13:500
28871991919,0cyclictest0-21swapper/308:28:503
28871991917,1cyclictest13385-21turbostat08:50:013
2887199190,18cyclictest6731-21apt-get08:38:503
28867991919,0cyclictest0-21swapper/208:13:502
28867991919,0cyclictest0-21swapper/207:43:492
28867991917,1cyclictest3938-21apt-get08:33:502
2886799190,18cyclictest20574-21cron09:05:002
28866991919,0cyclictest13937-21apt-get08:53:501
28866991919,0cyclictest0-21swapper/107:38:491
28861991917,1cyclictest23030-21ls09:10:000
28861991916,2cyclictest30612-21perf08:20:000
28871991818,0cyclictest0-21swapper/307:13:503
28867991817,1cyclictest11541-21apt-get08:48:502
28867991816,2cyclictest31159-21apt-get08:23:482
28866991818,0cyclictest0-21swapper/108:48:501
28866991816,1cyclictest8420-21sh07:35:001
28861991818,0cyclictest22982-21apt-get08:05:010
28861991818,0cyclictest16331-21apt-get08:58:510
28861991818,0cyclictest0-21swapper/007:58:510
28861991817,0cyclictest6405-21apt-get08:35:020
28861991817,0cyclictest0-21swapper/008:23:490
28867991717,0cyclictest16287-21apt-get07:53:492
28867991717,0cyclictest0-21swapper/208:18:492
28867991717,0cyclictest0-21swapper/207:18:502
28867991715,1cyclictest21138-21apt-get09:08:482
28866991717,0cyclictest6731-21apt-get08:38:501
28866991717,0cyclictest0-21swapper/108:13:501
28866991716,1cyclictest11002-21turbostat08:45:011
28867991615,0cyclictest29387-21apt-get07:13:502
28866991616,0cyclictest0-21swapper/108:33:501
28866991616,0cyclictest0-21swapper/107:48:501
2886699160,15cyclictest18913-21cstates07:58:521
2886699160,15cyclictest0-21swapper/109:01:481
2886699160,15cyclictest0-21swapper/107:23:491
28871991515,0cyclictest0-21swapper/308:33:493
28871991515,0cyclictest0-21swapper/308:08:483
2887199150,6cyclictest0-21swapper/308:43:503
2887199150,14cyclictest0-21swapper/309:00:493
28867991514,1cyclictest13893-21apt-get07:48:502
2886799150,14cyclictest4187-21apt-get07:28:502
28866991515,0cyclictest0-21swapper/108:03:511
28861991515,0cyclictest0-21swapper/008:33:490
28861991514,1cyclictest1791-21apt-get07:23:490
28861991513,1cyclictest0-21swapper/008:43:490
2887199140,14cyclictest0-21swapper/308:11:203
2887199140,14cyclictest0-21swapper/307:56:293
2887199140,14cyclictest0-21swapper/307:51:133
2887199140,14cyclictest0-21swapper/307:27:153
2887199140,0cyclictest0-21swapper/308:16:093
2887199140,0cyclictest0-21swapper/307:45:073
2886799140,14cyclictest0-21swapper/208:55:222
2886799140,14cyclictest0-21swapper/208:05:042
2886799140,14cyclictest0-21swapper/208:02:162
28866991414,0cyclictest0-21swapper/107:51:361
2886699140,0cyclictest0-21swapper/107:15:161
28861991414,0cyclictest0-21swapper/009:00:460
28861991414,0cyclictest0-21swapper/007:40:010
2886199140,0cyclictest0-21swapper/008:50:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional