You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 20:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 15, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
743599260,25cyclictest0-21swapper/210:59:272
7433992624,1cyclictest16753-21sh09:53:460
743699250,24cyclictest4749-21ssh09:13:433
7435992523,1cyclictest0-21swapper/210:20:292
743599250,25cyclictest0-21swapper/212:24:212
7434992525,0cyclictest0-21swapper/112:17:161
743499250,1cyclictest30708-21ssh11:33:131
7436992423,1cyclictest1496-21diskmemload09:35:523
743699240,23cyclictest21093-21ssh12:22:473
743699240,23cyclictest1496-21diskmemload10:48:133
743699240,23cyclictest0-21swapper/311:47:493
743699240,1cyclictest3839-21ntp_states10:39:533
743699240,0cyclictest0-21swapper/309:24:293
743599240,23cyclictest1496-21diskmemload12:04:022
743599240,23cyclictest0-21swapper/211:35:162
743599240,23cyclictest0-21swapper/211:26:592
743599240,23cyclictest0-21swapper/210:30:002
743599240,23cyclictest0-21swapper/209:55:442
7434992421,2cyclictest10143-21rm11:44:131
743499240,24cyclictest0-21swapper/109:10:581
743499240,23cyclictest23261-21memory09:29:531
743499240,1cyclictest0-21swapper/111:11:021
743499240,1cyclictest0-21swapper/109:33:581
7433992422,1cyclictest0-21swapper/012:28:200
7433992421,2cyclictest6942-21sh11:11:090
743399241,1cyclictest0-21swapper/009:34:490
743399240,2cyclictest5942-21wc11:10:000
743399240,24cyclictest0-21swapper/009:27:230
743399240,23cyclictest9972-21ssh09:18:060
743399240,23cyclictest0-21swapper/012:21:070
743399240,0cyclictest1496-21diskmemload12:37:460
743399240,0cyclictest1496-21diskmemload10:56:240
7436992323,0cyclictest0-21swapper/312:32:273
7436992323,0cyclictest0-21swapper/311:20:143
7436992323,0cyclictest0-21swapper/311:03:163
7436992322,1cyclictest1496-21diskmemload11:26:573
7436992322,1cyclictest1496-21diskmemload11:11:183
7436992321,1cyclictest3596-21ssh09:40:533
7436992321,1cyclictest0-21swapper/311:56:113
7436992321,1cyclictest0-21swapper/311:44:493
7436992321,1cyclictest0-21swapper/310:21:233
7436992320,2cyclictest9461-21sh09:46:143
743699230,2cyclictest29948-21sh12:01:023
743699230,2cyclictest29455-21idleruntime-cro07:55:003
743699230,23cyclictest0-21swapper/312:16:553
743699230,23cyclictest0-21swapper/310:27:443
743699230,22cyclictest8683-21perf12:40:013
743699230,22cyclictest5945-21grep11:10:003
743699230,22cyclictest3353-21ssh12:06:193
743699230,22cyclictest28589-21ssh11:30:133
743699230,22cyclictest1496-21diskmemload10:40:143
743699230,22cyclictest0-21swapper/309:30:003
743699230,0cyclictest0-21swapper/311:19:483
7435992323,0cyclictest0-21swapper/212:07:462
7435992323,0cyclictest0-21swapper/211:43:352
7435992323,0cyclictest0-21swapper/211:10:262
7435992321,2cyclictest8822-21ssh12:11:092
7435992321,2cyclictest0-21swapper/212:35:482
7435992320,2cyclictest1546-21sh10:38:112
7435992318,0cyclictest0-21swapper/212:33:092
743599230,2cyclictest1650-21ssh11:06:332
743599230,23cyclictest0-21swapper/211:19:272
743599230,23cyclictest0-21swapper/209:45:052
743599230,22cyclictest9538-21idleruntime-cro08:20:012
743599230,22cyclictest27088-21ssh09:33:522
743599230,22cyclictest1859-21ssh09:10:092
743599230,22cyclictest16873-21ssh09:24:472
743599230,22cyclictest1496-21diskmemload10:04:252
743599230,22cyclictest1496-21diskmemload09:27:152
743599230,22cyclictest0-21swapper/210:48:572
743599230,1cyclictest0-21swapper/211:22:062
743599230,0cyclictest1496-21diskmemload10:10:192
743599230,0cyclictest0-21swapper/210:05:132
743599230,0cyclictest0-21swapper/209:37:582
7434992323,0cyclictest0-21swapper/112:33:221
7434992323,0cyclictest0-21swapper/111:24:411
7434992323,0cyclictest0-21swapper/111:15:251
7434992323,0cyclictest0-21swapper/110:51:581
7434992323,0cyclictest0-21swapper/110:41:281
7434992323,0cyclictest0-21swapper/110:31:571
7434992323,0cyclictest0-21swapper/109:53:571
7434992322,1cyclictest1496-21diskmemload09:59:421
7434992321,1cyclictest12457-21ssh12:14:551
7434992321,1cyclictest0-21swapper/111:55:591
7434992321,1cyclictest0-21swapper/110:12:051
7434992320,2cyclictest13915-21ssh11:46:371
743499230,2cyclictest2907-21sh12:05:451
743499230,2cyclictest21874-21apt07:40:011
743499230,23cyclictest1496-21diskmemload10:25:291
743499230,23cyclictest0-21swapper/109:49:441
743499230,23cyclictest0-21swapper/109:41:111
743499230,22cyclictest590-21ssh11:05:051
743499230,22cyclictest23794-21ssh10:58:151
743499230,22cyclictest15422-21ssh10:20:281
743499230,0cyclictest0-21swapper/112:27:071
743499230,0cyclictest0-21swapper/112:00:391
743499230,0cyclictest0-21swapper/110:36:511
7433992323,0cyclictest0-21swapper/012:15:270
7433992323,0cyclictest0-21swapper/011:35:090
7433992323,0cyclictest0-21swapper/011:22:440
7433992323,0cyclictest0-21swapper/011:16:240
7433992323,0cyclictest0-21swapper/010:09:030
7433992322,1cyclictest1496-21diskmemload10:00:540
7433992321,1cyclictest0-21swapper/011:55:240
7433992321,1cyclictest0-21swapper/011:25:240
7433992319,3cyclictest19967-21rm11:52:240
743399230,2cyclictest5149-21ssh09:43:020
743399230,22cyclictest4024-21ssh09:12:490
743399230,22cyclictest3124-21ssh12:06:020
743399230,1cyclictest0-21swapper/009:49:030
743399230,0cyclictest1496-21diskmemload11:00:380
743399230,0cyclictest0-21swapper/012:04:100
743399230,0cyclictest0-21swapper/010:42:220
743399230,0cyclictest0-21swapper/010:13:200
7436992222,0cyclictest1496-21diskmemload10:17:103
7436992222,0cyclictest0-21swapper/309:04:473
7436992221,1cyclictest4086-21ssh10:10:073
7436992220,1cyclictest8472-21sh12:10:433
7436992220,1cyclictest14337-21latency_hist08:30:013
7436992220,1cyclictest12106-21latency09:19:513
7436992220,1cyclictest0-21swapper/312:25:253
7436992220,1cyclictest0-21swapper/311:35:103
7436992220,1cyclictest0-21swapper/308:50:003
7436992220,1cyclictest0-21swapper/308:44:483
743699220,2cyclictest31091-21ssh10:05:243
743699220,22cyclictest0-21swapper/310:50:563
743699220,21cyclictest26157-21rm10:01:133
743699220,21cyclictest22151-21ssh10:55:503
743699220,21cyclictest19961-21ssh09:55:313
743699220,21cyclictest15208-21apt-get07:29:473
743699220,1cyclictest15463-21kworker/u8:110:31:163
743699220,1cyclictest1496-21diskmemload09:32:383
743699220,0cyclictest0-21swapper/309:50:343
7435992222,0cyclictest1496-21diskmemload12:19:012
7435992222,0cyclictest1496-21diskmemload11:51:052
7435992222,0cyclictest0-21swapper/210:41:192
7435992221,0cyclictest0-21swapper/211:56:222
7435992220,1cyclictest32159-21apt-get09:09:472
7435992220,1cyclictest0-21swapper/210:31:492
7435992220,1cyclictest0-21swapper/208:05:002
7435992219,2cyclictest16286-21rm10:50:242
743599220,22cyclictest0-21swapper/209:16:252
743599220,21cyclictest4242-21ssh09:41:432
743599220,21cyclictest14495-21ssh09:50:362
743599220,21cyclictest12971-21rm11:45:252
743599220,1cyclictest27412-21ssh11:00:292
743599220,1cyclictest22160-21apt-get08:49:482
743599220,1cyclictest1496-21diskmemload10:15:382
743599220,1cyclictest0-21swapper/212:25:562
7434992222,0cyclictest0-21swapper/111:26:081
7434992222,0cyclictest0-21swapper/110:05:161
7434992220,1cyclictest27173-21sh11:00:111
7434992220,1cyclictest0-21swapper/110:15:471
7434992220,1cyclictest0-21swapper/109:21:461
7434992220,1cyclictest0-21swapper/109:15:031
743499220,22cyclictest1496-21diskmemload12:36:421
743499220,21cyclictest0-21swapper/111:50:201
743499220,21cyclictest0-21swapper/110:00:531
743499220,21cyclictest0-21swapper/107:49:471
743499220,1cyclictest0-21swapper/112:21:301
743499220,1cyclictest0-21swapper/111:36:101
743499220,1cyclictest0-21swapper/109:37:231
743499220,1cyclictest0-21swapper/108:15:001
7433992222,0cyclictest0-21swapper/012:14:270
7433992222,0cyclictest0-21swapper/010:35:060
7433992222,0cyclictest0-21swapper/010:20:450
7433992221,1cyclictest13678-21ssh11:46:200
7433992221,1cyclictest0-21swapper/011:43:240
7433992221,1cyclictest0-21swapper/010:46:150
7433992221,0cyclictest0-21swapper/008:34:480
7433992220,1cyclictest31861-21apt-get08:00:020
743399220,22cyclictest0-21swapper/010:30:440
743399220,21cyclictest20787-21ssh10:25:080
743399220,21cyclictest13602-21sh09:20:270
743399220,21cyclictest0-21swapper/011:30:370
743399220,21cyclictest0-21swapper/009:56:310
743399220,1cyclictest32169-21ssh12:32:560
743399220,1cyclictest26321-21perf08:55:000
743399220,1cyclictest14324-21awk08:30:010
743399220,1cyclictest0-21swapper/008:50:000
7436992119,1cyclictest4681-21munin-run08:10:003
7436992119,1cyclictest0-21swapper/308:55:003
743699210,20cyclictest25306-21apt-get07:49:473
743699210,0cyclictest10398-21apt-get07:19:483
7435992119,1cyclictest19137-21munin-run08:40:002
743599210,20cyclictest0-21swapper/209:04:462
743599210,20cyclictest0-21swapper/208:24:482
743599210,0cyclictest0-21swapper/208:29:482
743599210,0cyclictest0-21swapper/207:29:472
7434992121,0cyclictest0-21swapper/108:29:481
7434992120,1cyclictest29763-21apt-get09:04:461
7434992120,0cyclictest0-21swapper/107:24:481
743399210,21cyclictest0-21swapper/010:51:310
743399210,20cyclictest0-21swapper/009:09:470
7436992020,0cyclictest12816-21apt-get07:24:473
7436992018,2cyclictest19369-21awk07:35:013
7436992018,1cyclictest28747-21perf09:00:003
7436992018,1cyclictest1510-21perf09:10:013
743699200,20cyclictest0-21swapper/308:00:023
7435992020,0cyclictest22912-21apt-get07:44:472
7435992020,0cyclictest0-21swapper/208:34:482
7435992018,1cyclictest7061-21dump-pmu-power08:15:002
743599200,0cyclictest24554-21apt-get08:54:472
7434992020,0cyclictest0-21swapper/108:19:481
7434992020,0cyclictest0-21swapper/107:29:471
7433992020,0cyclictest0-21swapper/008:39:480
7433992020,0cyclictest0-21swapper/008:24:480
743399200,20cyclictest0-21swapper/007:40:020
743399200,0cyclictest0-21swapper/008:19:480
7436991919,0cyclictest0-21swapper/307:59:473
7436991917,1cyclictest0-21swapper/308:25:013
7435991917,1cyclictest21518-21idleruntime-cro08:45:002
7434991919,0cyclictest17604-21apt-get07:34:471
7433991919,0cyclictest0-21swapper/009:04:460
7436991818,0cyclictest0-21swapper/308:14:473
7436991817,0cyclictest0-21swapper/307:14:473
7436991816,1cyclictest0-21swapper/307:45:013
7435991818,0cyclictest0-21swapper/208:09:482
7435991818,0cyclictest0-21swapper/207:54:482
7435991818,0cyclictest0-21swapper/207:24:482
7435991818,0cyclictest0-21swapper/207:19:472
7435991814,1cyclictest0-21swapper/207:49:472
7434991817,1cyclictest451-21apt-get08:04:471
7434991817,1cyclictest19767-21apt-get08:44:481
7433991818,0cyclictest0-21swapper/008:44:480
7433991818,0cyclictest0-21swapper/007:39:470
7433991818,0cyclictest0-21swapper/007:29:470
7436991717,0cyclictest14957-21apt-get08:34:483
7435991717,0cyclictest0-21swapper/207:34:472
7434991717,0cyclictest0-21swapper/107:59:471
7434991715,1cyclictest26305-21sh08:55:001
7434991715,1cyclictest19103-21cron08:40:001
7434991715,1cyclictest16738-21munin-run08:35:011
7433991717,0cyclictest2897-21apt-get08:09:470
7433991717,0cyclictest0-21swapper/008:14:470
7433991717,0cyclictest0-21swapper/007:19:480
7436991614,1cyclictest9493-21cron08:20:013
7434991614,1cyclictest0-21swapper/107:44:471
7434991614,1cyclictest0-21swapper/107:20:001
743499160,4cyclictest313-21systemd-journal08:50:001
743499160,15cyclictest9768-21latency_hist07:15:001
7433991616,0cyclictest0-21swapper/007:54:480
7433991614,1cyclictest30097-21apt-get07:59:470
7436991515,0cyclictest0-21swapper/307:39:483
7435991515,0cyclictest0-21swapper/207:39:472
7434991515,0cyclictest0-21swapper/108:24:481
7434991515,0cyclictest0-21swapper/108:09:481
743399150,6cyclictest0-21swapper/007:34:470
743699140,14cyclictest0-21swapper/308:37:243
743599140,14cyclictest0-21swapper/208:55:012
743599140,14cyclictest0-21swapper/207:10:212
743599140,0cyclictest0-21swapper/207:55:012
743499140,0cyclictest0-21swapper/108:55:201
7433991414,0cyclictest0-21swapper/007:20:200
7433991414,0cyclictest0-21swapper/007:10:250
743399140,14cyclictest0-21swapper/008:55:120
743399140,0cyclictest0-21swapper/007:45:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional