You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 21:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Jun 19, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223054027839,14sleep30-21swapper/307:09:213
223033227839,13sleep00-21swapper/007:06:400
222943327144,19sleep20-21swapper/207:05:142
223053826242,14sleep10-21swapper/107:09:201
23074912480,2sleep23056-21PK-Backend10:45:202
23456592460,3sleep13056-21PK-Backend12:35:181
23280392450,3sleep03056-21PK-Backend11:45:170
23253332440,4sleep02325334-21munin-run11:40:000
23259462330,3sleep00-21swapper/011:40:120
223076099286,20cyclictest0-21swapper/208:42:142
23447592260,4sleep30-21swapper/312:35:003
23447592260,4sleep30-21swapper/312:35:003
2230765992413,9cyclictest2346441-21unin-run12:40:003
223075599240,21cyclictest2156-21gnome-shell08:59:090
223076599230,21cyclictest2336517-21cstates12:10:123
2230760992316,5cyclictest2292366-21cron10:05:012
2230757992320,2cyclictest3056-21PK-Backend10:18:171
139099230,4rtkit-daemon1389-21rtkit-daemon10:55:060
2230765992220,1cyclictest0-21swapper/311:35:583
2230765992220,1cyclictest0-21swapper/311:08:343
2230765992220,1cyclictest0-21swapper/310:55:033
2230765992220,1cyclictest0-21swapper/309:27:563
2230765992219,2cyclictest3056-21PK-Backend10:39:003
2230765992219,2cyclictest3056-21PK-Backend07:36:023
223076599221,4cyclictest0-21swapper/308:15:113
2230765992214,6cyclictest2323203-21users11:30:213
2230765992213,7cyclictest436-20systemd-journal11:45:003
223076599220,20cyclictest3056-21PK-Backend07:11:353
223076099223,6cyclictest2277461-21grep09:20:192
2230760992213,7cyclictest436-20systemd-journal08:05:012
223076099220,21cyclictest0-21swapper/210:41:042
2230757992220,1cyclictest0-21swapper/108:46:581
2230757992219,2cyclictest3056-21PK-Backend11:52:051
2230757992219,2cyclictest3056-21PK-Backend07:59:051
2230757992215,5cyclictest2283486-21systemd-run09:40:011
223075799220,21cyclictest3056-21PK-Backend08:27:511
223075799220,21cyclictest0-21swapper/109:46:191
223075599221,2cyclictest1788620-21WebKitWebProces09:01:250
139099220,15rtkit-daemon0-21swapper/207:43:012
23131942210,3sleep12313191-21awk11:05:001
2230765992119,1cyclictest3056-21PK-Backend10:40:563
2230765992119,1cyclictest0-21swapper/311:00:503
2230765992119,1cyclictest0-21swapper/310:47:183
2230765992119,1cyclictest0-21swapper/310:34:003
2230765992119,1cyclictest0-21swapper/310:23:253
2230765992119,1cyclictest0-21swapper/309:40:063
2230765992119,1cyclictest0-21swapper/309:22:563
2230765992119,1cyclictest0-21swapper/308:23:423
2230765992119,1cyclictest0-21swapper/308:13:133
2230765992119,1cyclictest0-21swapper/307:55:423
2230765992118,2cyclictest3056-21PK-Backend09:16:143
2230765992118,2cyclictest3056-21PK-Backend07:18:123
2230765992118,2cyclictest0-21swapper/312:07:283
223076599210,2cyclictest0-21swapper/312:29:333
223076599210,20cyclictest3056-21PK-Backend10:03:383
2230760992113,6cyclictest2260808-21sshd08:33:412
223076099210,20cyclictest0-21swapper/209:56:562
2230757992119,1cyclictest3056-21PK-Backend08:58:541
2230757992119,1cyclictest3056-21PK-Backend08:12:241
2230757992119,1cyclictest0-21swapper/109:52:141
2230757992119,1cyclictest0-21swapper/107:37:371
2230757992118,2cyclictest3056-21PK-Backend11:11:021
2230757992118,2cyclictest3056-21PK-Backend08:18:111
2230757992115,4cyclictest2285191-21turbostat09:45:001
223075799210,20cyclictest0-21swapper/108:42:041
223075799210,19cyclictest3056-21PK-Backend12:03:001
223075799210,19cyclictest3056-21PK-Backend11:36:511
223075799210,19cyclictest3056-21PK-Backend11:28:401
223075799210,19cyclictest3056-21PK-Backend10:30:331
223075799210,19cyclictest0-21swapper/107:45:201
2230755992115,5cyclictest883-21dbus-daemon07:30:000
2230755992114,5cyclictest883-21dbus-daemon07:38:030
223075599210,2cyclictest2337992-21apt12:15:110
223075599210,20cyclictest0-21swapper/009:55:400
223075599210,20cyclictest0-21swapper/009:05:240
223075599210,19cyclictest3056-21PK-Backend12:30:190
223075599210,19cyclictest3056-21PK-Backend12:30:190
139099210,15rtkit-daemon0-21swapper/210:11:002
139099210,15rtkit-daemon0-21swapper/209:50:212
139099210,14rtkit-daemon0-21swapper/208:10:342
223076599206,13cyclictest3056-21PK-Backend09:36:083
2230765992018,1cyclictest3056-21PK-Backend10:06:423
2230765992018,1cyclictest3056-21PK-Backend09:54:403
2230765992018,1cyclictest3056-21PK-Backend09:48:443
2230765992018,1cyclictest3056-21PK-Backend09:12:013
2230765992018,1cyclictest3056-21PK-Backend09:08:223
2230765992018,1cyclictest3056-21PK-Backend07:30:073
2230765992018,1cyclictest3056-21PK-Backend07:20:563
2230765992018,1cyclictest0-21swapper/310:25:563
2230765992012,6cyclictest2333154-21df12:00:123
223076599201,17cyclictest2281122-21python309:30:203
223076599200,19cyclictest3056-21PK-Backend07:29:193
223076599200,19cyclictest0-21swapper/311:28:213
223076599200,19cyclictest0-21swapper/311:20:253
223076599200,19cyclictest0-21swapper/311:15:443
223076599200,19cyclictest0-21swapper/310:15:553
223076599200,18cyclictest3056-21PK-Backend08:46:063
223076099202,13cyclictest2309991-21apt10:55:112
2230760992018,1cyclictest0-21swapper/211:35:522
2230760992018,1cyclictest0-21swapper/211:26:192
2230760992018,1cyclictest0-21swapper/211:16:262
2230760992018,1cyclictest0-21swapper/210:26:512
2230760992018,1cyclictest0-21swapper/209:10:192
2230760992014,5cyclictest34-21ksoftirqd/212:10:112
2230760992012,6cyclictest2333754-21sed12:00:232
2230760992012,6cyclictest2332251-21cron12:00:002
223076099200,1cyclictest0-21swapper/211:05:242
223076099200,1cyclictest0-21swapper/208:28:502
223076099200,1cyclictest0-21swapper/207:11:022
223076099200,19cyclictest3056-21PK-Backend10:05:212
223076099200,19cyclictest0-21swapper/212:17:162
223076099200,19cyclictest0-21swapper/211:48:232
223076099200,19cyclictest0-21swapper/211:23:012
223076099200,19cyclictest0-21swapper/210:24:552
223076099200,19cyclictest0-21swapper/209:19:182
223076099200,19cyclictest0-21swapper/207:53:402
223076099200,19cyclictest0-21swapper/207:48:062
223076099200,18cyclictest0-21swapper/209:05:322
223075799203,11cyclictest2306524-21apt10:45:111
2230757992018,1cyclictest3056-21PK-Backend10:56:221
2230757992018,1cyclictest3056-21PK-Backend10:54:261
2230757992018,1cyclictest3056-21PK-Backend10:27:291
2230757992018,1cyclictest3056-21PK-Backend10:11:351
2230757992018,1cyclictest3056-21PK-Backend08:35:161
2230757992018,1cyclictest3056-21PK-Backend08:02:571
2230757992018,1cyclictest0-21swapper/109:13:481
2230757992018,1cyclictest0-21swapper/107:43:441
2230757992018,1cyclictest0-21swapper/107:30:531
2230757992010,7cyclictest2234250-21sshd07:15:301
223075799200,1cyclictest0-21swapper/109:05:241
223075799200,1cyclictest0-21swapper/107:50:061
223075799200,19cyclictest3056-21PK-Backend11:16:501
223075799200,19cyclictest3056-21PK-Backend11:07:101
223075799200,19cyclictest0-21swapper/110:36:421
223075799200,19cyclictest0-21swapper/107:25:461
2230755992018,1cyclictest0-21swapper/011:11:100
2230755992018,1cyclictest0-21swapper/009:12:280
2230755992016,3cyclictest0-21swapper/007:10:200
2230755992015,3cyclictest2243336-21dump-pmu-power07:45:000
2230755992013,5cyclictest2341418-21sed12:25:010
2230755992013,5cyclictest2288661-21apt-get09:55:000
2230755992012,6cyclictest2305211-21cat10:40:150
223075599200,1cyclictest0-21swapper/009:20:520
223075599200,19cyclictest0-21swapper/012:10:320
223075599200,19cyclictest0-21swapper/011:56:120
223075599200,19cyclictest0-21swapper/011:54:510
223075599200,19cyclictest0-21swapper/010:54:420
223075599200,19cyclictest0-21swapper/010:17:370
223075599200,19cyclictest0-21swapper/009:27:210
223075599200,19cyclictest0-21swapper/008:50:570
223075599200,19cyclictest0-21swapper/008:04:270
223075599200,19cyclictest0-21swapper/007:47:110
139099200,3rtkit-daemon0-21swapper/209:39:372
139099200,14rtkit-daemon0-21swapper/209:47:242
139099200,14rtkit-daemon0-21swapper/208:50:162
139099200,14rtkit-daemon0-21swapper/208:47:342
139099200,14rtkit-daemon0-21swapper/208:18:452
2230765991917,1cyclictest3056-21PK-Backend07:41:233
2230765991917,1cyclictest0-21swapper/311:59:053
2230765991917,1cyclictest0-21swapper/310:51:103
2230765991917,1cyclictest0-21swapper/309:04:443
2230765991917,1cyclictest0-21swapper/308:59:573
2230765991916,2cyclictest3056-21PK-Backend09:58:523
2230765991915,3cyclictest2330445-21chrt11:54:103
223076599191,16cyclictest2258589-21python308:25:203
223076599190,1cyclictest3056-21PK-Backend12:15:403
223076599190,1cyclictest0-21swapper/311:12:263
223076599190,1cyclictest0-21swapper/308:03:333
223076599190,18cyclictest0-21swapper/308:05:293
2230760991917,1cyclictest0-21swapper/212:26:152
2230760991917,1cyclictest0-21swapper/211:33:442
2230760991917,1cyclictest0-21swapper/210:17:382
2230760991917,1cyclictest0-21swapper/209:27:232
2230760991917,1cyclictest0-21swapper/208:37:342
2230760991917,1cyclictest0-21swapper/208:06:592
2230760991917,1cyclictest0-21swapper/207:37:252
2230760991917,1cyclictest0-21swapper/207:31:312
2230760991916,2cyclictest0-21swapper/207:16:152
2230760991915,2cyclictest1095-21runrttasks08:21:352
2230760991914,3cyclictest978-21snmpd07:23:082
2230760991914,3cyclictest2303597-21latency10:35:152
2230760991913,5cyclictest2325773-21expr11:40:112
2230760991912,5cyclictest883-21dbus-daemon11:55:002
223076099190,1cyclictest0-21swapper/212:21:222
223076099190,1cyclictest0-21swapper/210:53:482
223076099190,1cyclictest0-21swapper/209:43:112
223076099190,1cyclictest0-21swapper/207:28:332
223076099190,18cyclictest0-21swapper/210:33:002
223075799197,8cyclictest26-21ksoftirqd/109:55:031
2230757991917,1cyclictest3056-21PK-Backend12:08:281
2230757991917,1cyclictest3056-21PK-Backend10:24:251
2230757991917,1cyclictest3056-21PK-Backend09:23:351
2230757991917,1cyclictest3056-21PK-Backend08:32:311
2230757991917,1cyclictest3056-21PK-Backend08:05:281
2230757991917,1cyclictest0-21swapper/110:41:091
2230757991917,1cyclictest0-21swapper/110:08:301
2230757991913,4cyclictest2276527-21sh09:20:001
223075799190,1cyclictest3056-21PK-Backend12:23:291
223075799190,1cyclictest3056-21PK-Backend11:57:331
223075799190,1cyclictest3056-21PK-Backend11:31:581
223075799190,1cyclictest3056-21PK-Backend08:24:341
223075799190,1cyclictest0-21swapper/107:22:151
223075799190,18cyclictest3056-21PK-Backend12:19:231
2230755991917,1cyclictest0-21swapper/011:08:400
2230755991917,1cyclictest0-21swapper/009:33:500
2230755991917,1cyclictest0-21swapper/009:17:130
2230755991917,1cyclictest0-21swapper/008:20:560
2230755991917,1cyclictest0-21swapper/008:18:270
2230755991914,4cyclictest2156-21gnome-shell08:44:100
2230755991912,5cyclictest2298863-21ls10:20:230
223075599190,1cyclictest3056-21PK-Backend10:46:160
223075599190,1cyclictest0-21swapper/011:22:530
223075599190,1cyclictest0-21swapper/010:25:140
223075599190,1cyclictest0-21swapper/007:20:470
223075599190,18cyclictest0-21swapper/012:25:390
223075599190,18cyclictest0-21swapper/011:01:230
223075599190,18cyclictest0-21swapper/007:50:220
223075599190,18cyclictest0-21swapper/007:32:430
139099190,13rtkit-daemon0-21swapper/308:34:303
2230765991816,1cyclictest3056-21PK-Backend08:40:373
2230765991811,5cyclictest42-21ksoftirqd/308:35:123
2230765991811,5cyclictest2340717-21cat12:20:213
223076599180,4cyclictest2295176-21wc10:10:203
2230760991816,1cyclictest0-21swapper/211:03:292
2230760991812,5cyclictest2315164-21find11:10:102
2230760991810,6cyclictest2269864-21dpkg09:00:122
2230757991816,1cyclictest3056-21PK-Backend11:21:301
2230757991816,1cyclictest0-21swapper/110:00:391
2230757991815,2cyclictest0-21swapper/111:40:241
2230757991812,3cyclictest2328792-21dump-pmu-power11:50:001
2230757991811,5cyclictest2337723-21ls12:15:001
223075799180,1cyclictest3056-21PK-Backend09:26:391
2230755991816,1cyclictest0-21swapper/010:38:110
2230755991816,1cyclictest0-21swapper/008:31:310
2230755991812,4cyclictest436-20systemd-journal08:37:310
2230755991811,5cyclictest2247485-21expr07:55:110
22808782170,3sleep13056-21PK-Backend09:30:181
2230765991712,3cyclictest2328335-21timerwakeupswit11:45:213
2230760991715,1cyclictest0-21swapper/209:31:482
2230760991715,1cyclictest0-21swapper/207:59:292
2230760991713,3cyclictest978-21snmpd12:36:512
2230757991715,1cyclictest3056-21PK-Backend12:32:411
2230757991715,1cyclictest3056-21PK-Backend12:32:411
2230757991715,1cyclictest3056-21PK-Backend12:29:101
2230755991715,1cyclictest0-21swapper/009:36:200
2230755991712,4cyclictest2334247-21cron12:05:000
2230755991711,4cyclictest2232926-21uptime07:15:030
2230755991710,5cyclictest2290926-21grep10:00:110
2230765991614,1cyclictest3056-21PK-Backend08:51:473
2230765991614,1cyclictest3056-21PK-Backend07:54:563
2230765991611,3cyclictest1095-21runrttasks07:45:153
2230760991614,1cyclictest0-21swapper/212:30:342
2230760991614,1cyclictest0-21swapper/212:30:342
2230757991611,3cyclictest2232392-21sh07:15:001
223075599169,5cyclictest2294374-21cat10:10:110
2230755991614,1cyclictest0-21swapper/008:06:570
2230755991612,3cyclictest2284670-21timerandwakeup09:40:230
2230755991611,3cyclictest2265271-21missed_timers08:45:180
2230755991610,5cyclictest2293545-21sed10:05:210
2230755991610,4cyclictest2334699-21cut12:05:140
2230755991610,4cyclictest2301820-21sed10:30:160
223075599160,5cyclictest0-21swapper/011:30:120
223076099151,10cyclictest2334527-21apt12:05:142
223075799159,4cyclictest0-21swapper/108:50:221
223075599158,5cyclictest2286027-21cat09:45:170
2230755991513,1cyclictest0-21swapper/011:27:190
2230755991511,3cyclictest2317044-21cpuspeed_turbos11:15:130
223076099148,5cyclictest2268315-21grep08:55:132
2230757991412,1cyclictest3056-21PK-Backend09:04:501
2230755991412,1cyclictest0-21swapper/012:36:200
2230755991412,1cyclictest0-21swapper/008:25:560
2230755991412,1cyclictest0-21swapper/008:10:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional