You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 21:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Aug 17, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
201029423220,18sleep00-21swapper/007:05:280
210888621260,2sleep20-21swapper/211:45:222
212083421080,2sleep30-21swapper/312:20:143
204541521080,3sleep00-21swapper/008:45:230
139099850,52rtkit-daemon0-21swapper/207:09:392
201053127942,14sleep30-21swapper/307:07:293
201061726444,14sleep10-21swapper/107:08:371
20783242410,2sleep30-21swapper/310:20:133
20702042390,4sleep13056-21PK-Backend09:55:401
20784442380,3sleep20-21swapper/210:20:172
20640282290,11sleep013-21ksoftirqd/009:40:170
139099270,4rtkit-daemon1389-21rtkit-daemon07:43:250
139099260,3rtkit-daemon1389-21rtkit-daemon12:16:401
2010862992520,3cyclictest2114971-21apt12:05:131
2010862992518,5cyclictest2064385-21uname09:40:201
139099250,4rtkit-daemon1389-21rtkit-daemon08:59:151
21054952240,3sleep00-21swapper/011:35:210
2010867992413,8cyclictest2084263-21seq10:35:223
2010862992414,8cyclictest2111477-21/usr/sbin/munin11:55:131
2010867992311,10cyclictest2018214-21cron07:30:013
201086799230,21cyclictest3056-21PK-Backend11:35:253
201086799222,5cyclictest2068220-21python309:50:183
2010867992220,1cyclictest0-21swapper/312:06:213
2010867992220,1cyclictest0-21swapper/308:01:033
2010867992220,1cyclictest0-21swapper/307:10:333
2010867992219,2cyclictest3056-21PK-Backend11:46:533
2010867992219,1cyclictest3056-21PK-Backend09:39:383
2010867992215,5cyclictest2042548-21cron08:39:593
201086799220,21cyclictest3056-21PK-Backend11:22:333
201086799220,20cyclictest3056-21PK-Backend11:51:333
201086799220,20cyclictest3056-21PK-Backend08:25:443
201086799220,20cyclictest3056-21PK-Backend08:15:373
2010864992217,3cyclictest2046296-21apt08:50:112
2010864992213,8cyclictest2041650-21load08:35:172
2010862992219,2cyclictest3056-21PK-Backend09:26:411
2010862992214,6cyclictest2117281-21memory12:10:171
201086299220,20cyclictest3056-21PK-Backend10:20:151
201085899221,19cyclictest2104019-21nm-dispatcher11:31:400
201085899221,18cyclictest2114712-21idleruntime-cro12:05:010
139099220,4rtkit-daemon1389-21rtkit-daemon11:21:210
139099220,4rtkit-daemon1389-21rtkit-daemon10:36:560
2010867992119,1cyclictest3056-21PK-Backend12:17:493
2010867992119,1cyclictest3056-21PK-Backend11:44:103
2010867992119,1cyclictest3056-21PK-Backend08:58:093
2010867992119,1cyclictest0-21swapper/311:15:113
2010867992119,1cyclictest0-21swapper/309:31:273
2010867992119,1cyclictest0-21swapper/309:19:323
2010867992119,1cyclictest0-21swapper/309:01:393
2010867992118,2cyclictest3056-21PK-Backend11:26:393
201086799211,7cyclictest2076031-21latency_hist10:15:013
2010867992115,3cyclictest2081218-21cron10:29:593
201086799211,19cyclictest0-21swapper/311:11:053
201086799210,20cyclictest0-21swapper/310:52:453
201086799210,20cyclictest0-21swapper/310:04:263
201086799210,19cyclictest3056-21PK-Backend12:37:433
201086799210,19cyclictest3056-21PK-Backend11:02:533
201086499210,20cyclictest0-21swapper/212:39:002
201086499210,20cyclictest0-21swapper/211:13:492
2010862992119,1cyclictest3056-21PK-Backend10:09:351
2010862992119,1cyclictest3056-21PK-Backend09:19:381
2010862992119,1cyclictest3056-21PK-Backend09:04:441
2010862992119,1cyclictest3056-21PK-Backend07:29:001
2010862992119,1cyclictest0-21swapper/111:54:181
2010862992119,1cyclictest0-21swapper/111:02:551
2010862992119,1cyclictest0-21swapper/108:52:481
2010862992119,1cyclictest0-21swapper/108:41:401
2010862992119,1cyclictest0-21swapper/108:38:091
2010862992119,1cyclictest0-21swapper/108:22:541
2010862992119,1cyclictest0-21swapper/107:12:041
2010862992118,2cyclictest3056-21PK-Backend09:13:581
201086299210,20cyclictest3056-21PK-Backend11:05:371
201086299210,20cyclictest0-21swapper/111:42:481
201086299210,19cyclictest3056-21PK-Backend10:37:461
201086299210,19cyclictest3056-21PK-Backend10:14:131
201086299210,19cyclictest3056-21PK-Backend09:45:481
201086299210,19cyclictest3056-21PK-Backend09:21:481
201086299210,19cyclictest3056-21PK-Backend07:55:571
201086299210,19cyclictest3056-21PK-Backend07:53:471
201086299210,19cyclictest3056-21PK-Backend07:39:081
201086299210,19cyclictest2123785-21sed12:30:001
2010858992119,1cyclictest0-21swapper/012:22:240
2010858992119,1cyclictest0-21swapper/012:16:220
2010858992119,1cyclictest0-21swapper/011:51:550
2010858992119,1cyclictest0-21swapper/011:47:150
2010858992119,1cyclictest0-21swapper/011:07:080
2010858992119,1cyclictest0-21swapper/010:46:450
2010858992119,1cyclictest0-21swapper/009:32:500
139099210,3rtkit-daemon1389-21rtkit-daemon10:32:150
139099210,3rtkit-daemon1389-21rtkit-daemon08:00:170
139099210,3rtkit-daemon1389-21rtkit-daemon07:55:120
2010867992018,1cyclictest3056-21PK-Backend12:04:583
2010867992018,1cyclictest3056-21PK-Backend08:50:323
2010867992018,1cyclictest3056-21PK-Backend08:23:013
2010867992018,1cyclictest0-21swapper/311:06:583
2010867992018,1cyclictest0-21swapper/309:59:463
2010867992018,1cyclictest0-21swapper/309:48:383
2010867992018,1cyclictest0-21swapper/308:09:353
2010867992018,1cyclictest0-21swapper/307:51:313
2010867992018,1cyclictest0-21swapper/307:23:463
2010867992017,2cyclictest3056-21PK-Backend11:34:023
201086799200,1cyclictest3056-21PK-Backend10:55:293
201086799200,1cyclictest3056-21PK-Backend08:45:383
201086799200,19cyclictest0-21swapper/309:23:513
2010864992018,1cyclictest0-21swapper/208:30:182
2010864992018,1cyclictest0-21swapper/208:20:102
2010864992018,1cyclictest0-21swapper/208:17:262
2010864992018,1cyclictest0-21swapper/207:50:362
2010864992016,2cyclictest2062526-21df09:35:132
2010864992012,6cyclictest436-20systemd-journal09:05:012
201086499200,1cyclictest0-21swapper/209:14:042
201086499200,19cyclictest0-21swapper/212:30:142
201086499200,19cyclictest0-21swapper/210:59:022
201086499200,19cyclictest0-21swapper/210:36:372
201086499200,19cyclictest0-21swapper/210:27:052
201086499200,19cyclictest0-21swapper/209:58:402
201086499200,19cyclictest0-21swapper/209:24:522
201086499200,19cyclictest0-21swapper/208:43:562
201086499200,19cyclictest0-21swapper/208:26:122
201086499200,19cyclictest0-21swapper/208:01:322
201086499200,19cyclictest0-21swapper/207:48:262
2010862992018,1cyclictest3056-21PK-Backend10:27:381
2010862992018,1cyclictest0-21swapper/111:34:381
2010862992018,1cyclictest0-21swapper/110:58:491
2010862992018,1cyclictest0-21swapper/110:45:571
2010862992018,1cyclictest0-21swapper/108:46:331
2010862992017,2cyclictest3056-21PK-Backend09:54:471
2010862992014,5cyclictest2101438-21expr11:25:141
2010862992013,5cyclictest436-20systemd-journal12:34:591
2010862992013,5cyclictest2034915-21pluginstate08:15:201
2010862992011,7cyclictest2126517-21python312:35:201
201086299200,1cyclictest3056-21PK-Backend10:01:371
201086299200,1cyclictest3056-21PK-Backend08:05:381
201086299200,19cyclictest0-21swapper/111:46:541
201086299200,19cyclictest0-21swapper/110:50:031
201086299200,19cyclictest0-21swapper/108:33:161
201086299200,19cyclictest0-21swapper/107:19:551
2010858992018,1cyclictest0-21swapper/011:56:350
2010858992018,1cyclictest0-21swapper/011:42:360
2010858992018,1cyclictest0-21swapper/011:26:400
2010858992018,1cyclictest0-21swapper/009:53:460
2010858992018,1cyclictest0-21swapper/008:36:060
2010858992018,1cyclictest0-21swapper/008:30:040
2010858992018,1cyclictest0-21swapper/007:12:240
2010858992013,5cyclictest436-20systemd-journal11:03:410
201085899201,17cyclictest2020352-21tr07:35:120
201085899200,1cyclictest0-21swapper/010:55:170
201085899200,19cyclictest0-21swapper/010:19:360
201085899200,19cyclictest0-21swapper/009:28:590
201085899200,19cyclictest0-21swapper/008:11:390
20185492190,4sleep03056-21PK-Backend07:30:110
2010867991917,1cyclictest3056-21PK-Backend12:32:173
2010867991917,1cyclictest3056-21PK-Backend08:31:113
2010867991917,1cyclictest0-21swapper/310:17:183
2010867991917,1cyclictest0-21swapper/309:07:213
2010867991916,2cyclictest3056-21PK-Backend07:17:513
2010867991912,5cyclictest2020617-21awk07:35:143
201086799191,16cyclictest2085955-21timerandwakeup10:40:243
201086799191,15cyclictest2086696-21apt10:45:133
201086799190,1cyclictest3056-21PK-Backend12:26:003
201086799190,1cyclictest3056-21PK-Backend12:13:433
201086799190,1cyclictest0-21swapper/307:41:293
2010864991917,1cyclictest0-21swapper/212:07:152
2010864991917,1cyclictest0-21swapper/211:39:512
2010864991917,1cyclictest0-21swapper/211:25:182
2010864991917,1cyclictest0-21swapper/210:53:012
2010864991917,1cyclictest0-21swapper/210:32:322
2010864991917,1cyclictest0-21swapper/209:52:242
2010864991917,1cyclictest0-21swapper/209:47:302
2010864991913,5cyclictest34-21ksoftirqd/208:10:112
2010864991913,5cyclictest2097594-21expr11:15:132
201086499190,1cyclictest0-21swapper/212:26:082
201086499190,1cyclictest0-21swapper/212:19:202
201086499190,1cyclictest0-21swapper/212:13:182
201086499190,1cyclictest0-21swapper/211:55:122
201086499190,1cyclictest0-21swapper/211:41:132
201086499190,1cyclictest0-21swapper/211:03:412
201086499190,1cyclictest0-21swapper/210:12:512
201086499190,1cyclictest0-21swapper/209:43:582
201086499190,18cyclictest0-21swapper/212:01:142
201086499190,18cyclictest0-21swapper/211:31:532
201086499190,18cyclictest0-21swapper/210:15:352
201086499190,18cyclictest0-21swapper/207:26:242
201086499190,18cyclictest0-21swapper/207:16:152
2010862991917,1cyclictest3056-21PK-Backend11:13:011
2010862991917,1cyclictest3056-21PK-Backend09:30:481
2010862991917,1cyclictest3056-21PK-Backend09:06:551
2010862991917,1cyclictest0-21swapper/112:21:361
2010862991912,6cyclictest2113943-21ntpq12:00:201
201086299190,1cyclictest3056-21PK-Backend08:12:471
201086299190,1cyclictest3056-21PK-Backend07:45:221
201086299190,1cyclictest3056-21PK-Backend07:22:241
201086299190,1cyclictest0-21swapper/111:37:211
201086299190,18cyclictest0-21swapper/111:21:461
2010858991917,1cyclictest0-21swapper/012:36:020
2010858991917,1cyclictest0-21swapper/008:44:520
2010858991917,1cyclictest0-21swapper/008:25:240
2010858991914,3cyclictest2025206-21sh07:50:000
2010858991913,4cyclictest2117366-21head12:10:180
201085899190,3cyclictest2116438-21munin-run12:10:010
201085899190,1cyclictest0-21swapper/010:40:240
201085899190,1cyclictest0-21swapper/009:36:420
201085899190,1cyclictest0-21swapper/009:21:160
201085899190,1cyclictest0-21swapper/007:53:490
201085899190,18cyclictest2072309-21grep10:05:000
201085899190,18cyclictest0-21swapper/009:48:330
201085899190,18cyclictest0-21swapper/008:54:250
201085899190,18cyclictest0-21swapper/007:18:340
2010867991816,1cyclictest0-21swapper/307:57:123
2010867991813,3cyclictest2032383-21/usr/sbin/munin08:10:133
2010867991811,6cyclictest2073567-21ntp_states10:05:193
2010867991811,5cyclictest2019950-21cron07:35:003
201086799180,4cyclictest2306-21gsd-housekeepin09:10:213
201086499188,8cyclictest2254-21gdbus08:46:362
2010864991816,1cyclictest0-21swapper/211:07:472
2010864991816,1cyclictest0-21swapper/207:30:292
2010864991816,1cyclictest0-21swapper/207:10:072
2010864991811,5cyclictest2099169-21cat11:20:112
2010864991811,5cyclictest2085725-21awk10:40:212
2010862991816,1cyclictest3056-21PK-Backend11:15:451
2010862991816,1cyclictest3056-21PK-Backend10:43:131
2010862991815,2cyclictest3056-21PK-Backend10:31:451
2010858991816,1cyclictest0-21swapper/011:18:430
2010858991816,1cyclictest0-21swapper/010:24:010
2010858991816,1cyclictest0-21swapper/008:19:240
2010858991812,5cyclictest13-21ksoftirqd/012:30:010
2010858991812,4cyclictest2125375-21cron12:34:590
2010858991812,4cyclictest2072984-21cpuspeed_turbos10:05:140
201086799178,7cyclictest436-20systemd-journal10:34:593
201086799172,13cyclictest2058893-21cstates09:25:133
2010867991715,1cyclictest3056-21PK-Backend08:41:323
2010867991715,1cyclictest0-21swapper/307:45:503
2010864991715,1cyclictest0-21swapper/207:57:402
2010864991715,1cyclictest0-21swapper/207:37:192
2010864991712,3cyclictest2070930-21cpuspeed_turbos10:00:132
201086499171,12cyclictest2058685-21apt09:25:132
2010864991710,6cyclictest2055607-21fw_packets09:15:142
2010864991710,6cyclictest1-21systemd09:00:012
2010864991710,5cyclictest2052749-21cat09:05:202
201086299178,7cyclictest2019955-21cron07:35:011
2010862991715,1cyclictest3056-21PK-Backend08:03:411
2010862991715,1cyclictest3056-21PK-Backend07:44:011
2010862991711,4cyclictest2039062-21cron08:29:591
201085899172,11cyclictest2088430-21apt10:50:120
2010858991715,1cyclictest0-21swapper/011:12:560
2010858991715,1cyclictest0-21swapper/010:14:360
2010858991715,1cyclictest0-21swapper/009:55:080
2010858991715,1cyclictest0-21swapper/009:03:570
2010858991715,1cyclictest0-21swapper/008:08:350
2010858991713,3cyclictest13-21ksoftirqd/009:15:020
2010858991713,2cyclictest2048390-21df08:55:120
21118712160,5sleep33056-21PK-Backend11:55:123
201086499169,5cyclictest28650irq/123-ahci[0008:05:222
201086499169,5cyclictest2073546-21ntpq10:05:192
201086499169,5cyclictest2015737-21ntpq07:20:182
201086499167,8cyclictest0-21swapper/209:35:002
2010864991614,1cyclictest0-21swapper/212:20:062
2010864991611,3cyclictest2023670-21latency_hist07:45:002
201086499160,1cyclictest0-21swapper/211:50:332
201085899169,5cyclictest2055926-21awk09:15:190
201085899169,5cyclictest2052413-21grep09:05:160
2010858991614,1cyclictest0-21swapper/010:25:570
2010858991610,4cyclictest2036867-21cat08:20:230
139099160,13rtkit-daemon13-21ksoftirqd/007:24:010
139099160,13rtkit-daemon0-21swapper/109:35:481
2010867991512,2cyclictest3056-21PK-Backend09:40:273
2010864991511,3cyclictest2087542-21rt-features10:45:212
2010862991513,1cyclictest3056-21PK-Backend10:16:571
201085899131,9cyclictest2017619-21python307:25:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional