You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Mon May 18, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100058421030,4sleep33056-21PK-Backend11:40:143
1390991020,86rtkit-daemon0-21swapper/207:08:552
10094132970,2sleep20-21swapper/212:05:202
139099920,75rtkit-daemon0-21swapper/307:05:273
90369527641,29sleep00-21swapper/007:06:240
9587752650,4sleep33056-21PK-Backend09:40:213
9764052640,4sleep33056-21PK-Backend10:30:223
90249626344,13sleep10-21swapper/107:05:041
9786762510,3sleep3978675-21apt10:40:003
139099450,3rtkit-daemon3056-21PK-Backend12:35:013
10199572390,2sleep10-21swapper/112:35:231
9298912340,5sleep10-21swapper/108:20:111
9656842280,3sleep23056-21PK-Backend10:00:202
9559242280,4sleep0161rcuc/009:35:010
90411599280,9cyclictest0-21swapper/011:39:590
90412899250,12cyclictest42-21ksoftirqd/309:35:213
904123992520,4cyclictest948787-21rm09:15:012
90411599250,16cyclictest0-21swapper/012:05:120
10124332250,10sleep013-21ksoftirqd/012:15:130
9690102240,7sleep342-21ksoftirqd/310:10:173
904128992421,2cyclictest3056-21PK-Backend08:20:193
90411599241,6cyclictest911738-21ls07:30:000
904115992411,12cyclictest956371-21cstates09:35:140
90411599240,15cyclictest0-21swapper/011:10:110
90412899230,21cyclictest3056-21PK-Backend08:00:323
904123992316,5cyclictest946953-21cron09:09:592
904123992312,9cyclictest962851-21unin-run09:55:002
90411599230,9cyclictest907403-21python307:15:200
90411599230,8cyclictest975244-21systemd-run10:30:000
90411599230,21cyclictest1004197-21awk11:50:180
90411599230,14cyclictest0-21swapper/011:20:110
904128992210,2cyclictest141rcu_preempt08:41:233
90412899220,20cyclictest3056-21PK-Backend07:39:113
904123992220,1cyclictest0-21swapper/211:59:332
904123992220,1cyclictest0-21swapper/210:41:002
90412399221,2cyclictest0-21swapper/209:58:482
90412399220,21cyclictest0-21swapper/212:15:152
90412399220,21cyclictest0-21swapper/207:35:442
904118992214,6cyclictest988527-21cut11:05:181
904115992220,1cyclictest0-21swapper/011:19:150
904115992220,1cyclictest0-21swapper/010:53:130
904115992215,5cyclictest913853-21rm07:35:010
90411599220,9cyclictest933375-21apt08:30:120
90411599220,9cyclictest0-21swapper/010:40:120
90411599220,20cyclictest0-21swapper/012:00:590
90411599220,13cyclictest0-21swapper/012:13:420
139099220,2rtkit-daemon3056-21PK-Backend11:18:483
139099220,16rtkit-daemon3056-21PK-Backend12:29:273
139099220,15rtkit-daemon3056-21PK-Backend08:52:133
139099220,15rtkit-daemon3056-21PK-Backend07:52:393
139099220,15rtkit-daemon3056-21PK-Backend07:47:393
139099220,14rtkit-daemon3056-21PK-Backend10:08:342
9428982210,5sleep20-21swapper/208:55:212
9179152210,11chrt34-21ksoftirqd/207:45:162
904128992119,1cyclictest3056-21PK-Backend11:38:263
904128992119,1cyclictest3056-21PK-Backend09:29:283
904128992119,1cyclictest3056-21PK-Backend08:58:393
904128992119,1cyclictest0-21swapper/311:05:213
904128992118,2cyclictest3056-21PK-Backend10:20:113
904128992118,2cyclictest3056-21PK-Backend07:26:193
90412899210,20cyclictest3056-21PK-Backend10:54:183
90412899210,19cyclictest3056-21PK-Backend09:20:563
90412899210,19cyclictest3056-21PK-Backend07:34:383
904123992119,1cyclictest0-21swapper/212:12:582
904123992119,1cyclictest0-21swapper/211:50:552
904123992119,1cyclictest0-21swapper/211:46:362
904123992119,1cyclictest0-21swapper/211:01:212
904123992119,1cyclictest0-21swapper/210:34:232
904123992119,1cyclictest0-21swapper/209:49:362
904123992119,1cyclictest0-21swapper/208:37:292
904123992119,1cyclictest0-21swapper/207:43:562
90412399210,20cyclictest0-21swapper/212:01:512
90412399210,20cyclictest0-21swapper/210:46:202
90412399210,20cyclictest0-21swapper/210:46:202
90412399210,20cyclictest0-21swapper/210:21:262
90412399210,20cyclictest0-21swapper/209:38:332
90412399210,20cyclictest0-21swapper/209:26:312
90412399210,1cyclictest0-21swapper/212:35:512
90412399210,1cyclictest0-21swapper/209:18:192
90411899210,20cyclictest0-21swapper/110:35:191
904115992119,1cyclictest0-21swapper/010:13:590
904115992119,1cyclictest0-21swapper/008:49:420
904115992119,1cyclictest0-21swapper/007:22:020
90411599210,9cyclictest0-21swapper/008:59:590
90411599210,8cyclictest0-21swapper/011:34:090
90411599210,8cyclictest0-21swapper/008:40:120
90411599210,5cyclictest918982-21turbostat07:50:000
90411599210,20cyclictest0-21swapper/011:59:450
90411599210,20cyclictest0-21swapper/011:40:370
90411599210,20cyclictest0-21swapper/011:08:470
90411599210,20cyclictest0-21swapper/008:13:200
90411599210,19cyclictest0-21swapper/011:02:400
90411599210,19cyclictest0-21swapper/009:15:310
139099210,15rtkit-daemon3056-21PK-Backend12:31:423
139099210,15rtkit-daemon3056-21PK-Backend11:56:153
139099210,15rtkit-daemon3056-21PK-Backend11:10:463
139099210,15rtkit-daemon3056-21PK-Backend10:42:243
139099210,15rtkit-daemon0-21swapper/211:41:312
139099210,14rtkit-daemon3056-21PK-Backend10:26:593
904128992018,1cyclictest3056-21PK-Backend07:22:333
904128992018,1cyclictest0-21swapper/309:30:303
904128992018,1cyclictest0-21swapper/309:16:173
904128992017,2cyclictest3056-21PK-Backend10:15:053
904128992017,2cyclictest3056-21PK-Backend08:36:093
904128992012,6cyclictest1003864-21cat11:50:153
90412899200,1cyclictest3056-21PK-Backend11:30:153
90412899200,19cyclictest3056-21PK-Backend09:59:563
904123992018,1cyclictest0-21swapper/211:05:402
904123992018,1cyclictest0-21swapper/208:47:372
904123992018,1cyclictest0-21swapper/208:08:362
904123992018,1cyclictest0-21swapper/207:51:332
904123992018,1cyclictest0-21swapper/207:16:522
90412399200,1cyclictest0-21swapper/211:35:422
90412399200,1cyclictest0-21swapper/208:14:592
90412399200,19cyclictest0-21swapper/211:25:472
90412399200,19cyclictest0-21swapper/209:41:382
90412399200,19cyclictest0-21swapper/208:44:472
90412399200,19cyclictest0-21swapper/208:20:472
90412399200,19cyclictest0-21swapper/208:04:372
90412399200,19cyclictest0-21swapper/207:22:132
904118992018,1cyclictest0-21swapper/112:33:011
904118992018,1cyclictest0-21swapper/110:15:121
90411899201,6cyclictest1008422-21turbostat12:05:001
904118992014,5cyclictest1389-21rtkit-daemon08:13:391
904118992013,6cyclictest931692-21awk08:25:121
904118992013,5cyclictest966276-21cron10:05:001
904118992013,5cyclictest925990-21sshd08:07:551
904118992012,6cyclictest26-21ksoftirqd/110:55:261
90411899200,1cyclictest0-21swapper/112:07:201
90411899200,1cyclictest0-21swapper/108:59:151
90411899200,1cyclictest0-21swapper/108:44:401
90411899200,1cyclictest0-21swapper/107:13:561
90411899200,19cyclictest0-21swapper/112:26:391
90411899200,19cyclictest0-21swapper/111:42:391
90411899200,19cyclictest0-21swapper/111:30:561
90411899200,19cyclictest0-21swapper/110:51:091
90411899200,19cyclictest0-21swapper/110:31:011
90411899200,19cyclictest0-21swapper/110:11:541
90411899200,19cyclictest0-21swapper/109:56:201
90411899200,19cyclictest0-21swapper/109:37:331
90411899200,19cyclictest0-21swapper/109:22:401
90411899200,19cyclictest0-21swapper/108:53:471
90411899200,19cyclictest0-21swapper/107:55:541
90411899200,19cyclictest0-21swapper/107:51:211
90411899200,19cyclictest0-21swapper/107:28:371
90411599206,12cyclictest948730-21unin-run09:15:010
904115992018,1cyclictest0-21swapper/012:28:570
904115992018,1cyclictest0-21swapper/010:36:230
904115992018,1cyclictest0-21swapper/009:27:210
904115992018,1cyclictest0-21swapper/007:57:510
904115992018,1cyclictest0-21swapper/007:53:180
904115992018,1cyclictest0-21swapper/007:43:330
904115992017,2cyclictest1095-21runrttasks08:24:510
90411599200,8cyclictest0-21swapper/008:35:130
90411599200,6cyclictest961359-21apt09:50:110
90411599200,19cyclictest0-21swapper/010:46:500
90411599200,19cyclictest0-21swapper/010:46:500
90411599200,19cyclictest0-21swapper/010:31:030
90411599200,19cyclictest0-21swapper/009:48:090
90411599200,19cyclictest0-21swapper/009:42:160
90411599200,19cyclictest0-21swapper/009:20:250
90411599200,19cyclictest0-21swapper/008:53:210
90411599200,19cyclictest0-21swapper/008:29:430
90411599200,19cyclictest0-21swapper/008:09:210
90411599200,19cyclictest0-21swapper/007:10:200
139099200,14rtkit-daemon3056-21PK-Backend11:45:483
139099200,14rtkit-daemon3056-21PK-Backend11:23:463
139099200,14rtkit-daemon3056-21PK-Backend10:06:283
139099200,14rtkit-daemon3056-21PK-Backend10:01:473
139099200,14rtkit-daemon3056-21PK-Backend08:25:303
139099200,14rtkit-daemon0-21swapper/309:50:313
139099200,14rtkit-daemon0-21swapper/208:51:352
904128991917,1cyclictest3056-21PK-Backend08:48:123
904128991916,2cyclictest3056-21PK-Backend09:48:213
904128991910,7cyclictest42-21ksoftirqd/307:10:203
90412899190,1cyclictest3056-21PK-Backend12:21:253
90412899190,1cyclictest3056-21PK-Backend12:18:213
90412899190,1cyclictest3056-21PK-Backend12:11:103
90412899190,1cyclictest3056-21PK-Backend10:45:193
90412899190,1cyclictest3056-21PK-Backend10:45:193
90412899190,1cyclictest3056-21PK-Backend08:17:573
90412899190,1cyclictest3056-21PK-Backend07:16:403
90412899190,1cyclictest0-21swapper/309:00:293
90412899190,18cyclictest3056-21PK-Backend07:59:453
904123991917,1cyclictest3056-21PK-Backend12:30:302
904123991917,1cyclictest3056-21PK-Backend09:30:352
904123991917,1cyclictest3056-21PK-Backend07:25:242
904123991917,1cyclictest0-21swapper/212:26:112
904123991917,1cyclictest0-21swapper/212:22:522
904123991917,1cyclictest0-21swapper/210:36:392
904123991917,1cyclictest0-21swapper/210:14:492
904123991917,1cyclictest0-21swapper/208:29:122
90412399190,1cyclictest0-21swapper/209:22:252
90412399190,18cyclictest0-21swapper/211:23:302
90411899198,9cyclictest0-21swapper/109:00:131
904118991917,1cyclictest0-21swapper/111:16:101
904118991917,1cyclictest0-21swapper/111:00:341
904118991917,1cyclictest0-21swapper/110:24:391
904118991917,1cyclictest0-21swapper/109:50:251
904118991917,1cyclictest0-21swapper/109:45:311
904118991917,1cyclictest0-21swapper/109:32:411
904118991917,1cyclictest0-21swapper/109:09:481
904118991917,1cyclictest0-21swapper/108:30:221
904118991917,1cyclictest0-21swapper/107:45:321
904118991917,1cyclictest0-21swapper/107:35:461
904118991917,1cyclictest0-21swapper/107:22:281
904118991911,6cyclictest979290-21expr10:40:121
90411899190,1cyclictest0-21swapper/112:21:181
90411899190,1cyclictest0-21swapper/111:27:391
90411899190,1cyclictest0-21swapper/109:29:361
90411899190,1cyclictest0-21swapper/108:36:371
90411899190,18cyclictest0-21swapper/111:23:191
90411899190,18cyclictest0-21swapper/109:16:441
90411899190,18cyclictest0-21swapper/108:02:031
90411899190,18cyclictest0-21swapper/107:31:001
904115991917,1cyclictest0-21swapper/011:29:570
904115991917,1cyclictest0-21swapper/010:23:380
904115991917,1cyclictest0-21swapper/010:18:180
904115991913,5cyclictest929017-21rt-features08:15:190
904115991912,5cyclictest946411-21switchtime09:05:230
904115991911,6cyclictest1020164-21awk12:35:230
904115991910,6cyclictest966272-21cron10:05:000
904115991910,6cyclictest2270-21gdbus08:00:030
90411599190,7cyclictest9153632cmp07:38:350
139099190,13rtkit-daemon3056-21PK-Backend11:02:393
9856912180,3sleep33056-21PK-Backend11:00:013
904128991810,6cyclictest934083-21awk08:30:193
904123991816,1cyclictest0-21swapper/210:17:072
904123991816,1cyclictest0-21swapper/207:57:422
904123991816,1cyclictest0-21swapper/207:14:292
904123991815,2cyclictest3056-21PK-Backend09:00:342
90412399180,1cyclictest0-21swapper/210:50:392
904118991816,1cyclictest0-21swapper/109:40:371
904118991811,6cyclictest1013830-21sed12:20:021
904118991810,6cyclictest998612-21expr11:35:131
904115991816,1cyclictest0-21swapper/009:01:400
90411599180,6cyclictest0-21swapper/009:55:200
90411599180,5cyclictest0-21swapper/010:05:130
904128991715,1cyclictest3056-21PK-Backend11:25:083
904128991715,1cyclictest3056-21PK-Backend09:11:383
904128991715,1cyclictest3056-21PK-Backend08:12:373
904128991714,2cyclictest3056-21PK-Backend07:41:343
904123991715,1cyclictest0-21swapper/211:31:212
904123991715,1cyclictest0-21swapper/207:30:102
904123991710,5cyclictest985605-21cron10:59:592
904123991710,5cyclictest928688-21grep08:15:162
90411899179,6cyclictest1005111-21sed11:55:011
904118991715,1cyclictest0-21swapper/111:11:021
904118991715,1cyclictest0-21swapper/108:47:311
904118991713,3cyclictest1010497-21cpuspeed12:10:131
904118991711,5cyclictest1006200-21sed11:55:211
904118991710,5cyclictest1002493-21ntpq11:45:191
904115991715,1cyclictest0-21swapper/012:34:180
904115991710,5cyclictest436-20systemd-journal11:46:540
904128991614,1cyclictest3056-21PK-Backend12:07:043
904128991614,1cyclictest3056-21PK-Backend09:06:583
904128991613,2cyclictest3056-21PK-Backend08:08:043
90412399169,5cyclictest974234-21cut10:25:162
904123991614,1cyclictest3056-21PK-Backend08:30:122
904123991614,1cyclictest0-21swapper/211:13:042
90411899169,5cyclictest974480-21cat10:25:191
904118991614,1cyclictest0-21swapper/109:12:531
904118991612,3cyclictest981716-21timerwakeupswit10:45:231
904118991612,3cyclictest981716-21timerwakeupswit10:45:221
904118991610,5cyclictest966970-21ls10:05:171
904118991610,5cyclictest928310-21expr08:15:121
904115991611,4cyclictest1014114-21cstates12:20:160
904115991610,4cyclictest984781-21sed10:55:220
139099160,4rtkit-daemon3056-21PK-Backend12:00:323
904123991511,3cyclictest991318-21/usr/sbin/munin11:15:172
904118991513,1cyclictest0-21swapper/107:17:551
904118991512,2cyclictest915761-21/usr/sbin/munin07:40:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional