You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 22:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Mar 20, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114987221330,9sleep126-21ksoftirqd/111:30:181
112105121060,2sleep20-21swapper/210:10:002
139099800,55rtkit-daemon0-21swapper/207:05:192
105614427740,14sleep00-21swapper/007:05:380
105503827644,22sleep30-21swapper/307:05:123
105632726344,14sleep10-21swapper/107:08:001
11454312610,3sleep13056-21PK-Backend11:20:011
11460132530,3sleep20-21swapper/211:20:142
11019382470,2sleep10-21swapper/109:15:131
11391272330,2sleep30-21swapper/311:00:143
11218482320,4sleep00-21swapper/010:10:190
139099270,4rtkit-daemon1389-21rtkit-daemon08:32:502
139099250,4rtkit-daemon1389-21rtkit-daemon09:54:553
139099250,4rtkit-daemon1389-21rtkit-daemon07:55:593
139099240,3rtkit-daemon1389-21rtkit-daemon11:15:023
105667499243,6cyclictest13-21ksoftirqd/009:45:010
105667499241,6cyclictest1072698-21find07:50:190
1056674992415,7cyclictest1113936-21basename09:50:010
139099230,20rtkit-daemon1317-21systemd10:50:423
1056685992312,9cyclictest978-21snmpd09:57:373
105667499234,6cyclictest13-21ksoftirqd/008:58:470
105667499230,21cyclictest1105530-21memory09:25:160
1056685992214,6cyclictest1-21systemd11:24:593
105668599220,20cyclictest3056-21PK-Backend11:55:143
1056679992220,1cyclictest0-21swapper/210:39:232
1056679992220,1cyclictest0-21swapper/210:17:272
1056678992220,1cyclictest3056-21PK-Backend11:22:461
1056678992220,1cyclictest3056-21PK-Backend10:26:491
105667499226,6cyclictest13-21ksoftirqd/012:30:000
1056674992220,1cyclictest0-21swapper/012:19:150
1056674992220,1cyclictest0-21swapper/010:07:280
1056674992220,1cyclictest0-21swapper/008:05:540
1056674992219,2cyclictest161rcuc/011:02:430
105667499220,21cyclictest3056-21PK-Backend08:20:210
105667499220,21cyclictest0-21swapper/010:02:000
11492952210,3chrt3056-21PK-Backend11:30:133
105668599218,11cyclictest1095-21runrttasks08:16:503
1056685992119,1cyclictest3056-21PK-Backend12:20:283
1056685992119,1cyclictest3056-21PK-Backend11:07:223
1056685992119,1cyclictest3056-21PK-Backend10:44:103
1056685992119,1cyclictest3056-21PK-Backend08:57:293
1056685992119,1cyclictest3056-21PK-Backend08:50:413
1056685992119,1cyclictest0-21swapper/311:14:043
1056685992119,1cyclictest0-21swapper/311:14:043
1056685992119,1cyclictest0-21swapper/310:55:463
1056685992119,1cyclictest0-21swapper/310:00:373
1056685992119,1cyclictest0-21swapper/309:39:483
1056685992119,1cyclictest0-21swapper/308:24:453
1056685992119,1cyclictest0-21swapper/308:13:303
1056685992118,2cyclictest3056-21PK-Backend09:13:123
1056685992118,2cyclictest3056-21PK-Backend07:41:263
1056685992112,7cyclictest1126053-21cron10:24:593
1056685992111,8cyclictest42-21ksoftirqd/312:25:213
105668599210,20cyclictest3056-21PK-Backend11:53:113
105668599210,20cyclictest3056-21PK-Backend11:39:193
105668599210,20cyclictest3056-21PK-Backend11:29:323
105668599210,20cyclictest3056-21PK-Backend08:47:163
105668599210,20cyclictest0-21swapper/309:00:063
105668599210,19cyclictest3056-21PK-Backend12:35:573
105668599210,19cyclictest3056-21PK-Backend10:35:383
1056679992119,1cyclictest3056-21PK-Backend10:50:192
1056679992119,1cyclictest0-21swapper/212:17:052
1056679992119,1cyclictest0-21swapper/211:53:262
1056679992119,1cyclictest0-21swapper/211:15:342
1056679992114,5cyclictest1073221-21cron07:55:012
105667999210,20cyclictest0-21swapper/209:58:482
105667999210,19cyclictest3056-21PK-Backend11:26:282
1056678992119,1cyclictest0-21swapper/112:32:561
1056678992119,1cyclictest0-21swapper/112:29:041
1056678992119,1cyclictest0-21swapper/111:39:481
1056678992119,1cyclictest0-21swapper/111:28:131
1056678992119,1cyclictest0-21swapper/110:45:271
1056678992119,1cyclictest0-21swapper/110:19:181
1056678992119,1cyclictest0-21swapper/110:12:011
1056678992119,1cyclictest0-21swapper/110:06:341
1056678992119,1cyclictest0-21swapper/109:22:121
1056678992118,2cyclictest3056-21PK-Backend09:39:031
105667899210,20cyclictest0-21swapper/107:10:391
105667899210,20cyclictest0-21swapper/107:10:381
1056674992119,1cyclictest0-21swapper/011:32:110
1056674992119,1cyclictest0-21swapper/011:12:030
1056674992119,1cyclictest0-21swapper/011:12:020
1056674992119,1cyclictest0-21swapper/010:58:250
1056674992119,1cyclictest0-21swapper/010:54:320
1056674992119,1cyclictest0-21swapper/010:47:490
1056674992119,1cyclictest0-21swapper/010:35:260
1056674992119,1cyclictest0-21swapper/010:26:550
1056674992119,1cyclictest0-21swapper/009:35:100
1056674992119,1cyclictest0-21swapper/009:13:470
1056674992119,1cyclictest0-21swapper/009:00:430
1056674992119,1cyclictest0-21swapper/008:10:070
1056674992119,1cyclictest0-21swapper/007:21:130
1056674992119,1cyclictest0-21swapper/007:11:190
1056674992119,1cyclictest0-21swapper/007:11:190
105667499211,5cyclictest1157130-21/usr/sbin/munin11:50:220
1056674992114,6cyclictest1081899-21cron08:20:000
105667499210,20cyclictest0-21swapper/010:21:130
105667499210,20cyclictest0-21swapper/009:09:210
105667499210,20cyclictest0-21swapper/008:40:150
105667499210,20cyclictest0-21swapper/008:36:020
11410272200,8chrt13-21ksoftirqd/011:05:160
1056685992018,1cyclictest3056-21PK-Backend12:16:373
1056685992018,1cyclictest3056-21PK-Backend12:04:003
1056685992018,1cyclictest3056-21PK-Backend10:45:113
1056685992018,1cyclictest3056-21PK-Backend09:30:553
1056685992018,1cyclictest3056-21PK-Backend08:42:163
1056685992018,1cyclictest3056-21PK-Backend07:34:093
1056685992018,1cyclictest0-21swapper/311:41:213
1056685992018,1cyclictest0-21swapper/308:38:513
1056685992017,2cyclictest3056-21PK-Backend12:08:533
105668599200,1cyclictest3056-21PK-Backend10:08:413
105668599200,1cyclictest3056-21PK-Backend07:22:323
105668599200,1cyclictest0-21swapper/307:15:093
105668599200,19cyclictest3056-21PK-Backend10:32:483
105668599200,19cyclictest0-21swapper/309:27:173
105668599200,19cyclictest0-21swapper/308:31:003
105668599200,19cyclictest0-21swapper/308:26:333
105668599200,18cyclictest3056-21PK-Backend10:14:093
1056679992018,1cyclictest3056-21PK-Backend09:00:212
1056679992018,1cyclictest0-21swapper/211:37:372
1056679992018,1cyclictest0-21swapper/210:24:162
1056679992018,1cyclictest0-21swapper/208:50:482
1056679992017,2cyclictest0-21swapper/208:57:102
1056679992014,5cyclictest1171903-21cron12:34:592
1056679992013,6cyclictest1077334-21diskstats08:05:122
105667999200,1cyclictest0-21swapper/207:30:092
105667999200,19cyclictest0-21swapper/210:10:382
105667999200,19cyclictest0-21swapper/209:37:452
105667999200,19cyclictest0-21swapper/209:34:212
105667999200,19cyclictest0-21swapper/209:19:552
105667999200,19cyclictest0-21swapper/207:47:142
1056678992018,1cyclictest0-21swapper/112:18:291
1056678992018,1cyclictest0-21swapper/110:20:201
1056678992018,1cyclictest0-21swapper/110:02:561
1056678992018,1cyclictest0-21swapper/109:51:061
1056678992018,1cyclictest0-21swapper/109:46:391
1056678992018,1cyclictest0-21swapper/109:44:511
1056678992018,1cyclictest0-21swapper/107:50:481
1056678992018,1cyclictest0-21swapper/107:46:071
1056678992018,1cyclictest0-21swapper/107:35:131
1056678992018,1cyclictest0-21swapper/107:18:101
1056678992013,6cyclictest1094249-21sed08:55:011
105667899200,19cyclictest3056-21PK-Backend08:39:141
105667899200,19cyclictest0-21swapper/112:10:441
105667899200,19cyclictest0-21swapper/112:04:491
105667899200,19cyclictest0-21swapper/111:52:131
105667899200,19cyclictest0-21swapper/110:40:331
105667899200,19cyclictest0-21swapper/110:37:431
105667899200,19cyclictest0-21swapper/108:55:161
105667499208,9cyclictest1064517-21pool-org.gnome.07:30:110
105667499202,6cyclictest13-21ksoftirqd/011:16:390
1056674992018,1cyclictest3056-21PK-Backend09:55:440
1056674992018,1cyclictest0-21swapper/012:31:050
1056674992018,1cyclictest0-21swapper/012:02:460
1056674992018,1cyclictest0-21swapper/011:41:090
1056674992018,1cyclictest0-21swapper/011:22:380
1056674992018,1cyclictest0-21swapper/010:32:360
1056674992018,1cyclictest0-21swapper/009:20:030
1056674992018,1cyclictest0-21swapper/009:18:140
1056674992018,1cyclictest0-21swapper/008:52:030
1056674992018,1cyclictest0-21swapper/007:26:060
1056674992017,2cyclictest161rcuc/011:35:130
1056674992012,6cyclictest1069486-21cron07:45:000
105667499200,1cyclictest0-21swapper/010:42:570
105667499200,1cyclictest0-21swapper/007:58:500
105667499200,19cyclictest3056-21PK-Backend09:52:060
105667499200,19cyclictest0-21swapper/008:49:270
105667499200,19cyclictest0-21swapper/008:26:210
105667499200,19cyclictest0-21swapper/007:15:100
10856322190,4sleep13056-21PK-Backend08:30:111
1056685991917,1cyclictest3056-21PK-Backend12:32:043
1056685991917,1cyclictest3056-21PK-Backend07:27:053
1056685991917,1cyclictest0-21swapper/310:27:063
1056685991917,1cyclictest0-21swapper/307:11:173
1056685991917,1cyclictest0-21swapper/307:11:173
105668599190,1cyclictest3056-21PK-Backend09:49:423
105668599190,1cyclictest0-21swapper/309:15:493
105667999194,13cyclictest1092295-21munin-run08:50:012
1056679991917,1cyclictest0-21swapper/211:58:522
1056679991917,1cyclictest0-21swapper/211:31:552
1056679991917,1cyclictest0-21swapper/208:40:272
1056679991912,5cyclictest1103701-21cut09:20:162
1056679991912,5cyclictest1081827-21sshd08:19:222
1056679991911,6cyclictest883-21dbus-daemon12:40:002
105667999191,16cyclictest1143635-21cron11:15:002
105667999191,16cyclictest1143635-21cron11:15:002
105667999190,1cyclictest0-21swapper/210:49:172
105667999190,1cyclictest0-21swapper/210:26:062
105667999190,1cyclictest0-21swapper/209:25:562
105667999190,1cyclictest0-21swapper/207:40:252
105667999190,18cyclictest0-21swapper/212:21:312
105667999190,18cyclictest0-21swapper/212:02:302
105667999190,18cyclictest0-21swapper/209:40:232
1056678991917,1cyclictest0-21swapper/112:37:491
1056678991917,1cyclictest0-21swapper/112:22:211
1056678991917,1cyclictest0-21swapper/110:53:121
1056678991917,1cyclictest0-21swapper/110:33:041
1056678991917,1cyclictest0-21swapper/109:11:461
1056678991917,1cyclictest0-21swapper/109:06:321
1056678991917,1cyclictest0-21swapper/108:49:141
1056678991916,2cyclictest3056-21PK-Backend08:15:201
1056678991911,6cyclictest1153541-21grep11:40:201
105667899190,1cyclictest0-21swapper/111:57:061
105667899190,1cyclictest0-21swapper/110:56:021
105667899190,1cyclictest0-21swapper/107:41:271
105667899190,1cyclictest0-21swapper/107:31:351
105667899190,1cyclictest0-21swapper/107:21:271
105667899190,18cyclictest3056-21PK-Backend11:01:441
105667899190,18cyclictest0-21swapper/112:05:511
105667899190,18cyclictest0-21swapper/108:40:011
105667899190,18cyclictest0-21swapper/107:29:451
105667499198,9cyclictest1161978-21cat12:05:100
1056674991917,1cyclictest0-21swapper/010:15:450
1056674991917,1cyclictest0-21swapper/008:00:540
105667499191,5cyclictest1147525-21grep11:25:130
1056674991913,4cyclictest2175-21JS10:27:480
1056674991912,5cyclictest1159513-21apt-get12:00:010
105667499190,6cyclictest1164707-21runrttasks12:11:430
105667499190,1cyclictest0-21swapper/009:31:320
105667499190,18cyclictest0-21swapper/011:46:020
105667499190,18cyclictest0-21swapper/008:31:360
10613122180,3chrt34-21ksoftirqd/207:20:112
105668599182,15cyclictest0-21swapper/309:05:543
105668599180,1cyclictest3056-21PK-Backend10:17:473
105667999189,7cyclictest1115261-21users09:50:212
1056679991816,1cyclictest3056-21PK-Backend11:00:112
1056679991816,1cyclictest0-21swapper/210:31:322
1056679991816,1cyclictest0-21swapper/207:12:262
1056679991816,1cyclictest0-21swapper/207:12:262
1056679991814,3cyclictest978-21snmpd09:50:012
1056679991812,4cyclictest1085390-21systemd-run08:30:002
105667999181,13cyclictest1095-21runrttasks10:00:112
105667999181,13cyclictest1087363-21apt08:35:112
105667999180,17cyclictest0-21swapper/210:43:022
105667999180,17cyclictest0-21swapper/207:16:522
1056678991816,1cyclictest0-21swapper/111:48:211
1056678991816,1cyclictest0-21swapper/111:07:241
1056678991816,1cyclictest0-21swapper/107:58:181
1056678991813,3cyclictest1097744-21sh09:05:001
1056678991813,3cyclictest1075343-21cpuspeed_turbos08:00:121
1056678991811,5cyclictest1084377-21cut08:25:161
105667899180,1cyclictest0-21swapper/108:06:091
105667499182,6cyclictest13-21ksoftirqd/007:36:590
1056674991816,1cyclictest0-21swapper/012:35:590
1056685991715,1cyclictest0-21swapper/308:04:163
105668599171,3cyclictest1154723-21hddtemp_smartct11:45:133
105668599170,15cyclictest1109879-21apt-get09:40:023
1056679991715,1cyclictest0-21swapper/208:02:082
1056679991713,3cyclictest1153675-21vmstat11:40:202
1056679991710,6cyclictest883-21dbus-daemon11:10:002
1056679991710,5cyclictest1083681-21cut08:25:012
105667999170,16cyclictest3056-21PK-Backend07:37:472
105667999170,16cyclictest0-21swapper/212:11:372
105667999170,16cyclictest0-21swapper/210:56:332
1056678991715,1cyclictest0-21swapper/109:55:191
1056685991614,1cyclictest3056-21PK-Backend08:09:173
105667999168,6cyclictest1168869-21cut12:25:132
1056679991612,2cyclictest34-21ksoftirqd/212:10:002
1056679991611,3cyclictest1063357-21missed_timers07:25:162
105667899169,6cyclictest1107076-21awk09:30:151
105667899161,12cyclictest1142182-21apt11:10:111
105667899161,12cyclictest1142182-21apt11:10:111
1056674991611,3cyclictest1071229-21dump-pmu-power07:50:010
1056685991513,1cyclictest0-21swapper/307:37:473
1056685991512,2cyclictest3056-21PK-Backend12:13:473
105667999159,5cyclictest1098016-21awk09:05:112
105667999157,6cyclictest436-20systemd-journal07:58:022
105667999151,11cyclictest1154327-21apt11:45:102
105667899158,5cyclictest1078704-21grep08:10:111
105667899151,10cyclictest1104952-21apt09:25:121
105668599142,4cyclictest42-21ksoftirqd/309:24:063
1056685991411,2cyclictest3056-21PK-Backend07:47:153
105668599139,3cyclictest3056-21PK-Backend07:50:043
105667999138,3cyclictest1078807-21cpuspeed_turbos08:10:122
105667999131,10cyclictest0-21swapper/209:14:592
105667899138,4cyclictest3056-21PK-Backend08:21:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional