You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 20:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Aug 08, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123974921250,7sleep0161rcuc/012:25:010
139099880,74rtkit-daemon0-21swapper/007:06:570
11271482870,6sleep10-21swapper/107:05:101
112718627545,22sleep30-21swapper/307:05:133
11469002650,7sleep1261ksoftirqd/108:00:001
112822926444,14sleep20-21swapper/207:09:382
11295352600,4sleep33056-21PK-Backend07:10:183
12046092520,3sleep1251rcuc/110:45:011
12369852500,2sleep00-21swapper/012:15:230
11925052490,4sleep10-21swapper/110:10:001
12248592460,2sleep00-21swapper/011:40:210
139099370,3rtkit-daemon3056-21PK-Backend10:59:490
139099360,3rtkit-daemon0-21swapper/010:22:500
139099350,3rtkit-daemon0-21swapper/008:21:550
1128475992616,8cyclictest1230484-21unin-run12:00:003
1128475992616,8cyclictest1230484-21unin-run12:00:003
11311992250,3sleep10-21swapper/107:15:131
112847099254,11cyclictest34-21ksoftirqd/209:29:592
112846699251,22cyclictest1149603-21python308:05:221
139099240,16rtkit-daemon3056-21PK-Backend12:18:411
112847099242,11cyclictest34-21ksoftirqd/210:10:002
139099230,15rtkit-daemon3056-21PK-Backend09:20:150
139099230,14rtkit-daemon0-21swapper/007:10:230
1128475992315,6cyclictest1202730-21perf10:40:003
112847599231,2cyclictest141rcu_preempt09:50:013
1128475992310,11cyclictest1172051-21/usr/sbin/munin09:10:213
1128470992320,2cyclictest0-21swapper/209:49:412
1128470992320,2cyclictest0-21swapper/207:51:382
1128470992320,1cyclictest0-21swapper/211:58:112
1128470992320,1cyclictest0-21swapper/211:58:102
1128470992318,3cyclictest1224045-21ls11:40:122
1128470992317,4cyclictest1165815-21ls08:55:012
1128470992313,4cyclictest34-21ksoftirqd/211:11:382
139099220,14rtkit-daemon0-21swapper/110:35:351
12297852220,4chrt0-21swapper/111:55:231
12297852220,4chrt0-21swapper/111:55:231
112847599220,20cyclictest1156044-21df08:25:133
112847099229,2cyclictest141rcu_preempt08:13:422
1128470992220,1cyclictest0-21swapper/212:12:512
1128470992220,1cyclictest0-21swapper/211:09:442
1128470992220,1cyclictest0-21swapper/210:41:052
1128470992220,1cyclictest0-21swapper/210:12:462
1128470992219,2cyclictest0-21swapper/210:46:462
1128470992218,3cyclictest1201244-21/usr/sbin/munin10:35:232
1128470992217,3cyclictest1207136-21cut10:50:182
1128470992214,6cyclictest1217564-21awk11:20:192
1128470992211,9cyclictest1146764-21unin-run08:00:002
1128470992211,4cyclictest34-21ksoftirqd/212:38:472
112847099220,20cyclictest11300972chrt07:12:182
1128466992220,1cyclictest0-21swapper/110:30:211
1128466992220,1cyclictest0-21swapper/109:06:051
1128466992220,1cyclictest0-21swapper/109:06:051
1128466992220,1cyclictest0-21swapper/107:28:581
1128466992220,1cyclictest0-21swapper/107:12:501
1128466992210,10cyclictest1165841-21unin-run08:55:011
112846699220,2cyclictest1233322-21sed12:05:181
112846699220,20cyclictest0-21swapper/108:42:521
112845999222,14cyclictest1095-21runrttasks08:10:130
1128459992216,4cyclictest1162335-21cron08:45:000
1128459992215,5cyclictest883-21dbus-daemon10:00:000
1128459992214,2cyclictest13-21ksoftirqd/008:00:000
1128459992212,7cyclictest1214865-21perf11:15:000
112845999220,20cyclictest1149099-21df08:05:140
139099210,14rtkit-daemon3056-21PK-Backend09:10:460
139099210,14rtkit-daemon0-21swapper/007:32:030
112847599217,9cyclictest42-21ksoftirqd/312:15:153
112847599213,8cyclictest141rcu_preempt12:10:203
112847599212,2cyclictest141rcu_preempt11:35:013
1128475992118,2cyclictest3056-21PK-Backend09:52:203
1128475992111,3cyclictest42-21ksoftirqd/311:00:003
1128475992110,9cyclictest3056-21PK-Backend11:49:593
112847599210,1cyclictest141rcu_preempt08:55:003
112847599210,1cyclictest0-21swapper/309:38:003
112847099219,4cyclictest34-21ksoftirqd/209:08:052
112847099219,4cyclictest34-21ksoftirqd/209:08:052
112847099218,4cyclictest34-21ksoftirqd/208:31:542
1128470992119,1cyclictest0-21swapper/211:19:582
1128470992119,1cyclictest0-21swapper/210:01:302
1128470992119,1cyclictest0-21swapper/209:33:452
1128470992119,1cyclictest0-21swapper/207:43:542
1128470992119,1cyclictest0-21swapper/207:30:572
1128470992114,5cyclictest34-21ksoftirqd/210:15:272
1128470992111,3cyclictest34-21ksoftirqd/209:16:212
1128470992110,3cyclictest34-21ksoftirqd/208:55:062
1128470992110,2cyclictest141rcu_preempt08:05:182
112847099210,20cyclictest0-21swapper/209:57:442
112847099210,20cyclictest0-21swapper/209:35:552
112847099210,20cyclictest0-21swapper/208:36:062
1128466992119,1cyclictest0-21swapper/112:03:551
1128466992119,1cyclictest0-21swapper/111:48:351
1128466992119,1cyclictest0-21swapper/111:43:081
1128466992119,1cyclictest0-21swapper/111:00:021
1128466992119,1cyclictest0-21swapper/110:01:281
1128466992119,1cyclictest0-21swapper/109:37:071
1128466992119,1cyclictest0-21swapper/109:01:321
1128466992119,1cyclictest0-21swapper/108:37:261
1128466992119,1cyclictest0-21swapper/108:34:351
1128466992119,1cyclictest0-21swapper/107:30:481
1128466992114,6cyclictest1151731-21sshd08:12:371
112846699210,20cyclictest3056-21PK-Backend10:21:221
112846699210,20cyclictest0-21swapper/111:08:261
112846699210,20cyclictest0-21swapper/110:26:501
112846699210,20cyclictest0-21swapper/107:21:421
1128459992119,1cyclictest0-21swapper/011:57:190
1128459992119,1cyclictest0-21swapper/011:57:190
1128459992119,1cyclictest0-21swapper/010:08:020
1128459992119,1cyclictest0-21swapper/009:54:510
1128459992110,8cyclictest883-21dbus-daemon11:30:010
112845999210,20cyclictest0-21swapper/010:29:050
112845999210,20cyclictest0-21swapper/007:41:410
139099200,14rtkit-daemon0-21swapper/112:29:341
139099200,14rtkit-daemon0-21swapper/111:52:111
112847599207,8cyclictest42-21ksoftirqd/312:25:223
112847599207,12cyclictest42-21ksoftirqd/308:30:183
112847599206,2cyclictest141rcu_preempt10:04:573
112847599204,2cyclictest141rcu_preempt08:01:433
1128475992018,1cyclictest3056-21PK-Backend10:45:333
1128475992018,1cyclictest0-21swapper/309:40:103
1128475992017,2cyclictest3056-21PK-Backend11:23:113
1128475992017,2cyclictest3056-21PK-Backend09:04:553
1128475992017,2cyclictest0-21swapper/307:57:293
1128475992013,5cyclictest1197142-21users10:20:233
1128475992012,5cyclictest1171006-21cron09:10:003
1128475992012,5cyclictest1171006-21cron09:10:003
1128475992012,2cyclictest42-21ksoftirqd/308:05:233
1128475992011,7cyclictest42-21ksoftirqd/312:05:013
112847599200,1cyclictest3056-21PK-Backend11:16:433
112847599200,1cyclictest0-21swapper/310:51:483
112847599200,19cyclictest3056-21PK-Backend11:51:443
112847599200,19cyclictest3056-21PK-Backend11:14:333
112847599200,19cyclictest3056-21PK-Backend11:01:493
112847599200,19cyclictest3056-21PK-Backend10:12:003
112847599200,19cyclictest3056-21PK-Backend08:57:593
112847599200,19cyclictest3056-21PK-Backend08:44:403
112847599200,19cyclictest3056-21PK-Backend07:50:463
112847599200,19cyclictest0-21swapper/312:22:473
112847599200,19cyclictest0-21swapper/309:24:013
112847599200,19cyclictest0-21swapper/308:45:423
112847599200,19cyclictest0-21swapper/308:35:213
112847599200,19cyclictest0-21swapper/308:10:273
112847599200,19cyclictest0-21swapper/307:26:063
112847599200,18cyclictest3056-21PK-Backend07:49:453
112847099206,6cyclictest141rcu_preempt12:25:192
112847099206,4cyclictest34-21ksoftirqd/211:50:562
1128470992018,1cyclictest0-21swapper/212:20:402
1128470992018,1cyclictest0-21swapper/212:03:042
1128470992018,1cyclictest0-21swapper/211:49:112
1128470992018,1cyclictest0-21swapper/210:33:142
1128470992018,1cyclictest0-21swapper/210:20:302
1128470992018,1cyclictest0-21swapper/209:50:282
1128470992018,1cyclictest0-21swapper/209:00:332
1128470992018,1cyclictest0-21swapper/208:18:292
1128470992018,1cyclictest0-21swapper/207:47:462
112847099201,5cyclictest34-21ksoftirqd/211:35:002
1128470992011,4cyclictest34-21ksoftirqd/207:26:212
112847099200,1cyclictest0-21swapper/212:34:542
112847099200,19cyclictest0-21swapper/212:16:222
112847099200,19cyclictest0-21swapper/210:55:242
112847099200,19cyclictest0-21swapper/209:42:242
1128466992018,1cyclictest0-21swapper/111:35:431
1128466992018,1cyclictest0-21swapper/108:25:431
1128466992018,1cyclictest0-21swapper/108:00:561
1128466992013,5cyclictest1162945-21expr08:45:141
1128466992012,6cyclictest1221041-21ntp_kernel_pll_11:30:201
112846699200,1cyclictest3056-21PK-Backend09:23:091
112846699200,19cyclictest0-21swapper/111:18:271
112846699200,19cyclictest0-21swapper/110:46:571
112846699200,19cyclictest0-21swapper/109:46:211
112846699200,19cyclictest0-21swapper/109:42:011
112846699200,19cyclictest0-21swapper/109:33:361
112846699200,19cyclictest0-21swapper/109:27:081
112846699200,19cyclictest0-21swapper/108:15:291
112846699200,19cyclictest0-21swapper/107:50:481
1128459992014,3cyclictest2156-21gnome-shell08:16:090
1128459992013,5cyclictest1225502-21/usr/sbin/munin11:45:170
112845999200,1cyclictest3056-21PK-Backend08:45:430
112845999200,1cyclictest0-21swapper/007:51:000
112845999200,19cyclictest3056-21PK-Backend12:05:300
112845999200,19cyclictest3056-21PK-Backend12:01:250
112845999200,19cyclictest0-21swapper/012:31:250
112845999200,19cyclictest0-21swapper/012:28:080
112845999200,19cyclictest0-21swapper/010:02:080
112845999200,19cyclictest0-21swapper/009:06:180
112845999200,19cyclictest0-21swapper/009:06:180
112845999200,19cyclictest0-21swapper/009:04:420
112845999200,19cyclictest0-21swapper/007:49:590
139099190,13rtkit-daemon0-21swapper/007:17:090
112847599197,11cyclictest42-21ksoftirqd/307:40:203
112847599196,9cyclictest42-21ksoftirqd/307:35:133
112847599195,9cyclictest42-21ksoftirqd/312:35:133
1128475991917,1cyclictest3056-21PK-Backend10:32:153
1128475991917,1cyclictest3056-21PK-Backend09:34:293
1128475991917,1cyclictest0-21swapper/312:01:173
1128475991914,3cyclictest42-21ksoftirqd/307:35:003
1128475991912,5cyclictest1174470-21sh09:19:593
112847599190,1cyclictest3056-21PK-Backend11:38:053
112847599190,1cyclictest3056-21PK-Backend09:29:363
112847599190,1cyclictest0-21swapper/310:40:403
112847599190,18cyclictest0-21swapper/311:40:493
112847599190,18cyclictest0-21swapper/308:21:353
112847599190,18cyclictest0-21swapper/307:24:033
112847599190,18cyclictest0-21swapper/307:15:453
112847099199,7cyclictest1160939-21cpuspeed08:40:122
112847099196,3cyclictest141rcu_preempt11:36:022
112847099192,12cyclictest1131090-21apt07:15:132
1128470991917,1cyclictest0-21swapper/212:09:192
1128470991917,1cyclictest0-21swapper/208:47:422
1128470991917,1cyclictest0-21swapper/208:23:562
1128470991914,4cyclictest34-21ksoftirqd/211:05:002
1128470991912,5cyclictest28650irq/123-ahci[0009:10:222
112847099190,9cyclictest1148485-21awk08:05:002
112847099190,1cyclictest0-21swapper/211:25:532
112847099190,1cyclictest0-21swapper/210:26:102
112847099190,1cyclictest0-21swapper/207:22:252
1128466991917,1cyclictest3056-21PK-Backend12:23:031
1128466991917,1cyclictest3056-21PK-Backend08:22:181
1128466991917,1cyclictest0-21swapper/112:39:321
1128466991917,1cyclictest0-21swapper/109:54:111
1128466991917,1cyclictest0-21swapper/107:47:581
1128466991916,2cyclictest0-21swapper/110:10:201
1128466991912,5cyclictest1195048-21ntp_kernel_pll_10:15:221
1128466991911,6cyclictest1234603-21expr12:10:131
1128466991911,6cyclictest1167100-21cat08:55:231
1128466991910,7cyclictest1217443-21memory11:20:191
112846699190,1cyclictest3056-21PK-Backend10:59:141
112846699190,18cyclictest3056-21PK-Backend10:53:471
112846699190,18cyclictest0-21swapper/111:25:441
112845999198,4cyclictest141rcu_preempt10:55:000
112845999192,15cyclictest1136347-21cat07:30:010
1128459991917,1cyclictest3056-21PK-Backend09:39:090
1128459991917,1cyclictest0-21swapper/012:36:390
1128459991917,1cyclictest0-21swapper/011:37:390
1128459991917,1cyclictest0-21swapper/011:19:470
1128459991917,1cyclictest0-21swapper/010:33:580
1128459991917,1cyclictest0-21swapper/010:13:570
1128459991917,1cyclictest0-21swapper/008:57:120
1128459991917,1cyclictest0-21swapper/008:26:160
1128459991917,1cyclictest0-21swapper/007:21:400
112845999190,1cyclictest0-21swapper/009:48:210
112845999190,1cyclictest0-21swapper/009:25:240
112845999190,18cyclictest0-21swapper/011:53:140
112845999190,18cyclictest0-21swapper/011:33:330
112845999190,18cyclictest0-21swapper/011:02:440
112845999190,18cyclictest0-21swapper/010:17:410
1128475991816,1cyclictest3056-21PK-Backend11:26:093
1128475991816,1cyclictest3056-21PK-Backend10:06:533
1128475991816,1cyclictest3056-21PK-Backend09:56:393
1128475991811,6cyclictest1153140-21sed08:15:243
112847099185,4cyclictest34-21ksoftirqd/207:36:122
112846699184,5cyclictest1095-21runrttasks07:39:551
1128466991816,1cyclictest3056-21PK-Backend09:12:141
1128466991811,6cyclictest1187510-21diskstats09:55:141
112845999184,12cyclictest1206186-21cron10:49:590
1128459991816,1cyclictest0-21swapper/008:52:250
1128459991816,1cyclictest0-21swapper/008:31:430
1128459991811,5cyclictest1203724-21ntpq10:40:190
112845999180,1cyclictest0-21swapper/012:12:200
112847599174,8cyclictest42-21ksoftirqd/310:15:203
1128470991711,5cyclictest1175743-21cat09:20:222
1128466991715,1cyclictest0-21swapper/111:12:451
1128459991714,2cyclictest1095-21runrttasks11:08:020
1128459991714,2cyclictest1095-21runrttasks08:38:530
1128459991713,3cyclictest13-21ksoftirqd/007:35:210
1128459991712,3cyclictest13-21ksoftirqd/010:35:140
1128459991710,5cyclictest1147943-21cat08:00:230
112847599167,3cyclictest141rcu_preempt11:05:213
112847599165,8cyclictest1197803-21apt10:25:133
112847599160,4cyclictest3056-21PK-Backend12:31:103
112847099167,6cyclictest1157137-21cron08:30:002
1128466991611,3cyclictest1243108-21cron12:35:011
112845999169,5cyclictest2156-21gnome-shell09:30:090
112845999169,5cyclictest1217043-21cut11:20:140
1128459991611,3cyclictest1173202-21cstates09:15:120
1128466991513,1cyclictest0-21swapper/107:41:291
1128466991510,4cyclictest1174117-21sshd09:15:381
1128459991513,1cyclictest3056-21PK-Backend09:41:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional