You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 17:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri May 01, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139099790,66rtkit-daemon0-21swapper/107:07:441
384723626546,13sleep20-21swapper/207:05:102
384842526444,14sleep00-21swapper/007:06:200
384855926343,14sleep30-21swapper/307:07:553
38986892470,4sleep33056-21PK-Backend09:30:103
38675602430,3chrt3056-21PK-Backend08:00:133
38863692370,2sleep20-21swapper/208:55:002
39189452270,7sleep03848861-21cyclictest10:25:170
38734182270,2sleep23056-21PK-Backend08:15:182
38932522260,5chrt1-21systemd09:15:011
38838292260,3chrt3056-21PK-Backend08:45:203
3848865992622,3cyclictest13-21ksoftirqd/009:45:000
3848865992622,3cyclictest13-21ksoftirqd/007:46:280
3848865992613,4cyclictest13-21ksoftirqd/009:10:000
39060062250,4sleep20-21swapper/209:50:102
3848878992418,5cyclictest42-21ksoftirqd/307:15:133
3848878992414,9cyclictest3902146-21cron09:39:593
384886899243,3cyclictest141rcu_preempt08:57:431
3848865992413,4cyclictest13-21ksoftirqd/010:14:560
384886599241,21cyclictest3895589-21df_inode09:20:120
39400222230,4sleep33056-21PK-Backend11:25:103
384887899237,4cyclictest3849544-21kernelversion07:10:173
3848878992317,5cyclictest1095-21runrttasks12:30:383
384887899230,21cyclictest3056-21PK-Backend11:07:313
384887299230,21cyclictest3914566-21munin-run10:15:002
384886899237,7cyclictest26-21ksoftirqd/111:45:131
3848865992318,4cyclictest13-21ksoftirqd/012:40:010
139099230,3rtkit-daemon1389-21rtkit-daemon10:35:262
3848878992220,1cyclictest3056-21PK-Backend11:02:513
384887899220,20cyclictest3056-21PK-Backend11:10:223
3848872992220,1cyclictest0-21swapper/212:36:142
3848872992220,1cyclictest0-21swapper/210:55:302
3848872992220,1cyclictest0-21swapper/210:47:452
3848872992220,1cyclictest0-21swapper/207:52:522
3848872992216,5cyclictest3921789-21systemd-run10:35:002
3848872992216,5cyclictest3921789-21systemd-run10:35:002
384887299220,20cyclictest0-21swapper/208:00:232
3848868992215,5cyclictest3879084-21sshd08:31:511
3848868992213,7cyclictest3936790-21memory11:15:171
3848868992210,4cyclictest26-21ksoftirqd/111:45:001
384886899220,20cyclictest3961806-21users12:25:221
3848865992220,1cyclictest0-21swapper/012:26:400
3848865992220,1cyclictest0-21swapper/011:56:050
3848865992220,1cyclictest0-21swapper/011:41:330
3848865992220,1cyclictest0-21swapper/009:38:500
3848865992220,1cyclictest0-21swapper/009:10:050
3848865992217,4cyclictest13-21ksoftirqd/008:30:000
3848865992217,3cyclictest3933168-21irqstats11:05:150
139099220,15rtkit-daemon3056-21PK-Backend11:41:013
3848878992119,1cyclictest3056-21PK-Backend11:37:533
3848878992119,1cyclictest3056-21PK-Backend11:17:533
3848878992119,1cyclictest3056-21PK-Backend08:36:303
3848878992119,1cyclictest3056-21PK-Backend08:18:263
3848878992119,1cyclictest3056-21PK-Backend07:31:353
3848878992119,1cyclictest0-21swapper/312:35:533
3848878992119,1cyclictest0-21swapper/311:58:413
3848878992119,1cyclictest0-21swapper/311:45:583
3848878992119,1cyclictest0-21swapper/308:40:223
3848878992118,2cyclictest3056-21PK-Backend09:57:293
3848878992118,2cyclictest3056-21PK-Backend09:48:093
3848878992118,2cyclictest3056-21PK-Backend08:21:173
3848878992118,2cyclictest3056-21PK-Backend07:40:193
3848878992113,6cyclictest3855006-21awk07:25:113
384887899210,20cyclictest3056-21PK-Backend12:28:493
384887899210,20cyclictest3056-21PK-Backend10:39:053
384887899210,20cyclictest3056-21PK-Backend07:54:263
384887899210,19cyclictest3056-21PK-Backend10:03:583
384887899210,19cyclictest3056-21PK-Backend09:21:263
384887899210,19cyclictest3056-21PK-Backend08:09:193
3848872992119,1cyclictest0-21swapper/212:34:252
3848872992119,1cyclictest0-21swapper/211:01:112
3848872992119,1cyclictest0-21swapper/210:18:522
3848872992119,1cyclictest0-21swapper/210:00:002
3848872992119,1cyclictest0-21swapper/209:21:552
3848872992119,1cyclictest0-21swapper/209:08:092
3848872992119,1cyclictest0-21swapper/208:25:242
3848872992119,1cyclictest0-21swapper/207:42:512
3848872992119,1cyclictest0-21swapper/207:36:572
3848872992119,1cyclictest0-21swapper/207:26:222
384887299210,20cyclictest0-21swapper/212:22:232
384887299210,20cyclictest0-21swapper/211:57:012
384887299210,20cyclictest0-21swapper/209:40:192
384887299210,20cyclictest0-21swapper/207:23:322
3848868992119,1cyclictest3056-21PK-Backend10:34:571
3848868992119,1cyclictest3056-21PK-Backend10:34:561
3848868992119,1cyclictest0-21swapper/111:03:231
3848868992119,1cyclictest0-21swapper/108:36:071
3848868992119,1cyclictest0-21swapper/107:56:111
3848868992119,1cyclictest0-21swapper/107:39:361
3848868992118,2cyclictest3056-21PK-Backend12:05:421
3848868992114,6cyclictest3890735-21ntp_kernel_pll_09:05:191
3848868992113,6cyclictest3958999-21apt12:20:111
3848868992113,6cyclictest3956387-21sensors_temp12:10:191
384886899210,20cyclictest3934442-21chrt11:10:061
384886899210,20cyclictest3871417-21ntpq08:10:181
384886899210,20cyclictest3056-21PK-Backend07:26:101
384886899210,20cyclictest0-21swapper/111:09:041
384886899210,20cyclictest0-21swapper/108:22:271
3848865992119,1cyclictest0-21swapper/012:31:550
3848865992119,1cyclictest0-21swapper/012:13:370
3848865992119,1cyclictest0-21swapper/012:07:350
3848865992119,1cyclictest0-21swapper/010:37:240
3848865992119,1cyclictest0-21swapper/010:24:470
3848865992119,1cyclictest0-21swapper/010:00:470
3848865992119,1cyclictest0-21swapper/008:46:250
3848865992119,1cyclictest0-21swapper/008:38:270
3848865992119,1cyclictest0-21swapper/008:18:060
3848865992119,1cyclictest0-21swapper/008:09:470
3848865992119,1cyclictest0-21swapper/008:04:340
3848865992119,1cyclictest0-21swapper/007:35:140
3848865992119,1cyclictest0-21swapper/007:21:010
3848865992118,2cyclictest3056-21PK-Backend10:41:170
3848865992115,4cyclictest3911524-21cpuspeed_turbos10:05:110
3848865992114,5cyclictest3959861-21python312:20:200
3848865992114,5cyclictest3919774-21apt-get10:30:020
3848865992114,5cyclictest3919774-21apt-get10:30:020
3848865992110,4cyclictest13-21ksoftirqd/010:19:130
3848865992110,4cyclictest13-21ksoftirqd/007:26:260
384886599210,20cyclictest0-21swapper/010:57:310
139099210,18rtkit-daemon978-21snmpd09:36:102
38512112200,5sleep13056-21PK-Backend07:15:031
3848878992018,1cyclictest3056-21PK-Backend11:30:503
3848878992018,1cyclictest3056-21PK-Backend10:58:123
3848878992018,1cyclictest3056-21PK-Backend10:22:033
3848878992018,1cyclictest3056-21PK-Backend09:26:543
3848878992018,1cyclictest3056-21PK-Backend07:48:183
3848878992018,1cyclictest0-21swapper/310:40:073
3848878992018,1cyclictest0-21swapper/310:10:393
3848878992018,1cyclictest0-21swapper/309:10:513
384887899200,1cyclictest3056-21PK-Backend07:38:173
384887899200,19cyclictest3056-21PK-Backend12:22:003
384887899200,19cyclictest3056-21PK-Backend11:20:433
384887899200,19cyclictest3056-21PK-Backend07:57:173
384887899200,19cyclictest0-21swapper/312:15:123
384887899200,19cyclictest0-21swapper/312:09:093
384887899200,19cyclictest0-21swapper/310:52:313
384887899200,19cyclictest0-21swapper/310:19:123
384887899200,19cyclictest0-21swapper/309:06:523
384887899200,19cyclictest0-21swapper/307:20:263
384887299209,8cyclictest883-21dbus-daemon10:41:322
384887299204,11cyclictest2156-21gnome-shell10:50:092
3848872992018,1cyclictest3056-21PK-Backend11:36:252
3848872992018,1cyclictest0-21swapper/212:29:122
3848872992018,1cyclictest0-21swapper/212:16:212
3848872992018,1cyclictest0-21swapper/211:15:232
3848872992018,1cyclictest0-21swapper/210:22:442
3848872992018,1cyclictest0-21swapper/210:01:022
3848872992018,1cyclictest0-21swapper/209:29:112
3848872992018,1cyclictest0-21swapper/208:48:212
3848872992018,1cyclictest0-21swapper/208:43:272
3848872992018,1cyclictest0-21swapper/208:21:312
3848872992018,1cyclictest0-21swapper/208:08:002
3848872992018,1cyclictest0-21swapper/207:32:042
3848872992018,1cyclictest0-21swapper/207:14:392
3848872992017,2cyclictest3056-21PK-Backend12:10:182
3848872992013,5cyclictest3853095-21cat07:20:012
384887299200,1cyclictest0-21swapper/211:48:422
384887299200,1cyclictest0-21swapper/208:11:242
384887299200,19cyclictest0-21swapper/212:08:292
384887299200,19cyclictest0-21swapper/211:08:412
384887299200,19cyclictest0-21swapper/209:02:412
384886899205,3cyclictest26-21ksoftirqd/112:30:321
3848868992018,1cyclictest3056-21PK-Backend10:53:011
3848868992018,1cyclictest0-21swapper/111:22:281
3848868992018,1cyclictest0-21swapper/110:45:321
3848868992018,1cyclictest0-21swapper/109:51:161
3848868992018,1cyclictest0-21swapper/108:07:411
3848868992018,1cyclictest0-21swapper/107:43:421
3848868992017,2cyclictest3056-21PK-Backend11:54:121
3848868992015,3cyclictest3857833-21vmstat07:30:221
3848868992013,5cyclictest3912628-21sshd10:07:511
3848868992012,6cyclictest3958704-21sshd12:19:531
3848868992012,6cyclictest3881350-21apt08:40:121
384886899200,1cyclictest0-21swapper/108:47:571
384886899200,19cyclictest3056-21PK-Backend12:03:051
384886899200,19cyclictest0-21swapper/111:38:521
384886899200,19cyclictest0-21swapper/110:57:411
384886899200,19cyclictest0-21swapper/109:32:381
384886899200,19cyclictest0-21swapper/108:19:561
384886899200,19cyclictest0-21swapper/107:46:461
384886899200,18cyclictest3056-21PK-Backend08:51:341
384886599209,4cyclictest13-21ksoftirqd/008:55:040
384886599207,3cyclictest141rcu_preempt10:50:140
384886599206,3cyclictest13-21ksoftirqd/011:23:590
3848865992018,1cyclictest0-21swapper/011:37:540
3848865992018,1cyclictest0-21swapper/011:34:150
3848865992018,1cyclictest0-21swapper/011:18:280
3848865992018,1cyclictest0-21swapper/011:10:570
3848865992018,1cyclictest0-21swapper/011:01:230
3848865992018,1cyclictest0-21swapper/010:47:590
3848865992018,1cyclictest0-21swapper/009:56:550
3848865992018,1cyclictest0-21swapper/009:27:410
3848865992018,1cyclictest0-21swapper/009:03:350
3848865992018,1cyclictest0-21swapper/007:43:120
3848865992018,1cyclictest0-21swapper/007:16:350
3848865992013,6cyclictest3957735-21awk12:15:150
3848865992013,6cyclictest3940983-21cat11:25:200
384886599200,1cyclictest0-21swapper/008:32:320
384886599200,1cyclictest0-21swapper/007:55:420
384886599200,19cyclictest3056-21PK-Backend11:45:110
384886599200,19cyclictest0-21swapper/007:14:460
384886599200,18cyclictest3874419-21apt08:20:120
139099200,3rtkit-daemon1389-21rtkit-daemon10:28:082
139099200,17rtkit-daemon884-21gmain09:46:432
3848878991917,1cyclictest3056-21PK-Backend09:51:003
3848878991917,1cyclictest3056-21PK-Backend09:19:373
3848878991917,1cyclictest0-21swapper/311:53:153
3848878991912,6cyclictest3887438-21sed08:55:203
384887899191,16cyclictest3926341-21memory10:45:173
384887899190,1cyclictest3056-21PK-Backend09:00:373
384887899190,1cyclictest3056-21PK-Backend08:34:273
384887899190,1cyclictest3056-21PK-Backend08:11:563
384887899190,1cyclictest0-21swapper/309:40:383
384887899190,18cyclictest0-21swapper/312:02:203
384887899190,18cyclictest0-21swapper/310:33:253
384887899190,18cyclictest0-21swapper/310:33:243
384887299199,9cyclictest3953523-21cron12:05:012
3848872991917,1cyclictest0-21swapper/211:51:342
3848872991917,1cyclictest0-21swapper/208:31:052
384887299190,1cyclictest0-21swapper/211:41:392
384887299190,1cyclictest0-21swapper/211:11:312
384887299190,1cyclictest0-21swapper/208:36:462
3848868991917,1cyclictest3056-21PK-Backend07:10:231
3848868991917,1cyclictest0-21swapper/111:28:571
3848868991917,1cyclictest0-21swapper/110:44:301
3848868991917,1cyclictest0-21swapper/110:26:241
3848868991917,1cyclictest0-21swapper/109:46:371
3848868991917,1cyclictest0-21swapper/108:00:381
3848868991914,4cyclictest26-21ksoftirqd/110:05:001
3848868991914,3cyclictest3900832-21tr09:35:121
3848868991912,5cyclictest3922749-21interrupts10:35:151
3848868991912,5cyclictest3895626-21idleruntime09:20:131
384886899190,1cyclictest0-21swapper/108:29:101
384886599197,3cyclictest13-21ksoftirqd/009:52:280
384886599197,3cyclictest13-21ksoftirqd/007:50:020
384886599193,2cyclictest141rcu_preempt08:50:200
3848865991917,1cyclictest0-21swapper/011:52:280
3848865991917,1cyclictest0-21swapper/009:30:320
3848865991912,6cyclictest3953534-21dump-pmu-power12:05:000
3848865991912,5cyclictest13-21ksoftirqd/009:45:140
3848865991911,6cyclictest883-21dbus-daemon09:20:000
384886599190,1cyclictest0-21swapper/008:14:150
384886599190,1cyclictest0-21swapper/007:33:100
38636092180,2sleep23056-21PK-Backend07:50:002
38539992180,4chrt3056-21PK-Backend07:20:161
3848878991816,1cyclictest0-21swapper/308:54:223
3848878991815,2cyclictest3056-21PK-Backend10:25:553
3848872991816,1cyclictest0-21swapper/209:32:022
3848872991816,1cyclictest0-21swapper/207:56:582
384887299180,1cyclictest0-21swapper/211:25:452
384886899188,7cyclictest883-21dbus-daemon09:01:291
384886899182,2cyclictest141rcu_preempt12:39:151
3848868991816,1cyclictest3056-21PK-Backend11:57:501
3848868991816,1cyclictest3056-21PK-Backend10:16:521
3848868991816,1cyclictest0-21swapper/109:16:021
3848868991811,5cyclictest3942719-21sed11:30:191
384887299179,6cyclictest3887281-21ntp_states08:55:182
3848872991715,1cyclictest0-21swapper/210:05:412
3848872991712,4cyclictest978-21snmpd09:12:112
3848872991711,4cyclictest3943122-21cron11:35:002
384887299170,1cyclictest0-21swapper/211:21:052
3848868991715,1cyclictest3056-21PK-Backend10:14:021
3848868991713,3cyclictest3896703-21latency_hist09:25:001
384886899171,2cyclictest141rcu_preempt09:41:311
3848868991712,3cyclictest3907820-21gdbus09:55:011
3848868991711,5cyclictest3917518-21ls10:20:201
3848865991712,3cyclictest3882196-21rt-features08:40:200
3848878991614,1cyclictest3056-21PK-Backend12:10:593
3848878991614,1cyclictest3056-21PK-Backend10:09:383
3848878991614,1cyclictest3056-21PK-Backend08:26:583
3848868991610,4cyclictest3864959-21sshd07:51:511
3848872991513,1cyclictest0-21swapper/209:16:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional