You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 15:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Thu Jun 04, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
211333722200,6sleep00-21swapper/007:05:240
22213222970,4sleep234-21ksoftirqd/212:10:212
211402027739,12sleep20-21swapper/207:09:522
211399027740,14sleep30-21swapper/307:09:293
139099730,59rtkit-daemon0-21swapper/107:09:321
21884402480,4sleep342-21ksoftirqd/310:39:283
139099270,4rtkit-daemon1389-21rtkit-daemon10:27:283
2114179992517,6cyclictest2217943-21python312:00:210
2114187992316,5cyclictest883-21dbus-daemon10:20:011
2114187992316,5cyclictest883-21dbus-daemon10:20:001
211418799230,21cyclictest2193958-21perf10:55:001
139099230,4rtkit-daemon1389-21rtkit-daemon07:33:332
139099230,4rtkit-daemon1389-21rtkit-daemon07:33:332
139099230,3rtkit-daemon1389-21rtkit-daemon08:21:162
22228582220,5sleep00-21swapper/012:15:170
2114188992220,1cyclictest0-21swapper/212:26:392
2114188992220,1cyclictest0-21swapper/211:54:342
2114188992220,1cyclictest0-21swapper/211:26:092
2114188992220,1cyclictest0-21swapper/207:42:342
211418799220,20cyclictest2156-21gnome-shell11:35:101
2114179992220,1cyclictest0-21swapper/012:21:520
2114179992220,1cyclictest0-21swapper/009:25:300
2114179992220,1cyclictest0-21swapper/007:57:350
2114179992219,2cyclictest0-21swapper/011:01:480
2114179992218,3cyclictest2195088-21smartctl10:55:200
139099220,4rtkit-daemon1389-21rtkit-daemon11:57:433
2114192992119,1cyclictest3056-21PK-Backend11:05:263
2114192992119,1cyclictest3056-21PK-Backend10:05:373
211419299210,20cyclictest3056-21PK-Backend10:13:213
2114188992119,1cyclictest0-21swapper/212:34:082
2114188992119,1cyclictest0-21swapper/211:37:302
2114188992119,1cyclictest0-21swapper/211:20:272
2114188992119,1cyclictest0-21swapper/211:10:542
2114188992119,1cyclictest0-21swapper/211:10:542
2114188992119,1cyclictest0-21swapper/210:56:412
2114188992119,1cyclictest0-21swapper/210:02:192
2114188992119,1cyclictest0-21swapper/209:54:012
2114188992119,1cyclictest0-21swapper/209:30:362
2114188992119,1cyclictest0-21swapper/208:53:252
2114188992119,1cyclictest0-21swapper/208:38:242
2114188992119,1cyclictest0-21swapper/208:28:442
2114188992119,1cyclictest0-21swapper/208:28:442
2114188992119,1cyclictest0-21swapper/208:15:272
2114188992119,1cyclictest0-21swapper/208:13:382
2114188992119,1cyclictest0-21swapper/207:59:582
2114188992119,1cyclictest0-21swapper/207:28:152
2114188992119,1cyclictest0-21swapper/207:10:032
2114188992118,2cyclictest0-21swapper/211:48:522
211418899210,20cyclictest0-21swapper/212:04:552
211418899210,20cyclictest0-21swapper/210:31:072
211418899210,19cyclictest0-21swapper/211:05:132
2114187992114,5cyclictest2226999-21sshd12:27:281
2114187992114,5cyclictest2121666-21cut07:30:011
2114187992113,6cyclictest2207866-21uname11:31:341
2114187992113,6cyclictest2198552-21python311:05:201
2114187992113,6cyclictest2147240-21python308:40:191
2114187992113,6cyclictest1-21systemd10:45:011
211418799210,20cyclictest0-21swapper/109:50:531
2114179992119,1cyclictest0-21swapper/012:33:480
2114179992119,1cyclictest0-21swapper/012:11:450
2114179992119,1cyclictest0-21swapper/011:23:180
2114179992119,1cyclictest0-21swapper/011:11:080
2114179992119,1cyclictest0-21swapper/011:11:080
2114179992119,1cyclictest0-21swapper/011:08:170
2114179992119,1cyclictest0-21swapper/010:20:400
2114179992119,1cyclictest0-21swapper/009:05:350
2114179992119,1cyclictest0-21swapper/008:07:370
2114179992119,1cyclictest0-21swapper/007:23:420
2114179992118,2cyclictest2158499-21apt-get09:15:020
2114179992116,3cyclictest2211624-21basename11:45:000
211417999211,1cyclictest0-21swapper/010:36:270
211417999210,20cyclictest0-21swapper/012:08:540
211417999210,20cyclictest0-21swapper/011:51:160
211417999210,20cyclictest0-21swapper/011:26:090
211417999210,20cyclictest0-21swapper/010:05:040
211417999210,20cyclictest0-21swapper/009:45:510
211417999210,20cyclictest0-21swapper/009:37:460
211417999210,20cyclictest0-21swapper/008:55:220
211417999210,1cyclictest0-21swapper/009:56:470
139099210,4rtkit-daemon1389-21rtkit-daemon09:42:582
139099210,3rtkit-daemon1389-21rtkit-daemon09:14:362
2114192992018,1cyclictest3056-21PK-Backend07:21:253
2114192992018,1cyclictest0-21swapper/307:43:433
2114192992012,6cyclictest2193235-21ntp_states10:50:193
211419299200,19cyclictest0-21swapper/312:26:583
2114188992018,1cyclictest0-21swapper/212:16:172
2114188992018,1cyclictest0-21swapper/211:55:362
2114188992018,1cyclictest0-21swapper/210:26:272
2114188992018,1cyclictest0-21swapper/208:56:492
2114188992018,1cyclictest0-21swapper/208:34:122
2114188992018,1cyclictest0-21swapper/208:07:352
2114188992018,1cyclictest0-21swapper/207:38:562
2114188992018,1cyclictest0-21swapper/207:20:382
2114188992017,2cyclictest0-21swapper/209:55:032
2114188992013,5cyclictest2210815-21grep11:40:182
211418899200,19cyclictest0-21swapper/211:33:382
211418899200,19cyclictest0-21swapper/210:49:582
211418899200,19cyclictest0-21swapper/209:26:102
211418899200,19cyclictest0-21swapper/208:04:582
211418899200,19cyclictest0-21swapper/207:51:342
2114187992018,1cyclictest0-21swapper/108:49:221
2114187992014,4cyclictest1095-21runrttasks09:45:141
2114187992012,6cyclictest2159890-21python309:15:201
2114187992012,6cyclictest2141760-21memory08:25:171
2114187992012,6cyclictest2141760-21memory08:25:161
2114187992011,7cyclictest883-21dbus-daemon10:40:011
211418799200,19cyclictest3056-21PK-Backend12:36:411
211418799200,19cyclictest3056-21PK-Backend10:27:151
211418799200,19cyclictest0-21swapper/112:34:511
211418799200,19cyclictest0-21swapper/112:15:381
211418799200,19cyclictest0-21swapper/112:05:311
211418799200,19cyclictest0-21swapper/112:02:401
211418799200,19cyclictest0-21swapper/111:56:111
211418799200,19cyclictest0-21swapper/111:21:091
211418799200,19cyclictest0-21swapper/110:56:021
211418799200,19cyclictest0-21swapper/110:47:431
211418799200,19cyclictest0-21swapper/110:11:411
211418799200,19cyclictest0-21swapper/110:09:511
211418799200,19cyclictest0-21swapper/109:42:481
211418799200,19cyclictest0-21swapper/109:26:521
211418799200,19cyclictest0-21swapper/109:05:231
211418799200,19cyclictest0-21swapper/108:58:331
211418799200,19cyclictest0-21swapper/108:30:081
211418799200,19cyclictest0-21swapper/107:32:571
211418799200,19cyclictest0-21swapper/107:32:571
211418799200,19cyclictest0-21swapper/107:24:171
211417999209,9cyclictest2157397-21df09:10:130
2114179992018,1cyclictest3056-21PK-Backend07:12:210
2114179992018,1cyclictest0-21swapper/009:44:020
2114179992018,1cyclictest0-21swapper/009:02:590
2114179992018,1cyclictest0-21swapper/008:31:090
2114179992018,1cyclictest0-21swapper/008:11:000
2114179992018,1cyclictest0-21swapper/007:45:250
2114179992018,1cyclictest0-21swapper/007:36:000
2114179992017,2cyclictest0-21swapper/010:40:190
2114179992012,6cyclictest2176084-21cron10:05:000
2114179992012,6cyclictest13-21ksoftirqd/008:35:120
211417999200,1cyclictest0-21swapper/011:15:490
211417999200,1cyclictest0-21swapper/009:53:070
211417999200,19cyclictest3056-21PK-Backend10:25:180
211417999200,19cyclictest0-21swapper/009:21:040
211417999200,19cyclictest0-21swapper/007:52:350
211417999200,19cyclictest0-21swapper/007:27:070
211417999200,19cyclictest0-21swapper/007:19:300
22085622190,6sleep013-21ksoftirqd/011:35:110
2114192991917,1cyclictest3056-21PK-Backend12:18:143
2114192991917,1cyclictest3056-21PK-Backend11:44:133
2114192991917,1cyclictest3056-21PK-Backend09:20:563
2114192991917,1cyclictest3056-21PK-Backend07:56:263
2114192991917,1cyclictest3056-21PK-Backend07:17:073
2114192991912,5cyclictest2156-21gnome-shell07:14:093
2114192991911,6cyclictest2127706-21awk07:45:153
2114192991910,7cyclictest2149235-21python308:45:193
211419299190,1cyclictest3056-21PK-Backend12:02:313
211419299190,1cyclictest3056-21PK-Backend08:50:143
211419299190,18cyclictest0-21swapper/308:23:033
2114188991917,1cyclictest0-21swapper/211:19:252
2114188991917,1cyclictest0-21swapper/211:02:232
2114188991917,1cyclictest0-21swapper/210:12:282
2114188991917,1cyclictest0-21swapper/209:36:522
2114188991917,1cyclictest0-21swapper/209:23:332
2114188991917,1cyclictest0-21swapper/209:06:172
2114188991917,1cyclictest0-21swapper/209:03:392
2114188991917,1cyclictest0-21swapper/208:49:132
211418899190,1cyclictest0-21swapper/212:36:592
211418899190,1cyclictest0-21swapper/209:15:422
211418899190,18cyclictest0-21swapper/210:09:372
2114187991917,1cyclictest3056-21PK-Backend08:11:151
2114187991917,1cyclictest0-21swapper/109:31:181
2114187991917,1cyclictest0-21swapper/109:11:241
2114187991912,5cyclictest2213809-21expr11:50:121
2114187991912,5cyclictest2196726-21seq11:00:181
2114187991911,6cyclictest2221127-21memory12:10:181
211418799190,1cyclictest0-21swapper/110:04:241
211418799190,1cyclictest0-21swapper/107:16:541
211418799190,18cyclictest3056-21PK-Backend07:38:101
211418799190,18cyclictest0-21swapper/111:25:491
211418799190,18cyclictest0-21swapper/111:18:191
2114179991917,1cyclictest3056-21PK-Backend08:02:360
2114179991917,1cyclictest0-21swapper/010:14:100
2114179991917,1cyclictest0-21swapper/007:42:140
2114179991912,5cyclictest883-21dbus-daemon10:50:010
2114179991912,5cyclictest13-21ksoftirqd/010:30:200
211417999190,1cyclictest0-21swapper/010:51:290
211417999190,1cyclictest0-21swapper/009:30:430
211417999190,1cyclictest0-21swapper/008:51:090
211417999190,1cyclictest0-21swapper/007:32:220
211417999190,1cyclictest0-21swapper/007:32:210
21238572180,4sleep33056-21PK-Backend07:35:113
2114192991811,5cyclictest2208315-21sed11:35:013
2114192991811,5cyclictest2158044-21wc09:10:213
211419299181,15cyclictest2136563-21memory08:10:173
2114192991810,6cyclictest2206080-21cron11:30:003
2114192991810,6cyclictest2153305-21cron09:00:013
2114188991816,1cyclictest0-21swapper/212:23:472
2114188991816,1cyclictest0-21swapper/210:42:282
2114188991816,1cyclictest0-21swapper/210:36:472
2114188991816,1cyclictest0-21swapper/210:23:352
2114188991816,1cyclictest0-21swapper/209:48:342
2114188991814,3cyclictest978-21snmpd07:15:352
2114187991816,1cyclictest0-21swapper/112:20:171
2114187991816,1cyclictest0-21swapper/111:13:401
2114187991816,1cyclictest0-21swapper/111:13:401
2114187991816,1cyclictest0-21swapper/110:30:061
2114187991816,1cyclictest0-21swapper/110:23:371
2114187991816,1cyclictest0-21swapper/109:58:091
2114187991816,1cyclictest0-21swapper/109:01:101
2114187991816,1cyclictest0-21swapper/108:53:341
2114187991816,1cyclictest0-21swapper/108:18:041
2114187991810,6cyclictest2166359-21fw_packets09:35:151
211418799180,1cyclictest0-21swapper/111:45:021
211418799180,17cyclictest3056-21PK-Backend08:02:301
2114179991816,1cyclictest0-21swapper/012:36:390
2114179991813,3cyclictest2215323-21acpi11:55:110
2114179991810,6cyclictest2207961-21anacron11:32:460
2114179991810,5cyclictest2149862-21basename08:50:000
211417999180,1cyclictest0-21swapper/008:23:040
21820472170,3sleep33056-21PK-Backend10:20:123
21350272170,2sleep1251rcuc/108:05:201
2114192991714,2cyclictest3056-21PK-Backend10:32:143
2114192991714,2cyclictest3056-21PK-Backend09:52:333
2114192991714,2cyclictest0-21swapper/309:47:283
2114192991713,3cyclictest2230266-21timerwakeupswit12:35:243
2114192991712,3cyclictest2208782-21df_inode11:35:113
211419299170,5cyclictest2133268-21ntpq08:00:203
2114188991710,5cyclictest2192635-21tr10:50:122
211418799179,6cyclictest2128088-21pluginstate07:45:191
2114187991715,1cyclictest0-21swapper/107:43:101
2114187991712,3cyclictest2144634-21acpi08:35:111
2114187991710,5cyclictest2161733-21cat09:20:201
2114187991710,5cyclictest2130151-21sshd07:50:291
211418799170,16cyclictest0-21swapper/108:20:421
211417999178,4cyclictest2227229-21idleruntime-cro12:30:000
2114179991712,3cyclictest2180567-21kernelversion10:15:150
2114179991712,3cyclictest2180567-21kernelversion10:15:150
2114179991710,5cyclictest2138790-21seq08:15:210
211419299166,5cyclictest42-21ksoftirqd/311:20:143
211419299162,12cyclictest2147946-21latency_hist08:45:003
2114192991614,1cyclictest3056-21PK-Backend12:21:243
2114192991614,1cyclictest3056-21PK-Backend09:30:373
2114192991614,1cyclictest3056-21PK-Backend09:26:523
211419299161,3cyclictest21232272chrt07:34:463
211419299161,3cyclictest21232272chrt07:34:463
2114192991613,2cyclictest3056-21PK-Backend10:15:453
2114192991613,2cyclictest3056-21PK-Backend10:15:453
2114192991610,4cyclictest2159745-21awk09:15:163
211419299160,3cyclictest2134831-21memory08:05:173
211419299160,14cyclictest3056-21PK-Backend12:30:093
211418899168,6cyclictest436-20systemd-journal07:45:012
2114188991614,1cyclictest0-21swapper/210:17:062
2114188991614,1cyclictest0-21swapper/210:17:062
2114188991614,1cyclictest0-21swapper/208:44:132
211418799169,5cyclictest2130892-21cat07:55:121
2114187991611,4cyclictest2210800-21tr11:40:181
2114187991611,3cyclictest2114497-21grep07:10:121
2114179991611,3cyclictest2212593-21ntp_kernel_pll_11:45:180
2114179991611,3cyclictest2147128-21sh08:40:170
21996752150,3chrt3056-21PK-Backend11:10:113
21996752150,3chrt3056-21PK-Backend11:10:113
211419299159,5cyclictest3056-21PK-Backend11:50:013
211419299158,5cyclictest42-21ksoftirqd/308:37:103
2114192991513,1cyclictest3056-21PK-Backend08:16:203
2114192991511,3cyclictest3056-21PK-Backend11:19:263
2114192991511,3cyclictest2155279-21/usr/sbin/munin09:05:143
211419299150,3cyclictest2141548-21taskset08:25:133
211419299150,3cyclictest2141548-21taskset08:25:133
211419299150,2cyclictest21688652sleep309:41:213
211419299150,14cyclictest3056-21PK-Backend12:05:423
211419299150,14cyclictest3056-21PK-Backend10:03:153
211419299150,14cyclictest3056-21PK-Backend09:57:543
211419299150,14cyclictest3056-21PK-Backend09:38:063
211419299150,13cyclictest21441902sleep308:32:453
2114179991510,3cyclictest2141165-21acpi08:25:110
2114179991510,3cyclictest2141165-21acpi08:25:100
22209162140,3chrt0-21swapper/312:10:143
2114192991410,3cyclictest3056-21PK-Backend10:42:123
2114192991410,3cyclictest3056-21PK-Backend07:25:483
211419299140,1cyclictest3056-21PK-Backend11:03:033
211419299140,1cyclictest3056-21PK-Backend10:48:433
211419299140,13cyclictest3056-21PK-Backend10:57:093
211419299140,13cyclictest3056-21PK-Backend09:04:413
211418899148,5cyclictest2219141-21expr12:05:132
211419299130,11cyclictest3056-21PK-Backend11:50:103
211419299123,3cyclictest0-21swapper/307:54:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional