You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 23:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 15, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
962404994338,3cyclictest1076333-21latency_hist09:00:013
962394994338,4cyclictest962333-21latency_hist07:10:010
962397994137,2cyclictest1113531-21kworker/u8:3+events_unbound10:05:391
962397993936,2cyclictest1238834-21kworker/u8:1+events_unbound12:18:401
962397993935,3cyclictest988623-21kworker/u8:0+events_unbound07:35:241
962397993734,2cyclictest1150279-21kworker/u8:0+events_unbound10:15:161
962404993632,3cyclictest1108356-21apt-get09:30:103
962397993633,2cyclictest1124659-21kworker/u8:1+events_unbound09:54:401
962404993531,3cyclictest1218086-21kworker/u8:3+flush-259:011:35:003
962397993532,2cyclictest1160687-21kworker/u8:1+events_unbound10:21:391
962397993532,2cyclictest1045360-21kworker/u8:1+events_unbound09:17:411
962397993532,2cyclictest1035059-21kworker/u8:2+events_unbound08:22:411
962397993529,4cyclictest1186816-21latency_hist10:45:001
962400993429,3cyclictest1140204-21apt-get10:00:122
962397993430,3cyclictest1098044-21kworker/u8:0+events_unbound09:30:411
962397993430,3cyclictest1035059-21kworker/u8:2+events_unbound09:10:231
962404993329,3cyclictest1155392-21latency_hist10:15:003
962397993330,2cyclictest1113531-21kworker/u8:3+events_unbound09:47:411
962397993230,2cyclictest1061055-21kworker/u8:3+events_unbound09:07:401
962397993229,2cyclictest1045360-21kworker/u8:1+events_unbound09:00:221
962397993229,2cyclictest1035059-21kworker/u8:2+events_unbound08:51:401
962397993228,3cyclictest1160687-21kworker/u8:1+events_unbound10:29:411
962397993228,3cyclictest1061055-21kworker/u8:3+events_unbound08:55:161
962397993128,2cyclictest988623-21kworker/u8:0+events_unbound07:43:331
962397993128,2cyclictest1248993-21kworker/u8:2+events_unbound12:00:401
962397993128,2cyclictest1176417-21kworker/u8:0+events_unbound10:48:401
962397993127,3cyclictest988623-21kworker/u8:0+events_unbound07:54:411
962397993127,3cyclictest1113531-21kworker/u8:3+events_unbound09:58:541
962394993124,6cyclictest1248993-21kworker/u8:2+flush-259:012:30:000
962397993027,2cyclictest998895-21kworker/u8:3+events_unbound07:55:251
962397993027,2cyclictest1218086-21kworker/u8:3+events_unbound11:20:271
962397993027,2cyclictest1160687-21kworker/u8:1+events_unbound11:00:211
962397993027,2cyclictest1035059-21kworker/u8:2+events_unbound09:43:531
962397993026,3cyclictest1301049-21kworker/u8:0+events_unbound12:36:411
962397993026,3cyclictest1160687-21kworker/u8:1+events_unbound10:59:091
962397993025,2cyclictest1218086-21kworker/u8:3+events_unbound11:50:231
962397992927,2cyclictest1176417-21kworker/u8:0+events_unbound11:40:141
962397992926,2cyclictest908779-21kworker/u8:4+events_unbound07:18:251
962397992926,2cyclictest1284796-21kworker/u8:3+events_unbound12:20:231
962397992926,2cyclictest1218086-21kworker/u8:3+events_unbound11:49:421
962397992926,2cyclictest1139577-21kworker/u8:4+events_unbound10:30:111
962397992926,2cyclictest1113531-21kworker/u8:3+events_unbound10:03:571
962397992926,2cyclictest1035059-21kworker/u8:2+events_unbound08:39:411
962397992926,2cyclictest1035059-21kworker/u8:2+events_unbound08:39:401
962397992825,2cyclictest988623-21kworker/u8:0+events_unbound08:05:281
962397992825,2cyclictest1238834-21kworker/u8:1+events_unbound12:30:201
962400992723,3cyclictest335557-21systemd-journal08:35:002
962400992723,3cyclictest1218086-21kworker/u8:3+flush-259:011:50:152
962400992720,5cyclictest1238792-21latency_hist11:35:022
962397992724,2cyclictest956867-21kworker/u8:2+events_unbound07:49:571
962397992724,2cyclictest1238834-21kworker/u8:1+events_unbound12:10:191
962397992724,2cyclictest1045360-21kworker/u8:1+events_unbound08:43:431
962394992723,3cyclictest1035059-21kworker/u8:2+flush-259:009:30:240
962394992722,3cyclictest1097394-21apt-get09:20:000
962404992622,3cyclictest1118814-21cp09:40:013
962400992623,2cyclictest1035059-21kworker/u8:2+flush-259:009:45:112
962397992624,2cyclictest956867-21kworker/u8:2+events_unbound07:12:391
962397992623,2cyclictest1176417-21kworker/u8:0+events_unbound11:37:411
962397992623,2cyclictest1019451-21kworker/u8:1+events_unbound08:17:401
962394992622,3cyclictest1035059-21kworker/u8:2+flush-259:009:15:000
962394992622,2cyclictest1275096-21apt-get12:10:110
962404992520,3cyclictest1223254-21latency_hist11:20:003
962404992520,3cyclictest1171343-21latency_hist10:30:013
962400992522,2cyclictest1035059-21kworker/u8:2+events_unbound09:35:012
962397992523,2cyclictest977882-21kworker/u8:1+events_unbound07:34:401
962397992523,2cyclictest1238834-21kworker/u8:1+events_unbound12:25:271
962397992522,2cyclictest1248993-21kworker/u8:2+events_unbound11:59:181
962397992521,3cyclictest1197555-21kworker/u8:2+events_unbound11:05:161
962394992511,13cyclictest0-21swapper/011:20:000
962397992422,2cyclictest988623-21kworker/u8:0+events_unbound08:10:271
962397992421,2cyclictest998895-21kworker/u8:3+events_unbound08:03:051
962397992421,2cyclictest1218086-21kworker/u8:3+events_unbound11:15:151
962397992421,2cyclictest1113531-21kworker/u8:3+events_unbound09:37:401
962397992418,4cyclictest1102108-21ntpq09:20:231
962394992412,11cyclictest0-21swapper/007:30:000
962404992319,3cyclictest1045597-21apt-get08:30:093
962404992319,3cyclictest1045360-21kworker/u8:1+flush-259:008:45:173
962404992319,2cyclictest0-21swapper/309:25:003
962404992317,4cyclictest1124379-21cp09:45:013
962400992320,2cyclictest1248993-21kworker/u8:2+flush-259:011:55:252
96240099230,21cyclictest1171292-21systemd10:29:512
962397992320,2cyclictest1160687-21kworker/u8:1+events_unbound11:13:401
962397992320,2cyclictest1045360-21kworker/u8:1+events_unbound08:49:391
962397992320,2cyclictest1035059-21kworker/u8:2+events_unbound10:11:561
96239499239,1cyclictest0-21swapper/012:20:000
962400992219,2cyclictest988623-21kworker/u8:0+flush-259:008:25:002
962400992215,5cyclictest335557-21systemd-journal08:20:002
962397992218,3cyclictest1248993-21kworker/u8:2+flush-259:012:10:001
962394992219,2cyclictest1248993-21kworker/u8:2+flush-259:012:00:260
962394992216,4cyclictest1274830-21latency_hist12:10:010
962394992216,4cyclictest1191970-21apt-get10:50:000
962404992117,3cyclictest335557-21systemd-journal11:05:003
962404992117,3cyclictest1268870-21ntpq12:00:243
962404992117,3cyclictest1223495-21/usr/sbin/munin11:20:163
962400992116,4cyclictest335557-21systemd-journal10:20:002
962397992119,2cyclictest1035059-21kworker/u8:2+events_unbound08:34:561
962397992118,2cyclictest908779-21kworker/u8:4+events_unbound07:28:311
962397992118,2cyclictest1176417-21kworker/u8:0+events_unbound11:25:211
962394992116,4cyclictest1123087-21ntpq09:40:210
962404992015,4cyclictest1176417-21kworker/u8:0+flush-259:011:35:203
962397992017,2cyclictest1218086-21kworker/u8:3+events_unbound11:33:201
962397992017,2cyclictest1176417-21kworker/u8:0+events_unbound10:54:091
962397992017,2cyclictest1160687-21kworker/u8:1+events_unbound10:38:221
962397992017,2cyclictest1035059-21kworker/u8:2+events_unbound09:25:531
962394992017,2cyclictest1035059-21kworker/u8:2+flush-259:009:05:000
962394992015,4cyclictest335557-21systemd-journal07:20:010
962394992011,8cyclictest60350irq/132-enp0s29f1:rx-007:40:110
962404991917,1cyclictest1264519-21cron12:00:003
962404991917,1cyclictest0-21swapper/309:30:003
962404991916,2cyclictest988623-21kworker/u8:0+flush-259:008:40:453
962404991915,3cyclictest1061055-21kworker/u8:3+flush-259:009:05:293
962404991915,3cyclictest1035059-21kworker/u8:2+flush-259:009:05:003
962404991914,3cyclictest1181935-21apt-get10:40:143
962400991914,3cyclictest1192159-21cp10:50:002
962397991916,2cyclictest908779-21kworker/u8:4+events_unbound07:22:401
962394991914,4cyclictest1071435-21apt-get08:55:110
962404991815,2cyclictest972673-21sh07:20:013
962404991813,3cyclictest978079-21/usr/sbin/munin07:25:143
962404991812,4cyclictest1248240-21ntpq11:40:223
962400991814,3cyclictest1238834-21kworker/u8:1+flush-259:012:15:262
962400991814,3cyclictest1176417-21kworker/u8:0+flush-259:011:40:182
962400991814,3cyclictest1061055-21kworker/u8:3+flush-259:009:15:252
962400991814,2cyclictest1254258-21sh11:50:012
962400991812,4cyclictest1102979-21latency_hist09:25:012
962394991814,3cyclictest335557-21systemd-journal09:53:540
962394991811,1cyclictest60350irq/132-enp0s29f1:rx-007:20:270
962394991811,1cyclictest1071179-21turbostat08:55:000
962404991713,3cyclictest1295483-21http12:29:593
962404991712,3cyclictest1030165-21/usr/sbin/munin08:15:153
962404991711,5cyclictest1202675-21latency_hist11:00:003
962404991711,4cyclictest335557-21systemd-journal12:39:593
962404991710,5cyclictest1253357-21ntpq11:45:213
962400991715,1cyclictest1186819-21latency_hist10:45:002
962400991715,1cyclictest0-21swapper/211:40:002
962400991715,1cyclictest0-21swapper/207:25:012
962400991714,2cyclictest996305-21kthreadcore07:40:182
962400991714,1cyclictest0-21swapper/210:55:012
962400991713,3cyclictest988623-21kworker/u8:0+flush-259:007:55:002
96239499179,1cyclictest1176516-21turbostat10:35:000
962394991714,2cyclictest60350irq/132-enp0s29f1:rx-009:20:260
962394991714,2cyclictest1191995-21sh10:50:000
962394991713,3cyclictest1248993-21kworker/u8:2+flush-259:012:40:000
962394991713,3cyclictest1124002-21apt-get09:45:010
962394991712,4cyclictest60350irq/132-enp0s29f1:rx-010:00:240
962404991612,3cyclictest1248993-21kworker/u8:2+flush-259:012:33:463
962404991612,3cyclictest1160687-21kworker/u8:1+flush-259:010:46:093
962404991611,4cyclictest335557-21systemd-journal07:43:323
962404991610,4cyclictest1014442-21latency_hist08:00:003
962400991613,2cyclictest968204-21irqcore07:15:162
962400991612,3cyclictest1124204-21gpgv09:45:012
962394991614,1cyclictest60350irq/132-enp0s29f1:rx-012:20:140
962394991614,1cyclictest60350irq/132-enp0s29f1:rx-011:50:130
962394991614,1cyclictest60350irq/132-enp0s29f1:rx-010:21:390
962394991613,2cyclictest60350irq/132-enp0s29f1:rx-008:45:180
962394991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:120
962394991612,3cyclictest60350irq/132-enp0s29f1:rx-011:05:150
962394991612,3cyclictest1218086-21kworker/u8:3+flush-259:011:30:230
962394991611,4cyclictest1139577-21kworker/u8:4+flush-259:010:25:260
962394991611,1cyclictest60350irq/132-enp0s29f1:rx-008:40:230
962404991511,3cyclictest507-21in:imuxsock09:50:003
962404991511,3cyclictest1124659-21kworker/u8:1+flush-259:009:50:173
962404991511,3cyclictest1113531-21kworker/u8:3+flush-259:010:05:173
962404991510,4cyclictest1269932-21/usr/sbin/munin12:05:153
962404991510,4cyclictest1097786-21gpgv09:20:013
962400991512,2cyclictest1228431-21idleruntime-cro11:25:002
962400991512,2cyclictest1161631-21irqcore10:20:162
962400991511,3cyclictest988623-21kworker/u8:0+flush-259:008:40:162
962400991511,3cyclictest977882-21kworker/u8:1+flush-259:007:30:262
962400991511,3cyclictest1238834-21kworker/u8:1+flush-259:012:10:232
962400991511,3cyclictest1145613-21fschecks_time10:05:162
96239799156,1cyclictest191rcu_preempt08:25:141
96239499159,4cyclictest1243036-21ntpq11:35:210
96239499159,4cyclictest1160950-21latency_hist10:20:000
96239499159,2cyclictest60350irq/132-enp0s29f1:rx-010:05:040
96239499159,2cyclictest60350irq/132-enp0s29f1:rx-008:00:230
96239499158,5cyclictest1044418-21ntpq08:25:210
962394991513,2cyclictest60350irq/132-enp0s29f1:rx-008:11:560
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-012:33:400
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-011:45:200
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-011:20:190
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-011:10:160
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-010:55:260
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-009:05:180
962394991513,1cyclictest60350irq/132-enp0s29f1:rx-007:35:260
962394991513,1cyclictest0-21swapper/010:15:000
962394991512,2cyclictest60350irq/132-enp0s29f1:rx-009:58:180
962394991512,2cyclictest60350irq/132-enp0s29f1:rx-009:35:140
962394991511,3cyclictest1160687-21kworker/u8:1+flush-259:010:40:270
962394991511,3cyclictest1160687-21kworker/u8:1+flush-259:010:35:240
962404991412,1cyclictest1193070-21irqcore10:50:173
962404991412,1cyclictest0-21swapper/307:15:013
962404991411,2cyclictest1160687-21kworker/u8:1+flush-259:010:35:263
962404991411,2cyclictest1020034-21fschecks_count08:05:153
962404991410,3cyclictest1045360-21kworker/u8:1+flush-259:008:50:283
962400991411,2cyclictest908779-21kworker/u8:4+flush-259:007:28:102
962400991411,2cyclictest500-21systemd-logind10:30:042
962400991411,2cyclictest1220651-21kthreadcore11:15:182
962400991411,2cyclictest1013570-21ntp_kernel_pll_07:55:242
962394991413,1cyclictest60350irq/132-enp0s29f1:rx-011:59:330
962394991413,1cyclictest60350irq/132-enp0s29f1:rx-009:27:160
962394991412,2cyclictest60350irq/132-enp0s29f1:rx-008:05:250
962394991412,1cyclictest60350irq/132-enp0s29f1:rx-008:20:240
962394991411,2cyclictest60350irq/132-enp0s29f1:rx-007:55:140
96240499139,3cyclictest1208031-21/usr/sbin/munin11:05:263
96240499138,3cyclictest1035273-21/usr/sbin/munin08:20:213
96240499137,4cyclictest1139944-21latency_hist10:00:013
962404991310,2cyclictest998895-21kworker/u8:3+flush-259:008:02:103
962404991310,2cyclictest1171673-21cpuspeed_turbos10:30:113
962404991310,2cyclictest1165670-21unixbench_singl10:20:253
962404991310,2cyclictest1051045-21fschecks_time08:35:153
962404991310,2cyclictest1051045-21fschecks_time08:35:143
96240099138,4cyclictest1160687-21kworker/u8:1+flush-259:011:10:262
96240099138,4cyclictest1035059-21kworker/u8:2+flush-259:008:28:102
96240099137,4cyclictest1290297-21latency_hist12:25:002
962400991310,2cyclictest1273821-21needreboot12:05:202
962400991310,2cyclictest1203194-21fschecks_time11:00:132
962400991310,2cyclictest1045360-21kworker/u8:1+flush-259:008:55:002
96239499137,4cyclictest335557-21systemd-journal11:45:010
962394991311,1cyclictest60350irq/132-enp0s29f1:rx-008:30:170
962394991311,1cyclictest60350irq/132-enp0s29f1:rx-008:15:150
962394991311,1cyclictest60350irq/132-enp0s29f1:rx-007:32:080
962394991310,2cyclictest60350irq/132-enp0s29f1:rx-011:25:100
96240499129,2cyclictest993288-21unixbench_multi07:35:263
96240499129,2cyclictest1284796-21kworker/u8:3+flush-259:012:20:263
96240099129,2cyclictest1268800-21gcc12:00:232
96240099128,3cyclictest1301049-21kworker/u8:0+flush-259:012:35:262
96240099127,4cyclictest1176417-21kworker/u8:0+flush-259:011:25:142
96240099127,3cyclictest1024619-21sshd08:08:392
96240099126,4cyclictest1113566-21apt-get09:35:132
96239499129,2cyclictest60350irq/132-enp0s29f1:rx-008:35:130
96239499129,2cyclictest60350irq/132-enp0s29f1:rx-008:35:130
962394991210,1cyclictest60350irq/132-enp0s29f1:rx-011:03:280
962394991210,1cyclictest60350irq/132-enp0s29f1:rx-007:50:170
96240499119,1cyclictest0-21swapper/310:15:233
96240499118,2cyclictest1238834-21kworker/u8:1+flush-259:012:10:063
96240499116,3cyclictest1233389-21sshd11:27:403
96240099119,1cyclictest0-21swapper/207:10:262
96240099118,2cyclictest1135107-21cpuspeed_turbos09:55:142
96240099117,2cyclictest1155382-21awk10:15:012
96240099116,3cyclictest513-21gdbus12:30:012
96240099116,3cyclictest335557-21systemd-journal09:10:022
96240499107,2cyclictest1258516-21ntp_kernel_pll_11:50:203
96240499101,8cyclictest1045336-21latency_hist08:29:593
96240099108,1cyclictest0-21swapper/208:45:222
96240099108,1cyclictest0-21swapper/208:35:262
96240099108,1cyclictest0-21swapper/208:35:262
96240099108,1cyclictest0-21swapper/207:35:252
96240099100,2cyclictest1134789-21awk09:55:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional