You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Mar 27, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1119807994339,3cyclictest1235760-21kworker/u8:0+flush-259:009:05:000
1119812993730,5cyclictest252-21systemd-journal10:05:001
1119819993631,4cyclictest1214675-21apt-get08:40:112
1119807993633,2cyclictest1114213-21kworker/u8:3+events_unbound07:55:140
1119822993530,3cyclictest1355029-21kworker/u8:4+flush-259:011:20:213
1119807993530,4cyclictest1349923-21apt-get10:50:130
1119807993330,2cyclictest1291841-21kworker/u8:1+flush-259:010:10:250
1119807993330,2cyclictest1245491-21kworker/u8:3+events_unbound09:40:230
1119807993229,2cyclictest2267822-21kworker/u8:2+flush-259:007:40:240
1119807993228,3cyclictest1187287-21kworker/u8:3+events_unbound08:35:210
1119807993128,2cyclictest1338980-21kworker/u8:3+events_unbound10:50:000
1119807993128,2cyclictest1235760-21kworker/u8:0+events_unbound09:10:130
1119812993023,5cyclictest1338954-21latency_hist10:40:011
1119807993027,2cyclictest1355029-21kworker/u8:4+events_unbound11:10:200
1119807993026,3cyclictest1442853-21kworker/u8:1+flush-259:012:35:180
1119822992925,3cyclictest2267822-21kworker/u8:2+flush-259:007:45:213
1119822992822,4cyclictest1307647-21latency_hist10:10:013
1119812992823,4cyclictest1266290-21/usr/sbin/munin09:30:151
1119807992822,3cyclictest1235760-21kworker/u8:0+events_unbound09:15:150
1119822992724,2cyclictest2267822-21kworker/u8:2+flush-259:007:55:003
1119822992723,3cyclictest1266075-21kworker/u8:2+flush-259:009:50:003
1119807992724,2cyclictest1421887-21kworker/u8:2+events_unbound12:20:190
1119807992723,3cyclictest1442853-21kworker/u8:1+events_unbound12:25:230
1119822992623,2cyclictest1390800-21kworker/u8:0+flush-259:011:45:243
1119822992623,2cyclictest1235760-21kworker/u8:0+flush-259:009:10:173
1119822992617,3cyclictest1338980-21kworker/u8:3+flush-259:010:55:003
1119807992623,2cyclictest1411203-21kworker/u8:1+flush-259:012:00:240
1119807992623,2cyclictest1291841-21kworker/u8:1+events_unbound10:40:120
1119807992622,3cyclictest1198523-21kworker/u8:1+events_unbound08:40:210
1119807992621,4cyclictest1135967-21apt-get07:25:120
1119807992618,2cyclictest1353897-21kworker/u8:0+events_unbound10:55:230
1119822992522,2cyclictest1421887-21kworker/u8:2+events_unbound12:25:143
1119822992521,3cyclictest1344302-21kworker/u8:2+flush-259:010:45:153
1119822992521,3cyclictest1266075-21kworker/u8:2+flush-259:009:50:153
1119822992521,3cyclictest1266075-21kworker/u8:2+flush-259:009:50:153
1119819992521,3cyclictest1245491-21kworker/u8:3+flush-259:009:40:162
1119819992520,3cyclictest1448256-21apt-get12:25:122
1119812992520,3cyclictest1119811-21latency_hist07:10:001
1119807992522,2cyclictest1344302-21kworker/u8:2+events_unbound11:15:200
1119807992522,2cyclictest1323476-21kworker/u8:0+events_unbound10:35:170
1119807992522,2cyclictest1260657-21kworker/u8:1+flush-259:009:45:150
1119807992522,2cyclictest1187287-21kworker/u8:3+events_unbound08:30:240
1119807992520,4cyclictest1390913-21latency_hist11:30:000
1119819992420,3cyclictest1411203-21kworker/u8:1+flush-259:012:05:142
1119819992419,3cyclictest1260855-21awk09:25:002
1119812992420,3cyclictest1209511-21apt-get08:35:111
1119807992421,2cyclictest1266075-21kworker/u8:2+flush-259:009:55:150
1119807992421,2cyclictest1266075-21kworker/u8:2+flush-259:009:55:140
1119807992421,2cyclictest1235760-21kworker/u8:0+events_unbound09:20:200
1119807992421,2cyclictest1081501-21kworker/u8:1+events_unbound07:10:180
111980799240,22cyclictest1-21systemd11:10:020
1119822992320,2cyclictest1344302-21kworker/u8:2+events_unbound11:30:113
1119819992317,4cyclictest1141313-21diskstats07:30:142
1119819992316,5cyclictest252-21systemd-journal07:50:322
1119812992319,3cyclictest1199188-21apt-get08:25:111
1119812992317,4cyclictest1125586-21cp07:15:011
1119807992320,2cyclictest1291841-21kworker/u8:1+flush-259:010:05:200
1119822992219,2cyclictest2267822-21kworker/u8:2+flush-259:008:20:003
1119822992219,2cyclictest1421887-21kworker/u8:2+flush-259:012:20:243
1119822992219,2cyclictest1411203-21kworker/u8:1+events_unbound12:05:233
1119822992219,2cyclictest1114213-21kworker/u8:3+flush-259:007:35:213
1119819992219,2cyclictest2267822-21kworker/u8:2+flush-259:008:35:162
1119819992218,3cyclictest1421887-21kworker/u8:2+flush-259:012:35:012
1119819992217,3cyclictest1119709-21latency_hist07:10:012
1119819992215,5cyclictest1286633-21latency_hist09:50:002
1119812992216,4cyclictest1375728-21apt-get11:15:111
1119807992219,2cyclictest1432571-21kworker/u8:3+flush-259:012:10:180
1119807992219,2cyclictest1411203-21kworker/u8:1+flush-259:011:50:180
1119822992118,2cyclictest1421887-21kworker/u8:2+flush-259:012:15:203
1119822992118,2cyclictest1124406-21kworker/u8:0+flush-259:007:30:213
1119822992117,3cyclictest1390800-21kworker/u8:0+events_unbound11:40:153
1119822992117,3cyclictest1266075-21kworker/u8:2+flush-259:010:10:213
1119822992117,3cyclictest1187287-21kworker/u8:3+events_unbound08:20:183
1119822992114,5cyclictest1422277-21diskstats12:00:143
1119819992118,2cyclictest1193365-21munin-plugin-st08:20:002
1119819992115,4cyclictest1152200-21gpgv07:40:012
1119812992119,1cyclictest1119803-21cyclictest08:25:001
1119812992117,3cyclictest500-21systemd-logind10:45:011
1119812992115,4cyclictest1437971-21apt-get12:15:121
1119807992117,3cyclictest1390800-21kworker/u8:0+events_unbound12:05:040
1119807992117,3cyclictest1219644-21kworker/u8:0+events_unbound08:45:190
1119822992017,2cyclictest1235760-21kworker/u8:0+flush-259:009:05:243
1119822992016,3cyclictest2267822-21kworker/u8:2+flush-259:008:50:113
1119822992016,3cyclictest1276616-21apt-get09:40:123
1119822992015,3cyclictest1125615-21/usr/sbin/munin07:15:143
1119812992016,3cyclictest1349256-21http10:50:001
1119812992014,4cyclictest1081501-21kworker/u8:1+flush-259:007:10:171
1119807992018,2cyclictest2267822-21kworker/u8:2+flush-259:007:30:230
1119807992017,2cyclictest2267822-21kworker/u8:2+events_unbound09:05:130
1119807992017,2cyclictest1355029-21kworker/u8:4+events_unbound11:20:160
1119807992017,2cyclictest1307867-21kworker/u8:3+events_unbound10:20:220
1119807992017,2cyclictest1245491-21kworker/u8:3+flush-259:009:35:180
1119807992016,2cyclictest1151834-21gpgconf07:40:010
1119807992015,4cyclictest1271215-21latency_hist09:35:000
1119822991915,3cyclictest1390800-21kworker/u8:0+events_unbound12:00:003
1119822991915,3cyclictest1355029-21kworker/u8:4+flush-259:011:25:243
1119822991915,3cyclictest1124544-21apt-get07:10:343
1119819991916,2cyclictest1225431-21irqcore08:50:162
1119819991915,3cyclictest1442823-21turbostat.cron12:20:002
1119819991915,3cyclictest1230148-21/usr/sbin/munin08:55:152
1119819991914,3cyclictest0-21swapper/209:15:002
1119812991915,3cyclictest1257052-21kthreadcore09:20:151
1119807991916,2cyclictest1124406-21kworker/u8:0+events_unbound08:05:140
1119807991915,3cyclictest1198523-21kworker/u8:1+flush-259:008:25:230
1119822991814,3cyclictest1187287-21kworker/u8:3+events_unbound08:30:223
1119819991812,4cyclictest1318291-40mandb10:19:342
1119812991811,5cyclictest252-21systemd-journal12:10:001
1119807991815,2cyclictest2267822-21kworker/u8:2+events_unbound08:10:190
1119807991815,2cyclictest1421887-21kworker/u8:2+events_unbound12:19:280
1119807991815,2cyclictest1266075-21kworker/u8:2+events_unbound10:02:340
1119807991814,3cyclictest1390800-21kworker/u8:0+events_unbound11:35:160
1119807991814,3cyclictest1323476-21kworker/u8:0+events_unbound10:30:170
1119807991811,5cyclictest1235095-21latency_hist09:00:000
1119822991714,2cyclictest1442853-21kworker/u8:1+events_unbound12:35:153
1119822991714,2cyclictest1344302-21kworker/u8:2+flush-259:011:05:003
1119822991714,2cyclictest1229519-21kworker/u8:1+events_unbound08:55:123
1119822991714,2cyclictest1124406-21kworker/u8:0+flush-259:008:05:213
1119822991713,3cyclictest1291841-21kworker/u8:1+flush-259:010:35:153
1119822991711,4cyclictest1369419-21ntpq11:05:203
1119819991714,2cyclictest1147159-21irqcore07:35:162
1119819991713,3cyclictest2267822-21kworker/u8:2+flush-259:009:05:152
1119819991712,4cyclictest1219882-21apt-get08:45:112
1119812991714,2cyclictest1307848-21latency_hist10:10:001
1119812991713,3cyclictest1442853-21kworker/u8:1+flush-259:012:30:181
1119812991712,4cyclictest2267822-21kworker/u8:2+flush-259:009:10:001
1119812991712,4cyclictest1130800-21/usr/sbin/munin07:20:131
1119812991711,4cyclictest1447992-21latency_hist12:25:001
1119812991711,4cyclictest1245730-21apt-get09:10:091
1119822991613,2cyclictest1266075-21kworker/u8:2+events_unbound10:15:243
1119822991613,2cyclictest1245491-21kworker/u8:3+events_unbound09:30:153
1119822991613,2cyclictest1235760-21kworker/u8:0+flush-259:009:15:253
1119822991612,3cyclictest1344302-21kworker/u8:2+events_unbound11:10:053
1119822991612,3cyclictest1297218-21apt-get10:00:113
1119822991611,4cyclictest1359960-21latency_hist11:00:013
111981999169,5cyclictest1290946-21ntpq09:50:222
111981999169,5cyclictest1290946-21ntpq09:50:212
1119819991614,1cyclictest509-21rs:main2
1119819991612,3cyclictest1349267-21gpgv10:50:002
1119819991612,3cyclictest1235760-21kworker/u8:0+flush-259:009:15:012
1119819991612,3cyclictest1114213-21kworker/u8:3+flush-259:007:55:162
1119812991613,2cyclictest1261552-21irqcore09:25:161
1119812991612,3cyclictest1235357-21apt-get09:00:111
1119812991612,3cyclictest1135729-21kworker/u8:1+flush-259:007:25:171
1119812991610,4cyclictest1281754-21apt-get09:45:121
1119807991614,1cyclictest60350irq/132-enp0s29f1:rx-010:28:040
1119807991613,2cyclictest60350irq/132-enp0s29f1:rx-012:30:150
1119807991613,2cyclictest60350irq/132-enp0s29f1:rx-011:01:400
1119807991613,2cyclictest60350irq/132-enp0s29f1:rx-007:51:500
1119807991613,2cyclictest1396100-21kworker/u8:3+events_unbound11:45:200
1119807991613,2cyclictest1390800-21kworker/u8:0+events_unbound11:55:090
1119807991613,2cyclictest1260657-21kworker/u8:1+flush-259:009:25:260
1119807991612,3cyclictest1125516-21gpgv07:15:010
1119807991611,4cyclictest1391184-21apt-get11:30:100
1119822991512,2cyclictest1291841-21kworker/u8:1+flush-259:010:30:213
1119822991512,2cyclictest1235760-21kworker/u8:0+events_unbound09:20:223
1119822991512,2cyclictest1124406-21kworker/u8:0+flush-259:008:00:113
111982299150,13cyclictest252-21systemd-journal11:50:263
111981999159,4cyclictest252-21systemd-journal10:30:002
1119819991512,2cyclictest2267822-21kworker/u8:2+flush-259:007:20:212
1119819991512,2cyclictest1355029-21kworker/u8:4+events_unbound11:10:172
1119812991512,2cyclictest1437692-21cron12:14:591
1119812991511,3cyclictest1355062-21apt-get10:55:121
1119807991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:180
1119807991512,2cyclictest60350irq/132-enp0s29f1:rx-011:40:200
1119807991512,2cyclictest60350irq/132-enp0s29f1:rx-008:00:090
1119807991512,2cyclictest1124406-21kworker/u8:0+flush-259:007:49:350
1119822991411,2cyclictest1398647-21kthreadcore11:35:193
1119822991411,2cyclictest1192975-21kworker/u8:0+events_unbound08:25:123
1119822991411,2cyclictest1124406-21kworker/u8:0+flush-259:007:55:273
1119822991410,3cyclictest2267822-21kworker/u8:2+events_unbound08:14:573
1119822991410,3cyclictest1276359-21latency_hist09:40:003
111981999149,3cyclictest252-21systemd-journal11:10:012
111981999149,3cyclictest1442853-21kworker/u8:1+flush-259:012:35:232
1119819991411,2cyclictest1182152-21ntp_kernel_err08:05:192
1119819991410,3cyclictest252-21systemd-journal11:48:262
1119819991410,3cyclictest1411203-21kworker/u8:1+flush-259:012:00:132
1119819991410,3cyclictest1355029-21kworker/u8:4+flush-259:011:25:212
111981299149,3cyclictest1152324-21apt-get07:40:121
111981299148,4cyclictest1146564-21cat07:35:001
1119812991410,3cyclictest1187287-21kworker/u8:3+flush-259:008:30:241
1119807991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:120
1119807991412,1cyclictest60350irq/132-enp0s29f1:rx-009:53:210
1119807991412,1cyclictest60350irq/132-enp0s29f1:rx-009:53:210
1119807991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:150
1119807991411,2cyclictest2267822-21kworker/u8:2+events_unbound08:15:240
1119807991411,2cyclictest1187287-21kworker/u8:3+events_unbound08:20:130
1119822991310,2cyclictest1432571-21kworker/u8:3+events_unbound12:10:163
1119822991310,2cyclictest1266075-21kworker/u8:2+flush-259:010:20:183
1119822991310,2cyclictest1245491-21kworker/u8:3+events_unbound09:28:343
1119822991310,2cyclictest1114213-21kworker/u8:3+flush-259:007:44:333
111981999139,3cyclictest1124406-21kworker/u8:0+flush-259:008:10:212
111981999139,2cyclictest0-21swapper/207:15:002
111981999138,3cyclictest1390800-21kworker/u8:0+flush-259:011:35:182
111981999137,4cyclictest513-21gdbus09:35:002
1119819991311,1cyclictest503-21tpm2-abrmd07:20:002
111981299138,3cyclictest1266075-21kworker/u8:2+flush-259:010:20:161
111982299129,2cyclictest1114213-21kworker/u8:3+events_unbound07:20:153
111982299129,2cyclictest0-21swapper/310:00:003
111982299129,2cyclictest0-21swapper/310:00:003
111982299129,1cyclictest0-21swapper/308:35:163
111982299128,3cyclictest1323476-21kworker/u8:0+flush-259:010:25:183
111981999129,2cyclictest1187287-21kworker/u8:3+flush-259:008:30:212
111981999125,5cyclictest509-21rs:main2
111981999123,6cyclictest1416714-21munin-run11:55:002
1119819991210,1cyclictest0-21swapper/211:00:162
111981299129,2cyclictest1166667-21ntp_kernel_err07:50:211
111981299128,3cyclictest1355029-21kworker/u8:4+flush-259:011:25:241
111981299128,3cyclictest1291841-21kworker/u8:1+flush-259:010:30:221
111981299128,3cyclictest0-21swapper/107:35:001
111981299127,4cyclictest1172992-21apt-get08:00:101
1119812991210,1cyclictest1157893-21irqcore07:45:151
111982299117,3cyclictest1442853-21kworker/u8:1+events_unbound12:31:273
111981999118,2cyclictest1379616-21needreboot11:15:192
111981999118,2cyclictest1297284-21cpuspeed_turbos10:00:132
111981999118,2cyclictest1271542-21cpuspeed_turbos09:35:122
111981999118,1cyclictest0-21swapper/212:10:142
111981999112,1cyclictest1239379-21ntp_kernel_pll_09:00:202
111981299119,1cyclictest1308757-21tr10:10:171
111981299119,1cyclictest0-21swapper/111:05:011
111981299119,1cyclictest0-21swapper/109:40:001
111981299118,2cyclictest1422525-21irqcore12:00:171
111981299117,3cyclictest2267822-21kworker/u8:2+events_unbound08:50:181
111981299117,3cyclictest1178159-21apt-get08:05:121
111982299107,2cyclictest2267822-21kworker/u8:2+events_unbound09:00:143
111981999107,2cyclictest1355322-21fschecks_time10:55:152
111981999107,1cyclictest1445295-21kthreadcore12:20:182
111981999106,2cyclictest0-21swapper/210:10:172
111981999100,8cyclictest1323529-21awk10:25:002
111981299105,3cyclictest1391439-21tune2fs11:30:131
11198199994,3cyclictest1138246-21tr07:25:172
11198129995,3cyclictest1451993-21cut12:25:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional