You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 07, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
976559995044,4cyclictest335557-21systemd-journal07:15:013
976549994338,4cyclictest1314834-21gpgv12:35:010
976559994237,3cyclictest997586-21latency_hist07:30:013
976549994035,3cyclictest1070208-21kworker/u8:2+flush-259:009:25:010
976559993933,4cyclictest1034023-21latency_hist08:05:003
976551993933,4cyclictest1190510-21apt-get10:35:001
976549993935,3cyclictest971400-21kworker/u8:1+flush-259:007:40:010
976549993935,3cyclictest1257982-21kworker/u8:5+flush-259:012:10:210
976549993935,3cyclictest1070208-21kworker/u8:2+flush-259:009:40:220
976551993732,3cyclictest1232187-21kworker/u8:0+flush-259:011:30:001
976549993734,2cyclictest987732-21kworker/u8:2+flush-259:007:30:240
976549993731,4cyclictest1216922-21/usr/sbin/munin11:00:130
976551993631,4cyclictest1100193-21ntpq09:05:211
976549993633,2cyclictest1070208-21kworker/u8:2+flush-259:008:50:250
976549993633,2cyclictest1070208-21kworker/u8:2+flush-259:008:50:240
976551993531,2cyclictest1191207-21apt-get10:35:121
976549993532,2cyclictest971400-21kworker/u8:1+flush-259:007:30:000
976549993531,3cyclictest1190152-21kworker/u8:2+events_unbound10:35:250
976559993431,2cyclictest1070208-21kworker/u8:2+flush-259:010:00:163
976559993428,4cyclictest335557-21systemd-journal08:51:373
976559993428,4cyclictest335557-21systemd-journal08:51:363
976549993430,3cyclictest1257982-21kworker/u8:5+flush-259:011:40:220
976559993328,4cyclictest1002944-21gpgv07:35:003
976554993329,3cyclictest1070208-21kworker/u8:2+flush-259:010:10:202
976549993330,2cyclictest1070208-21kworker/u8:2+flush-259:010:15:200
976559993228,3cyclictest1049700-21kworker/u8:3+flush-259:008:35:253
976554993226,4cyclictest335557-21systemd-journal09:20:012
976549993229,2cyclictest1201262-21kworker/u8:0+flush-259:010:50:230
976554993125,4cyclictest1018584-21latency_hist07:50:002
976551993125,4cyclictest335557-21systemd-journal11:00:061
976549993128,2cyclictest1044325-21kworker/u8:1+events_unbound09:10:200
976549993127,3cyclictest1257982-21kworker/u8:5+flush-259:012:10:000
976559993024,4cyclictest335557-21systemd-journal09:07:353
976551993022,5cyclictest1294083-21latency_hist12:15:021
976549993027,2cyclictest1180353-21kworker/u8:1+events_unbound10:30:000
976549993027,2cyclictest1122411-21kworker/u8:3+flush-259:009:40:010
976549993026,3cyclictest1294107-21kworker/u8:0+flush-259:012:15:180
976549993026,3cyclictest1116817-21apt-get09:25:100
976549993025,3cyclictest1315405-21apt-get12:35:130
976549993023,5cyclictest1241574-21ntpq11:20:220
976549993023,5cyclictest1241574-21ntpq11:20:220
976549993023,5cyclictest1069270-21ntpq08:35:190
976559992926,2cyclictest1070208-21kworker/u8:2+flush-259:009:40:263
976559992926,2cyclictest1013447-21kworker/u8:0+flush-259:008:05:223
976554992926,2cyclictest1070208-21kworker/u8:2+flush-259:009:50:212
976549992927,2cyclictest1122411-21kworker/u8:3+flush-259:011:00:000
976559992822,4cyclictest1303502-21ntpq12:20:203
976559992822,4cyclictest1132136-21ntpq09:35:233
976551992822,4cyclictest335557-21systemd-journal10:05:011
976554992721,4cyclictest1191369-21diskstats10:35:142
976551992721,4cyclictest1111639-21/usr/sbin/munin09:20:131
976549992724,2cyclictest1070208-21kworker/u8:2+flush-259:009:55:240
976549992724,2cyclictest1070208-21kworker/u8:2+events_unbound09:30:120
976549992724,2cyclictest1070208-21kworker/u8:2+events_unbound09:15:230
976549992723,3cyclictest971400-21kworker/u8:1+events_unbound07:53:380
976549992723,3cyclictest1232187-21kworker/u8:0+flush-259:011:40:000
976549992722,3cyclictest1222069-21kworker/u8:2+events_unbound11:05:230
976554992622,3cyclictest1122411-21kworker/u8:3+flush-259:010:45:272
976551992620,4cyclictest1054893-21/usr/sbin/munin08:25:131
976549992617,6cyclictest1095021-21ntpq09:00:200
976554992522,2cyclictest1044325-21kworker/u8:1+events_unbound08:40:192
976554992521,3cyclictest1263415-21kworker/u8:6+flush-259:012:20:242
976551992519,4cyclictest1128014-21/usr/sbin/munin09:35:151
976549992522,2cyclictest1263415-21kworker/u8:6+events_unbound11:55:220
976559992419,4cyclictest1127350-21apt-get09:35:003
976559992419,3cyclictest987099-21apt-get07:20:103
976554992420,3cyclictest1201262-21kworker/u8:0+events_unbound10:50:162
976554992420,3cyclictest1190152-21kworker/u8:2+flush-259:010:40:242
976554992419,3cyclictest1003236-21cat07:35:012
976554992418,4cyclictest1227297-21apt-get11:10:122
976551992421,2cyclictest1138300-21gpgv09:45:011
976551992419,3cyclictest1222070-21kworker/u8:4+flush-259:011:10:001
976551992418,4cyclictest976774-21apt-get07:10:121
976549992421,2cyclictest1013447-21kworker/u8:0+events_unbound08:05:250
976549992417,5cyclictest981675-21latency_hist07:15:000
976559992320,2cyclictest1070208-21kworker/u8:2+flush-259:009:25:113
976554992319,3cyclictest1222070-21kworker/u8:4+flush-259:011:35:012
976554992317,4cyclictest1090771-21latency_hist09:00:012
976551992319,3cyclictest1258220-21apt-get11:40:101
976551992318,3cyclictest971400-21kworker/u8:1+flush-259:007:40:251
976551992317,4cyclictest335557-21systemd-journal12:20:371
976551992316,5cyclictest335557-21systemd-journal08:30:361
976549992320,2cyclictest1122411-21kworker/u8:3+flush-259:010:05:210
976549992317,4cyclictest335557-21systemd-journal12:02:360
976549992317,4cyclictest1304677-21apt-get12:25:110
976551992218,3cyclictest1294107-21kworker/u8:0+flush-259:012:15:161
976551992217,3cyclictest1003410-21apt-get07:35:121
976549992218,3cyclictest1070208-21kworker/u8:2+events_unbound10:00:200
976549992218,3cyclictest1013447-21kworker/u8:0+events_unbound08:15:260
976549992216,4cyclictest335557-21systemd-journal08:45:000
976549992216,4cyclictest1029125-21/usr/sbin/munin08:00:140
976554992118,1cyclictest0-21swapper/212:30:002
97655499210,18cyclictest1-21systemd11:45:002
976551992117,3cyclictest987732-21kworker/u8:2+flush-259:007:30:151
976551992115,4cyclictest1138762-21/usr/sbin/munin09:45:151
976549992119,1cyclictest1013447-21kworker/u8:0+events_unbound08:10:230
976549992118,2cyclictest971400-21kworker/u8:1+events_unbound07:20:240
976549992117,2cyclictest971400-21kworker/u8:1+flush-259:007:15:180
976549992114,5cyclictest1053816-21ntpq08:20:230
976549992113,5cyclictest1200326-21ntpq10:40:200
97654999210,19cyclictest1-21systemd11:50:000
976559992014,4cyclictest985974-21ntpq07:15:233
976554992017,2cyclictest1013447-21kworker/u8:0+flush-259:008:25:202
976554992015,3cyclictest1-21systemd11:55:002
976554992014,4cyclictest1008732-21diskstats07:40:142
976551992016,3cyclictest335557-21systemd-journal11:14:371
976549992017,2cyclictest971400-21kworker/u8:1+flush-259:007:55:230
976549992017,2cyclictest1070208-21kworker/u8:2+flush-259:010:10:110
976549992015,3cyclictest1222070-21kworker/u8:4+flush-259:011:30:170
976549992015,3cyclictest1044325-21kworker/u8:1+events_unbound08:55:170
976549992014,4cyclictest335557-21systemd-journal11:55:000
976559991916,2cyclictest1039405-21apt-get08:10:123
976559991916,2cyclictest0-21swapper/308:30:003
976554991916,2cyclictest971400-21kworker/u8:1+events_unbound07:10:002
976554991916,2cyclictest1263415-21kworker/u8:6+flush-259:012:00:212
976554991916,2cyclictest1070208-21kworker/u8:2+events_unbound08:45:142
976554991914,4cyclictest971400-21kworker/u8:1+flush-259:007:50:212
976554991914,3cyclictest1222070-21kworker/u8:4+flush-259:011:15:172
976551991916,2cyclictest1169401-21cut10:15:001
976551991916,2cyclictest1080702-21kworker/u8:0+flush-259:009:00:151
976551991913,4cyclictest1273745-21apt-get11:55:121
976551991913,4cyclictest1028888-21latency_hist08:00:001
976551991911,6cyclictest335557-21systemd-journal11:50:001
976549991915,2cyclictest1222070-21kworker/u8:4+events_unbound11:30:000
976559991812,4cyclictest976481-21latency_hist07:10:003
976554991815,2cyclictest987732-21kworker/u8:2+flush-259:007:30:232
976554991814,3cyclictest1133222-21apt-get09:40:112
976554991813,4cyclictest1044325-21kworker/u8:1+flush-259:009:05:162
976554991812,4cyclictest1221842-21latency_hist11:05:002
976551991812,4cyclictest335557-21systemd-journal11:18:361
976549991815,2cyclictest1201262-21kworker/u8:0+events_unbound10:47:360
976549991815,2cyclictest1122411-21kworker/u8:3+events_unbound09:45:230
976559991714,2cyclictest1242470-21kworker/u8:1+flush-259:011:55:003
976559991714,2cyclictest1215813-21ntp_kernel_pll_10:55:223
976559991714,2cyclictest1044325-21kworker/u8:1+flush-259:008:30:223
976559991714,2cyclictest0-21swapper/311:35:003
976559991713,3cyclictest1201262-21kworker/u8:0+flush-259:011:00:163
976559991713,3cyclictest1070208-21kworker/u8:2+flush-259:010:15:153
976559991712,4cyclictest1179702-21latency_hist10:25:013
976559991712,3cyclictest1222069-21kworker/u8:2+flush-259:011:05:183
976554991713,3cyclictest933920-21kworker/u8:4+events_unbound07:20:132
976554991713,3cyclictest1070208-21kworker/u8:2+flush-259:009:10:022
976554991713,2cyclictest0-21swapper/210:35:002
976554991712,4cyclictest1013447-21kworker/u8:0+flush-259:008:15:162
976554991711,4cyclictest1185068-21apt-get10:27:272
976551991713,3cyclictest1044325-21kworker/u8:1+flush-259:008:55:211
976549991714,2cyclictest971400-21kworker/u8:1+events_unbound07:40:270
976549991714,2cyclictest60350irq/132-enp0s29f1:rx-007:45:250
976549991714,2cyclictest1304399-21cron12:25:000
976549991714,2cyclictest1070208-21kworker/u8:2+events_unbound09:50:110
976549991714,2cyclictest0-21swapper/010:25:010
976559991613,2cyclictest503-21tpm2-abrmd12:00:003
976559991612,3cyclictest1070208-21kworker/u8:2+events_unbound09:15:193
976559991611,4cyclictest1143923-21/usr/sbin/munin09:50:223
97655499161,8cyclictest1216683-21awk11:00:002
976554991612,3cyclictest1122411-21kworker/u8:3+flush-259:010:20:012
976554991612,3cyclictest1044325-21kworker/u8:1+events_unbound08:30:112
976554991610,4cyclictest1122411-21kworker/u8:3+flush-259:009:45:212
976549991614,1cyclictest60350irq/132-enp0s29f1:rx-008:45:240
976549991613,2cyclictest1222069-21kworker/u8:2+flush-259:011:10:160
976559991512,2cyclictest1273278-21kworker/u8:0+flush-259:012:05:013
976559991510,4cyclictest335557-21systemd-journal10:12:363
976559991510,4cyclictest1263415-21kworker/u8:6+flush-259:012:25:243
97655499158,5cyclictest1127349-21latency_hist09:35:002
976554991512,1cyclictest61350irq/137-enp0s29f1:tx-212:33:522
976554991511,3cyclictest1263415-21kworker/u8:6+flush-259:012:05:232
976554991511,3cyclictest1049700-21kworker/u8:3+events_unbound08:35:242
976551991512,2cyclictest61250irq/135-enp0s29f1:tx-108:38:001
976551991512,2cyclictest1070208-21kworker/u8:2+flush-259:009:50:061
976551991510,3cyclictest1075595-21apt-get08:45:121
97654999159,4cyclictest335557-21systemd-journal10:35:000
976549991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:230
976549991513,1cyclictest60350irq/132-enp0s29f1:rx-008:25:180
976549991510,4cyclictest1044325-21kworker/u8:1+events_unbound09:05:120
97655999149,3cyclictest1190515-21latency_hist10:35:003
976559991411,2cyclictest1264470-21tr11:45:183
976559991411,2cyclictest1232187-21kworker/u8:0+flush-259:011:25:003
976559991411,2cyclictest1232187-21kworker/u8:0+flush-259:011:25:003
976559991410,3cyclictest1263415-21kworker/u8:6+flush-259:012:30:253
97655499149,4cyclictest1080702-21kworker/u8:0+flush-259:009:00:212
97655499148,4cyclictest335557-21systemd-journal11:20:122
97655499148,4cyclictest335557-21systemd-journal11:20:122
97655499141,3cyclictest1278668-21awk12:00:002
976554991410,3cyclictest1122411-21kworker/u8:3+flush-259:010:10:012
97655199149,3cyclictest1242470-21kworker/u8:1+flush-259:011:35:481
97655199149,3cyclictest1122283-21base6409:30:001
976551991411,2cyclictest1211831-21apt-get10:55:121
976551991410,3cyclictest971400-21kworker/u8:1+flush-259:007:25:421
97655199140,13cyclictest1-21systemd12:05:001
976549991411,2cyclictest1232187-21kworker/u8:0+events_unbound11:18:190
97655999139,3cyclictest1122411-21kworker/u8:3+flush-259:009:45:163
97655999139,2cyclictest1295366-21kthreadcore12:15:193
976559991310,1cyclictest0-21swapper/308:00:013
97655499139,2cyclictest0-21swapper/209:30:002
97655499138,3cyclictest1320080-21kworker/u8:3+flush-259:012:40:002
97655499137,4cyclictest1242470-21kworker/u8:1+events_unbound11:35:172
976554991310,2cyclictest1070208-21kworker/u8:2+flush-259:008:51:122
976554991310,2cyclictest1070208-21kworker/u8:2+flush-259:008:51:112
976554991310,2cyclictest0-21swapper/212:10:252
97655199139,3cyclictest987732-21kworker/u8:2+flush-259:008:05:061
97655199139,3cyclictest1201262-21kworker/u8:0+flush-259:010:55:001
97655199138,3cyclictest1169657-21apt-get10:15:111
976551991310,2cyclictest1268801-21fschecks_time11:50:141
976551991310,2cyclictest1072729-21kthreadcore08:40:171
976551991310,2cyclictest1014111-21irqcore07:45:161
976551991310,2cyclictest0-21swapper/112:35:001
97655999129,2cyclictest1258337-21cpuspeed_turbos11:40:123
97655999129,2cyclictest1095431-21unixbench_multi09:00:243
97655499129,2cyclictest1294416-21cpuspeed_turbos12:15:132
97655499129,2cyclictest1222337-21fschecks_time11:05:152
97655499129,2cyclictest1128174-21cpuspeed_turbos09:35:132
97655499128,3cyclictest987732-21kworker/u8:2+flush-259:007:55:072
97655499127,3cyclictest1-21systemd11:30:002
97655499126,4cyclictest1174798-21/usr/sbin/munin10:20:142
97655499125,5cyclictest1034122-21cat08:04:592
97655199129,2cyclictest1315498-21cpuspeed_turbos12:35:131
97655199129,2cyclictest1179889-21apt-key10:25:011
97655199129,2cyclictest1153529-21unixbench_multi09:55:241
97655199128,3cyclictest1232187-21kworker/u8:0+flush-259:011:20:251
97655199128,3cyclictest1232187-21kworker/u8:0+flush-259:011:20:251
97655199128,3cyclictest1101340-21apt-get09:10:111
97655199127,4cyclictest992174-21base6407:25:011
97655999118,2cyclictest1304435-21kworker/u8:1+flush-259:012:35:113
97655999118,2cyclictest1149141-21cpuspeed_turbos09:55:133
97655999118,2cyclictest1070550-21cpuspeed_turbos08:40:133
97655999117,3cyclictest1263415-21kworker/u8:6+flush-259:012:05:483
97655999111,3cyclictest11152822kthreadcore09:20:163
97655199119,1cyclictest0-21swapper/109:30:011
97655199118,2cyclictest1122411-21kworker/u8:3+flush-259:010:06:081
97655199115,4cyclictest335557-21systemd-journal08:25:001
97655999108,1cyclictest0-21swapper/311:30:003
97655999107,2cyclictest1229588-21sort11:10:193
97655499105,3cyclictest1049700-21kworker/u8:3+flush-259:008:20:172
97655199106,3cyclictest1201262-21kworker/u8:0+flush-259:010:45:221
97655199106,3cyclictest1013447-21kworker/u8:0+flush-259:008:16:071
9765599993,4cyclictest1049067-21users08:15:263
9765519996,1cyclictest0-21swapper/107:15:181
9765519994,3cyclictest1080736-21apt-get08:50:121
9765519994,3cyclictest1080736-21apt-get08:50:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional