You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-05 - 15:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4s.osadl.org (updated Thu Nov 05, 2026 00:44:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
347191995043,4cyclictest425267-21/usr/sbin/munin20:25:151
347198994541,3cyclictest192314-21kworker/u8:2+events_unbound19:30:172
347189994439,4cyclictest378419-21/usr/sbin/munin19:40:130
347189994235,5cyclictest347139-21latency_hist19:10:010
347191994135,4cyclictest565094-21latency_hist22:40:011
347198994036,3cyclictest528801-21kworker/u8:0+events_unbound22:40:232
347198994034,4cyclictest335557-21systemd-journal23:27:042
347198993935,3cyclictest648530-21kworker/u8:2+events_unbound00:00:172
347191993831,5cyclictest393664-21latency_hist19:55:011
347189993834,3cyclictest486630-21kworker/u8:3+flush-259:021:25:260
347198993630,2cyclictest440505-21kworker/u8:1+events_unbound20:55:222
347189993630,4cyclictest466345-21latency_hist21:05:010
347202993531,3cyclictest486630-21kworker/u8:3+events_unbound22:15:213
347202993531,3cyclictest486630-21kworker/u8:3+events_unbound22:15:213
347202993529,4cyclictest393853-21cp19:55:003
347198993531,3cyclictest486630-21kworker/u8:3+events_unbound22:15:192
347198993531,3cyclictest486630-21kworker/u8:3+events_unbound22:15:192
347198993531,3cyclictest192314-21kworker/u8:2+events_unbound19:15:142
347191993528,5cyclictest414709-21latency_hist20:15:011
347202993430,3cyclictest529066-21kworker/u8:4+events_unbound22:55:123
347202993430,3cyclictest440505-21kworker/u8:1+flush-259:021:10:213
347191993429,4cyclictest373270-21apt-get19:35:121
347202993330,2cyclictest192314-21kworker/u8:2+events_unbound20:05:193
347202993327,4cyclictest455989-21latency_hist20:55:013
347198993330,2cyclictest440505-21kworker/u8:1+flush-259:021:20:252
347198993330,2cyclictest357721-21kworker/u8:3+flush-259:019:20:182
347198993327,4cyclictest508126-21latency_hist21:45:002
347189993329,3cyclictest549564-21kworker/u8:2+flush-259:022:35:240
347202993229,2cyclictest637765-21kworker/u8:1+events_unbound00:40:003
347202993229,2cyclictest637765-21kworker/u8:1+events_unbound00:40:003
347202993229,2cyclictest570265-21kworker/u8:1+flush-259:023:10:163
347202993229,2cyclictest192314-21kworker/u8:2+events_unbound19:40:203
347198993229,2cyclictest486630-21kworker/u8:3+events_unbound21:25:192
347198993228,3cyclictest627175-21kworker/u8:3+flush-259:023:40:242
347198993228,3cyclictest503186-21kworker/u8:2+flush-259:022:00:002
347191993226,4cyclictest674391-21/usr/sbin/munin00:25:161
347189993225,5cyclictest335557-21systemd-journal22:35:000
347198993128,2cyclictest373018-21kworker/u8:4+flush-259:020:20:212
347191993126,3cyclictest440505-21kworker/u8:1+flush-259:021:00:191
347191993125,4cyclictest627175-21kworker/u8:3+flush-259:023:45:131
347202993026,3cyclictest549564-21kworker/u8:2+events_unbound23:20:223
347202993026,3cyclictest544140-21kworker/u8:1+events_unbound22:23:033
347202993025,3cyclictest638202-21apt-get23:50:123
347202993024,4cyclictest335557-21systemd-journal21:40:003
347202992925,3cyclictest373018-21kworker/u8:4+events_unbound20:15:233
347198992926,3cyclictest544140-21kworker/u8:1+events_unbound22:25:242
347198992925,3cyclictest357505-21kworker/u8:1+events_unbound19:25:152
347191992923,4cyclictest451066-21/usr/sbin/munin20:50:161
347202992826,2cyclictest373018-21kworker/u8:4+events_unbound20:35:223
347202992824,3cyclictest549564-21kworker/u8:2+events_unbound22:30:043
347202992824,3cyclictest513312-21kworker/u8:1+events_unbound22:00:043
347202992823,3cyclictest658945-21apt-get00:10:133
347198992825,2cyclictest192314-21kworker/u8:2+flush-259:020:25:202
347198992824,3cyclictest503186-21kworker/u8:2+events_unbound21:45:212
347198992824,3cyclictest440505-21kworker/u8:1+events_unbound21:30:042
347191992822,4cyclictest394332-21/usr/sbin/munin19:55:141
347191992822,4cyclictest394332-21/usr/sbin/munin19:55:131
347189992824,3cyclictest486630-21kworker/u8:3+events_unbound21:40:210
347189992823,4cyclictest503186-21kworker/u8:2+events_unbound21:45:170
347202992725,2cyclictest303929-21kworker/u8:0+events_unbound19:46:053
347202992724,2cyclictest549564-21kworker/u8:2+events_unbound22:35:133
347202992723,3cyclictest627175-21kworker/u8:3+flush-259:023:45:163
347202992723,3cyclictest627175-21kworker/u8:3+events_unbound23:40:233
347202992723,3cyclictest357505-21kworker/u8:1+events_unbound19:29:053
347202992723,3cyclictest192314-21kworker/u8:2+events_unbound20:10:223
347198992724,2cyclictest617044-21kworker/u8:1+events_unbound23:35:132
347198992724,2cyclictest192314-21kworker/u8:2+events_unbound19:35:192
347198992723,3cyclictest192314-21kworker/u8:2+events_unbound19:51:052
347198992721,5cyclictest335557-21systemd-journal20:10:002
347191992721,4cyclictest549564-21kworker/u8:2+flush-259:023:25:151
347191992721,4cyclictest509-21rs:main1
347189992724,2cyclictest486630-21kworker/u8:3+flush-259:022:20:150
347189992724,2cyclictest425258-21kworker/u8:0+events_unbound20:50:190
347189992723,3cyclictest440505-21kworker/u8:1+flush-259:021:15:200
347189992723,3cyclictest192314-21kworker/u8:2+flush-259:019:10:210
347202992622,3cyclictest357721-21kworker/u8:3+events_unbound19:24:033
347198992623,2cyclictest303929-21kworker/u8:0+events_unbound19:55:152
347198992623,2cyclictest303929-21kworker/u8:0+events_unbound19:55:142
347198992622,3cyclictest674161-21kworker/u8:3+events_unbound00:35:282
347198992622,3cyclictest674161-21kworker/u8:3+events_unbound00:35:282
347198992622,3cyclictest570265-21kworker/u8:1+flush-259:023:20:182
347198992621,3cyclictest335557-21systemd-journal00:32:322
347198992621,3cyclictest335557-21systemd-journal00:32:312
347191992621,3cyclictest622268-21apt-get23:35:111
347191992619,5cyclictest658679-21latency_hist00:10:011
347189992623,2cyclictest674161-21kworker/u8:3+flush-259:000:35:210
347189992623,2cyclictest674161-21kworker/u8:3+flush-259:000:35:200
347189992623,2cyclictest549564-21kworker/u8:2+events_unbound23:05:230
347189992622,3cyclictest192314-21kworker/u8:2+events_unbound20:00:150
347189992622,3cyclictest192314-21kworker/u8:2+events_unbound20:00:140
347189992620,4cyclictest418985-21ntpq20:15:210
347189992618,6cyclictest434422-21ntpq20:30:230
347202992522,2cyclictest450869-21kworker/u8:2+events_unbound21:15:033
347202992521,3cyclictest549564-21kworker/u8:2+events_unbound23:25:133
347198992522,2cyclictest549564-21kworker/u8:2+events_unbound22:35:192
347198992522,2cyclictest528801-21kworker/u8:0+flush-259:022:10:002
347198992521,3cyclictest529066-21kworker/u8:4+events_unbound22:14:052
347198992521,3cyclictest503186-21kworker/u8:2+events_unbound22:04:042
347191992521,3cyclictest486630-21kworker/u8:3+flush-259:021:50:161
347191992519,4cyclictest659108-21diskstats00:10:141
347191992518,5cyclictest440493-21latency_hist20:40:011
347189992523,2cyclictest570265-21kworker/u8:1+events_unbound23:20:210
347189992521,3cyclictest627175-21kworker/u8:3+flush-259:023:40:210
347189992519,5cyclictest553846-21ntpq22:25:220
347202992422,1cyclictest303929-21kworker/u8:0+events_unbound19:55:113
347202992422,1cyclictest303929-21kworker/u8:0+events_unbound19:55:113
347202992421,2cyclictest648530-21kworker/u8:2+events_unbound00:00:193
347202992421,2cyclictest643159-21kworker/u8:0+flush-259:000:20:193
347202992421,2cyclictest637765-21kworker/u8:1+events_unbound00:15:103
347202992421,2cyclictest486630-21kworker/u8:3+events_unbound22:05:173
347202992420,2cyclictest1-21systemd21:50:003
347198992422,1cyclictest440505-21kworker/u8:1+events_unbound21:35:272
347198992421,2cyclictest653491-21kworker/u8:4+events_unbound00:10:012
347198992421,2cyclictest570265-21kworker/u8:1+flush-259:022:45:212
347198992421,2cyclictest529066-21kworker/u8:4+events_unbound22:55:142
347198992421,2cyclictest440505-21kworker/u8:1+flush-259:021:15:212
347198992421,2cyclictest341625-21kworker/u8:4+events_unbound19:10:062
347198992420,3cyclictest450869-21kworker/u8:2+flush-259:021:10:242
347198992419,4cyclictest435335-21latency_hist20:35:002
347198992418,4cyclictest664072-21/usr/sbin/munin00:15:132
347198992418,4cyclictest440920-21diskstats20:40:152
347191992419,3cyclictest192314-21kworker/u8:2+flush-259:020:30:181
347189992421,2cyclictest549564-21kworker/u8:2+flush-259:023:50:170
347189992420,3cyclictest486630-21kworker/u8:3+events_unbound22:05:270
347189992420,3cyclictest373018-21kworker/u8:4+flush-259:020:35:160
347202992320,2cyclictest486630-21kworker/u8:3+events_unbound21:30:003
347202992320,2cyclictest373018-21kworker/u8:4+flush-259:020:40:193
347202992320,2cyclictest192314-21kworker/u8:2+events_unbound19:10:173
347202992319,3cyclictest617044-21kworker/u8:1+events_unbound23:35:213
347198992320,2cyclictest570265-21kworker/u8:1+events_unbound23:15:182
347198992319,3cyclictest373018-21kworker/u8:4+events_unbound20:10:122
347191992318,4cyclictest549564-21kworker/u8:2+flush-259:023:30:171
347191992318,3cyclictest601553-21/usr/sbin/munin23:15:231
347191992316,5cyclictest335557-21systemd-journal23:57:271
347191992316,5cyclictest335557-21systemd-journal21:09:041
347189992320,2cyclictest373018-21kworker/u8:4+events_unbound20:20:230
347189992319,4cyclictest440505-21kworker/u8:1+flush-259:020:55:170
347189992319,3cyclictest549564-21kworker/u8:2+flush-259:022:50:220
347189992319,3cyclictest303929-21kworker/u8:0+events_unbound19:30:140
347189992319,3cyclictest192314-21kworker/u8:2+events_unbound19:15:210
347189992318,4cyclictest393667-21apt-get19:55:000
347189992318,3cyclictest440757-21apt-get20:40:120
347202992219,3cyclictest643159-21kworker/u8:0+events_unbound00:29:033
347202992219,2cyclictest192314-21kworker/u8:2+events_unbound19:30:193
347202992218,3cyclictest637765-21kworker/u8:1+events_unbound00:33:263
347202992218,3cyclictest637765-21kworker/u8:1+events_unbound00:33:253
347202992215,3cyclictest466334-21kworker/u8:3+events_unbound21:05:183
347198992219,2cyclictest617044-21kworker/u8:1+events_unbound23:32:042
347198992218,3cyclictest425258-21kworker/u8:0+events_unbound21:00:142
347198992217,4cyclictest549548-21latency_hist22:25:002
347191992217,3cyclictest570265-21kworker/u8:1+events_unbound23:20:161
347191992216,4cyclictest668987-21latency_hist00:20:001
347191992216,4cyclictest335557-21systemd-journal20:01:031
347191992216,4cyclictest335557-21systemd-journal20:01:021
347191992216,4cyclictest192314-21kworker/u8:2+flush-259:019:20:001
347189992218,3cyclictest357505-21kworker/u8:1+events_unbound19:25:190
347189992218,3cyclictest303929-21kworker/u8:0+flush-259:019:45:220
347202992119,1cyclictest503194-21/usr/sbin/munin21:40:143
347202992118,2cyclictest440505-21kworker/u8:1+events_unbound21:00:353
347202992117,3cyclictest637765-21kworker/u8:1+events_unbound23:57:313
347202992117,3cyclictest528801-21kworker/u8:0+events_unbound22:40:253
347202992117,3cyclictest513312-21kworker/u8:1+events_unbound21:57:033
347202992117,3cyclictest373018-21kworker/u8:4+flush-259:020:20:183
347202992117,3cyclictest192314-21kworker/u8:2+events_unbound20:25:273
347198992119,2cyclictest529066-21kworker/u8:4+events_unbound22:50:102
347198992117,3cyclictest549564-21kworker/u8:2+events_unbound23:50:122
347191992118,2cyclictest503186-21kworker/u8:2+flush-259:021:50:001
347191992115,4cyclictest596120-21latency_hist23:10:011
347191992113,5cyclictest481859-21latency_hist21:20:011
34719199210,19cyclictest490-21dbus-daemon19:25:001
347189992117,3cyclictest486630-21kworker/u8:3+flush-259:021:50:220
347189992115,4cyclictest361783-21ntpq19:20:200
347202992017,2cyclictest653491-21kworker/u8:4+events_unbound00:05:163
347202992017,2cyclictest549564-21kworker/u8:2+events_unbound23:30:213
347202992017,2cyclictest544140-21kworker/u8:1+events_unbound22:28:033
347202992015,4cyclictest606476-21latency_hist23:20:013
347198992017,2cyclictest643159-21kworker/u8:0+events_unbound23:56:032
347198992017,2cyclictest549564-21kworker/u8:2+events_unbound23:00:212
347198992017,2cyclictest486630-21kworker/u8:3+events_unbound21:50:012
347198992015,4cyclictest633024-21/usr/sbin/munin23:45:112
347198992014,4cyclictest470623-21ntpq21:05:212
347191992015,3cyclictest529066-21kworker/u8:4+flush-259:022:50:151
347189992017,2cyclictest617044-21kworker/u8:1+flush-259:023:35:220
347189992017,2cyclictest192314-21kworker/u8:2+events_unbound20:10:200
347189992016,3cyclictest585991-21kworker/u8:0+events_unbound23:10:220
347189992015,3cyclictest518708-21/usr/sbin/munin21:55:150
347189992011,7cyclictest335557-21systemd-journal21:25:000
347202991916,2cyclictest549564-21kworker/u8:2+events_unbound22:50:203
347202991916,2cyclictest425258-21kworker/u8:0+events_unbound20:46:033
347202991915,3cyclictest486630-21kworker/u8:3+events_unbound21:34:043
347198991916,2cyclictest643159-21kworker/u8:0+flush-259:000:20:262
347198991916,2cyclictest373018-21kworker/u8:4+flush-259:020:15:212
347198991916,2cyclictest303929-21kworker/u8:0+events_unbound19:45:162
347191991913,5cyclictest674161-21kworker/u8:3+flush-259:000:35:301
347191991913,5cyclictest674161-21kworker/u8:3+flush-259:000:35:291
347191991913,4cyclictest425024-21latency_hist20:25:011
347189991916,2cyclictest653491-21kworker/u8:4+flush-259:000:05:250
347189991916,2cyclictest570265-21kworker/u8:1+flush-259:022:45:150
347189991916,2cyclictest528801-21kworker/u8:0+flush-259:022:10:240
347189991915,3cyclictest637765-21kworker/u8:1+flush-259:000:15:210
347189991915,3cyclictest529066-21kworker/u8:4+events_unbound22:55:220
347189991915,3cyclictest492241-21kworker/u8:0+events_unbound21:35:160
347189991914,3cyclictest539494-21apt-get22:15:110
347189991914,3cyclictest539494-21apt-get22:15:110
347189991912,5cyclictest621081-21ntpq23:30:200
347202991815,2cyclictest192314-21kworker/u8:2+flush-259:020:00:193
347202991815,2cyclictest192314-21kworker/u8:2+flush-259:020:00:193
347198991815,2cyclictest637765-21kworker/u8:1+events_unbound00:10:222
347198991815,2cyclictest585991-21kworker/u8:0+events_unbound23:10:182
347198991815,2cyclictest549564-21kworker/u8:2+events_unbound23:05:152
347198991815,2cyclictest425258-21kworker/u8:0+flush-259:020:50:212
347198991815,2cyclictest192314-21kworker/u8:2+flush-259:020:00:242
347198991815,2cyclictest192314-21kworker/u8:2+flush-259:020:00:242
347191991814,3cyclictest303929-21kworker/u8:0+flush-259:019:49:591
347191991812,4cyclictest335557-21systemd-journal19:32:031
347189991815,2cyclictest192314-21kworker/u8:2+events_unbound20:05:260
347189991814,3cyclictest466334-21kworker/u8:3+flush-259:021:05:160
347202991713,3cyclictest549564-21kworker/u8:2+events_unbound23:05:253
347202991713,3cyclictest528801-21kworker/u8:0+events_unbound22:10:053
347198991714,2cyclictest440505-21kworker/u8:1+events_unbound20:45:302
347198991714,2cyclictest383359-21munin-plugin-st19:45:002
347198991713,3cyclictest373018-21kworker/u8:4+flush-259:020:35:162
347191991713,3cyclictest528801-21kworker/u8:0+flush-259:022:10:251
347191991712,3cyclictest632350-21apt-get23:44:591
347189991713,3cyclictest648530-21kworker/u8:2+events_unbound00:00:160
347189991713,3cyclictest643159-21kworker/u8:0+events_unbound23:55:270
347189991713,3cyclictest643159-21kworker/u8:0+events_unbound00:25:270
347189991713,3cyclictest549564-21kworker/u8:2+flush-259:023:00:250
347202991613,2cyclictest192314-21kworker/u8:2+events_unbound20:30:043
347202991612,3cyclictest570265-21kworker/u8:1+events_unbound22:45:163
347202991612,3cyclictest341625-21kworker/u8:4+events_unbound19:19:043
347191991614,1cyclictest544372-21cron22:20:001
347191991614,1cyclictest544372-21cron22:20:001
347191991612,3cyclictest565356-21apt-get22:40:111
347191991612,3cyclictest503186-21kworker/u8:2+flush-259:022:00:261
347191991612,2cyclictest550227-21irqcore22:25:171
347189991612,3cyclictest503186-21kworker/u8:2+events_unbound22:04:570
347189991612,3cyclictest303929-21kworker/u8:0+events_unbound19:55:170
347189991612,3cyclictest303929-21kworker/u8:0+events_unbound19:55:160
347189991611,4cyclictest440505-21kworker/u8:1+events_unbound20:45:210
347198991513,2cyclictest643159-21kworker/u8:0+flush-259:000:25:252
34719199159,4cyclictest335557-21systemd-journal20:07:031
347191991512,2cyclictest498087-21irqcore21:35:171
347191991511,3cyclictest486630-21kworker/u8:3+flush-259:021:30:261
347191991511,2cyclictest556019-21kthreadcore22:30:181
347191991511,2cyclictest0-21swapper/100:35:011
347191991511,2cyclictest0-21swapper/100:35:001
347189991513,2cyclictest60350irq/132-enp0s29f1:rx-000:34:230
347189991513,2cyclictest60350irq/132-enp0s29f1:rx-000:34:220
347189991513,1cyclictest60350irq/132-enp0s29f1:rx-021:30:170
347189991512,2cyclictest60350irq/132-enp0s29f1:rx-019:35:210
347189991512,2cyclictest570265-21kworker/u8:1+flush-259:023:15:250
347189991511,3cyclictest637765-21kworker/u8:1+events_unbound00:10:240
347189991511,3cyclictest192314-21kworker/u8:2+events_unbound20:25:230
347189991511,2cyclictest528801-21kworker/u8:0+flush-259:022:40:220
347202991411,2cyclictest458568-21kthreadcore20:55:173
347202991411,2cyclictest440505-21kworker/u8:1+flush-259:021:20:213
347191991411,2cyclictest673729-21unixbench_singl00:20:261
347191991411,2cyclictest0-21swapper/122:50:001
347191991410,2cyclictest0-21swapper/123:55:001
347189991412,2cyclictest60350irq/132-enp0s29f1:rx-023:48:180
347189991411,2cyclictest60350irq/132-enp0s29f1:rx-023:25:110
347189991411,2cyclictest60350irq/132-enp0s29f1:rx-021:12:330
347189991411,2cyclictest60350irq/132-enp0s29f1:rx-000:20:250
347202991311,2cyclictest486630-21kworker/u8:3+flush-259:021:50:153
347202991310,2cyclictest586284-21fschecks_time23:00:163
347202991310,2cyclictest377764-21unixbench_singl19:35:253
34719899139,3cyclictest549564-21kworker/u8:2+events_unbound22:30:182
34719199139,2cyclictest0-21swapper/121:30:001
347191991311,1cyclictest503-21tpm2-abrmd22:10:001
34719199128,3cyclictest544140-21kworker/u8:1+flush-259:022:22:081
34719199126,4cyclictest585999-21/usr/sbin/munin23:00:151
34719199118,2cyclictest415048-21cpuspeed_turbos20:15:131
34719199108,1cyclictest0-21swapper/123:10:121
34719199108,1cyclictest0-21swapper/123:00:011
34719199107,1cyclictest0-21swapper/121:10:171
34719199101,7cyclictest335557-21systemd-journal21:00:001
34719199100,8cyclictest367865-21latency_hist19:30:001
34719199100,2cyclictest373018-21kworker/u8:4+flush-259:019:45:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional