You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 04:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri May 22, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
618649994744,2cyclictest758843-21kworker/u8:2+events_unbound21:25:093
618649994037,2cyclictest737885-21kworker/u8:3+events_unbound21:05:153
618649993937,2cyclictest607721-21kworker/u8:1+events_unbound19:17:083
618626993932,5cyclictest660077-21latency_hist19:50:010
618649993734,2cyclictest665818-21kworker/u8:0+events_unbound19:56:093
618649993734,2cyclictest634045-21kworker/u8:2+events_unbound19:53:063
618642993731,4cyclictest706657-21/usr/sbin/munin20:35:132
618636993730,5cyclictest731882-21ntpq20:55:201
618649993633,2cyclictest665818-21kworker/u8:0+events_unbound20:20:183
618626993632,3cyclictest852892-21kworker/u8:3+events_unbound23:00:190
618626993530,3cyclictest665818-21kworker/u8:0+flush-259:020:20:000
618649993432,2cyclictest831749-21kworker/u8:4+events_unbound22:55:243
618649993432,2cyclictest831749-21kworker/u8:4+events_unbound22:55:243
618649993431,2cyclictest820786-21kworker/u8:0+events_unbound22:40:083
618626993431,2cyclictest680920-21kworker/u8:4+flush-259:020:10:210
618649993330,2cyclictest863078-21kworker/u8:1+events_unbound23:25:243
618649993330,2cyclictest852892-21kworker/u8:3+events_unbound23:00:203
618649993330,2cyclictest665818-21kworker/u8:0+events_unbound20:10:133
618649993329,3cyclictest863078-21kworker/u8:1+events_unbound00:12:443
618649993328,2cyclictest665818-21kworker/u8:0+events_unbound20:30:143
618636993327,4cyclictest889154-21/usr/sbin/munin23:30:151
618626993329,3cyclictest949999-21kworker/u8:0+flush-259:000:30:210
618649993230,2cyclictest722030-21kworker/u8:2+events_unbound20:56:093
618649993230,2cyclictest634045-21kworker/u8:2+events_unbound20:00:233
618649993229,2cyclictest920158-21kworker/u8:3+events_unbound00:05:153
618649993229,2cyclictest758383-21kworker/u8:1+events_unbound22:10:223
618649993229,2cyclictest613438-21kworker/u8:4+events_unbound19:35:223
618642993226,4cyclictest335557-21systemd-journal21:10:012
618636993227,3cyclictest852906-21/usr/sbin/munin22:55:151
618636993227,3cyclictest852906-21/usr/sbin/munin22:55:151
618626993228,3cyclictest702094-21kworker/u8:1+events_unbound20:40:140
618626993228,3cyclictest702094-21kworker/u8:1+events_unbound20:40:140
618626993227,3cyclictest784774-21/usr/sbin/munin21:50:150
618626993225,2cyclictest820786-21kworker/u8:0+events_unbound22:35:160
618649993129,2cyclictest702094-21kworker/u8:1+events_unbound20:54:083
618649993129,2cyclictest680920-21kworker/u8:4+events_unbound20:26:093
618649993128,2cyclictest800712-21kworker/u8:4+events_unbound22:20:213
618649993128,2cyclictest722031-21kworker/u8:4+events_unbound21:15:243
618649993128,2cyclictest619345-21kworker/u8:0+events_unbound19:30:223
618636993127,3cyclictest702094-21kworker/u8:1+flush-259:020:35:151
618626993128,2cyclictest887971-21kworker/u8:4+flush-259:000:35:250
618626993128,2cyclictest769245-21kworker/u8:4+events_unbound21:35:240
618626993128,2cyclictest743392-21kworker/u8:2+flush-259:021:10:210
618626993127,3cyclictest722031-21kworker/u8:4+flush-259:021:00:200
618626993127,3cyclictest665818-21kworker/u8:0+events_unbound19:59:590
618626993126,3cyclictest863078-21kworker/u8:1+events_unbound23:30:190
618626993126,3cyclictest613438-21kworker/u8:4+events_unbound19:15:010
618649993028,2cyclictest887971-21kworker/u8:4+events_unbound23:52:393
618649993028,2cyclictest665818-21kworker/u8:0+events_unbound21:42:093
618649993027,2cyclictest949999-21kworker/u8:0+events_unbound00:31:483
618649993027,2cyclictest920158-21kworker/u8:3+events_unbound00:02:393
618649993027,2cyclictest665818-21kworker/u8:0+events_unbound20:45:223
618649993026,3cyclictest790308-21cat21:55:013
618636993027,2cyclictest722031-21kworker/u8:4+flush-259:020:50:151
618636993027,2cyclictest665818-21kworker/u8:0+flush-259:020:45:151
618636993026,3cyclictest863331-21apt-get23:05:121
618626993027,2cyclictest607721-21kworker/u8:1+events_unbound19:20:320
618649992926,3cyclictest758383-21kworker/u8:1+events_unbound21:47:073
618636992923,5cyclictest852461-21store22:55:001
618626992926,2cyclictest847138-21kworker/u8:0+flush-259:023:05:150
618626992926,2cyclictest737885-21kworker/u8:3+flush-259:021:05:250
618649992826,2cyclictest920158-21kworker/u8:3+events_unbound00:22:453
618649992826,2cyclictest887971-21kworker/u8:4+events_unbound00:15:143
618649992826,2cyclictest769245-21kworker/u8:4+events_unbound21:39:063
618649992825,2cyclictest887971-21kworker/u8:4+events_unbound23:40:273
618636992825,2cyclictest722031-21kworker/u8:4+flush-259:021:15:271
618636992823,4cyclictest660335-21apt-get19:50:101
618636992821,5cyclictest335557-21systemd-journal20:10:001
618626992825,2cyclictest665818-21kworker/u8:0+events_unbound20:20:140
618626992823,4cyclictest722031-21kworker/u8:4+events_unbound21:15:170
618649992725,2cyclictest737885-21kworker/u8:3+flush-259:021:20:283
618649992724,2cyclictest887971-21kworker/u8:4+events_unbound23:39:073
618649992724,2cyclictest820786-21kworker/u8:0+events_unbound22:35:243
618649992724,2cyclictest634045-21kworker/u8:2+events_unbound20:05:173
618649992721,4cyclictest878598-21latency_hist23:20:003
618642992722,3cyclictest914958-21apt-get23:55:122
618626992724,2cyclictest920158-21kworker/u8:3+flush-259:000:05:210
618626992724,2cyclictest863078-21kworker/u8:1+flush-259:023:40:240
618626992724,2cyclictest863078-21kworker/u8:1+events_unbound23:25:220
618626992724,2cyclictest758383-21kworker/u8:1+events_unbound22:10:000
618626992723,3cyclictest737885-21kworker/u8:3+flush-259:022:15:200
618626992723,3cyclictest619345-21kworker/u8:0+flush-259:019:40:220
618626992721,4cyclictest857842-21latency_hist23:00:000
618626992721,4cyclictest857842-21latency_hist23:00:000
618649992624,2cyclictest887971-21kworker/u8:4+events_unbound00:35:073
618649992624,2cyclictest820786-21kworker/u8:0+events_unbound22:32:103
618649992623,2cyclictest665818-21kworker/u8:0+events_unbound20:36:083
618649992623,2cyclictest613438-21kworker/u8:4+events_unbound19:25:223
618649992621,4cyclictest748318-21latency_hist21:15:013
618642992621,4cyclictest758383-21kworker/u8:1+flush-259:022:10:252
618636992622,3cyclictest887971-21kworker/u8:4+flush-259:000:00:171
618636992620,4cyclictest863059-21latency_hist23:05:001
618636992620,4cyclictest335557-21systemd-journal21:28:071
618626992623,2cyclictest863078-21kworker/u8:1+flush-259:023:35:170
618626992623,2cyclictest800712-21kworker/u8:4+flush-259:022:25:240
618626992623,2cyclictest722030-21kworker/u8:2+events_unbound20:55:170
618626992620,4cyclictest628226-21ntpq19:15:190
618649992523,2cyclictest758383-21kworker/u8:1+events_unbound22:15:153
618649992523,2cyclictest655140-21kworker/u8:3+events_unbound20:16:033
618649992522,2cyclictest837375-21kworker/u8:2+events_unbound22:48:083
618649992522,2cyclictest800712-21kworker/u8:4+events_unbound22:25:073
618649992522,2cyclictest790361-21kworker/u8:2+events_unbound22:00:093
618649992520,2cyclictest758383-21kworker/u8:1+events_unbound22:52:083
618642992520,3cyclictest758855-21fwupd21:25:122
618642992520,3cyclictest722235-21store20:50:012
618636992520,4cyclictest758383-21kworker/u8:1+flush-259:022:25:001
618636992519,5cyclictest335557-21systemd-journal22:34:071
618636992518,5cyclictest789811-21cp21:55:011
618626992522,2cyclictest863079-21kworker/u8:2+events_unbound23:10:150
618626992522,2cyclictest702094-21kworker/u8:1+flush-259:020:35:000
618626992522,2cyclictest665818-21kworker/u8:0+flush-259:021:30:240
618649992421,2cyclictest887971-21kworker/u8:4+events_unbound23:49:573
618649992421,2cyclictest665818-21kworker/u8:0+events_unbound21:52:203
618636992419,4cyclictest335557-21systemd-journal00:11:071
618636992418,4cyclictest769002-21latency_hist21:35:011
618636992418,4cyclictest335557-21systemd-journal22:26:081
618636992418,4cyclictest335557-21systemd-journal19:46:071
618636992417,5cyclictest335557-21systemd-journal19:15:011
618626992421,3cyclictest758383-21kworker/u8:1+flush-259:022:50:160
618626992421,2cyclictest702094-21kworker/u8:1+events_unbound20:35:190
618626992421,2cyclictest634045-21kworker/u8:2+events_unbound20:05:190
618626992420,3cyclictest769245-21kworker/u8:4+flush-259:021:40:210
618626992419,3cyclictest894166-21kworker/u8:0+flush-259:023:45:170
618626992419,2cyclictest722031-21kworker/u8:4+events_unbound20:50:200
618649992321,2cyclictest863079-21kworker/u8:2+events_unbound23:23:213
618649992321,2cyclictest863078-21kworker/u8:1+events_unbound23:05:283
618649992321,2cyclictest758383-21kworker/u8:1+events_unbound21:33:573
618649992321,2cyclictest665818-21kworker/u8:0+events_unbound21:02:083
618649992319,3cyclictest887971-21kworker/u8:4+events_unbound00:29:563
618642992319,3cyclictest613438-21kworker/u8:4+events_unbound19:25:182
618642992316,5cyclictest674696-21ntpq20:00:202
618636992319,3cyclictest863078-21kworker/u8:1+events_unbound23:44:071
618636992319,3cyclictest613438-21kworker/u8:4+events_unbound19:23:091
618636992317,4cyclictest737949-21latency_hist21:05:011
618626992320,2cyclictest920158-21kworker/u8:3+events_unbound00:10:260
618626992320,2cyclictest619345-21kworker/u8:0+events_unbound19:30:200
618626992319,3cyclictest702094-21kworker/u8:1+flush-259:020:47:120
618626992317,4cyclictest919915-21cp00:00:010
618649992220,2cyclictest863078-21kworker/u8:1+events_unbound23:55:263
618649992219,2cyclictest863078-21kworker/u8:1+events_unbound23:30:363
618636992219,2cyclictest863078-21kworker/u8:1+flush-259:000:05:191
618636992218,3cyclictest887971-21kworker/u8:4+events_unbound23:52:061
618636992218,3cyclictest702094-21kworker/u8:1+flush-259:020:40:231
618636992218,3cyclictest702094-21kworker/u8:1+flush-259:020:40:221
618636992218,3cyclictest702094-21kworker/u8:1+events_unbound20:34:091
618636992218,3cyclictest680920-21kworker/u8:4+flush-259:020:25:151
618636992218,3cyclictest665818-21kworker/u8:0+events_unbound21:20:081
618636992216,4cyclictest884038-21apt-get23:25:121
618626992219,2cyclictest847138-21kworker/u8:0+flush-259:023:20:150
618626992219,2cyclictest665818-21kworker/u8:0+flush-259:021:20:240
618649992119,2cyclictest702094-21kworker/u8:1+events_unbound20:40:113
618649992119,2cyclictest702094-21kworker/u8:1+events_unbound20:40:103
618649992118,2cyclictest758383-21kworker/u8:1+events_unbound22:09:203
618649992118,2cyclictest613438-21kworker/u8:4+events_unbound19:21:493
618649992115,4cyclictest509-21rs:main3
618642992117,2cyclictest629403-21apt-get19:20:102
618642992114,5cyclictest768127-21ntpq21:30:212
618642992114,5cyclictest726709-21ntpq20:50:202
618636992117,3cyclictest837375-21kworker/u8:2+events_unbound22:45:251
618636992117,3cyclictest613438-21kworker/u8:4+flush-259:019:32:021
618636992116,4cyclictest863078-21kworker/u8:1+flush-259:023:15:001
618626992117,3cyclictest335557-21systemd-journal22:12:210
618626992115,2cyclictest634045-21kworker/u8:2+events_unbound20:00:150
618649992017,2cyclictest863079-21kworker/u8:2+events_unbound23:11:433
618649992017,2cyclictest649783-21kworker/u8:1+events_unbound19:45:093
618642992016,3cyclictest863078-21kworker/u8:1+flush-259:000:13:362
618642992016,3cyclictest748593-21apt-get21:15:132
618642992016,3cyclictest660744-21irqcore19:50:142
618642992015,3cyclictest507-21in:imuxsock21:40:002
618642992013,4cyclictest335557-21systemd-journal00:00:022
618636992017,2cyclictest887971-21kworker/u8:4+flush-259:023:55:181
618636992017,2cyclictest847138-21kworker/u8:0+events_unbound23:15:231
618636992016,3cyclictest949999-21kworker/u8:0+flush-259:000:34:591
618636992016,3cyclictest887971-21kworker/u8:4+events_unbound00:20:221
618636992016,3cyclictest820786-21kworker/u8:0+events_unbound22:35:081
618636992016,3cyclictest649783-21kworker/u8:1+events_unbound19:40:211
618636992016,3cyclictest619345-21kworker/u8:0+events_unbound19:15:141
618636992015,4cyclictest904707-21apt-get23:45:121
618626992017,2cyclictest863079-21kworker/u8:2+flush-259:023:15:160
618626992017,2cyclictest825824-21kworker/u8:2+events_unbound22:33:070
618626992017,2cyclictest649783-21kworker/u8:1+flush-259:019:50:160
618626992016,3cyclictest837375-21kworker/u8:2+events_unbound22:45:150
618649991916,2cyclictest1726600-21kworker/u8:3+events_unbound19:11:153
618642991914,4cyclictest789710-21apt-get21:55:002
618642991913,4cyclictest945759-21latency_hist00:25:012
618636991915,3cyclictest863078-21kworker/u8:1+events_unbound23:35:141
618636991915,3cyclictest790361-21kworker/u8:2+events_unbound21:58:081
618636991915,3cyclictest769274-21apt-get21:35:131
618636991915,3cyclictest758383-21kworker/u8:1+events_unbound22:11:091
618636991915,3cyclictest665818-21kworker/u8:0+flush-259:020:20:231
618636991915,3cyclictest634045-21kworker/u8:2+events_unbound19:29:081
618636991913,4cyclictest335557-21systemd-journal00:39:591
618626991916,2cyclictest863078-21kworker/u8:1+flush-259:023:50:240
618626991916,2cyclictest863078-21kworker/u8:1+events_unbound00:15:170
618626991912,3cyclictest920158-21kworker/u8:3+events_unbound00:25:190
618642991813,4cyclictest831749-21kworker/u8:4+flush-259:022:36:382
618636991816,1cyclictest655140-21kworker/u8:3+flush-259:020:17:051
618636991815,2cyclictest800712-21kworker/u8:4+events_unbound22:05:221
618636991812,4cyclictest507-21in:imuxsock22:20:001
618642991713,3cyclictest665818-21kworker/u8:0+flush-259:022:00:242
618642991713,3cyclictest613438-21kworker/u8:4+flush-259:019:36:572
618642991711,4cyclictest335557-21systemd-journal21:22:072
618642991710,5cyclictest800712-21kworker/u8:4+flush-259:022:25:172
618642991710,5cyclictest715946-21ntpq20:40:202
618642991710,5cyclictest715946-21ntpq20:40:202
618636991714,2cyclictest790361-21kworker/u8:2+events_unbound22:02:201
618636991714,2cyclictest634045-21kworker/u8:2+flush-259:020:00:241
618636991714,2cyclictest335557-21systemd-journal22:45:001
618636991713,3cyclictest722031-21kworker/u8:4+events_unbound21:05:091
618636991713,3cyclictest655140-21kworker/u8:3+events_unbound19:55:241
618626991715,1cyclictest685940-21kworker/0:2+pm21:25:090
618626991714,2cyclictest837375-21kworker/u8:2+events_unbound22:44:080
618626991714,2cyclictest613438-21kworker/u8:4+events_unbound19:25:260
618626991713,3cyclictest920158-21kworker/u8:3+flush-259:000:24:220
618626991713,3cyclictest758383-21kworker/u8:1+events_unbound21:47:090
618626991711,4cyclictest335557-21systemd-journal20:27:050
618642991612,3cyclictest655140-21kworker/u8:3+flush-259:019:56:382
618642991611,4cyclictest920158-21kworker/u8:3+flush-259:000:05:242
618642991610,4cyclictest878837-21/usr/sbin/munin23:20:152
618642991610,4cyclictest853091-21diskstats22:55:152
618642991610,4cyclictest853091-21diskstats22:55:142
618636991613,2cyclictest920158-21kworker/u8:3+events_unbound00:25:211
618636991613,2cyclictest863078-21kworker/u8:1+events_unbound23:21:061
618636991613,2cyclictest769245-21kworker/u8:4+events_unbound21:40:261
618636991613,2cyclictest680920-21kworker/u8:4+events_unbound20:10:241
618626991612,3cyclictest758383-21kworker/u8:1+events_unbound22:00:050
618626991612,3cyclictest613438-21kworker/u8:4+flush-259:019:35:160
618626991611,4cyclictest795303-21latency_hist22:00:010
618642991512,2cyclictest899979-21irqcore23:40:162
618642991510,4cyclictest837375-21kworker/u8:2+flush-259:022:45:002
618642991510,4cyclictest619345-21kworker/u8:0+flush-259:019:30:162
61864299149,3cyclictest888055-21ntpq23:25:222
618642991411,2cyclictest607721-21kworker/u8:1+flush-259:019:10:122
618642991410,3cyclictest899084-21journal-offline23:37:322
618642991410,3cyclictest769245-21kworker/u8:4+flush-259:021:45:012
618642991410,3cyclictest665818-21kworker/u8:0+flush-259:021:01:132
618642991410,3cyclictest0-21swapper/222:50:242
618636991411,2cyclictest769245-21kworker/u8:4+flush-259:021:46:121
618636991410,3cyclictest619345-21kworker/u8:0+flush-259:019:38:381
61864299139,2cyclictest858173-21cpuspeed_turbos23:00:132
61864299139,2cyclictest335557-21systemd-journal20:10:002
61864299136,2cyclictest940596-21sh00:20:012
61864299134,6cyclictest335557-21systemd-journal22:20:002
61864299131,3cyclictest873416-21awk23:15:002
618642991310,2cyclictest891517-21kthreadcore23:30:182
61863699139,3cyclictest887971-21kworker/u8:4+events_unbound00:15:071
61864299129,2cyclictest873939-21fschecks_time23:15:142
61864299129,2cyclictest804792-21ntp_kernel_pll_22:05:202
61864299128,3cyclictest949999-21kworker/u8:0+flush-259:000:30:312
61864299128,3cyclictest758383-21kworker/u8:1+flush-259:021:55:132
61864299128,3cyclictest665818-21kworker/u8:0+flush-259:020:22:052
61864299127,3cyclictest821153-21cron22:25:002
61864299126,5cyclictest913814-21ntpq23:50:222
61864299126,4cyclictest613438-21kworker/u8:4+flush-259:019:19:382
61864299115,4cyclictest827390-21sed22:30:162
61863699118,1cyclictest0-21swapper/119:10:011
61864299107,2cyclictest909143-21unixbench_singl23:45:252
61864299100,1cyclictest0-21swapper/220:10:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional