You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 07:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Sep 22, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3430962995549,4cyclictest3478684-21gpgv19:55:003
3430958995245,5cyclictest3771028-21latency_hist00:35:012
3430952995148,3cyclictest3393027-21kworker/u8:3+events_unbound21:50:230
3430955994842,4cyclictest3656166-21base6422:45:011
3430952994739,5cyclictest3682706-21diskstats23:10:130
3430952994542,2cyclictest3393027-21kworker/u8:3+events_unbound21:40:220
3430952994542,2cyclictest3393027-21kworker/u8:3+events_unbound20:20:230
3430962994339,3cyclictest3562124-21kworker/u8:2+flush-259:021:25:113
3430952994339,3cyclictest3745225-21kworker/u8:0+events_unbound00:20:140
3430952994339,3cyclictest3393027-21kworker/u8:3+events_unbound22:30:260
3430958994236,4cyclictest3708430-21apt-get23:35:112
3430958994236,4cyclictest3467473-21apt-get19:45:012
3430955994034,5cyclictest3457307-21base6419:35:001
3430952994037,2cyclictest3446388-21kworker/u8:0+events_unbound19:27:010
3430952994036,3cyclictest3393027-21kworker/u8:3+events_unbound20:55:190
3430962993934,4cyclictest3393027-21kworker/u8:3+flush-259:022:05:003
3430955993935,3cyclictest3467621-21kworker/u8:0+events_unbound19:45:251
3430955993935,3cyclictest3393027-21kworker/u8:3+flush-259:021:55:251
3430952993932,5cyclictest3671080-21ntpq22:55:230
3430952993931,6cyclictest3562338-21/usr/sbin/munin21:15:150
3430958993729,5cyclictest3739811-21cp00:05:002
3430952993733,3cyclictest3640695-21kworker/u8:1+events_unbound23:30:170
3430955993633,2cyclictest3640695-21kworker/u8:1+events_unbound23:25:151
3430952993632,3cyclictest3708208-21kworker/u8:3+events_unbound00:28:310
3430952993632,3cyclictest3708208-21kworker/u8:3+events_unbound00:03:310
3430952993632,3cyclictest3467621-21kworker/u8:0+events_unbound19:45:140
3430952993631,3cyclictest3713345-21apt-get23:40:000
3430952993631,3cyclictest3572454-21kworker/u8:0+events_unbound22:08:300
3430958993529,4cyclictest335557-21systemd-journal21:32:292
3430955993532,2cyclictest3656697-21apt-get22:45:121
3430952993531,3cyclictest3745225-21kworker/u8:0+events_unbound00:12:170
3430952993531,3cyclictest3708208-21kworker/u8:3+events_unbound23:53:300
3430952993531,3cyclictest3572454-21kworker/u8:0+events_unbound22:29:310
3430962993430,3cyclictest3682307-21kworker/u8:2+flush-259:023:25:003
3430962993430,3cyclictest3393027-21kworker/u8:3+flush-259:020:55:233
3430962993427,5cyclictest3650833-21latency_hist22:40:013
3430955993429,4cyclictest3734760-21apt-get00:00:131
3430955993428,4cyclictest3478199-21latency_hist19:55:001
3430952993430,3cyclictest3393027-21kworker/u8:3+events_unbound20:02:300
3430952993426,5cyclictest3461440-21ntpq19:35:220
3430955993330,2cyclictest3562124-21kworker/u8:2+flush-259:021:25:101
3430955993329,3cyclictest3682546-21apt-get23:10:111
3430952993330,2cyclictest3393027-21kworker/u8:3+events_unbound20:14:290
3430952993329,3cyclictest3724115-21kworker/u8:2+events_unbound00:05:280
3430952993329,3cyclictest3613988-21kworker/u8:2+events_unbound22:12:270
3430952993329,3cyclictest3562124-21kworker/u8:2+events_unbound21:25:010
3430952993329,3cyclictest3393027-21kworker/u8:3+events_unbound20:47:150
3430958993229,2cyclictest3572454-21kworker/u8:0+events_unbound22:05:132
3430958993227,3cyclictest3504028-21ntpq20:15:222
3430955993229,2cyclictest3393027-21kworker/u8:3+events_unbound20:25:141
3430955993226,4cyclictest3494324-21cp20:10:001
3430958993125,4cyclictest3494687-21cp20:10:012
3430955993127,3cyclictest3393027-21kworker/u8:3+events_unbound19:10:231
3430955993126,4cyclictest3714027-21apt-get23:40:101
3430952993128,2cyclictest3764805-21kworker/u8:2+events_unbound00:37:170
3430952993128,2cyclictest3393027-21kworker/u8:3+events_unbound20:25:190
3430952993127,3cyclictest3562124-21kworker/u8:2+events_unbound21:22:030
3430958993026,3cyclictest3431179-21apt-get19:10:132
3430958993025,4cyclictest335557-21systemd-journal22:35:012
3430958993024,4cyclictest3745198-21latency_hist00:10:012
3430952993027,2cyclictest3393027-21kworker/u8:3+events_unbound22:42:290
3430952993027,2cyclictest3393027-21kworker/u8:3+events_unbound19:18:300
3430958992925,3cyclictest3436082-21kworker/u8:2+flush-259:019:20:162
3430958992924,3cyclictest3745225-21kworker/u8:0+flush-259:000:20:172
3430955992925,2cyclictest3629512-21gpgv22:20:011
3430952992926,2cyclictest3393027-21kworker/u8:3+events_unbound21:11:310
3430962992823,3cyclictest3640695-21kworker/u8:1+flush-259:023:45:003
3430962992822,4cyclictest509-21rs:main3
3430955992825,2cyclictest3708208-21kworker/u8:3+flush-259:000:15:261
3430955992823,3cyclictest335557-21systemd-journal19:35:011
3430955992822,4cyclictest335557-21systemd-journal22:05:281
3430952992824,3cyclictest3530737-21kworker/u8:1+events_unbound20:52:000
3430955992720,5cyclictest335557-21systemd-journal20:31:271
3430952992724,2cyclictest3745225-21kworker/u8:0+events_unbound00:17:300
3430952992724,2cyclictest3656051-21kworker/u8:4+events_unbound22:52:300
3430962992622,3cyclictest3436082-21kworker/u8:2+flush-259:019:15:243
3430958992622,3cyclictest3393027-21kworker/u8:3+events_unbound19:40:212
3430955992623,2cyclictest3764805-21kworker/u8:2+flush-259:000:35:241
3430955992621,4cyclictest3505130-21/usr/sbin/munin20:20:141
3430955992620,4cyclictest335557-21systemd-journal22:10:291
3430962992521,2cyclictest3562124-21kworker/u8:2+flush-259:021:20:183
3430962992520,4cyclictest3393027-21kworker/u8:3+flush-259:019:40:253
3430962992519,4cyclictest3567252-21latency_hist21:20:003
343096299250,23cyclictest1-21systemd22:15:293
3430958992521,3cyclictest3708208-21kworker/u8:3+events_unbound23:55:132
3430958992521,3cyclictest3640695-21kworker/u8:1+events_unbound22:35:202
3430958992520,4cyclictest335557-21systemd-journal23:55:002
3430955992522,2cyclictest3640695-21kworker/u8:1+flush-259:022:50:161
3430955992521,3cyclictest3436082-21kworker/u8:2+flush-259:019:22:291
3430952992522,2cyclictest3682307-21kworker/u8:2+events_unbound23:23:300
3430952992521,3cyclictest3764805-21kworker/u8:2+events_unbound00:32:290
3430952992518,5cyclictest3661629-21latency_hist22:50:000
3430962992419,3cyclictest3393027-21kworker/u8:3+flush-259:020:20:163
3430962992419,3cyclictest3393027-21kworker/u8:3+flush-259:019:25:173
3430955992422,1cyclictest3393027-21kworker/u8:3+events_unbound21:35:111
3430955992421,2cyclictest3640695-21kworker/u8:1+flush-259:023:30:241
3430955992420,3cyclictest3708208-21kworker/u8:3+events_unbound00:05:221
3430955992420,3cyclictest3393027-21kworker/u8:3+flush-259:020:00:301
3430955992419,4cyclictest3441214-21latency_hist19:20:001
3430955992417,5cyclictest3750353-21latency_hist00:15:011
3430952992421,2cyclictest3656051-21kworker/u8:4+events_unbound23:01:290
3430962992317,4cyclictest335557-21systemd-journal20:04:563
3430958992319,3cyclictest3640695-21kworker/u8:1+flush-259:022:45:262
3430955992320,2cyclictest3488980-21kworker/u8:2+flush-259:020:15:251
3430955992319,3cyclictest3708208-21kworker/u8:3+events_unbound23:48:301
3430955992318,4cyclictest3510113-21kworker/u8:0+flush-259:020:40:211
343095599230,21cyclictest1-21systemd19:45:001
3430952992320,2cyclictest3393027-21kworker/u8:3+events_unbound19:57:080
3430952992319,3cyclictest3393027-21kworker/u8:3+events_unbound19:10:190
3430952992316,5cyclictest3456871-21base6419:35:010
3430962992220,1cyclictest3393027-21kworker/u8:3+events_unbound20:50:003
3430962992218,3cyclictest3393027-21kworker/u8:3+flush-259:021:00:223
3430962992216,4cyclictest3572454-21kworker/u8:0+flush-259:021:30:203
3430958992220,2cyclictest3393027-21kworker/u8:3+events_unbound22:20:112
3430958992220,1cyclictest3562124-21kworker/u8:2+events_unbound21:20:222
3430958992219,2cyclictest3708208-21kworker/u8:3+flush-259:023:45:192
3430958992218,3cyclictest3456694-21apt-get19:35:002
3430958992218,3cyclictest3393027-21kworker/u8:3+flush-259:021:50:192
3430955992219,2cyclictest3530737-21kworker/u8:1+flush-259:021:10:001
3430955992218,3cyclictest3572454-21kworker/u8:0+flush-259:022:37:271
3430955992218,3cyclictest3572454-21kworker/u8:0+events_unbound22:25:291
3430952992219,2cyclictest3640695-21kworker/u8:1+events_unbound23:27:300
3430952992219,2cyclictest3572454-21kworker/u8:0+events_unbound22:38:310
3430952992219,2cyclictest3510113-21kworker/u8:0+events_unbound20:35:270
3430952992218,3cyclictest3572454-21kworker/u8:0+events_unbound21:33:160
3430962992117,3cyclictest3530737-21kworker/u8:1+flush-259:020:50:243
3430962992117,3cyclictest3467621-21kworker/u8:0+flush-259:019:50:233
3430962992115,4cyclictest3687723-21apt-get23:15:133
3430958992118,2cyclictest3692892-21kworker/u8:0+flush-259:023:20:252
3430958992117,3cyclictest3708208-21kworker/u8:3+events_unbound00:15:172
3430958992117,3cyclictest3393027-21kworker/u8:3+events_unbound21:45:212
3430958992117,3cyclictest3393027-21kworker/u8:3+events_unbound20:45:242
3430955992117,3cyclictest3393027-21kworker/u8:3+events_unbound21:50:181
3430955992114,5cyclictest3582793-21latency_hist21:35:011
3430952992118,2cyclictest3593142-21kworker/u8:1+events_unbound22:00:570
3430952992118,2cyclictest3572454-21kworker/u8:0+events_unbound21:48:310
3430952992117,3cyclictest3640695-21kworker/u8:1+events_unbound23:42:360
3430952992117,3cyclictest3530737-21kworker/u8:1+events_unbound21:08:040
3430958992017,2cyclictest3393027-21kworker/u8:3+events_unbound20:25:162
3430958992016,3cyclictest3764805-21kworker/u8:2+flush-259:000:35:212
3430958992016,3cyclictest3640695-21kworker/u8:1+events_unbound23:30:012
3430958992016,3cyclictest3613988-21kworker/u8:2+flush-259:022:10:252
3430958992016,3cyclictest3446388-21kworker/u8:0+flush-259:019:30:002
3430958992015,3cyclictest3510113-21kworker/u8:0+events_unbound20:30:192
3430958992012,5cyclictest3561260-21ntpq21:10:242
3430955992017,2cyclictest3393027-21kworker/u8:3+flush-259:021:00:171
3430955992016,3cyclictest3745225-21kworker/u8:0+flush-259:000:22:421
3430955992016,3cyclictest3640695-21kworker/u8:1+events_unbound23:15:191
3430955992016,3cyclictest3530737-21kworker/u8:1+flush-259:021:05:271
3430955992016,3cyclictest3393027-21kworker/u8:3+flush-259:022:02:301
3430955992015,3cyclictest3764805-21kworker/u8:2+events_unbound00:30:181
3430955992015,3cyclictest3692892-21kworker/u8:0+events_unbound23:20:151
3430955992015,3cyclictest335557-21systemd-journal00:25:291
3430952992018,2cyclictest3488980-21kworker/u8:2+events_unbound20:42:170
3430952992017,2cyclictest3613988-21kworker/u8:2+events_unbound22:15:020
3430952992016,3cyclictest3393027-21kworker/u8:3+events_unbound21:01:060
3430958991916,2cyclictest3671954-21idleruntime-cro23:00:012
3430958991915,3cyclictest3745225-21kworker/u8:0+flush-259:000:10:182
3430958991915,3cyclictest3530737-21kworker/u8:1+flush-259:020:50:162
3430958991914,4cyclictest3656051-21kworker/u8:4+flush-259:023:05:212
3430955991916,2cyclictest3708208-21kworker/u8:3+events_unbound23:55:221
3430955991915,3cyclictest3467621-21kworker/u8:0+events_unbound19:55:131
3430955991915,3cyclictest3393027-21kworker/u8:3+flush-259:019:27:311
3430955991912,5cyclictest335557-21systemd-journal21:41:281
3430952991916,2cyclictest3708208-21kworker/u8:3+events_unbound23:55:270
3430952991916,2cyclictest3640695-21kworker/u8:1+events_unbound23:47:150
3430952991910,3cyclictest335557-21systemd-journal23:09:300
3430962991815,2cyclictest3608596-21idleruntime-cro21:59:593
3430962991814,3cyclictest3745441-21/usr/sbin/munin00:10:263
3430962991813,3cyclictest335557-21systemd-journal22:32:073
3430958991815,2cyclictest3613988-21kworker/u8:2+flush-259:022:25:212
3430958991815,2cyclictest3478201-21latency_hist19:55:002
3430958991814,3cyclictest3692892-21kworker/u8:0+events_unbound23:33:302
3430958991814,3cyclictest3525796-21apt-get20:40:132
3430958991814,3cyclictest3467621-21kworker/u8:0+flush-259:020:05:152
3430958991814,3cyclictest3393027-21kworker/u8:3+events_unbound21:00:192
3430955991814,3cyclictest3640695-21kworker/u8:1+events_unbound22:55:251
3430955991814,3cyclictest3393027-21kworker/u8:3+flush-259:023:10:011
3430955991813,4cyclictest3393027-21kworker/u8:3+flush-259:021:50:001
3430955991812,4cyclictest3536399-21cat20:50:021
3430952991815,2cyclictest3436082-21kworker/u8:2+events_unbound19:24:560
3430952991815,2cyclictest3393027-21kworker/u8:3+events_unbound21:58:320
3430952991815,2cyclictest3393027-21kworker/u8:3+events_unbound19:43:280
3430952991814,3cyclictest3393027-21kworker/u8:3+events_unbound22:23:510
3430962991713,3cyclictest3393027-21kworker/u8:3+flush-259:021:40:293
3430958991714,2cyclictest3708208-21kworker/u8:3+events_unbound00:25:252
3430958991714,2cyclictest3572454-21kworker/u8:0+flush-259:021:25:172
3430958991713,3cyclictest3393027-21kworker/u8:3+events_unbound22:15:282
3430955991714,2cyclictest3692892-21kworker/u8:0+events_unbound23:35:201
3430955991713,3cyclictest3393027-21kworker/u8:3+events_unbound20:12:121
3430955991712,3cyclictest3530970-21/usr/sbin/munin20:45:141
3430952991714,2cyclictest3572454-21kworker/u8:0+events_unbound21:35:020
3430952991714,2cyclictest3488980-21kworker/u8:2+events_unbound20:34:430
3430952991712,2cyclictest3467621-21kworker/u8:0+events_unbound20:07:020
3430962991613,2cyclictest3467621-21kworker/u8:0+flush-259:020:05:263
3430962991612,3cyclictest3572454-21kworker/u8:0+flush-259:022:05:163
3430962991612,2cyclictest3495228-21irqcore20:10:163
3430958991613,2cyclictest3593142-21kworker/u8:1+events_unbound22:00:312
3430958991611,3cyclictest490-21dbus-daemon22:55:002
3430958991610,5cyclictest3457246-21cp19:35:002
3430958991610,4cyclictest3713345-21apt-get23:40:012
3430955991613,2cyclictest3393027-21kworker/u8:3+flush-259:023:00:101
3430955991610,4cyclictest3546617-21latency_hist21:00:011
3430952991612,3cyclictest3393027-21kworker/u8:3+events_unbound20:16:490
343096299158,5cyclictest3640467-21latency_hist22:30:003
3430962991512,2cyclictest3769971-21missed_timers00:30:223
3430962991512,2cyclictest3729927-21irqcore23:55:163
3430962991512,2cyclictest3456995-21apt-key19:35:003
3430962991510,4cyclictest3393027-21kworker/u8:3+flush-259:021:10:263
343096299150,13cyclictest3676585-21cat23:00:233
3430958991512,2cyclictest3393027-21kworker/u8:3+flush-259:021:15:162
3430952991512,2cyclictest3393027-21kworker/u8:3+events_unbound19:51:510
343096299147,5cyclictest3587989-21latency_hist21:40:013
343096299147,4cyclictest335557-21systemd-journal21:49:543
3430958991412,1cyclictest3393027-21kworker/u8:3+events_unbound20:20:182
3430958991411,2cyclictest3593111-21idleruntime-cro21:44:592
3430958991411,2cyclictest3393027-21kworker/u8:3+flush-259:020:00:172
343095599149,4cyclictest3393027-21kworker/u8:3+flush-259:022:20:151
3430955991411,2cyclictest3640695-21kworker/u8:1+events_unbound23:50:271
3430955991411,2cyclictest3510113-21kworker/u8:0+flush-259:020:35:191
3430955991410,3cyclictest3562124-21kworker/u8:2+events_unbound21:23:311
343096299139,3cyclictest3724337-21apt-get23:50:143
3430962991310,2cyclictest3504443-21unixbench_singl20:15:263
343095899139,3cyclictest3572454-21kworker/u8:0+flush-259:021:35:242
3430958991311,2cyclictest3530737-21kworker/u8:1+events_unbound21:08:302
3430958991310,3cyclictest3510113-21kworker/u8:0+events_unbound20:35:242
3430958991310,2cyclictest3393027-21kworker/u8:3+events_unbound19:59:552
343096299129,2cyclictest3515648-21cpuspeed_turbos20:30:143
343096299129,2cyclictest3510506-21fschecks_count20:25:143
343096299121,9cyclictest3666817-21awk22:55:003
3430962991210,1cyclictest3652113-21kthreadcore22:40:173
3430962991210,1cyclictest0-21swapper/300:04:593
343096299120,10cyclictest3687477-21true23:15:013
343095899129,2cyclictest3640695-21kworker/u8:1+events_unbound23:18:302
343095899128,3cyclictest3545604-21needreboot20:55:212
343095899128,3cyclictest3436082-21kworker/u8:2+events_unbound19:15:182
343096299119,1cyclictest0-21swapper/323:40:003
343096299118,2cyclictest3750876-21fschecks_time00:15:163
343096299118,2cyclictest3719334-21cpuspeed_turbos23:45:123
343096299118,2cyclictest0-21swapper/321:50:193
343096299118,1cyclictest0-21swapper/322:55:203
343096299117,3cyclictest3456914-21kworker/u8:1+flush-259:019:35:183
343096299115,4cyclictest335557-21systemd-journal21:09:593
343096299111,8cyclictest3744313-21ntpq00:05:213
343096299110,2cyclictest3682291-21awk23:10:003
343095599117,3cyclictest3393027-21kworker/u8:3+events_unbound21:15:271
343096299107,2cyclictest3707157-21needreboot23:30:213
343096299107,2cyclictest3520835-21fschecks_count20:35:143
343095899106,3cyclictest3640695-21kworker/u8:1+flush-259:023:12:512
343095599106,3cyclictest3393027-21kworker/u8:3+flush-259:022:30:231
34309629995,3cyclictest491ktimers/320:40:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional