You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 14:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jul 21, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3917381994135,5cyclictest58507-21latency_hist00:30:011
3917389994022,13cyclictest4053886-21apt-get21:20:123
3917385993934,3cyclictest27138-21base6400:00:012
3917379993933,4cyclictest3922522-21latency_hist19:15:010
3917385993733,3cyclictest4116151-21kworker/u8:1+events_unbound22:50:212
3917385993731,4cyclictest4007156-21latency_hist20:35:002
3917381993733,3cyclictest3960091-21kworker/u8:0+flush-259:020:45:201
3917381993633,2cyclictest4178252-21kworker/u8:1+flush-259:023:45:151
3917381993631,3cyclictest3976337-21apt-get20:05:131
3917381993429,4cyclictest4090556-21apt-get21:55:131
3917381993427,5cyclictest32191-21latency_hist00:05:001
3917389993327,4cyclictest3965424-21gpgv19:55:013
3917381993330,2cyclictest4064042-21kworker/u8:2+flush-259:021:30:151
3917379993327,4cyclictest509-21rs:main0
3917385993228,3cyclictest37482-21gpgv00:10:012
3917381993227,3cyclictest4178887-21/usr/sbin/munin23:20:141
3917389993125,4cyclictest3996782-21latency_hist20:25:003
3917379993126,4cyclictest4116151-21kworker/u8:1+flush-259:022:30:290
3917381993027,2cyclictest4069843-21kworker/u8:0+events_unbound21:45:151
3917381993027,2cyclictest3938525-21kworker/u8:3+flush-259:019:55:011
3917381993026,3cyclictest4080190-21kworker/u8:1+events_unbound21:50:151
3917381993026,3cyclictest3917553-21kworker/u8:0+flush-259:019:20:161
3917389992925,3cyclictest63569-40mandb00:33:203
3917389992918,9cyclictest3943756-21latency_hist19:35:013
3917385992926,2cyclictest3874324-21kworker/u8:2+events_unbound19:35:232
3917381992926,2cyclictest4069843-21kworker/u8:0+events_unbound21:35:221
3917385992825,2cyclictest3981271-21kworker/u8:1+flush-259:020:35:152
3917385992824,3cyclictest53338-21kworker/u8:2+events_unbound00:37:182
3917385992824,3cyclictest4178252-21kworker/u8:1+events_unbound23:55:122
3917381992825,2cyclictest4048465-21kworker/u8:3+flush-259:021:25:161
3917381992824,3cyclictest4131638-21kworker/u8:4+flush-259:022:45:201
3917381992823,4cyclictest4012579-21apt-get20:40:111
3917379992822,4cyclictest3981486-21/usr/sbin/munin20:10:240
3917389992723,3cyclictest4110829-21kworker/u8:3+flush-259:023:05:003
3917385992724,2cyclictest4095526-21kworker/u8:2+flush-259:023:35:152
3917385992724,2cyclictest4028028-21kworker/u8:1+flush-259:021:15:242
3917385992723,3cyclictest4095526-21kworker/u8:2+flush-259:023:15:012
3917385992723,3cyclictest4095526-21kworker/u8:2+flush-259:023:15:002
3917381992724,2cyclictest4095526-21kworker/u8:2+events_unbound23:30:151
3917381992724,2cyclictest3874324-21kworker/u8:2+events_unbound19:41:161
3917381992724,2cyclictest10641-21kworker/u8:0+events_unbound00:18:161
3917381992723,3cyclictest3960091-21kworker/u8:0+flush-259:020:00:241
3917381992722,4cyclictest4095526-21kworker/u8:2+flush-259:000:05:161
3917379992721,4cyclictest3980401-21ntpq20:05:230
3917385992623,2cyclictest4028028-21kworker/u8:1+events_unbound21:05:242
3917385992622,3cyclictest3960091-21kworker/u8:0+events_unbound20:00:152
3917379992620,4cyclictest20954-21apt-get23:55:010
3917385992522,2cyclictest500-21systemd-logind22:10:002
3917385992522,2cyclictest4095526-21kworker/u8:2+events_unbound23:05:202
3917385992521,3cyclictest507-21in:imuxsock20:45:002
3917385992521,3cyclictest4116151-21kworker/u8:1+events_unbound22:39:162
3917381992520,4cyclictest335557-21systemd-journal23:15:001
3917381992520,4cyclictest335557-21systemd-journal23:14:591
3917389992420,3cyclictest4184091-21apt-get23:25:123
3917389992417,5cyclictest4043729-21diskstats21:10:133
3917385992421,2cyclictest4178252-21kworker/u8:1+flush-259:023:30:202
3917385992420,3cyclictest36523-21kworker/u8:4+events_unbound00:15:242
3917385992419,4cyclictest4069370-21cp21:35:002
3917381992421,2cyclictest4116151-21kworker/u8:1+events_unbound22:54:141
3917381992421,2cyclictest4110829-21kworker/u8:3+events_unbound22:25:241
3917381992421,2cyclictest3960091-21kworker/u8:0+events_unbound20:50:151
3917381992420,3cyclictest4080190-21kworker/u8:1+events_unbound22:10:131
3917381992418,4cyclictest38053-21apt-get00:10:111
3917381992319,3cyclictest3883701-21kworker/u8:1+flush-259:019:25:151
3917379992317,4cyclictest3944103-21cat19:35:010
3917389992218,3cyclictest21073-21gpgv23:55:003
3917385992219,2cyclictest10641-21kworker/u8:0+events_unbound00:21:162
3917385992218,3cyclictest4116151-21kworker/u8:1+events_unbound22:25:142
3917381992219,2cyclictest4028028-21kworker/u8:1+flush-259:021:00:151
3917381992218,3cyclictest4178252-21kworker/u8:1+flush-259:023:40:101
3917381992217,3cyclictest4110829-21kworker/u8:3+events_unbound22:40:131
3917379992217,4cyclictest335557-21systemd-journal21:34:130
391738999219,2cyclictest0-21swapper/300:10:013
3917389992116,4cyclictest335557-21systemd-journal19:30:003
3917389992115,4cyclictest10617-21latency_hist23:45:013
3917385992118,2cyclictest47910-21kworker/u8:1+events_unbound00:26:152
3917385992118,2cyclictest4110829-21kworker/u8:3+flush-259:022:40:152
3917385992118,2cyclictest3960091-21kworker/u8:0+flush-259:020:10:212
3917385992118,2cyclictest3917553-21kworker/u8:0+events_unbound19:20:142
3917385992117,3cyclictest4178252-21kworker/u8:1+events_unbound23:50:132
3917381992118,2cyclictest4178252-21kworker/u8:1+events_unbound23:25:251
3917381992118,2cyclictest4028028-21kworker/u8:1+flush-259:021:05:201
3917381992118,2cyclictest4028028-21kworker/u8:1+events_unbound21:15:151
3917381992117,3cyclictest4116151-21kworker/u8:1+events_unbound22:30:121
3917381992117,3cyclictest4028028-21kworker/u8:1+events_unbound20:55:291
3917381992117,3cyclictest4028028-21kworker/u8:1+events_unbound20:55:291
3917381992117,3cyclictest3965879-21kworker/u8:4+events_unbound20:18:161
3917381992117,3cyclictest3938525-21kworker/u8:3+events_unbound19:39:151
3917379992116,4cyclictest4116151-21kworker/u8:1+flush-259:022:20:500
3917379992114,5cyclictest42094-21ntpq00:10:210
391738999209,3cyclictest21643-21apt-get23:55:113
391738999208,10cyclictest0-21swapper/321:30:203
3917385992017,2cyclictest4074119-21kworker/u8:4+events_unbound21:40:322
3917385992017,2cyclictest4038144-21kworker/u8:2+events_unbound21:10:202
3917385992017,2cyclictest3949321-21kworker/u8:1+events_unbound19:46:572
3917385992017,2cyclictest36523-21kworker/u8:4+flush-259:000:10:242
3917385992016,3cyclictest4089980-21kworker/u8:3+events_unbound22:03:152
3917381992017,3cyclictest4116151-21kworker/u8:1+events_unbound22:20:151
3917381992017,2cyclictest4089980-21kworker/u8:3+events_unbound22:00:141
3917381992017,2cyclictest4064042-21kworker/u8:2+events_unbound21:40:191
3917379992017,2cyclictest3996790-21munin-run20:25:000
391738999199,8cyclictest0-21swapper/320:40:113
391738999198,1cyclictest0-21swapper/300:15:253
3917389991914,3cyclictest4038144-21kworker/u8:2+flush-259:021:05:173
391738599193,14cyclictest4085143-21munin-run21:50:002
3917385991916,2cyclictest4110829-21kworker/u8:3+flush-259:022:55:182
3917385991916,2cyclictest4089980-21kworker/u8:3+events_unbound21:55:232
3917385991916,2cyclictest3883701-21kworker/u8:1+events_unbound19:10:222
3917385991915,3cyclictest3965879-21kworker/u8:4+events_unbound20:05:142
3917381991917,2cyclictest53338-21kworker/u8:2+events_unbound00:39:151
3917381991916,2cyclictest4095526-21kworker/u8:2+events_unbound23:35:201
3917381991916,2cyclictest4095526-21kworker/u8:2+events_unbound23:05:151
3917381991916,2cyclictest4095526-21kworker/u8:2+events_unbound23:02:161
3917381991916,2cyclictest3949321-21kworker/u8:1+events_unbound19:46:551
3917381991915,2cyclictest4002221-21apt-get20:30:101
3917379991914,3cyclictest4110829-21kworker/u8:3+flush-259:022:15:160
3917379991912,5cyclictest509-21rs:main0
391738999186,2cyclictest3955258-21cpuspeed_turbos19:45:133
3917389991815,2cyclictest4163405-21irqcore23:05:193
3917385991815,2cyclictest4178252-21kworker/u8:1+flush-259:023:25:262
3917385991815,2cyclictest4080190-21kworker/u8:1+events_unbound22:10:162
3917385991815,2cyclictest3883701-21kworker/u8:1+events_unbound19:25:232
3917381991815,2cyclictest4131638-21kworker/u8:4+events_unbound22:35:241
3917381991815,2cyclictest4028028-21kworker/u8:1+events_unbound21:10:151
3917381991815,2cyclictest3917553-21kworker/u8:0+events_unbound19:10:131
3917381991814,3cyclictest3991833-21kworker/u8:3+events_unbound20:20:221
3917381991814,3cyclictest3960091-21kworker/u8:0+events_unbound20:10:221
3917379991815,2cyclictest4053850-21kworker/u8:0+events_unbound21:20:150
3917379991814,3cyclictest60350irq/132-enp0s29f1:rx-023:15:120
3917379991812,4cyclictest3960091-21kworker/u8:0+flush-259:020:30:190
391737999181,15cyclictest490-21dbus-daemon19:30:000
3917379991811,5cyclictest4168105-21/usr/sbin/munin23:10:150
3917379991811,5cyclictest4168105-21/usr/sbin/munin23:10:140
391738999175,2cyclictest0-21swapper/319:40:013
391738999174,3cyclictest513-21gdbus21:30:003
3917389991714,2cyclictest3883701-21kworker/u8:1+flush-259:019:25:003
3917385991714,2cyclictest4064042-21kworker/u8:2+events_unbound21:50:212
3917385991714,2cyclictest3874324-21kworker/u8:2+flush-259:019:40:252
3917385991712,4cyclictest335557-21systemd-journal23:50:002
391738599170,15cyclictest1-21systemd20:19:142
3917381991714,2cyclictest3874324-21kworker/u8:2+events_unbound19:32:161
3917381991712,4cyclictest3923376-21diskstats19:15:151
3917379991713,2cyclictest4162979-21apt-get23:05:130
3917379991712,3cyclictest53323-21latency_hist00:25:000
391737999171,13cyclictest490-21dbus-daemon20:00:010
3917379991710,5cyclictest335557-21systemd-journal22:55:000
3917389991613,2cyclictest5441-21idleruntime-cro23:40:003
3917389991611,3cyclictest335557-21systemd-journal00:02:153
391738999160,2cyclictest4007156-21latency_hist20:35:003
3917385991613,2cyclictest4053850-21kworker/u8:0+events_unbound21:20:272
3917385991613,2cyclictest4012241-21kworker/u8:2+events_unbound20:46:152
3917385991612,3cyclictest509-21rs:main2
3917385991612,3cyclictest4048465-21kworker/u8:3+events_unbound21:25:202
3917385991612,2cyclictest0-21swapper/219:30:202
3917385991611,4cyclictest4178385-21cat23:20:012
3917381991613,2cyclictest4110829-21kworker/u8:3+flush-259:022:55:261
3917381991613,2cyclictest4095526-21kworker/u8:2+events_unbound23:15:201
3917381991612,3cyclictest4053850-21kworker/u8:0+events_unbound21:21:161
391737999167,7cyclictest4116151-21kworker/u8:1+flush-259:022:46:130
3917379991614,1cyclictest60350irq/132-enp0s29f1:rx-023:47:520
3917379991614,1cyclictest60350irq/132-enp0s29f1:rx-020:01:280
3917379991614,1cyclictest0-21swapper/021:30:000
3917379991613,2cyclictest60350irq/132-enp0s29f1:rx-023:40:220
3917379991613,2cyclictest60350irq/132-enp0s29f1:rx-021:55:460
3917379991613,2cyclictest60350irq/132-enp0s29f1:rx-020:44:450
3917379991613,2cyclictest60350irq/132-enp0s29f1:rx-019:22:400
3917379991613,2cyclictest1-21systemd19:55:010
3917379991612,3cyclictest500-21systemd-logind23:35:000
3917379991612,2cyclictest4069188-21apt-get21:35:030
391737999161,13cyclictest335557-21systemd-journal22:29:590
3917379991610,4cyclictest466-21/usr/sbin/munin23:35:150
3917379991610,4cyclictest4043568-21apt-get21:10:110
391738999159,4cyclictest335557-21systemd-journal00:25:013
391738999156,1cyclictest3953978-21ntpq19:40:213
3917385991513,2cyclictest4095526-21kworker/u8:2+events_unbound23:00:172
3917385991512,2cyclictest4121302-21systemd-run22:24:592
3917385991512,2cyclictest4069843-21kworker/u8:0+events_unbound21:35:242
3917385991512,2cyclictest4028028-21kworker/u8:1+events_unbound21:04:162
3917385991512,2cyclictest3917553-21kworker/u8:0+events_unbound19:15:262
3917381991512,2cyclictest10641-21kworker/u8:0+events_unbound23:55:231
3917379991513,2cyclictest60350irq/132-enp0s29f1:rx-021:49:220
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-023:50:240
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-023:27:360
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:260
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-021:15:190
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-020:37:420
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:260
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-019:37:410
3917379991513,1cyclictest60350irq/132-enp0s29f1:rx-000:25:260
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-023:25:000
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-022:58:550
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-022:35:230
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-020:25:240
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-019:15:270
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-000:30:180
3917379991512,2cyclictest60350irq/132-enp0s29f1:rx-000:00:020
391738999148,4cyclictest509-21rs:main3
391738999148,4cyclictest509-21rs:main3
391738999148,4cyclictest335557-21systemd-journal22:55:143
3917389991411,2cyclictest4099778-21ntp_kernel_pll_22:00:233
3917389991411,2cyclictest4085400-21apt-get21:50:133
3917389991411,2cyclictest0-21swapper/322:15:013
3917385991411,2cyclictest3981271-21kworker/u8:1+flush-259:020:20:152
3917385991410,3cyclictest3991833-21kworker/u8:3+events_unbound20:26:162
391738199147,5cyclictest4011408-21ntpq20:35:221
3917381991411,2cyclictest53338-21kworker/u8:2+flush-259:000:30:211
391737999149,4cyclictest4064042-21kworker/u8:2+flush-259:021:40:180
3917379991412,1cyclictest60350irq/132-enp0s29f1:rx-022:10:250
3917379991412,1cyclictest60350irq/132-enp0s29f1:rx-021:53:060
3917379991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:150
3917379991412,1cyclictest60350irq/132-enp0s29f1:rx-020:45:130
3917379991411,2cyclictest60350irq/132-enp0s29f1:rx-019:40:260
3917379991411,2cyclictest60350irq/132-enp0s29f1:rx-000:35:190
3917379991411,2cyclictest60350irq/132-enp0s29f1:rx-000:05:120
3917379991410,3cyclictest60350irq/132-enp0s29f1:rx-000:15:220
391738599138,4cyclictest4131612-21latency_hist22:35:002
3917385991311,2cyclictest3965879-21kworker/u8:4+events_unbound19:55:172
3917381991310,2cyclictest47910-21kworker/u8:1+events_unbound00:20:281
3917381991310,2cyclictest3991833-21kworker/u8:3+flush-259:020:25:181
3917379991311,1cyclictest60350irq/132-enp0s29f1:rx-020:55:170
3917379991311,1cyclictest60350irq/132-enp0s29f1:rx-020:55:170
3917379991310,2cyclictest60350irq/132-enp0s29f1:rx-023:00:160
3917379991310,2cyclictest60350irq/132-enp0s29f1:rx-022:42:360
391738999129,2cyclictest4126762-21cpuspeed_turbos22:30:133
391738999129,2cyclictest4121955-21irqcore22:25:173
391738999129,2cyclictest4012241-21kworker/u8:2+flush-259:020:45:303
391738999129,2cyclictest3975064-21needreboot20:00:193
391738999128,3cyclictest10641-21kworker/u8:0+flush-259:000:15:013
391738999127,4cyclictest3874324-21kworker/u8:2+flush-259:019:55:213
391738999125,5cyclictest4012317-21latency_hist20:40:003
391738599129,2cyclictest47910-21kworker/u8:1+events_unbound00:34:542
391738599128,3cyclictest4095526-21kworker/u8:2+events_unbound23:21:162
3917385991210,1cyclictest0-21swapper/223:40:192
391738999119,1cyclictest0-21swapper/322:35:163
391738999119,1cyclictest0-21swapper/322:00:013
391738999118,2cyclictest4023006-21cpuspeed_turbos20:50:143
391738999118,2cyclictest0-21swapper/323:15:003
391738999118,2cyclictest0-21swapper/323:15:003
391738999118,1cyclictest0-21swapper/321:05:013
391738999116,3cyclictest58489-21cron00:30:013
391738999116,3cyclictest4053604-21cron21:20:013
391738599119,1cyclictest0-21swapper/220:50:212
391738199118,2cyclictest20992-21sh23:55:011
391738999108,1cyclictest0-21swapper/322:50:173
391738999108,1cyclictest0-21swapper/322:05:253
391738999107,2cyclictest4080341-21cpuspeed_turbos21:45:133
391738999101,2cyclictest4001959-21latency_hist20:30:003
391738599106,3cyclictest335557-21systemd-journal21:00:002
391738599106,3cyclictest335557-21systemd-journal21:00:002
391737999101,2cyclictest4022932-21apt-get20:50:130
39173899997,1cyclictest0-21swapper/320:10:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional