You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 09:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Mar 24, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
484966994034,4cyclictest509-21rs:main0
484977993935,3cyclictest625142-21kworker/u8:3+flush-259:021:55:243
484966993732,4cyclictest485419-21apt-get19:10:080
484977993632,3cyclictest521220-21kworker/u8:0+flush-259:020:10:253
484971993633,2cyclictest490322-21kworker/u8:1+flush-259:019:40:151
484966993533,1cyclictest734211-21kworker/0:1+pm23:55:270
484976993429,3cyclictest589222-21/usr/sbin/munin20:50:162
484966993428,4cyclictest724116-21apt-get23:00:120
484966993427,5cyclictest604436-21latency_hist21:05:000
484977993125,4cyclictest745303-21diskstats23:20:153
484971993128,2cyclictest760385-21kworker/u8:5+flush-259:023:55:261
484977993026,3cyclictest490322-21kworker/u8:1+flush-259:019:25:013
484977993024,4cyclictest625142-21kworker/u8:3+events_unbound21:35:173
484977992924,4cyclictest750278-21apt-get23:25:113
484977992924,4cyclictest734813-21apt-get23:10:103
484971992926,2cyclictest526612-21kworker/u8:2+flush-259:019:55:171
484971992925,3cyclictest625142-21kworker/u8:3+events_unbound21:50:211
484971992925,3cyclictest625142-21kworker/u8:3+events_unbound21:50:201
484966992925,2cyclictest2632101-21kworker/u8:5+events_unbound19:45:010
484971992825,2cyclictest671804-21kworker/u8:1+flush-259:022:45:291
484971992824,3cyclictest671804-21kworker/u8:1+flush-259:022:35:211
484971992824,3cyclictest625142-21kworker/u8:3+events_unbound21:35:231
484971992823,4cyclictest729275-21apt-get23:05:121
484971992820,5cyclictest594141-21latency_hist20:55:021
484977992721,4cyclictest252-21systemd-journal23:04:243
484971992723,3cyclictest2632101-21kworker/u8:5+flush-259:019:45:261
484971992720,5cyclictest802394-21cat00:15:011
484976992621,4cyclictest509-21rs:main2
484966992622,3cyclictest542428-21kworker/u8:3+flush-259:020:30:250
484966992620,4cyclictest661343-21kworker/u8:0+flush-259:022:30:010
484977992521,3cyclictest75-21kswapd023:55:273
484977992519,4cyclictest677326-21/usr/sbin/munin22:15:163
484971992522,2cyclictest723892-21kworker/u8:2+events_unbound23:25:171
484971992518,4cyclictest541961-21cp20:05:011
484966992519,4cyclictest252-21systemd-journal19:31:260
484976992420,3cyclictest750039-21kworker/u8:4+flush-259:023:35:002
484976992420,3cyclictest723892-21kworker/u8:2+flush-259:023:15:262
484976992417,5cyclictest494637-21ntpq19:15:232
484971992421,2cyclictest671804-21kworker/u8:1+events_unbound22:40:241
484971992418,4cyclictest252-21systemd-journal22:55:031
484966992419,4cyclictest760385-21kworker/u8:5+events_unbound23:45:150
484966992417,5cyclictest807348-21latency_hist00:20:010
484966992417,5cyclictest801956-21cp00:15:000
484966992417,5cyclictest734315-21cp23:10:010
484966992417,5cyclictest525560-21ntpq19:45:230
48496699240,22cyclictest765590-21true23:39:590
484977992319,3cyclictest553150-21kworker/u8:2+flush-259:020:55:173
484977992318,4cyclictest578890-21kworker/u8:1+flush-259:021:20:163
484977992318,4cyclictest252-21systemd-journal23:40:003
484976992318,3cyclictest252-21systemd-journal23:44:252
484976992317,4cyclictest630282-21latency_hist21:30:012
484976992317,4cyclictest542461-21apt-get20:05:112
484976992315,7cyclictest553150-21kworker/u8:2+flush-259:020:20:012
484971992320,2cyclictest542428-21kworker/u8:3+events_unbound20:20:151
484971992319,3cyclictest723892-21kworker/u8:2+events_unbound23:15:151
484971992318,3cyclictest547621-21/usr/sbin/munin20:10:211
484971992317,4cyclictest553150-21kworker/u8:2+events_unbound22:05:251
484966992319,3cyclictest661343-21kworker/u8:0+events_unbound22:40:180
484966992316,5cyclictest645243-21ntpq21:40:200
484976992216,4cyclictest588124-21ntpq20:45:242
484971992218,3cyclictest723892-21kworker/u8:2+events_unbound23:35:241
484971992218,3cyclictest661343-21kworker/u8:0+events_unbound22:10:161
484971992218,3cyclictest447369-21kworker/u8:2+events_unbound19:25:211
484971992217,3cyclictest553150-21kworker/u8:2+flush-259:021:10:261
484966992219,2cyclictest739212-21kworker/u8:1+flush-259:023:50:150
484966992219,2cyclictest526612-21kworker/u8:2+flush-259:020:00:190
484966992217,3cyclictest661343-21kworker/u8:0+flush-259:022:10:180
484977992117,3cyclictest516296-21/usr/sbin/munin19:40:133
484976992117,3cyclictest553150-21kworker/u8:2+flush-259:021:05:212
484976992115,4cyclictest651540-21/usr/sbin/munin21:50:202
484976992115,4cyclictest651540-21/usr/sbin/munin21:50:192
484971992118,2cyclictest723892-21kworker/u8:2+events_unbound23:10:131
484971992118,2cyclictest553150-21kworker/u8:2+events_unbound22:20:151
484971992117,3cyclictest739212-21kworker/u8:1+flush-259:000:20:011
484971992117,3cyclictest661343-21kworker/u8:0+events_unbound22:15:211
484971992117,3cyclictest553150-21kworker/u8:2+events_unbound21:25:251
484971992117,3cyclictest542428-21kworker/u8:3+flush-259:020:10:001
484971992115,4cyclictest505997-21/usr/sbin/munin19:30:191
484966992116,3cyclictest2632101-21kworker/u8:5+events_unbound19:50:210
484966992115,4cyclictest558324-21apt-get20:20:120
484966992115,4cyclictest495726-21apt-get19:20:110
484977992016,3cyclictest723892-21kworker/u8:2+flush-259:023:30:173
484976992017,2cyclictest0-21swapper/220:15:002
484976992016,3cyclictest723892-21kworker/u8:2+flush-259:023:14:562
484971992016,3cyclictest661343-21kworker/u8:0+flush-259:022:50:211
484971992016,3cyclictest563222-21kworker/u8:0+flush-259:020:25:211
484971992015,4cyclictest553150-21kworker/u8:2+events_unbound21:15:211
484971992015,3cyclictest553150-21kworker/u8:2+flush-259:021:00:211
484971992015,3cyclictest447369-21kworker/u8:2+flush-259:019:15:251
484966992017,2cyclictest666763-21sh22:04:590
484966992016,3cyclictest553150-21kworker/u8:2+events_unbound21:30:230
484966992013,5cyclictest769799-21ntpq23:40:210
484977991916,2cyclictest542428-21kworker/u8:3+flush-259:020:30:023
484976991914,3cyclictest713132-21kworker/u8:3+flush-259:023:00:162
484971991916,2cyclictest661343-21kworker/u8:0+flush-259:022:30:231
484971991916,2cyclictest661343-21kworker/u8:0+events_unbound22:25:231
484971991916,2cyclictest596708-21kthreadcore20:55:191
484971991915,3cyclictest755441-21apt-get23:30:121
484971991915,3cyclictest739212-21kworker/u8:1+events_unbound23:50:191
484971991915,3cyclictest739212-21kworker/u8:1+events_unbound23:45:231
484971991915,3cyclictest625142-21kworker/u8:3+flush-259:021:55:171
484971991914,4cyclictest542428-21kworker/u8:3+events_unbound20:30:221
484971991914,3cyclictest604708-21apt-get21:05:131
484971991913,4cyclictest728162-21ntpq23:00:231
484966991915,3cyclictest511606-21irqcore19:35:170
484966991913,4cyclictest717367-21ntpq22:50:210
484977991815,2cyclictest646135-21idleruntime-cro21:45:003
484977991815,2cyclictest447369-21kworker/u8:2+flush-259:019:30:003
484977991814,3cyclictest785805-21kworker/u8:0+flush-259:000:10:003
484977991814,3cyclictest785805-21kworker/u8:0+flush-259:000:10:003
484976991815,2cyclictest771379-21grep23:45:172
484976991815,2cyclictest578890-21kworker/u8:1+flush-259:021:04:552
484971991815,2cyclictest786425-21kworker/u8:3+flush-259:000:35:301
484971991814,3cyclictest739212-21kworker/u8:1+events_unbound23:43:261
484971991814,3cyclictest553150-21kworker/u8:2+flush-259:021:40:191
484971991812,4cyclictest252-21systemd-journal00:35:001
484966991814,3cyclictest786425-21kworker/u8:3+events_unbound00:25:150
484966991814,3cyclictest723892-21kworker/u8:2+events_unbound23:15:190
484977991714,2cyclictest781045-21munin-plugin-st23:55:003
484977991714,2cyclictest579342-21irqcore20:40:143
484977991713,3cyclictest827083-21ntp_kernel_err00:35:233
48497699173,8cyclictest765578-21munin-run23:40:002
484976991711,4cyclictest712184-21ntpq22:45:232
484971991714,2cyclictest620609-21irqcore21:20:171
484971991713,3cyclictest796860-21apt-get00:10:131
484971991711,5cyclictest630968-21apt-get21:30:121
484966991714,2cyclictest60350irq/132-enp0s29f1:rx-022:20:240
484966991713,3cyclictest718961-21apt-get22:55:080
484966991713,3cyclictest553150-21kworker/u8:2+events_unbound22:05:200
484966991713,3cyclictest553150-21kworker/u8:2+events_unbound20:55:180
484966991713,3cyclictest447369-21kworker/u8:2+flush-259:019:25:160
484966991711,5cyclictest646380-21/usr/sbin/munin21:45:150
484966991711,4cyclictest563437-21/usr/sbin/munin20:25:160
484977991614,1cyclictest0-21swapper/323:10:013
484977991613,1cyclictest0-21swapper/322:40:253
484977991612,3cyclictest739977-21apt-get23:15:113
484977991612,3cyclictest541807-21kworker/u8:1+flush-259:020:05:213
484977991610,4cyclictest252-21systemd-journal23:47:253
48497699169,5cyclictest780190-21ntpq23:50:232
484976991612,3cyclictest490322-21kworker/u8:1+flush-259:019:20:162
484976991612,2cyclictest539188-21kthreadcore20:00:192
484976991611,4cyclictest723892-21kworker/u8:2+flush-259:023:20:262
484976991611,3cyclictest817894-21/usr/sbin/munin00:30:192
484971991613,2cyclictest785805-21kworker/u8:0+events_unbound00:00:161
484971991613,2cyclictest490322-21kworker/u8:1+events_unbound19:20:261
484971991612,3cyclictest553059-21gpgv20:15:021
484966991614,1cyclictest60350irq/132-enp0s29f1:rx-023:10:150
484966991614,1cyclictest60350irq/132-enp0s29f1:rx-021:28:100
484966991614,1cyclictest60350irq/132-enp0s29f1:rx-021:15:210
484966991614,1cyclictest60350irq/132-enp0s29f1:rx-019:55:230
484966991614,1cyclictest60350irq/132-enp0s29f1:rx-019:15:070
484966991613,2cyclictest60350irq/132-enp0s29f1:rx-023:20:030
484966991613,2cyclictest60350irq/132-enp0s29f1:rx-022:37:070
484966991613,2cyclictest60350irq/132-enp0s29f1:rx-021:10:170
484966991613,2cyclictest60350irq/132-enp0s29f1:rx-020:09:460
484966991613,2cyclictest60350irq/132-enp0s29f1:rx-000:24:470
484976991511,3cyclictest661343-21kworker/u8:0+flush-259:022:15:262
484971991512,2cyclictest2632101-21kworker/u8:5+events_unbound19:35:181
484971991511,3cyclictest739212-21kworker/u8:1+flush-259:000:25:301
484971991511,3cyclictest723892-21kworker/u8:2+flush-259:023:24:301
484971991511,3cyclictest553150-21kworker/u8:2+events_unbound22:02:281
484966991513,2cyclictest60350irq/132-enp0s29f1:rx-021:53:150
484966991513,2cyclictest60350irq/132-enp0s29f1:rx-021:53:140
484966991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:200
484966991513,1cyclictest60350irq/132-enp0s29f1:rx-022:45:520
484966991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:230
484966991512,2cyclictest60350irq/132-enp0s29f1:rx-000:35:200
484966991511,3cyclictest563222-21kworker/u8:0+events_unbound20:35:210
484966991511,3cyclictest542428-21kworker/u8:3+flush-259:020:15:190
484966991511,3cyclictest252-21systemd-journal20:54:250
484966991511,2cyclictest0-21swapper/021:10:000
48497799149,4cyclictest671804-21kworker/u8:1+events_unbound22:55:193
48497799147,5cyclictest484710-21latency_hist19:10:003
484977991412,1cyclictest797264-21irqcore00:10:183
484977991411,2cyclictest2971-21cron21:55:003
484977991411,2cyclictest2971-21cron21:55:003
484977991410,2cyclictest785805-21kworker/u8:0+flush-259:000:00:173
48497699149,4cyclictest801771-21apt-get00:15:002
484976991412,1cyclictest785746-21fwupd23:55:262
484976991412,1cyclictest0-21swapper/223:10:012
484976991411,2cyclictest718640-21latency_hist22:55:012
484971991411,2cyclictest1-21systemd00:10:001
484971991411,2cyclictest1-21systemd00:09:591
48496699149,4cyclictest553150-21kworker/u8:2+flush-259:020:45:260
484966991412,1cyclictest60350irq/132-enp0s29f1:rx-020:40:180
484966991412,1cyclictest60350irq/132-enp0s29f1:rx-000:30:250
484966991412,1cyclictest60350irq/132-enp0s29f1:rx-000:08:520
484966991412,1cyclictest60350irq/132-enp0s29f1:rx-000:08:520
484966991411,2cyclictest60350irq/132-enp0s29f1:rx-022:31:000
484966991411,2cyclictest60350irq/132-enp0s29f1:rx-000:03:400
48497799139,3cyclictest786425-21kworker/u8:3+flush-259:000:30:263
48497799139,3cyclictest578890-21kworker/u8:1+flush-259:021:10:053
48497799138,4cyclictest553150-21kworker/u8:2+flush-259:022:05:143
484977991311,1cyclictest0-21swapper/319:40:013
484977991310,2cyclictest692026-21unixbench_multi22:25:253
484977991310,2cyclictest635846-21sh21:34:593
484977991310,2cyclictest494952-21unixbench-2d19:15:253
48497699139,3cyclictest713132-21kworker/u8:3+flush-259:023:30:002
48497699138,3cyclictest620174-21/usr/sbin/munin21:20:152
48497699138,3cyclictest509-21rs:main2
484976991310,2cyclictest0-21swapper/221:19:592
48497199139,3cyclictest563222-21kworker/u8:0+events_unbound20:35:161
484971991310,2cyclictest509-21rs:main1
484966991311,2cyclictest60350irq/132-enp0s29f1:rx-021:21:440
484966991310,2cyclictest60350irq/132-enp0s29f1:rx-022:15:120
48497799129,2cyclictest625793-21sed21:25:173
48497799129,2cyclictest567913-21unixbench_singl20:25:253
48497799129,2cyclictest500-21systemd-logind22:40:003
48497799129,1cyclictest0-21swapper/320:50:013
48497799128,2cyclictest0-21swapper/322:05:003
48497699129,2cyclictest536141-21unixbench_multi19:55:242
48497699129,2cyclictest0-21swapper/222:25:132
48497699128,3cyclictest785805-21kworker/u8:0+flush-259:000:00:242
48497699128,2cyclictest0-21swapper/200:10:002
48497699128,2cyclictest0-21swapper/200:10:002
48497699126,4cyclictest526387-21latency_hist19:50:012
484976991210,1cyclictest0-21swapper/222:00:012
484976991210,1cyclictest0-21swapper/221:40:182
48497199128,3cyclictest2632101-21kworker/u8:5+events_unbound19:10:101
48497799119,1cyclictest0-21swapper/321:20:003
48497799118,2cyclictest491ktimers/319:50:213
48497799118,2cyclictest0-21swapper/319:55:193
48497799117,3cyclictest718477-21gpgv22:55:013
48497799117,2cyclictest649548-21kthreadcore21:45:183
48497799116,3cyclictest489908-21sshd19:10:263
48497799115,5cyclictest563197-21latency_hist20:25:003
48497799110,9cyclictest541765-21awk20:05:013
48497699119,1cyclictest0-21swapper/222:55:132
48497699118,2cyclictest698113-21fschecks_count22:35:152
48497699118,2cyclictest0-21swapper/221:00:012
48497699117,2cyclictest0-21swapper/200:25:002
48497199117,3cyclictest553150-21kworker/u8:2+events_unbound20:41:261
48497199111,8cyclictest252-21systemd-journal20:50:001
48496699118,2cyclictest60350irq/132-enp0s29f1:rx-020:11:520
48497799108,1cyclictest0-21swapper/319:30:133
48497799108,1cyclictest0-21swapper/300:25:243
48497799106,3cyclictest713138-21latency_hist22:50:013
48497699107,2cyclictest672255-21cpuspeed_turbos22:10:142
48497699104,4cyclictest646925-21cut21:45:162
4849779997,1cyclictest0-21swapper/323:45:003
4849779997,1cyclictest0-21swapper/322:20:143
4849779997,1cyclictest0-21swapper/321:05:013
4849779996,2cyclictest802525-21cpuspeed_turbos00:15:153
4849779985,2cyclictest491ktimers/322:30:223
4849779984,3cyclictest808514-21sed00:20:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional