You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 07:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 21, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282282995447,5cyclictest463412-21latency_hist22:05:012
282282995346,5cyclictest344532-21latency_hist20:10:002
282284995145,4cyclictest468573-21latency_hist22:10:013
282282995147,3cyclictest593211-21kworker/u8:3+events_unbound00:31:022
282282995043,5cyclictest562007-21latency_hist23:40:002
282278994838,4cyclictest375433-21latency_hist20:40:011
282282994744,2cyclictest318230-21kworker/u8:4+events_unbound19:49:252
282282994743,3cyclictest505247-21kworker/u8:3+events_unbound22:49:242
282282994743,3cyclictest505247-21kworker/u8:3+events_unbound22:49:242
282282994643,2cyclictest479054-21kworker/u8:0+events_unbound22:29:242
282282994643,2cyclictest417288-21kworker/u8:4+events_unbound21:26:252
282282994642,3cyclictest297711-21kworker/u8:0+events_unbound20:35:022
282275994641,3cyclictest489960-21kworker/u8:1+flush-259:023:20:010
282282994542,2cyclictest396516-21kworker/u8:1+events_unbound21:17:122
282282994541,3cyclictest489960-21kworker/u8:1+events_unbound22:58:242
282275994537,5cyclictest556820-21latency_hist23:35:000
282282994437,5cyclictest335557-21systemd-journal22:45:012
282282994437,5cyclictest335557-21systemd-journal22:45:002
282278994439,3cyclictest562235-21/usr/sbin/munin23:40:151
282284994336,5cyclictest370530-21/usr/sbin/munin20:35:143
282282994340,2cyclictest380798-21kworker/u8:3+events_unbound20:57:092
282284994236,4cyclictest407015-21/usr/sbin/munin21:10:143
282282994240,2cyclictest297711-21kworker/u8:0+events_unbound21:04:242
282278994236,4cyclictest380570-21latency_hist20:45:001
282282994135,4cyclictest582673-21latency_hist00:00:012
282278994139,1cyclictest401711-21kworker/1:1+pm21:46:221
282275994135,4cyclictest592985-21latency_hist00:10:020
282278994035,3cyclictest587840-21latency_hist00:05:001
282275994035,3cyclictest479017-21gpgv22:20:000
282282993835,2cyclictest473514-21kworker/u8:2+events_unbound22:36:242
282278993631,3cyclictest478902-21apt-get22:20:001
282275993631,3cyclictest417288-21kworker/u8:4+flush-259:021:25:170
282275993631,3cyclictest292807-21apt-get19:20:110
282284993529,4cyclictest422480-21/usr/sbin/munin21:25:153
282284993527,6cyclictest335557-21systemd-journal19:35:013
282282993532,2cyclictest593211-21kworker/u8:3+events_unbound00:10:292
282282993530,4cyclictest335557-21systemd-journal23:32:232
282275993529,4cyclictest287643-21/usr/sbin/munin19:15:140
282282993427,5cyclictest335557-21systemd-journal22:14:592
282278993430,3cyclictest603570-21apt-get00:20:141
282275993429,3cyclictest360519-21kworker/u8:2+events_unbound21:05:170
282275993428,4cyclictest335557-21systemd-journal20:22:240
282284993329,3cyclictest297711-21kworker/u8:0+flush-259:020:10:163
282284993327,4cyclictest391598-21/usr/sbin/munin20:55:153
282282993330,2cyclictest282458-21kworker/u8:1+events_unbound19:10:262
282278993328,3cyclictest495116-21apt-get22:35:101
282275993228,3cyclictest307946-21kworker/u8:3+flush-259:020:05:000
282275993227,3cyclictest582694-21kworker/u8:1+flush-259:000:05:000
282275993226,4cyclictest335557-21systemd-journal00:37:240
282275993226,4cyclictest334179-21kworker/u8:2+events_unbound20:05:120
282284993125,4cyclictest603302-21latency_hist00:20:013
282284993125,4cyclictest588079-21/usr/sbin/munin00:05:143
282282993128,2cyclictest447595-21kworker/u8:3+events_unbound21:56:232
282275993127,3cyclictest479556-21kworker/u8:4+events_unbound22:25:170
282275993124,5cyclictest483617-21ntpq22:20:210
282282993028,2cyclictest360519-21kworker/u8:2+events_unbound20:25:282
282282993028,2cyclictest282458-21kworker/u8:1+events_unbound19:24:252
282282993026,3cyclictest375692-21apt-get20:40:102
282278993025,4cyclictest312214-21ntpq19:35:211
282278993023,5cyclictest353987-21ntpq20:15:221
282275993023,4cyclictest500454-21diskstats22:40:140
282275993023,4cyclictest500454-21diskstats22:40:130
282275993022,6cyclictest550821-21ntpq23:25:230
282282992926,2cyclictest603324-21kworker/u8:1+events_unbound00:37:142
282282992926,2cyclictest447595-21kworker/u8:3+events_unbound22:06:582
282278992924,4cyclictest335557-21systemd-journal23:22:231
282278992922,5cyclictest602449-21ntpq00:15:211
282275992926,2cyclictest271734-21kworker/u8:2+flush-259:019:40:230
282284992822,4cyclictest297711-21kworker/u8:0+flush-259:019:50:163
282284992821,5cyclictest530141-21ntpq23:05:223
282282992825,2cyclictest479054-21kworker/u8:0+events_unbound22:24:562
282282992825,2cyclictest426423-21kworker/u8:0+events_unbound21:39:582
282282992824,3cyclictest520434-21kworker/u8:0+events_unbound23:01:472
282278992824,3cyclictest335557-21systemd-journal21:42:301
282278992822,5cyclictest452207-21ntpq21:50:221
282275992824,3cyclictest297711-21kworker/u8:0+flush-259:021:20:010
282275992822,4cyclictest520655-21latency_hist23:00:010
282282992725,2cyclictest417074-21kworker/u8:2+events_unbound21:24:572
282278992723,3cyclictest609129-21apt-get00:25:121
282275992724,2cyclictest297711-21kworker/u8:0+flush-259:020:50:160
282275992723,3cyclictest334179-21kworker/u8:2+flush-259:020:15:240
282275992722,3cyclictest463418-21kworker/u8:0+flush-259:022:10:200
282275992722,3cyclictest324097-21apt-get19:50:120
282275992721,4cyclictest335557-21systemd-journal23:05:010
282284992622,3cyclictest437919-21apt-get21:40:113
282282992623,2cyclictest473514-21kworker/u8:2+events_unbound22:30:402
282282992623,2cyclictest297711-21kworker/u8:0+events_unbound21:05:262
282282992623,2cyclictest297711-21kworker/u8:0+events_unbound19:55:342
282278992622,3cyclictest489960-21kworker/u8:1+flush-259:022:55:001
282278992621,4cyclictest624364-21https00:40:001
282275992621,4cyclictest380798-21kworker/u8:3+flush-259:020:55:210
282275992619,5cyclictest510648-21apt-get22:50:120
282282992523,2cyclictest354850-21kworker/u8:1+events_unbound20:20:312
282282992522,2cyclictest556846-21kworker/u8:0+events_unbound23:46:382
282278992520,4cyclictest335557-21systemd-journal23:38:221
282275992521,3cyclictest426423-21kworker/u8:0+events_unbound21:45:220
282275992520,4cyclictest593211-21kworker/u8:3+events_unbound00:25:000
282284992417,5cyclictest359966-21latency_hist20:25:003
282282992422,2cyclictest297711-21kworker/u8:0+events_unbound20:01:302
282282992421,2cyclictest489960-21kworker/u8:1+events_unbound23:28:062
282282992421,2cyclictest447595-21kworker/u8:3+events_unbound22:16:312
282282992421,2cyclictest417074-21kworker/u8:2+events_unbound21:34:592
282282992421,2cyclictest282458-21kworker/u8:1+events_unbound19:25:392
282282992420,3cyclictest297711-21kworker/u8:0+events_unbound19:39:002
282278992419,4cyclictest335557-21systemd-journal20:10:001
282278992418,4cyclictest572380-21latency_hist23:50:011
282275992418,4cyclictest335557-21systemd-journal21:57:360
282284992319,3cyclictest426423-21kworker/u8:0+flush-259:021:40:013
282284992318,3cyclictest556846-21kworker/u8:0+flush-259:023:45:163
282284992317,4cyclictest535301-21ntpq23:10:183
282284992317,4cyclictest458502-21/usr/sbin/munin22:00:203
282284992317,4cyclictest282485-21apt-get19:10:123
282282992320,2cyclictest556846-21kworker/u8:0+events_unbound00:17:522
282282992320,2cyclictest489960-21kworker/u8:1+events_unbound23:14:562
282282992320,2cyclictest489960-21kworker/u8:1+events_unbound23:08:172
282282992320,2cyclictest380588-21kworker/u8:1+events_unbound20:46:462
282282992320,2cyclictest271734-21kworker/u8:2+events_unbound19:41:572
282282992320,1cyclictest132-1kworker/2:1H+kblockd21:46:212
282282992319,3cyclictest297711-21kworker/u8:0+events_unbound20:10:542
282278992319,3cyclictest324072-21/usr/sbin/munin19:50:141
282278992319,3cyclictest303073-21apt-get19:30:111
282278992318,4cyclictest588104-21apt-get00:05:111
282275992320,1cyclictest349693-21latency_hist20:15:000
282275992319,3cyclictest473514-21kworker/u8:2+flush-259:022:35:000
282275992319,3cyclictest447595-21kworker/u8:3+events_unbound22:05:230
282275992318,4cyclictest473514-21kworker/u8:2+events_unbound23:50:220
282275992316,5cyclictest400722-21ntpq21:00:200
282284992216,4cyclictest608439-21latency_hist00:25:003
28228299225,11cyclictest453099-21idleruntime-cro21:55:002
282282992219,2cyclictest603324-21kworker/u8:1+events_unbound00:24:222
282282992219,2cyclictest489960-21kworker/u8:1+events_unbound22:54:472
282282992219,2cyclictest318230-21kworker/u8:4+events_unbound19:53:372
282282992219,2cyclictest297711-21kworker/u8:0+events_unbound20:18:042
282282992218,3cyclictest603324-21kworker/u8:1+flush-259:000:25:172
282282992218,3cyclictest582694-21kworker/u8:1+events_unbound00:08:272
282282992218,3cyclictest567176-21kworker/u8:5+events_unbound23:51:562
282278992216,5cyclictest348821-21ntpq20:10:211
282275992218,3cyclictest603324-21kworker/u8:1+flush-259:000:25:240
282275992217,4cyclictest335557-21systemd-journal21:37:290
282284992117,3cyclictest603324-21kworker/u8:1+events_unbound00:25:183
282284992117,2cyclictest297711-21kworker/u8:0+events_unbound19:40:003
282282992118,2cyclictest489960-21kworker/u8:1+events_unbound23:17:422
282282992118,2cyclictest432518-21kworker/u8:1+events_unbound21:44:592
282282992118,2cyclictest380798-21kworker/u8:3+events_unbound20:54:352
282282992118,2cyclictest297711-21kworker/u8:0+events_unbound20:33:292
282278992118,2cyclictest458281-21systemd-run21:59:591
282275992117,3cyclictest453317-21kworker/u8:2+events_unbound22:00:150
282275992117,3cyclictest432518-21kworker/u8:1+flush-259:021:40:210
282275992117,3cyclictest426423-21kworker/u8:0+flush-259:021:50:200
282275992117,3cyclictest318204-21apt-get19:45:020
282275992117,3cyclictest307946-21kworker/u8:3+events_unbound19:55:270
282275992116,3cyclictest489960-21kworker/u8:1+flush-259:023:05:180
282284992017,2cyclictest313792-21irqcore19:40:153
282284992014,4cyclictest412131-21/usr/sbin/munin21:15:143
28228299207,6cyclictest0-21swapper/219:10:012
282282992016,3cyclictest410984-21kworker/u8:3+events_unbound21:14:192
282275992016,3cyclictest426423-21kworker/u8:0+events_unbound21:30:230
282275992016,3cyclictest297711-21kworker/u8:0+flush-259:019:30:210
282275992015,3cyclictest567176-21kworker/u8:5+flush-259:023:55:210
28227599200,18cyclictest335557-21systemd-journal20:34:230
282284991915,3cyclictest335557-21systemd-journal22:12:173
282284991911,5cyclictest484526-21latency_hist22:25:013
282282991916,2cyclictest473514-21kworker/u8:2+events_unbound23:22:092
282282991916,2cyclictest271734-21kworker/u8:2+events_unbound19:34:382
282278991916,2cyclictest287392-21cron19:15:001
282278991913,4cyclictest335557-21systemd-journal22:31:241
282278991913,4cyclictest319050-21diskstats19:45:121
282275991915,3cyclictest473514-21kworker/u8:2+events_unbound23:20:210
282275991915,3cyclictest410984-21kworker/u8:3+flush-259:021:20:210
282282991816,2cyclictest582694-21kworker/u8:1+events_unbound00:02:322
282282991815,2cyclictest556846-21kworker/u8:0+events_unbound23:41:292
282278991814,3cyclictest453317-21kworker/u8:2+flush-259:022:02:541
282278991814,3cyclictest355095-21apt-get20:20:121
282275991815,2cyclictest380798-21kworker/u8:3+events_unbound20:45:130
282275991814,3cyclictest355060-21kworker/u8:4+flush-259:020:40:180
282275991814,3cyclictest271734-21kworker/u8:2+flush-259:019:25:240
282284991715,1cyclictest489960-21kworker/u8:1+events_unbound22:35:243
282284991712,4cyclictest335557-21systemd-journal21:32:143
282284991712,3cyclictest603324-21kworker/u8:1+flush-259:000:35:303
282284991711,4cyclictest335557-21systemd-journal20:55:003
282278991714,2cyclictest552110-21fschecks_count23:30:131
282275991713,3cyclictest603324-21kworker/u8:1+flush-259:000:30:210
282275991713,3cyclictest556846-21kworker/u8:0+events_unbound23:45:010
282275991713,3cyclictest505247-21kworker/u8:3+events_unbound22:45:150
282275991713,3cyclictest505247-21kworker/u8:3+events_unbound22:45:140
282275991713,3cyclictest2971-21cron23:15:010
282284991611,4cyclictest479054-21kworker/u8:0+flush-259:022:25:243
282284991611,4cyclictest249382-21kworker/u8:3+flush-259:019:15:243
282282991613,2cyclictest249382-21kworker/u8:3+events_unbound19:16:212
28227899169,5cyclictest436758-21ntpq21:35:211
28227899166,6cyclictest365521-21df_inode20:30:111
28227899162,4cyclictest421529-21/usr/sbin/munin21:20:251
28227899162,4cyclictest389913-21cat20:50:201
282278991613,2cyclictest489960-21kworker/u8:1+flush-259:022:42:521
282278991613,2cyclictest489960-21kworker/u8:1+flush-259:022:42:511
282278991612,3cyclictest297711-21kworker/u8:0+flush-259:019:55:181
282275991613,2cyclictest60350irq/132-enp0s29f1:rx-021:12:200
282275991613,2cyclictest60350irq/132-enp0s29f1:rx-020:29:520
282275991612,3cyclictest572383-21turbostat23:50:000
282275991611,4cyclictest297711-21kworker/u8:0+flush-259:019:35:200
282284991513,1cyclictest0-21swapper/319:30:013
28228499151,2cyclictest598159-21dump-pmu-power00:15:003
282284991511,3cyclictest360208-21/usr/sbin/munin20:25:213
28227899159,4cyclictest396504-21latency_hist21:00:011
28227899152,6cyclictest417061-21munin-run21:20:001
28227899151,6cyclictest297431-21seq19:22:031
282278991512,2cyclictest490-21dbus-daemon19:45:001
282278991512,2cyclictest361250-21kthreadcore20:25:181
282278991510,4cyclictest335557-21systemd-journal23:54:551
282275991514,1cyclictest60350irq/132-enp0s29f1:rx-020:35:410
282275991513,1cyclictest60350irq/132-enp0s29f1:rx-023:35:220
282275991512,2cyclictest60350irq/132-enp0s29f1:rx-022:36:060
28228499148,4cyclictest556846-21kworker/u8:0+flush-259:023:35:163
28228499148,4cyclictest344539-21awk20:10:003
282284991411,2cyclictest493928-21ntp_kernel_err22:30:223
282284991411,2cyclictest0-21swapper/322:20:003
282284991410,3cyclictest505247-21kworker/u8:3+flush-259:022:49:273
282284991410,3cyclictest505247-21kworker/u8:3+flush-259:022:49:273
282284991410,2cyclictest0-21swapper/320:45:233
28228499140,4cyclictest587839-21awk00:05:013
28227899149,4cyclictest335557-21systemd-journal23:57:231
28227899142,3cyclictest510300-21runrttasks22:49:121
28227899142,3cyclictest510300-21runrttasks22:49:111
28227899142,2cyclictest489011-21/usr/sbin/munin22:25:241
28227899142,2cyclictest291682-21ntpq19:15:211
28227899141,7cyclictest536450-21dpkg23:15:131
282278991411,2cyclictest551635-21idleruntime-cro23:30:011
28227599147,5cyclictest282646-21diskstats19:10:140
282275991412,2cyclictest60350irq/132-enp0s29f1:rx-000:14:570
282275991412,1cyclictest60350irq/132-enp0s29f1:rx-000:15:110
28228499138,4cyclictest432518-21kworker/u8:1+flush-259:021:50:003
28228499137,3cyclictest354828-21awk20:20:003
282284991310,2cyclictest334511-21cpuspeed_turbos20:00:113
282284991310,1cyclictest0-21swapper/321:00:113
282284991310,1cyclictest0-21swapper/320:00:003
28227899133,5cyclictest406412-21seq21:05:461
28227899132,5cyclictest427019-21runrttasks21:26:051
28227899132,10cyclictest427846-21uniq21:30:141
28227899131,7cyclictest463987-21hddtemp_smartct22:05:161
282278991310,2cyclictest468927-21cpuspeed_turbos22:10:131
282278991310,2cyclictest0-21swapper/119:25:161
28227899130,7cyclictest521077-21diskstats23:00:131
28227899130,4cyclictest401439-21chrt21:03:021
28227899130,3cyclictest380797-21taskset20:45:041
28227899130,10cyclictest597814-21taskset00:10:551
28228499128,3cyclictest271734-21kworker/u8:2+flush-259:019:22:283
28228499128,2cyclictest355060-21kworker/u8:4+flush-259:020:40:113
28227899125,1cyclictest191rcu_preempt22:55:141
28227899122,5cyclictest0-21swapper/123:05:141
28227899121,5cyclictest531396-21df23:10:101
28228499115,4cyclictest452012-21memory21:50:213
28227899112,5cyclictest32-21ksoftirqd/122:15:251
28227899112,4cyclictest0-21swapper/100:30:241
28228499108,1cyclictest0-21swapper/322:40:153
28228499108,1cyclictest0-21swapper/322:40:143
2822849997,1cyclictest0-21swapper/323:15:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional