You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 19:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 18, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
116214994744,2cyclictest230289-21kworker/u8:0+flush-259:009:10:251
116214994542,2cyclictest230912-21kworker/u8:1+flush-259:009:25:251
116214994541,3cyclictest293140-21kworker/u8:2+events_unbound10:50:151
116214994540,3cyclictest142371-21kworker/u8:2+events_unbound09:15:271
116210994438,4cyclictest272511-21apt-get09:40:120
116214994234,3cyclictest339022-21kworker/u8:1+events_unbound10:45:011
116210994134,5cyclictest335557-21systemd-journal09:34:590
116217994030,9cyclictest142371-21kworker/u8:2+flush-259:009:00:002
116214994036,3cyclictest293140-21kworker/u8:2+flush-259:010:45:251
116214993932,4cyclictest391821-21/usr/sbin/munin11:35:151
116222993834,3cyclictest438758-21apt-get12:20:123
116214993835,2cyclictest62428-21kworker/u8:4+flush-259:007:20:151
116214993834,3cyclictest319008-21kworker/u8:3+flush-259:010:30:251
116214993734,2cyclictest417781-21kworker/u8:0+events_unbound12:00:251
116214993732,3cyclictest142371-21kworker/u8:2+events_unbound08:35:001
116210993729,6cyclictest335557-21systemd-journal08:43:240
116222993632,3cyclictest137139-21kworker/u8:0+flush-259:007:53:563
116214993633,2cyclictest354813-21kworker/u8:0+flush-259:011:30:251
116214993630,2cyclictest230912-21kworker/u8:1+events_unbound09:05:011
116214993532,2cyclictest230912-21kworker/u8:1+flush-259:010:00:251
116214993531,3cyclictest230912-21kworker/u8:1+flush-259:009:05:211
116210993531,3cyclictest360595-21kworker/u8:2+flush-259:011:35:240
116210993530,4cyclictest287752-21kworker/u8:0+flush-259:009:55:260
116222993429,4cyclictest256648-21kworker/u8:5+flush-259:009:44:593
116214993432,1cyclictest142371-21kworker/u8:2+flush-259:007:40:241
116214993431,2cyclictest137139-21kworker/u8:0+events_unbound08:25:261
116214993329,3cyclictest360595-21kworker/u8:2+flush-259:012:05:241
116214993226,4cyclictest335557-21systemd-journal10:09:591
116214993224,2cyclictest354813-21kworker/u8:0+events_unbound11:40:201
116217993125,4cyclictest385531-21ntpq11:25:212
116214993128,2cyclictest417781-21kworker/u8:0+flush-259:012:35:011
116214993128,2cyclictest360595-21kworker/u8:2+flush-259:012:25:241
116214993127,3cyclictest251687-21apt-get09:20:111
116214993127,3cyclictest142371-21kworker/u8:2+events_unbound08:20:261
116214993126,4cyclictest142371-21kworker/u8:2+events_unbound07:57:251
116214993126,3cyclictest122269-21kworker/u8:1+flush-259:007:25:151
116210993127,3cyclictest319008-21kworker/u8:3+flush-259:010:30:150
116210993126,3cyclictest319008-21kworker/u8:3+flush-259:010:25:260
116214993026,3cyclictest459180-21apt-get12:39:591
116210993026,3cyclictest142371-21kworker/u8:2+flush-259:008:45:170
116210993025,3cyclictest334505-21apt-get10:40:130
116210993024,4cyclictest137139-21kworker/u8:0+flush-259:008:10:010
116210993024,4cyclictest137139-21kworker/u8:0+flush-259:008:10:000
116214992927,2cyclictest137139-21kworker/u8:0+events_unbound08:05:221
116214992927,2cyclictest137139-21kworker/u8:0+events_unbound08:05:221
116214992926,2cyclictest396696-21kworker/u8:1+events_unbound11:54:591
116214992925,3cyclictest137139-21kworker/u8:0+flush-259:008:00:191
116214992924,3cyclictest251447-21kworker/u8:3+flush-259:009:40:171
116214992923,4cyclictest173381-21kworker/u8:3+events_unbound08:54:001
116214992922,2cyclictest251447-21kworker/u8:3+events_unbound09:50:221
116210992925,3cyclictest360595-21kworker/u8:2+flush-259:011:20:260
116210992921,5cyclictest303274-21latency_hist10:10:000
116214992825,2cyclictest303311-21kworker/u8:0+events_unbound10:15:011
116214992824,3cyclictest142371-21kworker/u8:2+flush-259:008:15:241
116210992823,3cyclictest142371-21kworker/u8:2+flush-259:009:15:000
116210992822,4cyclictest371182-21apt-get11:15:130
116217992722,4cyclictest142371-21kworker/u8:2+flush-259:008:15:002
116214992723,3cyclictest62428-21kworker/u8:4+events_unbound07:30:151
116210992723,3cyclictest142371-21kworker/u8:2+flush-259:008:40:000
116210992722,3cyclictest230489-21store09:00:010
116210992721,4cyclictest163276-21apt-get07:55:130
116210992720,5cyclictest416906-21ntpq11:55:210
116210992720,5cyclictest136266-21ntpq07:25:220
116217992622,3cyclictest459205-21gpgv12:39:592
116217992622,3cyclictest137139-21kworker/u8:0+flush-259:008:00:002
116217992620,4cyclictest449133-21apt-get12:30:122
116217992620,4cyclictest335557-21systemd-journal09:32:252
116214992622,3cyclictest293140-21kworker/u8:2+events_unbound10:15:121
116214992622,3cyclictest122269-21kworker/u8:1+events_unbound07:35:221
116214992620,4cyclictest428418-21apt-get12:10:121
116214992620,2cyclictest354813-21kworker/u8:0+events_unbound11:10:181
116217992518,5cyclictest219100-21ntpq08:45:232
116214992522,2cyclictest319008-21kworker/u8:3+flush-259:010:35:151
116214992522,2cyclictest110459-21kworker/u8:0+events_unbound07:15:211
116214992521,3cyclictest230912-21kworker/u8:1+flush-259:010:25:261
116210992520,4cyclictest360595-21kworker/u8:2+events_unbound12:10:230
116210992520,3cyclictest354813-21kworker/u8:0+flush-259:011:00:160
116217992420,3cyclictest230912-21kworker/u8:1+flush-259:009:25:262
116217992418,4cyclictest335557-21systemd-journal11:07:252
116214992421,2cyclictest251447-21kworker/u8:3+flush-259:009:30:251
116214992421,2cyclictest230912-21kworker/u8:1+events_unbound10:20:221
116214992421,2cyclictest142371-21kworker/u8:2+events_unbound08:45:211
116214992421,2cyclictest142371-21kworker/u8:2+events_unbound08:40:231
116214992420,3cyclictest230912-21kworker/u8:1+flush-259:009:35:161
116214992420,3cyclictest173381-21kworker/u8:3+flush-259:008:35:161
116214992420,3cyclictest137139-21kworker/u8:0+events_unbound07:48:531
116210992420,3cyclictest354813-21kworker/u8:0+flush-259:011:40:240
116222992310,9cyclictest241071-21cron09:10:003
116217992319,3cyclictest507-21in:imuxsock09:20:002
116214992320,2cyclictest354813-21kworker/u8:0+events_unbound11:28:251
116214992319,3cyclictest142371-21kworker/u8:2+flush-259:008:59:031
116214992317,4cyclictest437635-21ntpq12:15:221
116210992320,2cyclictest251447-21kworker/u8:3+events_unbound09:45:240
116210992320,2cyclictest241115-21kworker/u8:4+flush-259:009:20:240
116210992319,3cyclictest236151-21apt-get09:05:120
116210992319,3cyclictest142371-21kworker/u8:2+events_unbound07:45:190
116214992219,2cyclictest344810-21kworker/u8:3+flush-259:011:05:001
116214992219,2cyclictest142371-21kworker/u8:2+flush-259:007:50:171
116214992218,3cyclictest412316-21kworker/u8:3+flush-259:011:55:161
116214992218,3cyclictest360595-21kworker/u8:2+events_unbound11:45:281
116222992115,4cyclictest230912-21kworker/u8:1+flush-259:010:10:173
116217992115,4cyclictest335557-21systemd-journal11:48:242
116214992118,2cyclictest339022-21kworker/u8:1+events_unbound10:55:201
116214992117,3cyclictest100853-21kworker/u8:2+events_unbound07:14:261
116210992118,1cyclictest0-21swapper/011:09:230
116210992116,3cyclictest396696-21kworker/u8:1+flush-259:011:50:210
116210992115,4cyclictest423022-21kworker/u8:1+flush-259:012:09:590
116222992016,3cyclictest417781-21kworker/u8:0+flush-259:012:05:003
116222992016,3cyclictest215011-21apt-get08:45:123
116217992015,3cyclictest277640-21/usr/sbin/munin09:45:152
116217992015,3cyclictest142371-21kworker/u8:2+flush-259:008:50:262
116217992014,4cyclictest354959-21apt-get11:00:002
116217992013,5cyclictest120689-21ntpq07:10:202
116214992017,2cyclictest417781-21kworker/u8:0+events_unbound12:20:171
116214992017,2cyclictest354813-21kworker/u8:0+flush-259:011:15:201
116214992016,3cyclictest354813-21kworker/u8:0+events_unbound11:05:021
116210992016,3cyclictest110459-21kworker/u8:0+flush-259:007:15:210
116210992015,4cyclictest293140-21kworker/u8:2+events_unbound10:55:210
116222991914,4cyclictest122269-21kworker/u8:1+flush-259:007:45:003
116217991916,2cyclictest0-21swapper/208:45:002
116217991915,3cyclictest142371-21kworker/u8:2+flush-259:008:30:212
116217991913,4cyclictest335557-21systemd-journal07:36:242
116217991912,5cyclictest335557-21systemd-journal07:55:002
116210991915,3cyclictest360595-21kworker/u8:2+flush-259:012:35:210
116210991915,3cyclictest360595-21kworker/u8:2+events_unbound11:45:160
116210991912,4cyclictest335557-21systemd-journal07:23:240
116222991813,4cyclictest417195-21sshd11:55:243
116222991813,4cyclictest194325-21apt-get08:25:143
11621799189,7cyclictest293140-21kworker/u8:2+flush-259:010:05:002
116217991814,3cyclictest396696-21kworker/u8:1+flush-259:011:55:312
116217991814,3cyclictest142371-21kworker/u8:2+events_unbound08:20:192
116214991815,2cyclictest142371-21kworker/u8:2+events_unbound08:10:171
116214991813,4cyclictest287999-21apt-get09:55:131
116210991814,3cyclictest251447-21kworker/u8:3+events_unbound09:50:120
116210991812,4cyclictest509-21rs:main0
116210991810,6cyclictest312773-21ntpq10:15:190
116222991713,3cyclictest189122-21apt-get08:20:133
116217991714,2cyclictest423022-21kworker/u8:1+flush-259:012:14:592
116217991714,2cyclictest349790-21sh10:55:002
116217991713,3cyclictest62428-21kworker/u8:4+flush-259:007:30:262
116217991712,4cyclictest293140-21kworker/u8:2+flush-259:010:30:012
116210991714,2cyclictest61150irq/133-enp0s29f1:tx-008:15:130
116210991714,2cyclictest60350irq/132-enp0s29f1:rx-011:31:510
116210991713,3cyclictest354813-21kworker/u8:0+events_unbound11:25:190
11621099171,15cyclictest1-21systemd12:26:240
116210991710,5cyclictest335557-21systemd-journal08:35:000
11622299169,4cyclictest0-21swapper/310:30:153
11622299163,2cyclictest427304-21ntpq12:05:243
11622299163,2cyclictest302449-21ntpq10:05:243
11622299163,2cyclictest293334-21df_inode10:00:153
116217991613,2cyclictest188855-21latency_hist08:20:002
116217991612,3cyclictest230912-21kworker/u8:1+flush-259:009:14:552
116217991612,2cyclictest0-21swapper/210:20:182
116217991610,4cyclictest142371-21kworker/u8:2+flush-259:009:05:112
116214991612,3cyclictest360595-21kworker/u8:2+events_unbound11:22:251
116214991612,3cyclictest251447-21kworker/u8:3+events_unbound09:49:211
116210991614,1cyclictest60350irq/132-enp0s29f1:rx-010:10:020
116210991614,1cyclictest60350irq/132-enp0s29f1:rx-008:23:240
116210991613,2cyclictest60350irq/132-enp0s29f1:rx-009:18:400
116210991613,2cyclictest60350irq/132-enp0s29f1:rx-007:30:160
116210991613,2cyclictest142371-21kworker/u8:2+flush-259:007:50:240
116210991612,3cyclictest60350irq/132-enp0s29f1:rx-007:35:190
116210991612,3cyclictest142371-21kworker/u8:2+flush-259:008:10:160
116210991610,4cyclictest147762-21/usr/sbin/munin07:40:140
11622299159,4cyclictest183701-21latency_hist08:15:013
11622299153,3cyclictest224231-21ntpq08:50:213
11622299151,8cyclictest128007-21irqstats07:20:173
116222991512,2cyclictest271321-21ntp_kernel_err09:35:223
116222991512,2cyclictest126284-21unixbench_multi07:15:243
116222991512,2cyclictest0-21swapper/308:35:003
116222991511,3cyclictest293140-21kworker/u8:2+flush-259:010:45:113
11621799159,4cyclictest423022-21kworker/u8:1+flush-259:012:15:172
116217991512,1cyclictest0-21swapper/207:30:002
116217991510,4cyclictest360595-21kworker/u8:2+flush-259:011:35:252
11621099159,4cyclictest348911-21ntpq10:50:220
11621099159,4cyclictest318774-21latency_hist10:25:010
116210991513,1cyclictest60350irq/132-enp0s29f1:rx-012:00:250
116210991513,1cyclictest60350irq/132-enp0s29f1:rx-011:11:310
116210991513,1cyclictest60350irq/132-enp0s29f1:rx-010:48:190
116210991513,1cyclictest60350irq/132-enp0s29f1:rx-009:00:150
116210991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:160
116210991512,2cyclictest60350irq/132-enp0s29f1:rx-010:35:210
116210991512,2cyclictest230912-21kworker/u8:1+events_unbound09:25:240
116210991510,3cyclictest267497-21diskstats09:35:140
11622299143,7cyclictest407964-21diskstats11:50:143
11622299142,3cyclictest376755-21/usr/sbin/munin11:20:173
11622299142,3cyclictest241329-21/usr/sbin/munin09:10:243
11622299141,3cyclictest50-21ksoftirqd/308:00:173
11622299141,2cyclictest401067-21ntpq11:40:203
11622299141,2cyclictest234972-21ntpq09:00:203
116222991411,2cyclictest434006-21irqcore12:15:173
116222991411,2cyclictest360595-21kworker/u8:2+flush-259:012:30:023
116222991411,2cyclictest334227-21idleruntime-cro10:40:003
116222991410,3cyclictest293140-21kworker/u8:2+flush-259:010:15:153
11621799148,1cyclictest0-21swapper/211:35:002
11621799146,6cyclictest428150-21latency_hist12:10:012
116217991411,2cyclictest205066-21sort08:35:142
116217991411,2cyclictest116349-21latency_hist07:10:022
116217991411,2cyclictest0-21swapper/211:45:002
116217991411,1cyclictest0-21swapper/210:09:592
116217991410,3cyclictest360595-21kworker/u8:2+flush-259:012:04:292
116217991410,3cyclictest344810-21kworker/u8:3+flush-259:011:12:302
116210991412,1cyclictest60350irq/132-enp0s29f1:rx-012:20:170
116210991412,1cyclictest60350irq/132-enp0s29f1:rx-010:00:580
116210991412,1cyclictest60350irq/132-enp0s29f1:rx-008:03:370
116210991412,1cyclictest417781-21kworker/u8:0+events_unbound12:30:200
11622299138,3cyclictest230255-21latency_hist09:00:023
11622299137,2cyclictest191rcu_preempt07:25:233
11622299135,3cyclictest167300-21ntpq07:55:223
11622299132,9cyclictest335557-21systemd-journal09:49:593
11622299132,2cyclictest458338-21ntpq12:35:233
11622299131,6cyclictest50-21ksoftirqd/308:15:143
11622299131,3cyclictest146701-21ntpq07:35:223
11622299131,2cyclictest448087-21taskset12:25:223
11622299131,11cyclictest356663-21ps11:00:173
116222991310,2cyclictest314085-21fschecks_count10:20:143
116222991310,1cyclictest191rcu_preempt10:45:013
11622299130,8cyclictest204939-21fw_conntrack08:35:123
11622299130,8cyclictest141273-21memory07:30:203
11621799139,2cyclictest0-21swapper/212:25:252
116217991311,1cyclictest0-21swapper/209:39:592
116217991310,2cyclictest438870-21cpuspeed_turbos12:20:132
116217991310,2cyclictest293140-21kworker/u8:2+flush-259:010:45:172
116217991310,2cyclictest0-21swapper/210:40:002
11621099139,3cyclictest423022-21kworker/u8:1+events_unbound12:15:160
11621099138,3cyclictest115954-21apt-get07:10:010
11622299129,2cyclictest262527-21irqcore09:30:163
11622299129,2cyclictest152996-21cpuspeed_turbos07:45:133
11622299123,5cyclictest50-21ksoftirqd/311:45:203
11622299121,6cyclictest50-21ksoftirqd/309:20:253
11622299121,6cyclictest210041-21diskstats08:40:153
11622299121,3cyclictest50-21ksoftirqd/310:50:213
11622299121,3cyclictest50-21ksoftirqd/308:05:223
11622299121,3cyclictest50-21ksoftirqd/308:05:223
11622299121,3cyclictest50-21ksoftirqd/307:10:213
11622299121,2cyclictest50-21ksoftirqd/309:15:233
11622299121,2cyclictest432450-21ntpq12:10:203
11622299121,2cyclictest284583-21grep09:50:163
11622299120,7cyclictest369840-21memory11:10:203
11621799128,3cyclictest251447-21kworker/u8:3+flush-259:009:40:222
11621799128,3cyclictest251447-21kworker/u8:3+flush-259:009:24:302
11621799128,2cyclictest0-21swapper/207:40:162
11621799122,8cyclictest0-21swapper/210:20:012
11621799121,1cyclictest0-21swapper/211:25:012
11621799120,3cyclictest376114-21awk11:20:002
11622299111,2cyclictest50-21ksoftirqd/309:55:173
11622299111,2cyclictest390693-21ntpq11:30:213
11622299110,2cyclictest260774-21memory09:25:213
11621799119,1cyclictest0-21swapper/209:50:172
11621799118,2cyclictest396696-21kworker/u8:1+flush-259:011:50:112
11621799118,2cyclictest0-21swapper/208:25:212
11621799117,2cyclictest0-21swapper/210:10:212
11621799116,4cyclictest509-21rs:main2
11622299103,5cyclictest50-21ksoftirqd/311:05:193
11622299100,2cyclictest50-21ksoftirqd/311:25:013
11621799101,1cyclictest3520952kthreadcore10:55:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional