You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 02:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Mar 15, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
535472994741,4cyclictest561654-21cp07:35:002
535472994137,3cyclictest562123-21kworker/u8:2+flush-259:007:40:152
535472994036,3cyclictest530081-21kworker/u8:0+flush-259:009:20:142
535472993833,4cyclictest800552-21apt-get11:25:002
535479993733,2cyclictest530081-21kworker/u8:0+flush-259:009:05:153
535479993530,3cyclictest733055-21latency_hist10:20:013
535458993531,3cyclictest748782-21apt-get10:35:120
535462993428,4cyclictest817155-21/usr/sbin/munin11:40:141
535479993229,2cyclictest676556-21kworker/u8:3+flush-259:010:05:213
535479993227,4cyclictest869419-21apt-get12:30:003
535472993228,3cyclictest530081-21kworker/u8:0+events_unbound07:25:162
535462993228,3cyclictest848747-21kworker/u8:0+flush-259:012:20:001
535462993227,4cyclictest875667-21apt-get12:35:111
535462993227,4cyclictest530081-21kworker/u8:0+flush-259:009:20:001
535479993123,6cyclictest676536-21cp09:25:003
535472993128,2cyclictest530081-21kworker/u8:0+flush-259:007:20:232
535458993125,4cyclictest252-21systemd-journal12:30:000
535462993026,3cyclictest561471-21latency_hist07:35:001
535479992925,3cyclictest838002-21kworker/u8:3+events_unbound12:30:243
535479992925,3cyclictest738221-21kworker/u8:3+events_unbound11:15:173
535472992926,2cyclictest822686-21kworker/u8:3+flush-259:011:50:002
535472992926,2cyclictest800758-21kworker/u8:0+events_unbound11:40:142
535472992926,2cyclictest696991-21kworker/u8:1+flush-259:009:50:152
535462992925,3cyclictest670781-21kworker/u8:2+flush-259:009:30:161
535472992825,2cyclictest795228-21kworker/u8:4+flush-259:011:55:182
535472992824,3cyclictest562123-21kworker/u8:2+events_unbound07:55:172
535458992824,2cyclictest562157-21apt-get07:35:110
535458992824,2cyclictest562157-21apt-get07:35:110
535479992724,3cyclictest670781-21kworker/u8:2+flush-259:009:30:233
535479992724,2cyclictest738221-21kworker/u8:3+flush-259:011:10:223
535479992723,3cyclictest795228-21kworker/u8:4+events_unbound11:55:233
535479992723,3cyclictest530081-21kworker/u8:0+flush-259:008:40:243
535472992723,3cyclictest795228-21kworker/u8:4+flush-259:012:15:212
535479992622,2cyclictest676556-21kworker/u8:3+flush-259:009:55:273
535479992621,3cyclictest660703-21apt-get09:10:103
535472992624,2cyclictest676556-21kworker/u8:3+events_unbound09:35:002
535472992623,2cyclictest629162-21kworker/u8:1+events_unbound08:45:142
535472992622,3cyclictest806144-21apt-get11:30:002
535472992622,3cyclictest676556-21kworker/u8:3+flush-259:010:00:252
535472992621,4cyclictest880547-21latency_hist12:40:012
535462992623,2cyclictest759694-21kworker/u8:1+flush-259:010:45:231
535458992622,3cyclictest1655375-21kworker/u8:3+flush-259:007:10:270
535458992620,4cyclictest806151-21latency_hist11:29:590
535458992620,4cyclictest509-21rs:main0
535479992518,5cyclictest252-21systemd-journal08:40:003
535472992522,2cyclictest822072-21kworker/u8:1+flush-259:012:05:232
535472992522,2cyclictest822072-21kworker/u8:1+flush-259:011:55:002
535472992522,2cyclictest562122-21kworker/u8:1+events_unbound07:50:202
535462992521,3cyclictest1655375-21kworker/u8:3+events_unbound07:25:141
535479992421,2cyclictest727880-21kworker/u8:2+flush-259:010:35:263
535479992421,2cyclictest707298-21kworker/u8:0+flush-259:010:05:013
535479992420,3cyclictest1655375-21kworker/u8:3+flush-259:007:40:003
535479992420,3cyclictest1655375-21kworker/u8:3+flush-259:007:40:003
535479992418,4cyclictest252-21systemd-journal11:02:223
535472992421,2cyclictest838002-21kworker/u8:3+flush-259:012:10:242
535472992421,2cyclictest795228-21kworker/u8:4+flush-259:011:30:142
535472992421,2cyclictest753703-21kworker/u8:0+flush-259:011:10:012
535472992421,2cyclictest707298-21kworker/u8:0+flush-259:010:10:202
535472992420,3cyclictest795228-21kworker/u8:4+flush-259:012:30:262
535462992420,3cyclictest582828-21kworker/u8:4+flush-259:008:05:151
535458992417,5cyclictest252-21systemd-journal07:30:000
535472992321,2cyclictest582828-21kworker/u8:4+events_unbound09:00:132
535472992320,2cyclictest753703-21kworker/u8:0+events_unbound11:15:032
535472992319,3cyclictest816901-21cron11:40:002
535472992317,4cyclictest597301-21ntpq08:05:212
535472992317,4cyclictest252-21systemd-journal10:25:002
535462992321,2cyclictest696991-21kworker/u8:1+flush-259:009:50:231
535462992320,2cyclictest795228-21kworker/u8:4+events_unbound12:05:111
535462992320,2cyclictest535610-21latency_hist07:10:011
535462992317,4cyclictest806533-21cat11:30:001
535458992319,3cyclictest733323-21apt-get10:20:110
535458992319,3cyclictest639469-21latency_hist08:50:010
535458992319,3cyclictest582828-21kworker/u8:4+flush-259:009:15:160
535479992218,3cyclictest572529-21apt-get07:45:123
535472992219,2cyclictest753703-21kworker/u8:0+flush-259:010:55:162
535472992219,2cyclictest582828-21kworker/u8:4+flush-259:008:55:242
535472992218,3cyclictest676556-21kworker/u8:3+flush-259:009:35:212
535462992218,3cyclictest822072-21kworker/u8:1+events_unbound12:00:141
535462992218,3cyclictest822072-21kworker/u8:1+events_unbound12:00:141
535462992217,3cyclictest738221-21kworker/u8:3+events_unbound10:40:181
535458992217,3cyclictest859337-21apt-get12:20:110
535458992217,3cyclictest728136-21apt-get10:15:110
535458992215,5cyclictest837982-21latency_hist12:00:010
535479992117,3cyclictest795228-21kworker/u8:4+flush-259:011:30:223
535479992117,3cyclictest530081-21kworker/u8:0+events_unbound08:15:003
535472992118,2cyclictest696991-21kworker/u8:1+events_unbound09:45:142
535472992118,2cyclictest530081-21kworker/u8:0+flush-259:008:10:212
535472992117,3cyclictest795228-21kworker/u8:4+flush-259:012:00:242
535472992117,3cyclictest795228-21kworker/u8:4+flush-259:012:00:242
535472992117,3cyclictest753703-21kworker/u8:0+flush-259:010:50:162
535462992117,3cyclictest629162-21kworker/u8:1+events_unbound08:45:121
535462992115,4cyclictest811996-21apt-get11:35:111
535462992114,5cyclictest252-21systemd-journal08:55:011
535458992117,3cyclictest530081-21kworker/u8:0+flush-259:009:25:150
535458992116,3cyclictest252-21systemd-journal08:07:220
535458992115,4cyclictest252-21systemd-journal12:40:000
535479992018,1cyclictest582828-21kworker/u8:4+flush-259:009:20:213
535479992017,3cyclictest562123-21kworker/u8:2+flush-259:007:45:003
535479992017,2cyclictest696991-21kworker/u8:1+events_unbound09:45:213
535479992016,3cyclictest696991-21kworker/u8:1+events_unbound10:25:123
535472992018,2cyclictest753703-21kworker/u8:0+flush-259:011:10:242
535472992017,2cyclictest530081-21kworker/u8:0+events_unbound08:25:262
535472992016,3cyclictest582828-21kworker/u8:4+flush-259:008:35:172
535462992017,2cyclictest676556-21kworker/u8:3+events_unbound09:35:121
535462992017,2cyclictest530081-21kworker/u8:0+events_unbound07:40:231
535462992016,3cyclictest789808-21apt-config11:15:001
535462992016,3cyclictest696991-21kworker/u8:1+flush-259:009:45:161
535458992016,3cyclictest795228-21kworker/u8:4+flush-259:012:25:260
535479991917,1cyclictest696991-21kworker/u8:1+events_unbound09:50:183
535479991916,2cyclictest670781-21kworker/u8:2+flush-259:009:38:253
535479991915,3cyclictest795228-21kworker/u8:4+flush-259:011:45:153
535479991914,3cyclictest252-21systemd-journal08:35:003
535472991916,2cyclictest670781-21kworker/u8:2+events_unbound09:40:162
535472991916,2cyclictest1655375-21kworker/u8:3+flush-259:007:10:312
535472991915,3cyclictest582828-21kworker/u8:4+flush-259:008:30:212
535462991915,3cyclictest795228-21kworker/u8:4+flush-259:011:45:141
535462991914,4cyclictest707298-21kworker/u8:0+events_unbound10:10:141
535462991914,3cyclictest738221-21kworker/u8:3+flush-259:010:35:201
53546299190,17cyclictest869465-21unin-run12:30:011
535458991916,2cyclictest0-21swapper/007:50:000
535458991915,3cyclictest696991-21kworker/u8:1+flush-259:009:55:180
535458991913,4cyclictest598436-21apt-get08:10:120
535458991912,5cyclictest800558-21latency_hist11:25:010
535479991815,2cyclictest822072-21kworker/u8:1+flush-259:012:09:233
535479991814,3cyclictest629162-21kworker/u8:1+events_unbound08:45:103
535479991812,4cyclictest727017-21ntpq10:10:203
535472991815,2cyclictest696991-21kworker/u8:1+flush-259:010:25:212
535472991815,2cyclictest696991-21kworker/u8:1+events_unbound10:34:172
535472991815,2cyclictest530081-21kworker/u8:0+flush-259:009:29:592
535462991815,2cyclictest670781-21kworker/u8:2+events_unbound09:40:221
535462991814,3cyclictest838002-21kworker/u8:3+events_unbound12:30:151
535462991814,3cyclictest753703-21kworker/u8:0+flush-259:011:05:231
535462991814,3cyclictest608528-21kworker/u8:2+events_unbound08:25:211
535462991814,3cyclictest562122-21kworker/u8:1+flush-259:007:50:231
535462991814,2cyclictest530081-21kworker/u8:0+flush-259:007:20:151
535462991812,4cyclictest252-21systemd-journal11:35:001
535458991813,4cyclictest685828-21ntpq09:30:210
535479991714,2cyclictest800758-21kworker/u8:0+events_unbound11:50:173
535479991714,2cyclictest795228-21kworker/u8:4+flush-259:011:20:223
535479991714,2cyclictest795228-21kworker/u8:4+events_unbound11:25:013
535479991714,2cyclictest629162-21kworker/u8:1+events_unbound08:50:233
535479991714,2cyclictest1655375-21kworker/u8:3+events_unbound07:25:223
535472991714,2cyclictest696991-21kworker/u8:1+flush-259:010:15:162
535472991714,2cyclictest530081-21kworker/u8:0+flush-259:008:20:182
535472991714,2cyclictest530081-21kworker/u8:0+flush-259:008:15:262
535472991710,5cyclictest859312-21/usr/sbin/munin12:20:132
535462991714,2cyclictest1655375-21kworker/u8:3+events_unbound07:35:231
535462991714,2cyclictest1655375-21kworker/u8:3+events_unbound07:35:231
535462991713,3cyclictest696991-21kworker/u8:1+flush-259:010:25:161
535462991713,3cyclictest530081-21kworker/u8:0+flush-259:007:50:001
535462991713,3cyclictest530081-21kworker/u8:0+events_unbound08:10:231
535462991712,4cyclictest619124-21apt-get08:30:101
535458991714,2cyclictest655331-21cron09:05:010
535458991713,3cyclictest696991-21kworker/u8:1+events_unbound10:30:010
535458991713,3cyclictest582828-21kworker/u8:4+flush-259:008:00:150
535458991712,3cyclictest624238-21/usr/sbin/munin08:35:140
535479991614,2cyclictest800758-21kworker/u8:0+events_unbound11:40:243
535479991613,2cyclictest876687-21kthreadcore12:35:163
535479991613,2cyclictest530081-21kworker/u8:0+flush-259:007:24:243
535479991612,3cyclictest822072-21kworker/u8:1+events_unbound12:00:183
535479991612,3cyclictest822072-21kworker/u8:1+events_unbound12:00:173
535479991612,3cyclictest795228-21kworker/u8:4+flush-259:012:20:303
535479991612,3cyclictest759694-21kworker/u8:1+events_unbound10:50:143
535472991613,2cyclictest759694-21kworker/u8:1+events_unbound10:45:152
535472991613,2cyclictest707298-21kworker/u8:0+events_unbound10:06:232
535472991611,4cyclictest545944-21latency_hist07:20:002
535462991613,2cyclictest530081-21kworker/u8:0+flush-259:009:10:231
535462991613,1cyclictest0-21swapper/110:55:011
535462991612,3cyclictest727880-21kworker/u8:2+flush-259:010:30:171
535462991612,3cyclictest530081-21kworker/u8:0+flush-259:009:05:171
535458991614,1cyclictest60350irq/132-enp0s29f1:rx-010:10:150
535458991614,1cyclictest60350irq/132-enp0s29f1:rx-009:10:450
535458991613,2cyclictest60350irq/132-enp0s29f1:rx-011:30:160
535458991613,2cyclictest60350irq/132-enp0s29f1:rx-011:10:180
535458991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:180
535458991613,2cyclictest60350irq/132-enp0s29f1:rx-010:05:130
535458991612,3cyclictest822072-21kworker/u8:1+events_unbound11:45:000
535458991611,4cyclictest692099-21apt-get09:40:120
535458991610,4cyclictest252-21systemd-journal08:45:010
535479991513,2cyclictest530081-21kworker/u8:0+events_unbound08:00:243
535479991512,3cyclictest582828-21kworker/u8:4+flush-259:008:55:193
535479991512,2cyclictest670781-21kworker/u8:2+flush-259:009:40:273
535479991512,2cyclictest561495-21gpgv07:35:003
535479991512,2cyclictest480658-21kworker/u8:4+flush-259:007:15:013
535472991512,2cyclictest795228-21kworker/u8:4+events_unbound12:25:182
535472991512,1cyclictest0-21swapper/208:00:222
535472991511,3cyclictest582828-21kworker/u8:4+events_unbound08:50:032
535462991511,3cyclictest795228-21kworker/u8:4+events_unbound11:55:141
535462991511,3cyclictest582828-21kworker/u8:4+events_unbound08:55:211
535458991513,1cyclictest60350irq/132-enp0s29f1:rx-012:15:240
535458991513,1cyclictest60350irq/132-enp0s29f1:rx-009:05:190
535458991513,1cyclictest60350irq/132-enp0s29f1:rx-008:26:430
535458991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:260
535458991513,1cyclictest60350irq/132-enp0s29f1:rx-007:15:170
535458991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:170
535458991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:160
535458991512,2cyclictest60350irq/132-enp0s29f1:rx-011:45:100
535458991512,2cyclictest60350irq/132-enp0s29f1:rx-007:50:210
535458991512,2cyclictest60350irq/132-enp0s29f1:rx-007:40:100
535458991511,3cyclictest702399-21apt-get09:50:100
535458991511,3cyclictest60350irq/132-enp0s29f1:rx-009:45:200
535458991511,2cyclictest60350irq/132-enp0s29f1:rx-011:05:100
53547999148,4cyclictest252-21systemd-journal08:19:293
535479991411,2cyclictest759694-21kworker/u8:1+flush-259:010:45:263
535479991411,2cyclictest727880-21kworker/u8:2+flush-259:010:30:243
535479991411,2cyclictest530081-21kworker/u8:0+events_unbound07:52:233
535479991411,2cyclictest480658-21kworker/u8:4+events_unbound07:17:003
535479991410,3cyclictest758820-21latency_hist10:45:013
53547999140,13cyclictest586940-21ntpq07:55:213
535472991412,2cyclictest753703-21kworker/u8:0+events_unbound11:03:222
535472991411,2cyclictest696991-21kworker/u8:1+flush-259:009:55:202
535472991411,2cyclictest562122-21kworker/u8:1+events_unbound07:48:582
535462991412,1cyclictest530081-21kworker/u8:0+events_unbound08:15:221
535462991411,2cyclictest848988-21apt-get12:10:111
535462991411,2cyclictest769815-21irqcore10:55:171
535462991411,2cyclictest738191-21cron10:25:001
53546299141,0cyclictest0-21swapper/110:00:001
535462991410,3cyclictest696991-21kworker/u8:1+events_unbound10:15:141
53545899147,5cyclictest252-21systemd-journal11:20:010
535458991413,1cyclictest60350irq/132-enp0s29f1:rx-011:51:380
535458991413,1cyclictest60350irq/132-enp0s29f1:rx-011:35:140
535458991413,1cyclictest60350irq/132-enp0s29f1:rx-010:01:440
535458991412,2cyclictest60350irq/132-enp0s29f1:rx-010:55:270
535458991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:180
535458991411,2cyclictest60350irq/132-enp0s29f1:rx-012:10:160
535458991411,2cyclictest60350irq/132-enp0s29f1:rx-011:01:220
535458991411,2cyclictest60350irq/132-enp0s29f1:rx-010:30:140
535458991411,2cyclictest60350irq/132-enp0s29f1:rx-007:59:020
535479991310,2cyclictest696991-21kworker/u8:1+events_unbound10:20:273
53547299131,2cyclictest567105-21awk07:40:012
53547299131,2cyclictest567105-21awk07:40:002
535472991311,2cyclictest738221-21kworker/u8:3+events_unbound10:40:202
535472991311,1cyclictest0-21swapper/209:10:132
53546299139,3cyclictest480658-21kworker/u8:4+flush-259:007:15:151
53546299139,3cyclictest252-21systemd-journal09:24:591
535462991311,1cyclictest828459-21irqcore11:50:151
535458991311,1cyclictest60350irq/132-enp0s29f1:rx-008:59:480
535458991310,2cyclictest60350irq/132-enp0s29f1:rx-012:05:210
53547999129,2cyclictest614369-21irqcore08:25:163
53547999129,2cyclictest530081-21kworker/u8:0+flush-259:008:06:273
53547999128,3cyclictest822072-21kworker/u8:1+events_unbound12:16:233
535479991210,2cyclictest582828-21kworker/u8:4+flush-259:008:20:293
535479991210,1cyclictest0-21swapper/309:19:593
53546299129,2cyclictest796053-21irqcore11:20:141
53546299129,2cyclictest722713-21idleruntime-cro10:10:001
53546299129,2cyclictest716712-21ntp_kernel_pll_10:00:221
53546299129,2cyclictest608991-21fschecks_time08:20:131
53546299129,2cyclictest540358-21unixbench_singl07:10:381
53546299127,4cyclictest629162-21kworker/u8:1+events_unbound08:40:181
53546299121,9cyclictest779467-21unin-run11:05:001
535462991210,1cyclictest0-21swapper/108:05:001
53545899129,2cyclictest60350irq/132-enp0s29f1:rx-008:30:180
53545899128,3cyclictest639461-21apt-get08:50:010
535458991211,1cyclictest60350irq/132-enp0s29f1:rx-010:50:170
535458991210,2cyclictest60350irq/132-enp0s29f1:rx-010:43:000
53547999118,2cyclictest849210-21fschecks_time12:10:143
53545899119,1cyclictest0-21swapper/009:20:180
53546299108,1cyclictest0-21swapper/112:20:141
53545899108,1cyclictest60350irq/132-enp0s29f1:rx-008:20:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional