You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 23:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jun 25, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4175247995751,4cyclictest158086-21latency_hist10:00:000
4175254995450,3cyclictest190167-21kworker/u8:3+events_unbound11:50:012
4175257994743,3cyclictest4180510-21gpgv07:15:003
4175252994741,4cyclictest4116372-21kworker/u8:0+flush-259:007:25:001
4175257994336,5cyclictest303624-21latency_hist12:20:003
4175254994338,3cyclictest4185982-21latency_hist07:20:022
4175252994237,4cyclictest126962-21apt-get09:30:121
4175252994135,4cyclictest241109-21apt-get11:19:001
4175254993530,3cyclictest131807-21latency_hist09:35:012
4175247993327,4cyclictest251634-21latency_hist11:30:010
4175254993229,2cyclictest158319-21kworker/u8:4+events_unbound10:05:112
4175254993226,5cyclictest307884-21ntpq12:20:212
4175252993227,3cyclictest184627-21/usr/sbin/munin10:25:141
4175247993227,4cyclictest73819-21ntpq08:35:200
4175254993128,2cyclictest16928-21kworker/u8:0+flush-259:007:50:202
4175254993127,3cyclictest85636-21kworker/u8:1+events_unbound09:39:122
4175252993128,2cyclictest85636-21kworker/u8:1+flush-259:009:05:161
4175257993023,5cyclictest324269-21latency_hist12:40:003
4175252993026,3cyclictest13042-21/usr/sbin/munin07:40:161
4175252993023,5cyclictest68648-21ntpq08:30:211
4175247993026,3cyclictest335557-21systemd-journal08:45:000
4175247993025,4cyclictest152025-21ntpq09:50:200
4175254992926,2cyclictest84536-21kworker/u8:0+events_unbound09:10:002
4175254992925,3cyclictest307857-21kworker/u8:3+events_unbound12:26:122
4175254992924,4cyclictest184394-21latency_hist10:25:012
4175247992925,3cyclictest335557-21systemd-journal10:50:000
4175247992925,3cyclictest262215-21apt-get11:40:110
4175257992822,4cyclictest293298-21diskstats12:10:123
4175254992825,2cyclictest16928-21kworker/u8:0+events_unbound08:23:132
4175254992824,3cyclictest18159-21kworker/u8:1+events_unbound08:12:142
4175252992824,3cyclictest18159-21kworker/u8:1+events_unbound08:27:121
4175252992824,3cyclictest18159-21kworker/u8:1+events_unbound08:27:121
4175254992724,2cyclictest85636-21kworker/u8:1+events_unbound09:12:122
4175254992723,3cyclictest38841-21apt-get08:05:112
4175254992721,4cyclictest7627-21latency_hist07:35:002
4175252992723,3cyclictest85636-21kworker/u8:1+flush-259:009:50:221
4175252992721,4cyclictest6751-21ntpq07:30:201
4175254992623,2cyclictest1083568-21kworker/u8:3+events_unbound07:35:132
4175252992622,3cyclictest1083568-21kworker/u8:3+events_unbound08:11:121
4175247992622,3cyclictest131808-21apt-get09:35:030
4175257992519,4cyclictest313896-21latency_hist12:30:003
4175254992521,3cyclictest18159-21kworker/u8:1+events_unbound07:47:112
4175252992522,2cyclictest121574-21kworker/u8:0+events_unbound10:07:121
4175252992521,3cyclictest16928-21kworker/u8:0+events_unbound08:22:121
4175247992521,3cyclictest183465-21kworker/u8:2+flush-259:011:10:000
4175247992521,3cyclictest168596-21gpgv10:10:000
4175247992520,4cyclictest231110-21apt-get11:10:110
4175247992520,3cyclictest38571-21latency_hist08:05:000
4175247992519,4cyclictest335557-21systemd-journal09:20:110
4175257992418,4cyclictest94909-21ntpq08:55:213
4175257992418,4cyclictest335557-21systemd-journal11:55:003
4175254992422,2cyclictest1083568-21kworker/u8:3+events_unbound07:10:052
4175252992421,2cyclictest64542-21kworker/u8:4+events_unbound08:43:121
4175252992421,2cyclictest307857-21kworker/u8:3+events_unbound12:27:131
4175252992421,2cyclictest183465-21kworker/u8:2+flush-259:010:30:161
4175252992420,3cyclictest307857-21kworker/u8:3+events_unbound12:23:131
4175252992420,3cyclictest246447-21kworker/u8:2+events_unbound12:31:091
4175252992420,3cyclictest190167-21kworker/u8:3+flush-259:011:25:211
4175252992420,3cyclictest1083568-21kworker/u8:3+flush-259:008:04:591
4175247992418,4cyclictest58273-21ntpq08:20:210
4175247992418,4cyclictest298060-21gpgv12:15:000
4175257992318,4cyclictest209396-21ntpq10:45:213
4175254992320,2cyclictest246447-21kworker/u8:2+flush-259:011:55:212
4175254992320,2cyclictest190167-21kworker/u8:3+flush-259:010:35:232
4175254992320,2cyclictest168120-21kworker/u8:1+events_unbound10:14:142
4175254992320,2cyclictest158319-21kworker/u8:4+flush-259:010:00:392
4175254992319,3cyclictest246447-21kworker/u8:2+flush-259:012:30:232
4175254992319,3cyclictest121574-21kworker/u8:0+events_unbound10:31:112
4175252992320,2cyclictest28459-21kworker/u8:4+flush-259:007:55:171
4175252992320,2cyclictest121574-21kworker/u8:0+events_unbound10:40:131
4175252992319,3cyclictest319290-21kworker/u8:4+events_unbound12:36:131
4175252992319,3cyclictest258013-21kworker/u8:1+events_unbound11:35:261
4175252992319,3cyclictest16928-21kworker/u8:0+events_unbound07:53:131
4175252992318,4cyclictest4175486-21apt-get07:10:131
4175252992318,3cyclictest174326-21/usr/sbin/munin10:15:131
417524799230,21cyclictest1-21systemd12:38:110
4175257992217,3cyclictest168666-21cp10:09:593
4175254992219,2cyclictest64542-21kworker/u8:4+events_unbound08:35:132
4175254992219,2cyclictest190167-21kworker/u8:3+flush-259:011:30:212
4175254992218,3cyclictest106321-21kworker/u8:3+events_unbound09:25:452
4175254992217,4cyclictest49140-21apt-get08:15:122
4175252992219,3cyclictest183465-21kworker/u8:2+events_unbound11:05:021
4175252992219,2cyclictest190167-21kworker/u8:3+events_unbound10:35:131
4175252992219,2cyclictest183465-21kworker/u8:2+events_unbound10:50:211
4175252992218,3cyclictest85636-21kworker/u8:1+flush-259:009:25:201
4175252992218,3cyclictest85636-21kworker/u8:1+flush-259:009:15:211
4175252992218,3cyclictest183465-21kworker/u8:2+events_unbound10:47:111
4175252992218,3cyclictest16928-21kworker/u8:0+flush-259:007:45:151
4175247992218,3cyclictest1083568-21kworker/u8:3+events_unbound08:10:180
4175247992216,4cyclictest509-21rs:main0
4175247992215,5cyclictest267376-21apt-get11:45:100
4175257992115,4cyclictest28459-21kworker/u8:4+flush-259:007:55:173
4175257992115,4cyclictest106310-21/usr/sbin/munin09:10:183
4175254992119,2cyclictest106321-21kworker/u8:3+events_unbound09:40:152
4175254992118,2cyclictest85636-21kworker/u8:1+events_unbound09:22:122
4175254992118,2cyclictest7865-21kworker/u8:2+events_unbound07:40:252
4175254992118,2cyclictest183465-21kworker/u8:2+events_unbound11:05:122
4175254992117,3cyclictest85636-21kworker/u8:1+flush-259:009:15:252
4175254992117,3cyclictest84536-21kworker/u8:0+flush-259:008:55:002
4175254992117,3cyclictest246447-21kworker/u8:2+flush-259:012:10:162
4175254992117,3cyclictest1083568-21kworker/u8:3+flush-259:007:20:102
4175252992118,2cyclictest7865-21kworker/u8:2+flush-259:007:35:121
4175252992118,2cyclictest246447-21kworker/u8:2+events_unbound12:02:131
4175252992118,2cyclictest190167-21kworker/u8:3+flush-259:011:10:241
4175252992118,2cyclictest1083568-21kworker/u8:3+events_unbound08:40:001
4175252992117,3cyclictest246447-21kworker/u8:2+events_unbound12:18:121
4175247992117,3cyclictest246447-21kworker/u8:2+flush-259:012:04:420
4175254992017,2cyclictest16928-21kworker/u8:0+flush-259:008:25:162
4175254992017,2cyclictest16928-21kworker/u8:0+flush-259:008:25:152
4175252992016,3cyclictest121574-21kworker/u8:0+events_unbound09:43:131
4175252992015,3cyclictest292869-21latency_hist12:10:001
4175247992016,3cyclictest132474-21kworker/u8:4+flush-259:009:45:240
4175247992014,4cyclictest220948-21diskstats11:00:140
4175257991913,4cyclictest509-21rs:main3
4175254991916,2cyclictest307857-21kworker/u8:3+events_unbound12:35:222
4175254991916,2cyclictest258013-21kworker/u8:1+events_unbound11:43:122
4175254991916,2cyclictest0-21swapper/208:50:012
4175254991915,3cyclictest121574-21kworker/u8:0+events_unbound10:40:122
4175252991916,2cyclictest246447-21kworker/u8:2+events_unbound11:50:241
4175252991916,2cyclictest121574-21kworker/u8:0+flush-259:010:20:201
4175252991916,2cyclictest121574-21kworker/u8:0+flush-259:010:10:151
4175252991915,3cyclictest1083568-21kworker/u8:3+flush-259:008:45:311
4175252991912,5cyclictest335557-21systemd-journal11:05:001
4175247991913,4cyclictest79960-21gpgv08:45:010
4175247991913,4cyclictest335557-21systemd-journal07:51:120
4175247991912,5cyclictest335557-21systemd-journal10:29:590
4175257991814,3cyclictest261975-21kworker/u8:4+flush-259:012:00:113
4175257991813,4cyclictest16928-21kworker/u8:0+flush-259:008:05:153
4175257991812,4cyclictest121574-21kworker/u8:0+flush-259:010:20:173
4175257991812,4cyclictest116399-21latency_hist09:20:013
4175254991815,2cyclictest28459-21kworker/u8:4+events_unbound07:55:222
4175254991815,2cyclictest236236-21kworker/u8:4+events_unbound11:20:012
4175254991815,2cyclictest190167-21kworker/u8:3+events_unbound11:25:262
4175254991815,2cyclictest1083568-21kworker/u8:3+flush-259:007:25:222
4175254991815,2cyclictest1083568-21kworker/u8:3+events_unbound08:00:172
4175254991814,3cyclictest74889-21kworker/u8:2+events_unbound09:03:122
4175254991814,3cyclictest64542-21kworker/u8:4+events_unbound08:40:222
4175254991814,3cyclictest183465-21kworker/u8:2+flush-259:011:00:252
4175252991814,2cyclictest282580-21idleruntime-cro12:00:001
4175247991812,4cyclictest158517-21diskstats10:00:140
4175257991714,2cyclictest47977-21ntp_kernel_pll_08:10:213
4175257991714,2cyclictest1083568-21kworker/u8:3+flush-259:008:30:173
4175257991712,3cyclictest13068-21apt-get07:40:133
4175254991714,2cyclictest230889-21kworker/u8:0+flush-259:011:20:182
4175254991712,4cyclictest210481-21/usr/sbin/munin10:50:192
4175254991712,3cyclictest1-21systemd10:30:002
4175252991715,1cyclictest246447-21kworker/u8:2+events_unbound12:10:231
4175252991714,2cyclictest258013-21kworker/u8:1+events_unbound11:40:591
4175252991714,2cyclictest230889-21kworker/u8:0+flush-259:011:20:171
4175252991713,3cyclictest84536-21kworker/u8:0+events_unbound09:10:131
4175252991713,3cyclictest84536-21kworker/u8:0+events_unbound09:00:181
4175247991714,2cyclictest60350irq/132-enp0s29f1:rx-008:25:130
4175247991714,2cyclictest60350irq/132-enp0s29f1:rx-008:25:120
4175247991713,3cyclictest60350irq/132-enp0s29f1:rx-007:20:120
417524799171,15cyclictest509-21rs:main0
4175257991614,1cyclictest80035-21apt-key08:45:003
4175257991613,2cyclictest18191-21apt-get07:45:113
4175257991613,2cyclictest153179-21kworker/u8:3+flush-259:009:55:263
4175257991613,2cyclictest132474-21kworker/u8:4+events_unbound09:45:183
4175254991613,2cyclictest121574-21kworker/u8:0+flush-259:009:55:212
4175252991613,2cyclictest85636-21kworker/u8:1+events_unbound08:57:131
4175252991613,2cyclictest18159-21kworker/u8:1+flush-259:008:15:251
4175252991612,3cyclictest190167-21kworker/u8:3+events_unbound11:46:091
417524799168,6cyclictest309188-21diskstats12:25:130
4175247991614,1cyclictest509-21rs:main0
4175247991613,2cyclictest60350irq/132-enp0s29f1:rx-011:00:010
4175247991613,2cyclictest60350irq/132-enp0s29f1:rx-009:15:170
4175247991613,2cyclictest60350irq/132-enp0s29f1:rx-009:08:520
4175247991613,2cyclictest60350irq/132-enp0s29f1:rx-008:55:250
4175247991613,2cyclictest4192712-21kthreadcore07:25:170
417525799159,5cyclictest80504-21/usr/sbin/munin08:45:143
4175257991512,2cyclictest307857-21kworker/u8:3+flush-259:012:21:113
4175257991512,2cyclictest131819-21cut09:35:013
4175257991511,3cyclictest1083568-21kworker/u8:3+flush-259:007:35:143
4175254991512,2cyclictest246447-21kworker/u8:2+events_unbound12:15:232
4175254991512,2cyclictest169140-21kworker/u8:3+events_unbound10:15:272
4175252991512,2cyclictest74889-21kworker/u8:2+events_unbound08:50:311
4175252991510,4cyclictest219608-21ntpq10:55:211
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-012:30:230
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-012:20:250
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-011:59:110
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-011:31:020
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-010:15:250
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-009:27:470
4175247991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:170
4175247991512,2cyclictest60350irq/132-enp0s29f1:rx-009:30:150
4175247991512,2cyclictest60350irq/132-enp0s29f1:rx-008:50:170
4175247991512,2cyclictest60350irq/132-enp0s29f1:rx-007:59:170
4175247991512,2cyclictest60350irq/132-enp0s29f1:rx-007:48:350
4175247991512,2cyclictest60350irq/132-enp0s29f1:rx-007:40:140
4175247991511,3cyclictest60350irq/132-enp0s29f1:rx-010:50:120
4175247991511,3cyclictest60350irq/132-enp0s29f1:rx-008:15:220
4175247991510,4cyclictest4186005-21kworker/u8:4+flush-259:007:30:150
4175257991411,1cyclictest0-21swapper/309:40:173
4175257991410,2cyclictest0-21swapper/307:30:003
417525499148,4cyclictest190167-21kworker/u8:3+flush-259:011:35:162
4175254991411,2cyclictest147721-21kworker/u8:2+events_unbound09:54:552
4175254991411,2cyclictest1083568-21kworker/u8:3+events_unbound08:30:202
4175254991410,3cyclictest74889-21kworker/u8:2+flush-259:008:55:162
4175254991410,3cyclictest183465-21kworker/u8:2+events_unbound10:47:132
417525299149,3cyclictest132474-21kworker/u8:4+flush-259:009:45:151
4175252991411,2cyclictest16928-21kworker/u8:0+events_unbound08:05:201
4175252991410,3cyclictest121574-21kworker/u8:0+events_unbound10:00:121
417524799148,4cyclictest335557-21systemd-journal10:33:110
4175247991413,1cyclictest60350irq/132-enp0s29f1:rx-012:05:210
4175247991413,1cyclictest60350irq/132-enp0s29f1:rx-009:04:570
4175247991412,2cyclictest60350irq/132-enp0s29f1:rx-010:23:020
4175247991412,1cyclictest60350irq/132-enp0s29f1:rx-011:35:580
4175247991412,1cyclictest60350irq/132-enp0s29f1:rx-011:17:090
4175247991412,1cyclictest60350irq/132-enp0s29f1:rx-008:30:220
4175247991412,1cyclictest60350irq/132-enp0s29f1:rx-008:05:280
4175247991412,1cyclictest0-21swapper/007:10:000
4175247991411,2cyclictest60350irq/132-enp0s29f1:rx-011:54:240
4175247991411,2cyclictest60350irq/132-enp0s29f1:rx-010:39:500
4175257991310,2cyclictest500-21systemd-logind08:55:013
4175257991310,2cyclictest4185551-21unixbench_singl07:15:243
4175257991310,2cyclictest25651-21kthreadcore07:50:173
4175257991310,2cyclictest245980-21unixbench_singl11:20:243
4175257991310,2cyclictest168120-21kworker/u8:1+flush-259:010:25:263
417525499139,3cyclictest132474-21kworker/u8:4+events_unbound09:45:142
4175254991310,2cyclictest121574-21kworker/u8:0+events_unbound10:55:012
417525299139,3cyclictest85636-21kworker/u8:1+events_unbound09:20:211
4175252991311,1cyclictest4175448-21kworker/u8:1+events_unbound07:15:021
4175247991311,1cyclictest60350irq/132-enp0s29f1:rx-007:39:000
4175247991310,2cyclictest60350irq/132-enp0s29f1:rx-009:43:030
4175247991310,2cyclictest60350irq/132-enp0s29f1:rx-007:15:020
417525799129,2cyclictest0-21swapper/310:35:003
4175257991210,1cyclictest0-21swapper/311:04:593
417525299129,2cyclictest147721-21kworker/u8:2+events_unbound09:57:111
417525299128,3cyclictest4116372-21kworker/u8:0+events_unbound07:29:131
417525299127,4cyclictest335557-21systemd-journal09:35:351
417525799118,2cyclictest96104-21cpuspeed_turbos09:00:123
417525799118,2cyclictest0-21swapper/311:55:223
417525799117,2cyclictest73743-21ntpq08:35:203
417525499117,2cyclictest288153-21grep12:05:142
417525299108,1cyclictest0-21swapper/111:30:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional