You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Nov 26, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4164526995650,4cyclictest69580-21latency_hist08:45:012
4164522994842,4cyclictest256684-21latency_hist11:45:010
4164525994639,4cyclictest126682-21latency_hist09:40:011
4164526994439,4cyclictest199620-21latency_hist10:50:012
4164530994339,3cyclictest74936-21kworker/u8:4+events_unbound10:44:053
4164530994239,2cyclictest11206-21kworker/u8:3+events_unbound07:56:583
4164530994238,3cyclictest189346-21kworker/u8:1+events_unbound12:15:163
4164530994238,3cyclictest158462-21kworker/u8:2+events_unbound10:38:383
4164530994238,3cyclictest148187-21kworker/u8:1+events_unbound10:04:143
4164530994138,2cyclictest90639-21kworker/u8:1+events_unbound09:07:243
4164530994138,2cyclictest267397-21kworker/u8:2+events_unbound12:06:003
4164530994137,3cyclictest38280-21kworker/u8:3+events_unbound08:21:013
4164530994037,2cyclictest74936-21kworker/u8:4+flush-259:010:22:143
4164530994037,2cyclictest59328-21kworker/u8:0+events_unbound08:40:393
4164530994037,2cyclictest4169559-21kworker/u8:2+events_unbound08:03:313
4164530994037,2cyclictest38891-21kworker/u8:4+events_unbound08:15:323
4164530994036,3cyclictest189346-21kworker/u8:1+events_unbound11:47:273
4164530994034,5cyclictest116412-21latency_hist09:30:013
4164530993936,2cyclictest74936-21kworker/u8:4+events_unbound09:19:593
4164530993935,3cyclictest215290-21kworker/u8:0+events_unbound11:07:023
4164530993835,2cyclictest4144136-21kworker/u8:0+events_unbound08:15:003
4164530993835,2cyclictest4144136-21kworker/u8:0+events_unbound08:14:593
4164530993835,2cyclictest245914-21kworker/u8:0+events_unbound11:50:423
4164530993834,3cyclictest189346-21kworker/u8:1+events_unbound12:01:383
4164530993734,2cyclictest158462-21kworker/u8:2+events_unbound10:29:203
4164530993733,3cyclictest225400-21kworker/u8:2+events_unbound11:28:523
4164530993633,2cyclictest74936-21kworker/u8:4+events_unbound09:42:563
4164530993633,2cyclictest74936-21kworker/u8:4+events_unbound08:52:073
4164530993632,3cyclictest74936-21kworker/u8:4+events_unbound09:56:023
4164530993632,3cyclictest4169559-21kworker/u8:2+flush-259:008:50:013
4164530993632,3cyclictest225400-21kworker/u8:2+events_unbound11:34:533
4164526993633,2cyclictest90639-21kworker/u8:1+flush-259:009:24:532
4164530993532,2cyclictest74936-21kworker/u8:4+events_unbound10:14:353
4164530993532,2cyclictest38280-21kworker/u8:3+events_unbound08:28:053
4164526993531,3cyclictest4169559-21kworker/u8:2+flush-259:009:10:182
4164522993530,4cyclictest173855-21latency_hist10:25:000
4164530993431,2cyclictest74936-21kworker/u8:4+events_unbound09:33:053
4164530993431,2cyclictest189346-21kworker/u8:1+events_unbound11:58:543
4164526993431,2cyclictest4144136-21kworker/u8:0+flush-259:007:35:002
4164522993428,4cyclictest309103-21latency_hist12:35:000
4164530993331,2cyclictest4169559-21kworker/u8:2+events_unbound09:12:193
4164530993330,2cyclictest189346-21kworker/u8:1+events_unbound11:21:473
4164530993229,2cyclictest267397-21kworker/u8:2+events_unbound12:23:283
4164522993128,2cyclictest4169559-21kworker/u8:2+flush-259:009:00:010
4164530993027,2cyclictest74936-21kworker/u8:4+events_unbound10:50:223
4164530993027,2cyclictest22439-21kworker/u8:1+events_unbound08:05:233
4164530993026,3cyclictest137452-21gpgv09:50:013
4164526993025,4cyclictest11704-21latency_hist07:50:002
4164530992926,2cyclictest74936-21kworker/u8:4+flush-259:008:55:253
4164530992926,2cyclictest158462-21kworker/u8:2+events_unbound10:32:373
4164525992923,4cyclictest4164738-21/usr/sbin/munin07:10:161
4164530992825,2cyclictest189346-21kworker/u8:1+flush-259:010:55:233
4164530992824,3cyclictest158462-21kworker/u8:2+events_unbound10:15:183
4164522992822,5cyclictest2698871-21systemd-journal07:15:010
4164530992725,2cyclictest4169559-21kworker/u8:2+events_unbound07:25:113
4164530992724,2cyclictest90639-21kworker/u8:1+flush-259:009:35:233
4164522992721,4cyclictest245079-21ntpq11:30:200
4164530992624,2cyclictest303580-21kworker/u8:3+events_unbound12:30:203
4164530992623,2cyclictest74936-21kworker/u8:4+flush-259:009:50:203
4164530992623,2cyclictest4169559-21kworker/u8:2+flush-259:007:50:193
4164530992623,2cyclictest4169559-21kworker/u8:2+events_unbound07:24:473
4164522992623,2cyclictest74936-21kworker/u8:4+flush-259:010:50:180
4164530992521,3cyclictest4169559-21kworker/u8:2+events_unbound08:30:233
4164530992521,3cyclictest245914-21kworker/u8:0+events_unbound11:35:233
4164526992522,2cyclictest4144136-21kworker/u8:0+flush-259:007:25:002
4164526992522,2cyclictest261651-21fwupd11:48:502
4164522992520,4cyclictest214209-21ntpq11:00:220
4164522992518,5cyclictest220197-21latency_hist11:10:010
4164530992422,1cyclictest74936-21kworker/u8:4+events_unbound10:05:143
4164530992421,2cyclictest74936-21kworker/u8:4+events_unbound09:20:123
4164530992421,2cyclictest4169559-21kworker/u8:2+events_unbound07:45:303
4164530992421,2cyclictest4144136-21kworker/u8:0+flush-259:007:15:223
4164530992421,2cyclictest215290-21kworker/u8:0+flush-259:011:15:243
4164530992421,2cyclictest189346-21kworker/u8:1+events_unbound12:10:143
4164525992421,2cyclictest74936-21kworker/u8:4+flush-259:009:55:001
4164525992420,3cyclictest158462-21kworker/u8:2+flush-259:010:25:161
4164530992320,2cyclictest59328-21kworker/u8:0+flush-259:008:35:193
4164530992319,3cyclictest245914-21kworker/u8:0+events_unbound11:40:013
4164525992317,4cyclictest2698871-21systemd-journal08:06:481
4164530992219,2cyclictest189346-21kworker/u8:1+events_unbound11:00:233
4164526992219,2cyclictest215290-21kworker/u8:0+flush-259:011:10:192
4164525992216,4cyclictest267909-21cp11:55:011
4164530992117,3cyclictest4144136-21kworker/u8:0+events_unbound07:33:283
4164530992116,2cyclictest158462-21kworker/u8:2+events_unbound10:45:133
4164526992118,2cyclictest3000063-21rs:main2
4164526992115,4cyclictest267351-21apt-get11:55:002
4164525992117,3cyclictest4175042-21/usr/sbin/munin07:20:161
4164525992117,3cyclictest225400-21kworker/u8:2+flush-259:011:20:191
4164525992116,4cyclictest246179-21/usr/sbin/munin11:35:201
4164525992114,6cyclictest4173874-21ntpq07:15:221
4164522992118,2cyclictest4169559-21kworker/u8:2+flush-259:007:49:590
4164522992117,3cyclictest90639-21kworker/u8:1+flush-259:009:30:010
4164522992114,5cyclictest53196-21ntpq08:25:210
4164526992018,1cyclictest0-21swapper/211:35:002
4164526992017,2cyclictest90639-21kworker/u8:1+flush-259:009:45:172
4164526992017,2cyclictest38891-21kworker/u8:4+flush-259:008:25:252
4164526992017,2cyclictest158462-21kworker/u8:2+events_unbound10:25:242
4164522992017,2cyclictest225400-21kworker/u8:2+flush-259:011:25:180
4164522992016,3cyclictest132546-21apt-get09:45:140
4164530991916,2cyclictest293641-21kworker/u8:0+events_unbound12:35:243
4164526991916,2cyclictest4144136-21kworker/u8:0+events_unbound07:35:142
4164526991916,2cyclictest148187-21kworker/u8:1+flush-259:010:10:182
4164526991915,3cyclictest74936-21kworker/u8:4+flush-259:010:50:162
4164526991915,2cyclictest215049-21idleruntime-cro11:05:002
4164525991915,3cyclictest74936-21kworker/u8:4+flush-259:010:30:191
4164525991915,3cyclictest4144136-21kworker/u8:0+flush-259:007:35:261
4164525991915,3cyclictest2698871-21systemd-journal08:15:481
4164522991916,2cyclictest4169559-21kworker/u8:2+flush-259:009:30:170
4164522991915,3cyclictest38280-21kworker/u8:3+flush-259:008:20:180
4164522991914,4cyclictest23062-21/usr/sbin/munin08:00:150
4164522991913,5cyclictest4189363-21ntpq07:30:210
4164522991912,5cyclictest298799-21latency_hist12:25:000
4164530991814,3cyclictest215290-21kworker/u8:0+events_unbound11:13:493
4164526991815,3cyclictest4169559-21kworker/u8:2+events_unbound08:49:572
4164526991815,2cyclictest189346-21kworker/u8:1+flush-259:010:55:182
4164526991814,3cyclictest4169559-21kworker/u8:2+flush-259:007:55:172
4164526991814,3cyclictest189346-21kworker/u8:1+flush-259:011:35:242
4164525991815,2cyclictest267360-21idleruntime-cro11:55:001
4164525991812,4cyclictest299034-21/usr/sbin/munin12:25:151
4164525991811,4cyclictest2698871-21systemd-journal09:58:481
4164522991816,1cyclictest0-21swapper/011:50:010
4164522991814,3cyclictest158462-21kworker/u8:2+flush-259:010:30:250
4164522991812,4cyclictest17504-21cp07:55:090
4164522991811,5cyclictest15971-21ntpq07:50:210
4164530991714,2cyclictest267397-21kworker/u8:2+events_unbound12:25:493
4164526991715,1cyclictest59328-21kworker/u8:0+events_unbound08:35:132
4164526991715,1cyclictest0-21swapper/212:25:002
4164526991714,2cyclictest215290-21kworker/u8:0+flush-259:011:15:152
4164526991712,4cyclictest38394-21cat08:15:012
4164526991712,4cyclictest38394-21cat08:15:002
4164526991711,4cyclictest304348-21diskstats12:30:132
4164525991713,3cyclictest44088-21/usr/sbin/munin08:20:151
4164525991713,3cyclictest4169559-21kworker/u8:2+flush-259:007:25:141
4164525991711,4cyclictest292720-21ntpq12:15:211
4164525991711,4cyclictest209949-21latency_hist11:00:011
4164522991715,1cyclictest0-21swapper/009:15:010
4164522991714,2cyclictest90639-21kworker/u8:1+flush-259:009:05:140
4164522991714,1cyclictest0-21swapper/009:20:010
4164522991713,3cyclictest58459-21ntp_offset08:30:220
4164522991713,3cyclictest4009275-21kworker/u8:3+flush-259:007:20:220
4164522991712,4cyclictest209066-21ntpq10:55:210
4164522991712,3cyclictest131454-21ntp_offset09:40:220
4164522991711,4cyclictest37393-21ntpq08:10:220
4164522991711,4cyclictest37393-21ntpq08:10:210
4164530991613,2cyclictest38280-21kworker/u8:3+events_unbound09:04:073
4164526991613,2cyclictest74936-21kworker/u8:4+flush-259:009:50:192
4164526991613,2cyclictest4169559-21kworker/u8:2+events_unbound09:39:382
4164526991612,3cyclictest59328-21kworker/u8:0+flush-259:008:55:002
4164526991612,3cyclictest48162-21ntp_offset08:20:232
4164526991612,3cyclictest189346-21kworker/u8:1+events_unbound11:40:192
4164522991614,1cyclictest60650irq/133-enp0s29f1:rx-007:40:160
4164522991613,2cyclictest74936-21kworker/u8:4+events_unbound10:05:180
4164522991613,2cyclictest60650irq/133-enp0s29f1:rx-011:35:240
4164522991611,4cyclictest148405-21apt-get10:00:110
4164530991513,2cyclictest4169559-21kworker/u8:2+events_unbound07:35:183
4164530991512,2cyclictest4169559-21kworker/u8:2+events_unbound07:40:243
416452699158,5cyclictest2698871-21systemd-journal07:30:002
4164526991511,3cyclictest74936-21kworker/u8:4+events_unbound09:40:232
4164526991511,3cyclictest267397-21kworker/u8:2+events_unbound12:04:552
4164526991511,2cyclictest0-21swapper/210:40:002
4164525991513,1cyclictest0-21swapper/110:20:001
4164525991512,2cyclictest10781-21ntp_kernel_err07:45:211
4164525991511,3cyclictest21572-21ntp_offset07:55:231
4164522991513,2cyclictest60650irq/133-enp0s29f1:rx-010:44:490
4164522991513,2cyclictest60650irq/133-enp0s29f1:rx-007:37:260
4164522991513,1cyclictest60650irq/133-enp0s29f1:rx-012:29:540
4164522991513,1cyclictest60650irq/133-enp0s29f1:rx-012:18:290
4164522991512,2cyclictest61450irq/134-enp0s29f1:tx-008:40:270
4164522991512,2cyclictest60650irq/133-enp0s29f1:rx-011:10:170
4164522991512,2cyclictest60650irq/133-enp0s29f1:rx-010:25:160
4164522991512,2cyclictest60650irq/133-enp0s29f1:rx-009:50:590
4164522991511,3cyclictest267351-21apt-get11:55:020
4164522991511,2cyclictest0-21swapper/007:20:000
4164522991510,4cyclictest273173-21/usr/sbin/munin12:00:140
4164522991510,4cyclictest121806-21apt-get09:35:110
4164530991411,2cyclictest4009275-21kworker/u8:3+events_unbound07:12:483
416452699149,4cyclictest2698871-21systemd-journal12:20:002
4164526991411,2cyclictest158462-21kworker/u8:2+events_unbound10:40:142
4164526991411,2cyclictest111536-21apt-get09:25:152
4164526991411,2cyclictest105237-21ntp_kernel_pll_09:15:222
416452599149,4cyclictest3000061-21in:imuxsock11:50:011
416452599147,5cyclictest2698871-21systemd-journal08:55:001
4164525991411,2cyclictest38280-21kworker/u8:3+flush-259:008:55:171
4164525991410,3cyclictest4144136-21kworker/u8:0+flush-259:007:54:541
4164522991413,1cyclictest60650irq/133-enp0s29f1:rx-012:10:250
4164522991413,1cyclictest60650irq/133-enp0s29f1:rx-011:18:010
4164522991413,1cyclictest60650irq/133-enp0s29f1:rx-010:47:360
4164522991413,1cyclictest60650irq/133-enp0s29f1:rx-010:10:160
4164522991413,1cyclictest60650irq/133-enp0s29f1:rx-008:07:120
4164522991412,2cyclictest60650irq/133-enp0s29f1:rx-008:54:430
4164522991412,2cyclictest60650irq/133-enp0s29f1:rx-008:18:570
4164522991412,1cyclictest60650irq/133-enp0s29f1:rx-012:35:240
4164522991412,1cyclictest60650irq/133-enp0s29f1:rx-011:50:150
4164522991412,1cyclictest60650irq/133-enp0s29f1:rx-010:37:130
4164522991412,1cyclictest60650irq/133-enp0s29f1:rx-009:55:210
4164522991412,1cyclictest60650irq/133-enp0s29f1:rx-007:25:140
4164522991412,1cyclictest0-21swapper/009:04:590
4164522991411,2cyclictest60650irq/133-enp0s29f1:rx-008:35:210
416452699139,3cyclictest293641-21kworker/u8:0+flush-259:012:35:202
416452699136,5cyclictest183259-21ntpq10:30:222
4164526991310,2cyclictest173852-21idleruntime-cro10:25:002
4164526991310,2cyclictest16859-21latency_hist07:55:012
4164526991310,2cyclictest147651-21unixbench_multi09:55:252
416452599139,3cyclictest235665-21kworker/u8:3+events_unbound11:30:011
416452599138,4cyclictest59328-21kworker/u8:0+flush-259:008:35:151
416452599138,3cyclictest74936-21kworker/u8:4+events_unbound10:05:001
416452599138,3cyclictest54125-21latency_hist08:30:011
416452599137,4cyclictest127364-21base6409:40:171
4164525991311,1cyclictest217611-21kthreadcore11:05:161
4164525991310,2cyclictest294296-21irqcore12:20:161
4164522991311,1cyclictest60650irq/133-enp0s29f1:rx-011:20:240
4164522991310,2cyclictest60650irq/133-enp0s29f1:rx-012:05:260
416453099121,5cyclictest50-21ksoftirqd/307:10:023
416452699129,2cyclictest268242-21fschecks_count11:55:152
416452699129,2cyclictest225400-21kworker/u8:2+flush-259:011:25:162
416452699128,2cyclictest168263-21unixbench_multi10:15:252
416452699127,3cyclictest189346-21kworker/u8:1+events_unbound12:10:182
416452599129,2cyclictest282831-21unixbench_multi12:05:251
416452599129,2cyclictest273338-21cpuspeed_turbos12:00:121
416452599129,2cyclictest194052-21unixbench_singl10:40:271
416452599129,2cyclictest158414-21idleruntime-cro10:10:001
416452599129,2cyclictest113824-21kthreadcore09:25:221
416452599129,2cyclictest0-21swapper/111:15:001
416452599128,3cyclictest4144136-21kworker/u8:0+flush-259:007:30:261
416452599127,3cyclictest2698871-21systemd-journal12:15:001
4164525991210,1cyclictest0-21swapper/108:35:001
416452599120,2cyclictest215060-21awk11:05:001
4164522991210,1cyclictest60650irq/133-enp0s29f1:rx-010:18:490
416452699118,1cyclictest0-21swapper/208:15:232
416452699117,3cyclictest4174816-21awk07:20:012
416452699117,3cyclictest267397-21kworker/u8:2+events_unbound12:25:172
416452699115,4cyclictest90854-21/usr/sbin/munin09:05:182
416452599118,2cyclictest0-21swapper/108:15:011
416452599118,2cyclictest0-21swapper/108:15:001
416452599117,3cyclictest91015-21tr09:05:121
416452599117,3cyclictest158462-21kworker/u8:2+flush-259:010:45:161
416452299119,1cyclictest60650irq/133-enp0s29f1:rx-009:20:480
416452699106,3cyclictest225400-21kworker/u8:2+flush-259:011:20:142
41645259996,2cyclictest0-21swapper/109:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional