You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 15:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 13, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3436525994731,5cyclictest3576772-21latency_hist21:25:013
3436515994138,2cyclictest3560232-21kworker/u8:0+flush-259:021:55:000
3436519993228,3cyclictest3665891-21kworker/u8:2+flush-259:022:55:001
3436515993229,2cyclictest3560232-21kworker/u8:0+events_unbound22:20:000
3436521993127,3cyclictest3738191-21journal-offline23:57:102
3436521992824,3cyclictest3676081-21gpgv23:00:002
3436521992824,3cyclictest3560232-21kworker/u8:0+flush-259:022:25:002
3436525992620,4cyclictest3529808-21/usr/sbin/munin20:40:243
3436525992619,4cyclictest3712640-21latency_hist23:35:023
3436519992621,3cyclictest3749254-21latency_hist00:10:011
3436515992522,2cyclictest3477696-21kworker/u8:1+events_unbound20:05:200
3436519992419,3cyclictest3722025-21kworker/u8:0+events_unbound00:35:001
3436515992421,2cyclictest3560232-21kworker/u8:0+flush-259:022:20:160
3436515992419,4cyclictest3686799-21latency_hist23:10:000
3436525992318,3cyclictest3728146-21kworker/u8:2+flush-259:023:55:143
3436521992319,3cyclictest500-21systemd-logind22:50:012
3436519992317,4cyclictest335557-21systemd-journal21:20:011
3436515992320,2cyclictest3765272-21kworker/u8:2+flush-259:000:29:590
3436515992319,3cyclictest3508578-21kworker/u8:0+events_unbound20:27:100
3436515992319,3cyclictest3477696-21kworker/u8:1+events_unbound20:15:130
3436515992319,3cyclictest3477696-21kworker/u8:1+events_unbound20:15:130
3436521992215,5cyclictest3739082-21cp00:00:012
3436515992220,1cyclictest3738448-21/usr/sbin/munin00:00:000
3436515992219,2cyclictest3722025-21kworker/u8:0+flush-259:000:05:170
3436515992219,2cyclictest3613061-21kworker/u8:1+flush-259:022:40:150
3436515992218,3cyclictest335557-21systemd-journal21:30:010
3436525992119,1cyclictest3675948-21cron23:00:003
3436525992116,3cyclictest3697336-21kworker/u8:3+flush-259:023:30:003
3436525992115,4cyclictest3540700-21diskstats20:50:143
3436521992118,2cyclictest3702317-21sh23:25:002
3436521992117,3cyclictest3560232-21kworker/u8:0+events_unbound21:50:162
3436515992118,2cyclictest3697123-21kworker/u8:2+events_unbound23:35:180
3436515992118,2cyclictest3607660-21kworker/u8:4+flush-259:021:55:250
3436525992017,2cyclictest2971-21cron00:34:593
3436525992016,3cyclictest509-21rs:main3
3436525992014,4cyclictest3498250-21latency_hist20:10:013
3436521992013,5cyclictest3519314-21latency_hist20:30:012
3436519992016,3cyclictest3477696-21kworker/u8:1+events_unbound20:40:191
3436515992017,2cyclictest3722025-21kworker/u8:0+events_unbound00:15:140
3436515992016,3cyclictest3665891-21kworker/u8:2+flush-259:023:00:250
343651599201,17cyclictest1-21systemd22:28:080
3436521991916,2cyclictest3550803-21kworker/u8:3+flush-259:021:00:142
3436519991916,2cyclictest3477696-21kworker/u8:1+events_unbound20:06:251
3436519991916,2cyclictest3477696-21kworker/u8:1+events_unbound20:04:091
3436519991915,3cyclictest507-21in:imuxsock20:15:001
3436519991914,4cyclictest3597328-21latency_hist21:45:011
3436515991916,2cyclictest3613061-21kworker/u8:1+events_unbound22:09:090
3436515991915,3cyclictest3707730-21apt-get23:30:120
3436515991915,3cyclictest3560232-21kworker/u8:0+events_unbound22:51:430
3436525991815,2cyclictest3509227-21irqcore20:20:173
3436525991812,4cyclictest335557-21systemd-journal23:01:093
3436525991811,4cyclictest509-21rs:main3
3436521991814,3cyclictest509-21rs:main2
3436521991814,3cyclictest3545457-21kworker/u8:2+flush-259:021:40:012
3436521991813,4cyclictest335557-21systemd-journal19:25:082
3436519991815,2cyclictest3631222-21kthreadcore22:15:151
3436515991815,2cyclictest3728146-21kworker/u8:2+flush-259:023:50:110
3436515991815,2cyclictest3712881-21kworker/u8:1+flush-259:023:45:180
3436515991815,2cyclictest3477696-21kworker/u8:1+events_unbound20:20:550
3436515991815,2cyclictest3383113-21kworker/u8:4+flush-259:019:10:260
3436525991714,2cyclictest3452164-21kworker/u8:2+flush-259:019:56:143
3436525991713,3cyclictest3765284-21unin-run00:25:003
3436521991714,2cyclictest3628688-21kworker/u8:2+flush-259:022:15:202
3436521991713,3cyclictest3722025-21kworker/u8:0+events_unbound23:46:452
3436521991711,4cyclictest3644541-21latency_hist22:30:012
3436519991714,2cyclictest3728146-21kworker/u8:2+flush-259:000:00:331
3436519991714,2cyclictest3508578-21kworker/u8:0+events_unbound20:51:001
3436519991714,2cyclictest3508578-21kworker/u8:0+events_unbound20:49:551
3436519991714,1cyclictest0-21swapper/123:55:001
3436519991713,3cyclictest509-21rs:main1
3436519991713,3cyclictest3644561-21kworker/u8:4+events_unbound23:15:101
3436519991713,3cyclictest3613061-21kworker/u8:1+events_unbound23:14:101
3436519991713,3cyclictest3477696-21kworker/u8:1+events_unbound20:58:091
3436519991713,2cyclictest3660056-21cron22:45:001
3436515991715,2cyclictest3644561-21kworker/u8:4+events_unbound22:45:180
3436515991714,2cyclictest60350irq/132-enp0s29f1:rx-023:40:250
3436515991714,2cyclictest60350irq/132-enp0s29f1:rx-023:25:140
3436515991714,2cyclictest60350irq/132-enp0s29f1:rx-021:15:380
3436515991714,2cyclictest3560232-21kworker/u8:0+events_unbound21:20:220
3436515991713,3cyclictest3592400-21kworker/u8:1+flush-259:021:40:210
3436515991713,3cyclictest3452202-21apt-get19:25:110
3436515991713,2cyclictest60350irq/132-enp0s29f1:rx-019:55:140
3436515991712,3cyclictest3477696-21kworker/u8:1+events_unbound20:45:270
3436525991613,2cyclictest0-21swapper/321:20:003
3436525991612,3cyclictest2971-21cron22:10:003
3436525991611,4cyclictest335557-21systemd-journal19:30:453
3436525991610,4cyclictest3654905-21latency_hist22:40:013
3436525991610,4cyclictest3654905-21latency_hist22:40:003
3436521991614,1cyclictest509-21rs:main2
3436521991614,1cyclictest3560232-21kworker/u8:0+events_unbound21:22:082
3436521991613,3cyclictest3441869-21kworker/u8:0+events_unbound19:16:112
3436521991613,2cyclictest3545457-21kworker/u8:2+flush-259:021:55:102
3436521991613,2cyclictest3477696-21kworker/u8:1+events_unbound20:45:192
3436521991613,2cyclictest3431340-21kworker/u8:1+events_unbound19:30:172
3436521991612,3cyclictest3722025-21kworker/u8:0+events_unbound00:38:282
3436521991612,3cyclictest3613061-21kworker/u8:1+events_unbound23:15:002
343652199160,10cyclictest3571625-21idleruntime-cro21:20:002
343651999169,1cyclictest0-21swapper/119:49:591
3436519991614,1cyclictest3529573-21cut20:40:001
3436519991613,3cyclictest3416033-21kworker/u8:3+events_unbound19:11:181
3436519991613,2cyclictest3759674-21kworker/u8:4+events_unbound00:20:121
3436519991613,2cyclictest3697123-21kworker/u8:2+events_unbound23:37:081
3436519991613,2cyclictest3560232-21kworker/u8:0+flush-259:022:05:001
3436519991613,2cyclictest3560232-21kworker/u8:0+events_unbound21:50:141
3436519991613,2cyclictest3477696-21kworker/u8:1+flush-259:020:30:151
3436519991612,3cyclictest3697336-21kworker/u8:3+events_unbound23:40:191
3436519991612,3cyclictest3697123-21kworker/u8:2+flush-259:023:30:211
3436519991611,4cyclictest3591313-21ntpq21:35:221
3436519991611,4cyclictest3446810-21latency_hist19:20:001
3436519991610,4cyclictest3780324-21ntpq00:35:231
3436519991610,4cyclictest335557-21systemd-journal21:12:081
3436515991614,1cyclictest60350irq/132-enp0s29f1:rx-023:15:230
3436515991614,1cyclictest60350irq/132-enp0s29f1:rx-000:38:420
3436515991613,2cyclictest60350irq/132-enp0s29f1:rx-021:30:220
3436515991613,2cyclictest60350irq/132-enp0s29f1:rx-021:00:200
3436515991613,2cyclictest3722025-21kworker/u8:0+events_unbound00:10:240
3436515991613,2cyclictest3508578-21kworker/u8:0+events_unbound20:30:280
3436515991613,2cyclictest3477696-21kworker/u8:1+events_unbound19:50:250
3436515991613,2cyclictest3452164-21kworker/u8:2+events_unbound20:00:100
3436515991613,2cyclictest3452164-21kworker/u8:2+events_unbound19:40:070
3436515991613,2cyclictest3441869-21kworker/u8:0+events_unbound19:15:190
3436515991612,3cyclictest3467379-21latency_hist19:40:000
3436515991612,2cyclictest3473217-21irqcore19:45:150
3436515991612,2cyclictest0-21swapper/021:40:000
3436525991512,1cyclictest0-21swapper/323:50:153
3436525991511,2cyclictest0-21swapper/300:15:003
3436525991510,3cyclictest3665230-21sh22:50:003
3436521991513,1cyclictest3617986-21cron22:05:002
3436521991512,2cyclictest3524471-21kworker/u8:2+events_unbound20:40:592
3436521991512,2cyclictest3477696-21kworker/u8:1+flush-259:020:05:272
3436521991512,2cyclictest3477696-21kworker/u8:1+events_unbound20:57:092
3436521991512,1cyclictest0-21swapper/220:15:002
3436521991511,3cyclictest3759674-21kworker/u8:4+flush-259:000:20:242
3436521991511,3cyclictest3508578-21kworker/u8:0+events_unbound20:53:092
3436521991511,2cyclictest0-21swapper/220:35:002
3436519991513,2cyclictest3644561-21kworker/u8:4+events_unbound23:05:091
3436519991512,2cyclictest3477696-21kworker/u8:1+events_unbound21:04:101
3436519991512,2cyclictest3462229-21kworker/u8:0+flush-259:019:40:201
3436519991512,2cyclictest3452164-21kworker/u8:2+events_unbound19:55:231
3436519991511,2cyclictest0-21swapper/100:19:591
3436515991513,1cyclictest60350irq/132-enp0s29f1:rx-022:31:330
3436515991513,1cyclictest60350irq/132-enp0s29f1:rx-021:45:170
3436515991512,2cyclictest60350irq/132-enp0s29f1:rx-019:30:080
3436515991512,2cyclictest60350irq/132-enp0s29f1:rx-000:20:430
3436515991512,2cyclictest3765272-21kworker/u8:2+events_unbound00:30:240
3436515991512,2cyclictest3477696-21kworker/u8:1+events_unbound21:05:140
3436515991511,2cyclictest3617985-21turbostat22:05:000
3436515991511,2cyclictest3529575-21turbostat20:40:000
343652599149,4cyclictest3452164-21kworker/u8:2+flush-259:020:00:153
343652599148,4cyclictest335557-21systemd-journal19:50:003
3436525991411,2cyclictest3627754-21ntp_kernel_err22:10:223
3436521991411,2cyclictest3441869-21kworker/u8:0+events_unbound19:20:142
3436521991410,3cyclictest3749494-21/usr/sbin/munin00:10:172
3436521991410,3cyclictest3722025-21kworker/u8:0+events_unbound00:05:182
3436521991410,3cyclictest3560232-21kworker/u8:0+flush-259:021:10:192
3436519991411,2cyclictest3644561-21kworker/u8:4+events_unbound23:02:111
3436519991411,2cyclictest3628688-21kworker/u8:2+flush-259:022:35:001
3436519991411,2cyclictest3545457-21kworker/u8:2+flush-259:022:00:011
3436519991411,2cyclictest3545457-21kworker/u8:2+events_unbound21:25:201
3436519991411,2cyclictest3498491-21kworker/u8:2+events_unbound20:20:191
3436519991411,2cyclictest3462229-21kworker/u8:0+events_unbound19:36:201
3436519991411,2cyclictest3431340-21kworker/u8:1+flush-259:019:25:161
3436519991410,3cyclictest3697336-21kworker/u8:3+events_unbound23:45:101
3436519991410,3cyclictest3545457-21kworker/u8:2+events_unbound21:48:091
3436519991410,2cyclictest3759674-21kworker/u8:4+flush-259:000:25:201
3436519991410,2cyclictest0-21swapper/122:50:011
3436515991412,1cyclictest60350irq/132-enp0s29f1:rx-023:20:160
3436515991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:180
3436515991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:170
3436515991412,1cyclictest60350irq/132-enp0s29f1:rx-019:20:250
3436515991410,3cyclictest3644561-21kworker/u8:4+flush-259:022:55:200
343652599138,4cyclictest3452202-21apt-get19:25:123
343652599138,4cyclictest335557-21systemd-journal23:42:093
343652599136,5cyclictest335557-21systemd-journal19:25:003
3436525991310,2cyclictest3588341-21kthreadcore21:35:183
343652199139,3cyclictest3722025-21kworker/u8:0+events_unbound00:19:122
3436521991310,2cyclictest3759674-21kworker/u8:4+events_unbound00:25:202
3436521991310,2cyclictest3697123-21kworker/u8:2+flush-259:023:35:192
3436521991310,2cyclictest3477696-21kworker/u8:1+events_unbound20:35:182
343651999139,3cyclictest3712881-21kworker/u8:1+flush-259:023:55:111
343651999139,3cyclictest3613061-21kworker/u8:1+events_unbound22:05:191
343651999138,4cyclictest3707467-21latency_hist23:30:021
3436519991310,2cyclictest3722025-21kworker/u8:0+flush-259:000:10:101
3436519991310,2cyclictest3627801-21ntp_kernel_pll_22:10:241
3436519991310,2cyclictest3545457-21kworker/u8:2+events_unbound21:32:091
3436519991310,2cyclictest3498491-21kworker/u8:2+events_unbound20:15:251
3436519991310,2cyclictest3498491-21kworker/u8:2+events_unbound20:15:251
3436519991310,2cyclictest3477696-21kworker/u8:1+flush-259:020:25:151
3436519991310,2cyclictest0-21swapper/121:10:001
343651599139,3cyclictest3477696-21kworker/u8:1+flush-259:020:55:260
343651599138,3cyclictest3498520-21apt-get20:10:120
3436515991311,1cyclictest60350irq/132-enp0s29f1:rx-023:10:160
3436515991311,1cyclictest60350irq/132-enp0s29f1:rx-000:00:140
343652599128,3cyclictest3756161-21kthreadcore00:15:193
343652599128,3cyclictest3713109-21fschecks_count23:35:163
343652199129,2cyclictest3560232-21kworker/u8:0+events_unbound21:43:082
343652199129,2cyclictest3416033-21kworker/u8:3+events_unbound19:45:162
343652199128,3cyclictest3452164-21kworker/u8:2+events_unbound20:02:102
3436521991210,1cyclictest0-21swapper/222:10:002
343651999129,2cyclictest3697123-21kworker/u8:2+flush-259:023:21:451
343651999129,2cyclictest3644561-21kworker/u8:4+events_unbound22:55:191
343651999129,2cyclictest3560232-21kworker/u8:0+events_unbound22:35:221
343651999129,2cyclictest3560232-21kworker/u8:0+events_unbound22:35:211
343651999129,2cyclictest3477696-21kworker/u8:1+events_unbound19:50:191
343651999129,2cyclictest3431340-21kworker/u8:1+events_unbound19:31:191
3436519991210,1cyclictest0-21swapper/122:30:001
343652199117,3cyclictest3644873-21runrttasks22:30:132
343651999118,2cyclictest3634644-21cpuspeed_turbos22:20:141
343652199107,2cyclictest3452164-21kworker/u8:2+events_unbound19:55:252
343651999105,4cyclictest311ktimers/121:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional