You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 23:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 08, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3704931994640,4cyclictest3854716-21latency_hist09:35:013
3704921994539,4cyclictest335557-21systemd-journal12:35:130
3704921994239,2cyclictest3886686-21kworker/u8:0+events_unbound10:56:130
3704925993933,4cyclictest335557-21systemd-journal11:45:131
3704921993936,2cyclictest3984607-21kworker/u8:3+events_unbound12:09:130
3704931993833,3cyclictest4041790-21journal-offline12:34:133
3704921993834,3cyclictest3736056-21apt-get07:40:120
3704929993733,3cyclictest3963983-21kworker/u8:2+flush-259:012:10:002
3704921993734,2cyclictest3869750-21kworker/u8:1+events_unbound09:57:130
3704921993633,2cyclictest3886686-21kworker/u8:0+events_unbound11:23:140
3704921993633,2cyclictest3886686-21kworker/u8:0+events_unbound10:41:140
3704929993531,3cyclictest3886148-21gpgv10:05:012
3704921993533,2cyclictest3766522-21kworker/u8:1+events_unbound09:28:140
3704921993532,2cyclictest3766522-21kworker/u8:1+events_unbound09:05:230
3704921993529,4cyclictest509-21rs:main0
3704929993427,5cyclictest509-21rs:main2
3704921993431,3cyclictest3807934-21kworker/u8:3+events_unbound09:41:140
3704921993430,3cyclictest3963983-21kworker/u8:2+events_unbound12:04:120
3704929993327,4cyclictest335557-21systemd-journal12:00:132
3704921993330,2cyclictest3886686-21kworker/u8:0+events_unbound11:14:140
3704921993330,2cyclictest3792450-21kworker/u8:2+events_unbound08:45:150
3704921993330,2cyclictest3751049-21kworker/u8:0+events_unbound07:57:150
3704921993330,2cyclictest3715212-21kworker/u8:0+events_unbound07:30:240
3704921993329,3cyclictest3817623-21kworker/u8:0+events_unbound09:10:010
3704921993329,3cyclictest3817623-21kworker/u8:0+events_unbound09:10:010
3704921993229,2cyclictest644494-21kworker/u8:4+events_unbound07:39:120
3704921993229,2cyclictest3766522-21kworker/u8:1+events_unbound09:02:140
3704921993128,2cyclictest644494-21kworker/u8:4+events_unbound08:13:220
3704921993127,3cyclictest3839459-21kworker/u8:0+events_unbound09:23:330
3704921993127,3cyclictest3834098-21kworker/u8:2+events_unbound10:00:150
3704925993027,2cyclictest3963983-21kworker/u8:2+flush-259:011:55:001
3704925993027,2cyclictest3735811-21kworker/u8:2+flush-259:007:50:011
3704929992815,11cyclictest3828542-21latency_hist09:10:002
3704925992824,3cyclictest4031692-21gpgv12:25:011
3704921992824,3cyclictest509-21rs:main0
3704921992823,4cyclictest3931855-21ntpq10:45:180
3704921992821,5cyclictest3725492-21latency_hist07:30:010
3704931992723,3cyclictest3875749-21kworker/u8:3+flush-259:009:55:183
3704929992722,4cyclictest3984607-21kworker/u8:3+flush-259:012:15:012
3704929992718,8cyclictest3982120-21kthreadcore11:35:152
3704925992724,2cyclictest644494-21kworker/u8:4+flush-259:007:50:161
3704925992724,2cyclictest3834098-21kworker/u8:2+events_unbound09:17:141
3704925992724,2cyclictest3756401-21kworker/u8:2+events_unbound08:08:141
3704925992724,2cyclictest3715212-21kworker/u8:0+flush-259:007:40:011
3704921992724,2cyclictest644494-21kworker/u8:4+events_unbound08:33:260
3704931992623,2cyclictest4036620-21kworker/u8:4+events_unbound12:40:013
3704931992623,2cyclictest4031155-21gpgv12:25:003
3704931992620,4cyclictest335557-21systemd-journal07:51:133
3704929992621,4cyclictest3984607-21kworker/u8:3+flush-259:012:35:002
3704925992623,2cyclictest3751049-21kworker/u8:0+flush-259:008:00:231
3704921992623,2cyclictest4015687-21kworker/u8:1+events_unbound12:25:180
3704921992623,2cyclictest3984607-21kworker/u8:3+events_unbound11:46:130
3704921992623,2cyclictest3938139-21kworker/u8:1+events_unbound11:30:180
3704921992623,2cyclictest3766522-21kworker/u8:1+events_unbound08:15:150
3704921992621,2cyclictest3896733-21kworker/u8:2+events_unbound10:15:140
3704921992620,4cyclictest3907065-21latency_hist10:25:010
3704929992521,3cyclictest3766522-21kworker/u8:1+flush-259:009:00:002
3704925992522,2cyclictest3869750-21kworker/u8:1+events_unbound10:30:131
3704925992521,3cyclictest3886686-21kworker/u8:0+flush-259:010:23:441
3704925992520,4cyclictest3829061-21cat09:10:011
3704925992520,4cyclictest3829061-21cat09:10:011
3704921992522,2cyclictest3963983-21kworker/u8:2+events_unbound11:25:160
3704921992522,2cyclictest3963983-21kworker/u8:2+events_unbound11:25:150
3704921992522,2cyclictest3901592-21kworker/u8:4+events_unbound11:00:130
3704931992420,3cyclictest644494-21kworker/u8:4+flush-259:007:35:003
3704931992420,3cyclictest3984607-21kworker/u8:3+flush-259:011:44:063
3704931992420,3cyclictest3984607-21kworker/u8:3+events_unbound12:25:213
3704925992421,2cyclictest3901592-21kworker/u8:4+flush-259:010:25:251
3704925992421,2cyclictest3901592-21kworker/u8:4+events_unbound11:01:141
3704925992418,4cyclictest3897129-21diskstats10:15:121
3704921992422,2cyclictest4000434-21kworker/u8:0+events_unbound12:30:140
3704931992319,3cyclictest3869750-21kworker/u8:1+flush-259:009:50:253
3704931992319,3cyclictest3704895-21kworker/u8:1+events_unbound07:16:123
3704931992318,4cyclictest3886686-21kworker/u8:0+flush-259:011:35:003
3704931992318,4cyclictest335557-21systemd-journal08:42:123
3704931992317,4cyclictest3870152-21latency_hist09:50:023
370492999232,6cyclictest335557-21systemd-journal11:55:002
3704929992318,4cyclictest335557-21systemd-journal08:48:142
3704929992317,4cyclictest335557-21systemd-journal12:25:002
3704925992320,2cyclictest3869750-21kworker/u8:1+events_unbound09:50:021
3704925992320,2cyclictest3834098-21kworker/u8:2+events_unbound09:33:361
3704925992319,3cyclictest644494-21kworker/u8:4+events_unbound08:20:131
3704925992319,3cyclictest644494-21kworker/u8:4+events_unbound07:40:221
3704925992319,3cyclictest3766522-21kworker/u8:1+events_unbound08:43:141
3704921992320,2cyclictest3886686-21kworker/u8:0+events_unbound10:13:410
3704931992216,4cyclictest335557-21systemd-journal08:35:003
3704929992210,2cyclictest3776532-21unixbench_multi08:15:242
3704925992221,1cyclictest3869750-21kworker/u8:1+events_unbound10:35:141
3704925992219,2cyclictest3963983-21kworker/u8:2+events_unbound11:43:151
3704925992218,3cyclictest3869750-21kworker/u8:1+events_unbound10:14:131
3704921992219,2cyclictest3886686-21kworker/u8:0+events_unbound10:05:130
3704921992217,4cyclictest3995327-21apt-get11:50:110
3704931992118,2cyclictest3807934-21kworker/u8:3+events_unbound08:55:143
3704931992118,2cyclictest3766522-21kworker/u8:1+flush-259:008:23:243
3704931992116,4cyclictest3740928-21latency_hist07:45:013
3704931992114,5cyclictest335557-21systemd-journal09:10:003
370492999218,1cyclictest0-21swapper/208:30:152
3704929992117,3cyclictest509-21rs:main2
3704925992118,2cyclictest3984607-21kworker/u8:3+flush-259:012:05:211
3704925992118,2cyclictest3938139-21kworker/u8:1+flush-259:011:35:221
3704925992118,2cyclictest3927652-21kworker/u8:2+flush-259:010:55:251
3704925992118,2cyclictest3766522-21kworker/u8:1+events_unbound09:05:151
3704925992117,2cyclictest4031550-21gpgv12:25:011
3704925992116,4cyclictest335557-21systemd-journal09:01:131
3704921992118,2cyclictest644494-21kworker/u8:4+events_unbound08:36:150
370492199211,18cyclictest1-21systemd09:16:130
3704931992016,3cyclictest644494-21kworker/u8:4+events_unbound07:12:133
3704931992016,3cyclictest3984607-21kworker/u8:3+events_unbound12:06:153
3704931992015,3cyclictest335557-21systemd-journal12:20:013
3704931992014,4cyclictest335557-21systemd-journal10:05:133
370492999208,2cyclictest3907387-21cpuspeed_turbos10:25:132
3704929992016,2cyclictest0-21swapper/211:00:002
3704929992015,4cyclictest335557-21systemd-journal11:33:142
3704925992018,2cyclictest644494-21kworker/u8:4+events_unbound07:33:151
3704925992017,2cyclictest644494-21kworker/u8:4+flush-259:008:30:221
3704925992017,2cyclictest4036620-21kworker/u8:4+events_unbound12:35:001
3704925992017,2cyclictest3807934-21kworker/u8:3+flush-259:008:55:251
3704925992016,3cyclictest3968411-21ntp_kernel_pll_11:20:221
3704925992016,3cyclictest3901592-21kworker/u8:4+events_unbound10:40:201
3704925992015,4cyclictest3807934-21kworker/u8:3+events_unbound08:52:151
3704921992017,2cyclictest644494-21kworker/u8:4+events_unbound07:13:130
3704921992017,2cyclictest3735811-21kworker/u8:2+events_unbound07:45:250
3704931991916,2cyclictest3834098-21kworker/u8:2+flush-259:009:35:173
3704931991916,2cyclictest0-21swapper/310:55:003
370492999197,3cyclictest0-21swapper/207:35:012
3704925991917,2cyclictest3901592-21kworker/u8:4+events_unbound10:48:521
3704925991916,3cyclictest3963983-21kworker/u8:2+events_unbound11:25:131
3704925991916,3cyclictest3963983-21kworker/u8:2+events_unbound11:25:131
3704925991916,3cyclictest3766522-21kworker/u8:1+events_unbound09:22:151
3704925991915,3cyclictest3984607-21kworker/u8:3+events_unbound12:14:151
3704925991915,2cyclictest644494-21kworker/u8:4+flush-259:007:55:251
3704921991915,3cyclictest3839459-21kworker/u8:0+events_unbound09:45:280
3704931991815,2cyclictest644494-21kworker/u8:4+flush-259:008:40:003
3704931991815,2cyclictest3896733-21kworker/u8:2+flush-259:010:15:233
3704931991815,2cyclictest3869750-21kworker/u8:1+events_unbound10:35:193
3704931991814,3cyclictest3807934-21kworker/u8:3+events_unbound09:15:153
370492999187,1cyclictest0-21swapper/207:10:012
3704929991813,3cyclictest3954076-21/usr/sbin/munin11:10:132
3704929991812,5cyclictest3807934-21kworker/u8:3+flush-259:008:50:162
3704929991812,4cyclictest3953417-21latency_hist11:10:002
3704925991815,2cyclictest3948920-21irqcore11:05:171
3704925991814,3cyclictest4000434-21kworker/u8:0+events_unbound12:18:141
3704925991814,3cyclictest3963983-21kworker/u8:2+events_unbound12:04:141
3704925991814,3cyclictest3938139-21kworker/u8:1+events_unbound11:16:151
3704921991815,2cyclictest3901592-21kworker/u8:4+events_unbound11:08:570
3704921991815,2cyclictest3834098-21kworker/u8:2+events_unbound09:35:270
3704921991815,2cyclictest3766522-21kworker/u8:1+events_unbound08:20:060
3704921991815,2cyclictest3751049-21kworker/u8:0+events_unbound08:09:430
3704921991814,3cyclictest3901592-21kworker/u8:4+events_unbound10:26:150
3704921991812,5cyclictest4031134-21apt-get12:25:010
3704931991713,3cyclictest3963983-21kworker/u8:2+flush-259:011:25:003
370492999171,6cyclictest3761537-21awk08:05:012
3704929991712,3cyclictest3922733-21apt-get10:40:112
3704925991714,2cyclictest3875749-21kworker/u8:3+events_unbound10:08:151
3704925991714,2cyclictest3766522-21kworker/u8:1+events_unbound08:38:251
3704925991714,2cyclictest3715212-21kworker/u8:0+events_unbound07:22:121
3704925991713,3cyclictest644494-21kworker/u8:4+flush-259:008:10:211
3704925991712,3cyclictest3710267-21/usr/sbin/munin07:15:211
3704925991712,3cyclictest3704895-21kworker/u8:1+events_unbound07:10:171
3704921991714,2cyclictest60350irq/132-enp0s29f1:rx-007:22:050
3704921991714,2cyclictest60350irq/132-enp0s29f1:rx-007:18:090
3704921991714,2cyclictest3901592-21kworker/u8:4+events_unbound10:53:520
3704921991714,2cyclictest3869750-21kworker/u8:1+events_unbound10:35:300
3704931991614,1cyclictest3807899-21cron08:50:003
3704931991614,1cyclictest0-21swapper/311:05:003
3704931991614,1cyclictest0-21swapper/308:00:013
3704931991613,2cyclictest3901592-21kworker/u8:4+flush-259:010:25:233
3704931991613,2cyclictest3886686-21kworker/u8:0+flush-259:011:05:193
3704931991613,2cyclictest3839459-21kworker/u8:0+events_unbound09:20:223
3704931991613,2cyclictest3807934-21kworker/u8:3+events_unbound08:50:243
3704931991613,2cyclictest3742215-21kthreadcore07:45:173
3704931991612,3cyclictest3984607-21kworker/u8:3+events_unbound11:54:133
3704931991612,3cyclictest3901592-21kworker/u8:4+events_unbound10:45:223
3704929991613,2cyclictest4025939-21cron12:20:002
3704925991614,1cyclictest3886686-21kworker/u8:0+events_unbound10:51:161
3704921991614,1cyclictest60350irq/132-enp0s29f1:rx-012:10:140
3704921991614,1cyclictest60350irq/132-enp0s29f1:rx-007:54:490
3704921991613,2cyclictest3989886-21kworker/u8:4+events_unbound11:55:270
3704921991613,2cyclictest3963983-21kworker/u8:2+events_unbound11:40:260
3704921991613,2cyclictest3834098-21kworker/u8:2+events_unbound09:33:140
3704921991613,2cyclictest3807934-21kworker/u8:3+events_unbound08:54:160
3704921991611,2cyclictest4000434-21kworker/u8:0+events_unbound12:16:380
3704931991513,2cyclictest3715212-21kworker/u8:0+events_unbound07:35:143
3704931991512,2cyclictest644494-21kworker/u8:4+events_unbound08:10:153
3704931991512,2cyclictest3886686-21kworker/u8:0+flush-259:010:10:203
3704931991512,2cyclictest3751049-21kworker/u8:0+events_unbound08:00:173
3704931991511,3cyclictest3886686-21kworker/u8:0+events_unbound11:11:163
3704925991512,2cyclictest644494-21kworker/u8:4+flush-259:008:25:111
3704925991511,3cyclictest3938139-21kworker/u8:1+events_unbound11:30:121
3704925991511,3cyclictest3839459-21kworker/u8:0+events_unbound09:45:181
3704925991510,0cyclictest0-21swapper/108:50:001
3704921991513,1cyclictest60350irq/132-enp0s29f1:rx-009:50:110
3704921991513,1cyclictest60350irq/132-enp0s29f1:rx-008:28:150
3704921991512,2cyclictest60350irq/132-enp0s29f1:rx-008:59:010
3704921991511,1cyclictest60350irq/132-enp0s29f1:rx-010:30:240
3704931991411,2cyclictest4000434-21kworker/u8:0+events_unbound12:00:173
3704931991410,3cyclictest644494-21kworker/u8:4+events_unbound08:05:263
370492999149,3cyclictest3886033-21apt-get10:05:022
370492999148,4cyclictest3964144-21latency_hist11:20:002
3704929991412,1cyclictest0-21swapper/207:25:192
3704929991411,2cyclictest3902409-21gltestperf10:20:142
3704925991410,3cyclictest3869750-21kworker/u8:1+flush-259:009:57:231
370492199143,3cyclictest171ktimers/011:35:190
3704921991412,1cyclictest60350irq/132-enp0s29f1:rx-008:41:500
370493199139,3cyclictest3963983-21kworker/u8:2+events_unbound11:25:213
370493199139,3cyclictest3963983-21kworker/u8:2+events_unbound11:25:213
370493199139,3cyclictest3927652-21kworker/u8:2+flush-259:010:55:173
370493199139,3cyclictest3839459-21kworker/u8:0+events_unbound09:40:193
370493199139,3cyclictest3839459-21kworker/u8:0+events_unbound09:25:243
370493199139,3cyclictest3766522-21kworker/u8:1+events_unbound09:00:183
3704931991310,3cyclictest644494-21kworker/u8:4+events_unbound08:25:133
3704931991310,2cyclictest3983833-21ntp_kernel_pll_11:35:193
3704931991310,2cyclictest3776583-21unixbench_singl08:15:253
370492999138,3cyclictest507-21in:imuxsock08:15:002
370492999137,4cyclictest335557-21systemd-journal08:00:002
3704929991311,1cyclictest0-21swapper/209:35:192
3704929991310,2cyclictest3734864-21ntp_kernel_err07:35:202
3704925991310,2cyclictest4000434-21kworker/u8:0+flush-259:012:35:181
3704925991310,2cyclictest3839459-21kworker/u8:0+flush-259:009:25:151
3704925991310,1cyclictest0-21swapper/110:05:001
370493199129,3cyclictest3869750-21kworker/u8:1+events_unbound10:33:473
370493199129,2cyclictest3984607-21kworker/u8:3+flush-259:012:10:153
370493199129,2cyclictest3963983-21kworker/u8:2+flush-259:011:55:153
370492999129,2cyclictest3969646-21cpuspeed_turbos11:25:122
370492999129,2cyclictest3969646-21cpuspeed_turbos11:25:122
370492999129,2cyclictest3844005-21unixbench_singl09:20:242
370492999128,3cyclictest3901592-21kworker/u8:4+flush-259:011:04:432
370492999128,2cyclictest3712580-21sed07:15:182
370492999125,5cyclictest3764371-21cut08:05:182
370492999125,5cyclictest335557-21systemd-journal11:25:012
3704929991210,1cyclictest0-21swapper/209:10:192
3704929991210,1cyclictest0-21swapper/209:10:192
370492999120,4cyclictest38998832cut10:15:162
370492599129,2cyclictest644494-21kworker/u8:4+flush-259:007:25:261
370492599129,2cyclictest3958983-21basename11:15:001
370492599127,4cyclictest4000469-21apt-get11:55:131
370493199118,2cyclictest644494-21kworker/u8:4+events_unbound07:20:133
370493199118,2cyclictest3963705-21unixbench_singl11:15:253
370493199118,2cyclictest3901592-21kworker/u8:4+events_unbound10:20:143
370493199117,3cyclictest3886686-21kworker/u8:0+events_unbound10:40:273
370492999118,2cyclictest3930175-21kthreadcore10:45:162
370492999118,2cyclictest3917717-21cpuspeed_turbos10:35:112
370492999118,2cyclictest3705535-21irqcore07:10:172
370492999116,4cyclictest335557-21systemd-journal07:50:012
370492999116,3cyclictest3870195-21unin-run09:50:002
370492999115,4cyclictest335557-21systemd-journal11:44:132
370492599118,2cyclictest3860209-21cpuspeed_turbos09:40:131
370493199108,1cyclictest3886045-21idleruntime-cro10:05:003
370493199108,1cyclictest0-21swapper/307:25:173
370492999108,1cyclictest3746778-21tr07:50:162
370492999105,3cyclictest3820790-21grep09:00:192
370492999101,7cyclictest3782163-21awk08:25:002
370492999101,6cyclictest2109693-21snmpd09:40:132
37049319997,1cyclictest0-21swapper/311:45:143
37049319995,3cyclictest3830052-21cut09:10:143
37049319995,3cyclictest3830052-21cut09:10:143
37049299991,5cyclictest3937899-21idleruntime-cro10:55:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional