You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 18:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Apr 10, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3995359994743,3cyclictest118295-21kworker/u8:0+flush-259:012:15:152
3995360994338,4cyclictest3937398-21kworker/u8:3+flush-259:007:45:153
3995355994338,3cyclictest4094254-21apt-get08:45:120
3995355994237,4cyclictest509-21rs:main0
3995356994137,3cyclictest4193591-21kworker/u8:2+flush-259:010:30:201
3995355994135,4cyclictest252-21systemd-journal07:25:010
3995360993732,4cyclictest4057511-21apt-get08:10:003
3995359993731,4cyclictest56209-21latency_hist11:15:002
3995359993731,4cyclictest102958-21latency_hist12:00:012
3995355993731,4cyclictest252-21systemd-journal07:35:000
3995356993532,2cyclictest4042024-21kworker/u8:2+events_unbound08:00:211
3995355993532,2cyclictest4125442-21kworker/u8:1+flush-259:009:15:210
3995359993430,3cyclictest4078573-21kworker/u8:1+flush-259:008:40:002
3995359993429,3cyclictest139334-21/usr/sbin/munin12:35:142
3995359993427,5cyclictest252-21systemd-journal07:55:002
3995356993427,5cyclictest66908-21latency_hist11:25:011
3995355993430,3cyclictest4005355-21kworker/u8:1+flush-259:007:50:220
3995359993327,4cyclictest4031840-21kworker/u8:0+flush-259:007:55:182
3995356993327,4cyclictest4109880-21latency_hist09:00:001
3995355993330,2cyclictest4172502-21kworker/u8:3+events_unbound10:49:590
3995355993228,3cyclictest4125441-21kworker/u8:0+flush-259:009:25:210
3995360993125,4cyclictest45881-21latency_hist11:05:013
3995356993128,2cyclictest56237-21kworker/u8:1+flush-259:011:35:241
3995356993128,2cyclictest56237-21kworker/u8:1+flush-259:011:35:231
3995356993128,2cyclictest4140950-21kworker/u8:4+flush-259:009:45:211
3995355993127,3cyclictest4140950-21kworker/u8:4+events_unbound09:35:010
3995360993024,4cyclictest118449-21latency_hist12:15:013
3995359993024,5cyclictest76296-21ntpq11:30:192
3995359993024,4cyclictest4135771-21latency_hist09:25:012
3995356993027,2cyclictest35786-21kworker/u8:4+events_unbound11:25:241
3995356993025,4cyclictest4083951-21apt-get08:35:111
3995355992926,2cyclictest4193591-21kworker/u8:2+flush-259:010:30:200
3995360992822,5cyclictest56211-21apt-get11:15:003
3995356992824,3cyclictest4088874-21kworker/u8:3+flush-259:009:20:221
3995355992825,2cyclictest56237-21kworker/u8:1+flush-259:011:55:000
3995355992825,2cyclictest35786-21kworker/u8:4+flush-259:011:05:310
3995359992720,5cyclictest24380-21ntpq10:40:202
3995355992724,2cyclictest4125441-21kworker/u8:0+flush-259:009:50:180
3995355992720,5cyclictest107223-21ntpq12:00:180
3995356992623,2cyclictest4115048-21kworker/u8:6+flush-259:009:15:001
3995356992623,2cyclictest35786-21kworker/u8:4+flush-259:011:30:231
3995356992623,2cyclictest25271-21kworker/u8:1+flush-259:011:00:201
3995356992622,3cyclictest4094219-21kworker/u8:2+flush-259:009:00:161
3995355992623,2cyclictest96931-21kworker/u8:0+events_unbound11:55:190
3995355992623,2cyclictest4094219-21kworker/u8:2+events_unbound09:10:000
3995355992623,2cyclictest4078573-21kworker/u8:1+flush-259:008:35:230
3995355992623,2cyclictest4005355-21kworker/u8:1+flush-259:008:05:230
3995360992521,3cyclictest45898-21kworker/u8:0+flush-259:011:20:213
3995360992519,4cyclictest252-21systemd-journal11:54:593
3995360992518,5cyclictest98191-21diskstats11:55:113
3995359992521,3cyclictest4005355-21kworker/u8:1+flush-259:007:20:002
3995359992519,4cyclictest4093131-21ntpq08:40:202
3995359992518,5cyclictest4016613-21apt-get07:30:092
3995356992522,2cyclictest3937398-21kworker/u8:3+events_unbound07:25:241
3995356992521,3cyclictest4042024-21kworker/u8:2+flush-259:008:20:211
3995356992519,4cyclictest4031823-21latency_hist07:45:011
3995355992522,2cyclictest4172502-21kworker/u8:3+events_unbound10:15:150
3995355992522,2cyclictest25271-21kworker/u8:1+events_unbound11:00:250
3995355992522,2cyclictest102575-21kworker/u8:4+events_unbound12:10:210
3995355992521,3cyclictest4193786-21diskstats10:20:130
3995355992518,5cyclictest4187375-21ntpq10:10:200
3995360992414,8cyclictest4172502-21kworker/u8:3+flush-259:010:20:103
3995359992420,3cyclictest4042024-21kworker/u8:2+events_unbound08:15:222
3995359992420,3cyclictest25271-21kworker/u8:1+flush-259:010:45:012
3995359992419,3cyclictest4172502-21kworker/u8:3+flush-259:010:35:012
3995356992420,3cyclictest4140950-21kworker/u8:4+flush-259:010:15:171
3995356992419,3cyclictest252-21systemd-journal09:30:161
3995355992421,2cyclictest4068266-21kworker/u8:0+flush-259:008:30:180
3995355992421,2cyclictest4042024-21kworker/u8:2+events_unbound08:25:190
3995355992420,3cyclictest4042024-21kworker/u8:2+events_unbound08:00:230
3995359992320,2cyclictest4120238-21cron09:10:002
3995359992318,4cyclictest4099414-21apt-get08:50:112
3995356992320,2cyclictest56322-21gpgv11:15:001
3995356992320,2cyclictest4125441-21kworker/u8:0+events_unbound09:35:181
3995356992320,2cyclictest4042024-21kworker/u8:2+events_unbound08:19:541
3995356992320,2cyclictest35786-21kworker/u8:4+flush-259:011:05:211
3995356992319,3cyclictest4172502-21kworker/u8:3+events_unbound10:25:231
3995356992319,3cyclictest102575-21kworker/u8:4+events_unbound11:56:161
3995356992317,4cyclictest252-21systemd-journal12:35:011
3995355992320,2cyclictest4125441-21kworker/u8:0+flush-259:010:00:200
3995360992219,2cyclictest4058084-21gpgv08:10:023
3995360992216,4cyclictest4140934-21latency_hist09:30:003
3995359992218,3cyclictest4172502-21kworker/u8:3+flush-259:010:15:212
3995359992217,3cyclictest4151530-21kworker/u8:1+flush-259:009:55:162
3995356992219,2cyclictest108325-21kworker/u8:3+flush-259:012:20:231
3995356992219,2cyclictest108325-21kworker/u8:3+events_unbound12:25:261
3995356992218,3cyclictest66762-21kworker/u8:2+events_unbound12:00:171
3995356992218,3cyclictest4172502-21kworker/u8:3+events_unbound10:45:131
3995356992218,3cyclictest4151530-21kworker/u8:1+events_unbound09:55:221
3995355992219,2cyclictest3936478-21kworker/u8:0+events_unbound07:10:250
3995355992216,5cyclictest112406-21ntpq12:05:190
3995360992118,2cyclictest509-21rs:main3
3995360992118,2cyclictest4151530-21kworker/u8:1+flush-259:009:40:013
3995360992117,3cyclictest4172502-21kworker/u8:3+flush-259:010:40:163
3995360992116,4cyclictest4183044-21latency_hist10:10:013
3995360992116,3cyclictest252-21systemd-journal08:26:153
3995360992115,4cyclictest108325-21kworker/u8:3+flush-259:012:25:183
3995359992117,3cyclictest87507-21kworker/u8:3+flush-259:011:50:162
3995359992117,3cyclictest4094219-21kworker/u8:2+events_unbound09:15:232
3995359992117,3cyclictest108325-21kworker/u8:3+flush-259:012:30:192
3995359992114,5cyclictest252-21systemd-journal10:10:002
3995356992118,2cyclictest4109900-21kworker/u8:4+events_unbound09:08:151
3995356992118,2cyclictest4005355-21kworker/u8:1+flush-259:007:40:011
3995356992117,3cyclictest118295-21kworker/u8:0+flush-259:012:20:001
3995356992117,2cyclictest4005355-21kworker/u8:1+flush-259:007:51:211
3995355992118,2cyclictest9820-21kworker/u8:1+events_unbound10:36:160
3995355992118,2cyclictest4172502-21kworker/u8:3+flush-259:010:25:220
3995355992118,2cyclictest4172502-21kworker/u8:3+events_unbound10:42:170
3995355992118,2cyclictest4088874-21kworker/u8:3+flush-259:009:20:200
3995355992118,2cyclictest4057563-21kworker/u8:3+events_unbound08:10:200
3995355992117,3cyclictest66762-21kworker/u8:2+events_unbound11:26:170
3995355992117,3cyclictest3937398-21kworker/u8:3+events_unbound07:45:220
3995360992014,4cyclictest4104292-21latency_hist08:55:013
3995360992013,5cyclictest56827-21cat11:15:013
3995359992016,3cyclictest87507-21kworker/u8:3+flush-259:011:45:202
3995359992016,3cyclictest56237-21kworker/u8:1+flush-259:011:35:202
3995359992016,3cyclictest56237-21kworker/u8:1+flush-259:011:35:202
3995359992015,4cyclictest19992-21apt-get10:39:152
3995359992014,4cyclictest509-21rs:main2
3995359992014,4cyclictest4172517-21/usr/sbin/munin10:00:142
3995356992017,3cyclictest4005355-21kworker/u8:1+events_unbound07:32:161
3995356992017,2cyclictest4088874-21kworker/u8:3+flush-259:009:20:011
3995356992016,3cyclictest4068266-21kworker/u8:0+flush-259:008:30:121
3995355992018,2cyclictest56237-21kworker/u8:1+events_unbound11:44:160
3995355992018,2cyclictest56237-21kworker/u8:1+events_unbound11:44:160
3995355992018,2cyclictest4088874-21kworker/u8:3+events_unbound08:55:170
3995355992017,2cyclictest77442-21kworker/u8:0+flush-259:011:35:160
3995355992017,2cyclictest77442-21kworker/u8:0+flush-259:011:35:150
3995355992017,2cyclictest108325-21kworker/u8:3+flush-259:012:35:000
3995360991915,3cyclictest4042024-21kworker/u8:2+flush-259:008:20:163
3995360991913,4cyclictest4188640-21diskstats10:15:123
3995359991916,2cyclictest25271-21kworker/u8:1+flush-259:010:50:192
3995359991915,3cyclictest25271-21kworker/u8:1+flush-259:011:00:192
3995356991916,2cyclictest66762-21kworker/u8:2+flush-259:011:45:221
3995356991916,2cyclictest4078573-21kworker/u8:1+flush-259:008:29:591
3995356991915,3cyclictest77442-21kworker/u8:0+events_unbound11:40:361
3995356991915,3cyclictest77442-21kworker/u8:0+events_unbound11:40:361
3995356991915,3cyclictest4172502-21kworker/u8:3+events_unbound10:05:221
3995356991915,3cyclictest108325-21kworker/u8:3+events_unbound12:36:171
3995356991914,4cyclictest4177440-21apt-get10:05:011
3995356991913,4cyclictest4042339-21/usr/sbin/munin07:55:141
3995355991916,3cyclictest108325-21kworker/u8:3+events_unbound12:20:450
3995355991916,2cyclictest4104552-21latency_hist08:55:000
3995355991916,2cyclictest4042024-21kworker/u8:2+flush-259:008:20:250
3995355991914,4cyclictest56892-21apt-get11:15:110
3995360991815,2cyclictest4151530-21kworker/u8:1+flush-259:009:59:553
3995360991814,3cyclictest4094219-21kworker/u8:2+flush-259:009:00:253
3995359991815,2cyclictest66762-21kworker/u8:2+events_unbound11:25:152
3995359991814,3cyclictest4094219-21kworker/u8:2+flush-259:009:00:202
3995359991814,3cyclictest25271-21kworker/u8:1+events_unbound10:55:252
3995359991813,3cyclictest252-21systemd-journal08:05:002
399535999180,17cyclictest1-21systemd08:15:002
3995356991814,3cyclictest4125441-21kworker/u8:0+events_unbound10:23:151
3995356991814,3cyclictest102575-21kworker/u8:4+events_unbound12:10:181
3995356991814,2cyclictest0-21swapper/107:10:001
3995355991814,3cyclictest3937398-21kworker/u8:3+events_unbound07:27:150
3995360991713,3cyclictest4140950-21kworker/u8:4+flush-259:009:45:163
3995360991713,3cyclictest129002-21kworker/u8:4+flush-259:012:36:503
3995359991714,2cyclictest56237-21kworker/u8:1+events_unbound12:05:222
3995359991714,2cyclictest4125441-21kworker/u8:0+flush-259:009:30:202
3995359991713,3cyclictest4193591-21kworker/u8:2+flush-259:010:25:172
3995359991713,3cyclictest4125441-21kworker/u8:0+events_unbound09:35:202
3995359991713,3cyclictest4068266-21kworker/u8:0+events_unbound08:30:192
3995359991713,3cyclictest35786-21kworker/u8:4+flush-259:011:05:152
3995359991712,4cyclictest4172502-21kworker/u8:3+flush-259:010:10:232
3995359991712,4cyclictest4011194-21kworker/u8:0+flush-259:007:25:172
3995356991714,2cyclictest87507-21kworker/u8:3+events_unbound11:53:161
3995356991714,2cyclictest4125441-21kworker/u8:0+flush-259:009:40:211
3995356991714,2cyclictest3937398-21kworker/u8:3+events_unbound07:45:121
3995356991713,3cyclictest4068266-21kworker/u8:0+events_unbound08:53:161
3995356991713,3cyclictest4057563-21kworker/u8:3+events_unbound08:10:181
3995356991713,3cyclictest35786-21kworker/u8:4+events_unbound11:19:161
3995355991714,3cyclictest35786-21kworker/u8:4+events_unbound11:10:250
3995355991714,2cyclictest4042024-21kworker/u8:2+events_unbound08:16:170
3995355991714,2cyclictest4005355-21kworker/u8:1+events_unbound07:55:250
3995355991714,2cyclictest108325-21kworker/u8:3+events_unbound12:36:030
3995355991713,3cyclictest4146811-21apt-get09:35:110
3995355991713,3cyclictest4068266-21kworker/u8:0+events_unbound08:40:160
3995355991713,3cyclictest4021776-21apt-get07:35:120
3995355991713,1cyclictest60350irq/132-enp0s29f1:rx-009:00:150
3995360991614,1cyclictest0-21swapper/310:05:013
3995360991613,2cyclictest4172502-21kworker/u8:3+flush-259:010:33:463
3995359991613,2cyclictest83023-21irqcore11:40:152
3995359991613,2cyclictest83023-21irqcore11:40:152
3995359991613,2cyclictest500-21systemd-logind09:55:002
399535999161,13cyclictest4645-21munin-run10:25:002
3995356991613,2cyclictest4068266-21kworker/u8:0+events_unbound08:40:141
3995356991613,2cyclictest25271-21kworker/u8:1+events_unbound10:55:231
3995356991612,3cyclictest4088874-21kworker/u8:3+flush-259:009:25:051
3995356991612,3cyclictest20031-21kworker/u8:0+flush-259:010:44:561
3995355991614,1cyclictest0-21swapper/012:29:590
3995355991613,2cyclictest87507-21kworker/u8:3+events_unbound11:45:210
3995355991613,2cyclictest45898-21kworker/u8:0+events_unbound11:20:170
3995355991612,3cyclictest4000177-21kworker/u8:2+flush-259:007:15:160
3995355991611,4cyclictest4005355-21kworker/u8:1+flush-259:007:40:050
3995360991510,3cyclictest4037225-21apt-get07:50:113
3995359991512,2cyclictest66762-21kworker/u8:2+flush-259:012:00:192
3995359991511,3cyclictest4140950-21kworker/u8:4+flush-259:009:50:012
3995359991511,3cyclictest108325-21kworker/u8:3+flush-259:012:25:252
399535699159,4cyclictest4000476-21latency_hist07:15:011
3995356991512,2cyclictest4005355-21kworker/u8:1+flush-259:008:08:211
3995356991512,2cyclictest102575-21kworker/u8:4+events_unbound12:05:201
3995355991514,1cyclictest60350irq/132-enp0s29f1:rx-009:49:390
3995355991513,1cyclictest60350irq/132-enp0s29f1:rx-010:05:210
3995355991512,2cyclictest60350irq/132-enp0s29f1:rx-009:10:100
3995355991511,3cyclictest30646-21kworker/u8:2+flush-259:010:50:170
3995355991511,3cyclictest25271-21kworker/u8:1+flush-259:010:55:190
3995355991511,2cyclictest0-21swapper/012:15:150
399536099149,4cyclictest252-21systemd-journal08:00:143
3995360991411,2cyclictest4193591-21kworker/u8:2+flush-259:010:38:453
3995360991411,2cyclictest4125441-21kworker/u8:0+flush-259:009:50:213
3995360991411,2cyclictest4087981-21ntp_kernel_pll_08:35:223
3995360991410,3cyclictest4068266-21kworker/u8:0+flush-259:008:34:593
399536099140,13cyclictest1-21systemd11:33:143
399535999149,4cyclictest4125419-21latency_hist09:15:002
3995359991412,1cyclictest118426-21cron12:15:002
3995359991411,2cyclictest4000177-21kworker/u8:2+events_unbound07:20:202
3995359991411,2cyclictest108325-21kworker/u8:3+flush-259:012:20:182
3995359991410,3cyclictest3937398-21kworker/u8:3+flush-259:007:45:212
399535699149,3cyclictest4005646-21gpgv07:20:001
3995356991412,2cyclictest9820-21kworker/u8:1+events_unbound10:35:151
3995356991411,2cyclictest4000177-21kworker/u8:2+flush-259:007:20:211
3995356991410,3cyclictest4140950-21kworker/u8:4+flush-259:010:12:521
3995356991410,3cyclictest4094219-21kworker/u8:2+events_unbound08:45:251
3995355991412,1cyclictest60350irq/132-enp0s29f1:rx-011:30:180
399536099139,3cyclictest4187735-21unixbench_multi10:10:223
399536099139,3cyclictest4068266-21kworker/u8:0+flush-259:008:40:183
399536099138,3cyclictest3936478-21kworker/u8:0+flush-259:007:10:243
3995360991310,2cyclictest500-21systemd-logind07:35:003
399535999139,3cyclictest4152016-21cpuspeed_turbos09:40:112
3995359991310,2cyclictest4069512-21kthreadcore08:20:182
3995359991310,2cyclictest4005355-21kworker/u8:1+flush-259:007:39:452
399535699139,3cyclictest25271-21kworker/u8:1+events_unbound10:54:571
399536099129,2cyclictest4026181-21unixbench_multi07:35:243
399536099129,2cyclictest25935-21irqcore10:45:163
399536099129,1cyclictest0-21swapper/309:10:233
399536099121,9cyclictest4146109-21awk09:35:003
3995360991210,1cyclictest4010245-21needreboot07:20:193
399535999128,3cyclictest45898-21kworker/u8:0+flush-259:011:20:222
399535999128,3cyclictest45898-21kworker/u8:0+flush-259:011:15:232
3995359991210,1cyclictest0-21swapper/208:10:012
399536099119,1cyclictest46266-21cpuspeed_turbos11:05:123
399536099119,1cyclictest0-21swapper/308:19:593
399536099118,2cyclictest87819-21cpuspeed_turbos11:45:133
399536099118,2cyclictest107681-21unixbench_singl12:00:223
399536099118,2cyclictest0-21swapper/312:25:003
399536099117,3cyclictest4031840-21kworker/u8:0+flush-259:007:55:183
399536099115,4cyclictest513-21gdbus11:30:003
399535999119,1cyclictest0-21swapper/208:45:162
399535999117,3cyclictest3937398-21kworker/u8:3+events_unbound07:40:222
399535999115,4cyclictest252-21systemd-journal09:29:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional