You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 20:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 21, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3978424995956,2cyclictest3978407-21kworker/u8:0+flush-259:007:30:010
3978424995956,2cyclictest3978407-21kworker/u8:0+flush-259:007:30:000
3978424994743,3cyclictest4134151-21kworker/u8:2+events_unbound10:40:010
3978424994642,2cyclictest1-21systemd11:25:000
3978434994542,2cyclictest4176914-21kworker/u8:4+flush-259:010:25:233
3978424994340,2cyclictest4134151-21kworker/u8:2+flush-259:011:10:000
3978424994338,3cyclictest335557-21systemd-journal08:50:000
3978426994236,4cyclictest335557-21systemd-journal12:05:001
3978434994036,3cyclictest34631-21kworker/u8:0+flush-259:011:35:013
3978434993833,3cyclictest118248-21/usr/sbin/munin12:30:153
3978429993831,5cyclictest4128942-21latency_hist09:35:012
3978426993833,3cyclictest4176914-21kworker/u8:4+flush-259:010:25:151
3978424993834,3cyclictest76288-21kworker/u8:4+flush-259:012:00:200
3978434993734,2cyclictest3993873-21kworker/u8:1+events_unbound07:40:243
3978429993730,5cyclictest97326-21latency_hist12:10:002
3978426993733,3cyclictest3993873-21kworker/u8:1+flush-259:007:40:011
3978426993732,3cyclictest65776-21kworker/u8:1+flush-259:011:40:001
3978426993730,5cyclictest4154774-21apt-get10:00:011
3978434993633,2cyclictest4134151-21kworker/u8:2+flush-259:011:25:003
3978434993532,2cyclictest92159-21kworker/u8:1+flush-259:012:15:153
3978434993532,2cyclictest4087901-21kworker/u8:2+flush-259:009:10:233
3978434993531,3cyclictest34631-21kworker/u8:0+events_unbound12:09:233
3978426993531,3cyclictest4128557-21kworker/u8:0+events_unbound09:45:011
3978426993530,3cyclictest3999247-21/usr/sbin/munin07:30:231
3978426993529,5cyclictest335557-21systemd-journal10:35:001
3978424993532,2cyclictest4128557-21kworker/u8:0+events_unbound10:40:230
3978424993532,2cyclictest4128557-21kworker/u8:0+events_unbound09:40:220
3978424993532,2cyclictest4087901-21kworker/u8:2+events_unbound09:15:000
3978424993532,2cyclictest3944333-21kworker/u8:4+flush-259:007:45:000
3978424993531,3cyclictest4076992-21kworker/u8:1+flush-259:008:50:010
3978434993431,2cyclictest3993873-21kworker/u8:1+flush-259:008:10:013
3978434993430,3cyclictest4134151-21kworker/u8:2+events_unbound10:34:423
3978434993430,3cyclictest4118853-21kworker/u8:1+events_unbound10:09:223
3978434993430,3cyclictest1926144-21kworker/u8:2+events_unbound07:15:233
3978429993428,4cyclictest335557-21systemd-journal11:12:222
3978424993431,2cyclictest39853-21kworker/u8:3+events_unbound11:25:220
3978424993430,3cyclictest4134151-21kworker/u8:2+flush-259:010:05:000
3978434993330,2cyclictest39853-21kworker/u8:3+flush-259:011:25:213
3978434993329,3cyclictest4051504-21kworker/u8:4+flush-259:009:25:003
3978424993330,2cyclictest4128557-21kworker/u8:0+events_unbound09:50:230
3978424993330,2cyclictest4003901-21kworker/u8:2+events_unbound07:35:150
3978424993329,3cyclictest4015130-21kworker/u8:3+events_unbound08:03:220
3978434993229,2cyclictest3993873-21kworker/u8:1+flush-259:008:10:213
3978429993227,3cyclictest4134151-21kworker/u8:2+events_unbound11:05:232
3978429993227,3cyclictest34631-21kworker/u8:0+flush-259:012:10:242
3978429993226,4cyclictest4113907-21diskstats09:20:122
3978426993229,2cyclictest4015130-21kworker/u8:3+events_unbound07:50:241
3978426993228,3cyclictest4015130-21kworker/u8:3+flush-259:008:25:201
3978426993228,3cyclictest3978407-21kworker/u8:0+events_unbound07:29:241
3978426993228,3cyclictest3978407-21kworker/u8:0+events_unbound07:29:241
3978426993226,4cyclictest4077382-21latency_hist08:45:011
3978424993229,2cyclictest4134151-21kworker/u8:2+events_unbound11:00:200
3978424993229,2cyclictest4031045-21kworker/u8:0+events_unbound08:25:230
3978424993228,3cyclictest4118853-21kworker/u8:1+flush-259:009:30:000
3978434993127,3cyclictest4134151-21kworker/u8:2+events_unbound11:04:503
3978426993128,2cyclictest4118853-21kworker/u8:1+flush-259:009:39:321
3978426993124,5cyclictest4067034-21latency_hist08:35:011
3978424993128,2cyclictest4128557-21kworker/u8:0+flush-259:010:30:160
3978424993128,2cyclictest39853-21kworker/u8:3+events_unbound11:45:220
3978424993128,2cyclictest34631-21kworker/u8:0+events_unbound11:35:110
3978426993027,2cyclictest4051504-21kworker/u8:4+events_unbound09:00:261
3978426993026,3cyclictest4118853-21kworker/u8:1+events_unbound09:58:231
3978426993026,3cyclictest4098207-21kworker/u8:3+events_unbound09:19:291
3978426993026,3cyclictest123186-21kworker/u8:0+flush-259:012:40:001
3978424993027,2cyclictest4134151-21kworker/u8:2+flush-259:011:14:530
3978424993027,2cyclictest39853-21kworker/u8:3+flush-259:012:15:200
3978434992926,3cyclictest4118853-21kworker/u8:1+events_unbound09:29:313
3978434992926,2cyclictest92380-21kworker/u8:2+flush-259:012:25:253
3978434992926,2cyclictest92159-21kworker/u8:1+events_unbound12:22:233
3978434992926,2cyclictest4134151-21kworker/u8:2+flush-259:010:25:003
3978434992926,2cyclictest102516-21kworker/u8:4+flush-259:012:35:213
3978434992925,3cyclictest4118853-21kworker/u8:1+events_unbound10:17:243
3978424992926,2cyclictest76288-21kworker/u8:4+flush-259:011:55:200
3978424992926,2cyclictest4128557-21kworker/u8:0+events_unbound10:10:230
3978424992926,2cyclictest4098207-21kworker/u8:3+flush-259:009:15:140
3978424992926,2cyclictest39853-21kworker/u8:3+flush-259:012:05:160
3978434992824,3cyclictest4134151-21kworker/u8:2+flush-259:009:45:263
3978426992825,2cyclictest92159-21kworker/u8:1+events_unbound12:20:231
3978424992825,2cyclictest4134151-21kworker/u8:2+events_unbound11:30:130
3978424992825,2cyclictest4031045-21kworker/u8:0+events_unbound08:05:150
3978424992825,2cyclictest13733-21kworker/u8:3+events_unbound10:50:220
3978434992724,2cyclictest4128557-21kworker/u8:0+flush-259:009:40:203
3978434992724,2cyclictest4087901-21kworker/u8:2+flush-259:009:00:193
3978434992724,2cyclictest4051504-21kworker/u8:4+events_unbound09:10:003
3978434992723,3cyclictest82031-21cat11:55:013
3978434992723,3cyclictest3944333-21kworker/u8:4+flush-259:007:25:113
3978434992723,3cyclictest3944333-21kworker/u8:4+flush-259:007:25:103
3978434992723,3cyclictest13733-21kworker/u8:3+events_unbound10:59:503
3978429992723,3cyclictest3978407-21kworker/u8:0+flush-259:007:25:242
3978429992723,3cyclictest3978407-21kworker/u8:0+flush-259:007:25:242
3978429992721,4cyclictest4134151-21kworker/u8:2+flush-259:011:20:002
3978426992725,1cyclictest4176246-21kworker/u8:3+events_unbound10:20:231
3978426992724,2cyclictest4031045-21kworker/u8:0+flush-259:008:20:251
3978426992723,3cyclictest4118853-21kworker/u8:1+events_unbound10:07:231
3978426992722,3cyclictest19001-21base6410:55:011
3978424992723,3cyclictest81452-21gpgv11:55:000
3978424992723,3cyclictest4041153-21kworker/u8:2+events_unbound08:35:190
3978434992623,2cyclictest4041153-21kworker/u8:2+events_unbound08:30:013
3978429992621,4cyclictest4041153-21kworker/u8:2+events_unbound08:35:242
3978429992620,4cyclictest3583-21/usr/sbin/munin10:40:212
3978429992618,6cyclictest335557-21systemd-journal11:55:002
3978426992624,2cyclictest4134151-21kworker/u8:2+events_unbound11:13:231
3978426992622,3cyclictest4128557-21kworker/u8:0+events_unbound10:45:171
3978426992622,3cyclictest39853-21kworker/u8:3+events_unbound12:30:091
3978424992624,2cyclictest102516-21kworker/u8:4+events_unbound12:25:090
3978424992623,2cyclictest4031045-21kworker/u8:0+events_unbound08:20:220
3978424992623,2cyclictest1926144-21kworker/u8:2+flush-259:007:20:010
3978434992522,2cyclictest3944333-21kworker/u8:4+events_unbound07:35:163
3978434992521,3cyclictest4128557-21kworker/u8:0+flush-259:009:35:163
3978429992520,4cyclictest4056686-21kworker/u8:5+events_unbound08:30:232
3978429992519,4cyclictest4087668-21latency_hist08:55:002
3978426992522,2cyclictest4051504-21kworker/u8:4+events_unbound08:45:141
3978426992522,2cyclictest4031045-21kworker/u8:0+events_unbound08:17:231
3978426992522,2cyclictest3993873-21kworker/u8:1+events_unbound08:10:211
3978426992521,3cyclictest39853-21kworker/u8:3+events_unbound12:18:231
3978426992521,3cyclictest39853-21kworker/u8:3+events_unbound11:55:221
3978426992521,3cyclictest24626-21kworker/u8:4+events_unbound11:04:221
3978424992522,2cyclictest4051504-21kworker/u8:4+flush-259:009:00:250
3978424992522,2cyclictest4015130-21kworker/u8:3+flush-259:007:55:160
3978424992521,3cyclictest4176914-21kworker/u8:4+events_unbound10:25:140
3978434992422,1cyclictest39853-21kworker/u8:3+events_unbound11:40:213
3978434992421,3cyclictest4051504-21kworker/u8:4+events_unbound08:59:223
3978426992419,3cyclictest50419-21apt-get11:25:121
3978426992418,5cyclictest4143574-21ntpq09:45:231
3978424992421,2cyclictest3944333-21kworker/u8:4+events_unbound07:14:020
3978424992419,4cyclictest13688-21latency_hist10:50:010
3978434992320,2cyclictest65776-21kworker/u8:1+flush-259:011:50:203
3978434992318,4cyclictest4051482-21latency_hist08:20:003
3978429992319,3cyclictest4118853-21kworker/u8:1+flush-259:009:45:212
3978429992316,5cyclictest335557-21systemd-journal10:10:002
3978426992319,3cyclictest4051504-21kworker/u8:4+events_unbound08:59:251
3978426992319,3cyclictest3993873-21kworker/u8:1+events_unbound07:46:221
3978426992319,3cyclictest3993873-21kworker/u8:1+events_unbound07:40:151
3978426992319,3cyclictest39853-21kworker/u8:3+flush-259:011:20:211
3978424992319,3cyclictest4134151-21kworker/u8:2+events_unbound10:24:390
3978424992319,3cyclictest4025249-21apt-get07:55:010
3978424992318,4cyclictest70262-21ntpq11:40:190
3978424992317,5cyclictest4076536-21ntpq08:40:220
3978434992219,2cyclictest39853-21kworker/u8:3+flush-259:011:45:203
3978429992218,3cyclictest3944333-21kworker/u8:4+flush-259:007:25:012
3978429992218,3cyclictest3944333-21kworker/u8:4+flush-259:007:25:002
3978429992218,3cyclictest102516-21kworker/u8:4+events_unbound12:30:172
3978429992217,4cyclictest13733-21kworker/u8:3+flush-259:010:55:012
3978426992218,3cyclictest4015130-21kworker/u8:3+flush-259:007:55:171
3978424992219,2cyclictest4134151-21kworker/u8:2+events_unbound11:15:210
3978424992219,2cyclictest4051504-21kworker/u8:4+events_unbound08:55:150
3978424992218,3cyclictest4118853-21kworker/u8:1+events_unbound09:35:500
3978424992218,3cyclictest3978368-21latency_hist07:10:000
3978434992119,2cyclictest24626-21kworker/u8:4+events_unbound11:05:013
3978434992118,2cyclictest4118853-21kworker/u8:1+events_unbound09:55:133
3978434992117,3cyclictest4041153-21kworker/u8:2+events_unbound08:30:183
3978434992116,4cyclictest4128066-21ntpq09:30:213
3978429992117,3cyclictest4015130-21kworker/u8:3+flush-259:008:00:252
3978426992118,3cyclictest4051504-21kworker/u8:4+flush-259:008:35:261
3978426992118,2cyclictest39853-21kworker/u8:3+events_unbound12:08:231
3978426992118,2cyclictest1926144-21kworker/u8:2+events_unbound07:10:001
3978426992115,4cyclictest102496-21latency_hist12:15:001
3978424992118,2cyclictest4118853-21kworker/u8:1+events_unbound10:15:210
3978424992118,2cyclictest102516-21kworker/u8:4+events_unbound12:35:230
3978434992017,2cyclictest4031045-21kworker/u8:0+flush-259:008:00:203
3978434992017,2cyclictest34631-21kworker/u8:0+flush-259:011:10:203
3978429992015,4cyclictest1926144-21kworker/u8:2+flush-259:007:10:242
3978426992017,2cyclictest39853-21kworker/u8:3+events_unbound11:45:141
3978426992017,2cyclictest102516-21kworker/u8:4+flush-259:012:27:271
3978426992016,3cyclictest4031045-21kworker/u8:0+events_unbound08:00:251
3978426992016,3cyclictest39853-21kworker/u8:3+events_unbound11:40:031
3978426992016,3cyclictest39853-21kworker/u8:3+events_unbound11:32:241
3978424992017,2cyclictest92159-21kworker/u8:1+events_unbound12:20:080
3978424992017,2cyclictest4118853-21kworker/u8:1+flush-259:009:30:250
3978424992017,2cyclictest4118853-21kworker/u8:1+events_unbound10:05:020
3978424992017,2cyclictest3993873-21kworker/u8:1+flush-259:008:10:260
3978424992017,2cyclictest3978407-21kworker/u8:0+flush-259:007:20:160
3978424992017,2cyclictest3978407-21kworker/u8:0+flush-259:007:20:150
3978434991917,2cyclictest3944333-21kworker/u8:4+events_unbound07:50:283
3978434991916,2cyclictest4098207-21kworker/u8:3+flush-259:009:15:203
3978434991916,2cyclictest4051504-21kworker/u8:4+events_unbound08:45:123
3978434991915,3cyclictest3944333-21kworker/u8:4+events_unbound07:30:023
3978429991915,3cyclictest3944333-21kworker/u8:4+events_unbound07:30:222
3978429991914,3cyclictest335557-21systemd-journal11:30:002
3978429991914,3cyclictest335557-21systemd-journal11:24:222
3978429991913,4cyclictest19520-21apt-get10:55:122
397842999191,16cyclictest1-21systemd12:00:012
3978429991911,5cyclictest3350-21latency_hist10:40:012
3978426991916,2cyclictest4118853-21kworker/u8:1+events_unbound09:54:571
3978426991916,2cyclictest1926144-21kworker/u8:2+events_unbound07:15:261
3978424991916,2cyclictest4118853-21kworker/u8:1+flush-259:009:55:160
3978424991915,3cyclictest509-21rs:main0
3978424991915,3cyclictest4041153-21kworker/u8:2+events_unbound08:33:550
3978434991816,2cyclictest34631-21kworker/u8:0+flush-259:011:15:203
3978434991815,2cyclictest4134151-21kworker/u8:2+flush-259:010:00:253
3978434991815,2cyclictest4041153-21kworker/u8:2+flush-259:008:35:163
3978434991815,2cyclictest3944333-21kworker/u8:4+events_unbound07:20:243
3978434991815,2cyclictest3944333-21kworker/u8:4+events_unbound07:20:233
3978434991814,3cyclictest4134151-21kworker/u8:2+flush-259:010:40:263
3978434991814,3cyclictest34631-21kworker/u8:0+events_unbound11:35:273
3978434991814,3cyclictest335557-21systemd-journal09:54:553
3978429991815,2cyclictest3993873-21kworker/u8:1+events_unbound08:10:232
3978429991811,5cyclictest335557-21systemd-journal09:45:002
3978426991815,2cyclictest4118853-21kworker/u8:1+events_unbound09:34:241
3978426991815,2cyclictest4118853-21kworker/u8:1+events_unbound09:25:131
3978426991814,2cyclictest0-21swapper/109:25:001
3978426991812,4cyclictest29816-21/usr/sbin/munin11:05:151
3978434991715,1cyclictest0-21swapper/312:05:003
3978434991714,2cyclictest1926144-21kworker/u8:2+events_unbound07:10:253
3978429991714,2cyclictest0-21swapper/209:39:592
3978429991713,3cyclictest4134151-21kworker/u8:2+flush-259:009:55:232
3978429991711,4cyclictest4087915-21/usr/sbin/munin08:55:142
3978429991711,4cyclictest3993873-21kworker/u8:1+flush-259:007:50:262
3978426991714,2cyclictest8527-21idleruntime-cro10:45:001
3978426991714,2cyclictest4128557-21kworker/u8:0+events_unbound10:15:121
3978426991714,2cyclictest4051504-21kworker/u8:4+flush-259:008:50:181
3978424991713,3cyclictest3944333-21kworker/u8:4+events_unbound07:31:250
3978434991612,3cyclictest34631-21kworker/u8:0+events_unbound12:10:123
3978429991612,2cyclictest4041153-21kworker/u8:2+events_unbound08:40:172
3978426991614,1cyclictest0-21swapper/107:25:001
3978426991614,1cyclictest0-21swapper/107:24:591
3978426991612,3cyclictest4031045-21kworker/u8:0+events_unbound08:05:011
3978424991613,2cyclictest4098207-21kworker/u8:3+events_unbound09:05:220
3978424991613,2cyclictest4031045-21kworker/u8:0+events_unbound08:19:180
3978424991612,3cyclictest3993873-21kworker/u8:1+events_unbound07:48:270
3978434991511,3cyclictest4128557-21kworker/u8:0+events_unbound10:45:133
397842999159,4cyclictest509-21rs:main2
3978429991511,3cyclictest4134151-21kworker/u8:2+events_unbound11:35:232
3978429991511,3cyclictest4097497-21unixbench_multi09:00:262
3978429991510,4cyclictest335557-21systemd-journal08:23:232
3978426991512,2cyclictest4134151-21kworker/u8:2+events_unbound10:35:161
3978426991512,1cyclictest0-21swapper/111:55:001
3978424991513,1cyclictest60350irq/132-enp0s29f1:rx-012:30:060
3978434991411,2cyclictest4134151-21kworker/u8:2+events_unbound10:37:193
3978434991411,2cyclictest4051504-21kworker/u8:4+events_unbound08:54:293
3978426991411,2cyclictest4134151-21kworker/u8:2+events_unbound10:55:341
3978424991412,1cyclictest60350irq/132-enp0s29f1:rx-009:20:150
3978424991411,3cyclictest92159-21kworker/u8:1+events_unbound12:14:520
397843499139,3cyclictest4166086-21apt-key10:10:013
3978434991310,2cyclictest13733-21kworker/u8:3+flush-259:010:50:163
397842999136,2cyclictest4181374-21idleruntime-cro10:25:002
3978429991310,3cyclictest4031045-21kworker/u8:0+flush-259:008:30:002
397843499129,2cyclictest3993873-21kworker/u8:1+events_unbound07:55:033
397842999128,3cyclictest4087901-21kworker/u8:2+events_unbound09:10:222
397842699128,3cyclictest4098207-21kworker/u8:3+events_unbound09:05:231
397842999118,2cyclictest4015267-21cpuspeed_turbos07:45:112
397842999117,2cyclictest4128557-21kworker/u8:0+flush-259:010:10:242
397842999115,4cyclictest3944333-21kworker/u8:4+flush-259:007:40:162
397842699118,3cyclictest4134151-21kworker/u8:2+events_unbound11:15:481
397842699118,2cyclictest4051504-21kworker/u8:4+events_unbound09:12:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional