You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 00:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 17, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3171815994843,3cyclictest3418099-21kworker/u8:3+flush-259:011:10:231
3171821994741,4cyclictest335557-21systemd-journal09:27:313
3171821994741,4cyclictest335557-21systemd-journal09:27:303
3171811994539,4cyclictest3307596-21kworker/u8:1+flush-259:010:15:000
3171815994239,2cyclictest3512018-21kworker/u8:0+flush-259:012:35:221
3171815994135,4cyclictest3313011-21latency_hist09:25:011
3171819994035,3cyclictest335557-21systemd-journal12:05:302
3171819994035,3cyclictest3224308-21latency_hist08:00:012
3171811994035,3cyclictest3328253-21kworker/u8:3+flush-259:009:55:010
3171819993732,3cyclictest335557-21systemd-journal09:00:302
3171811993629,5cyclictest3249727-21ntpq08:20:210
3171811993532,2cyclictest3470374-21kworker/u8:1+flush-259:012:00:210
3171811993532,2cyclictest3470374-21kworker/u8:1+flush-259:012:00:200
3171811993529,4cyclictest3428553-21latency_hist11:15:010
3171819993429,4cyclictest3381637-21kworker/u8:2+flush-259:010:40:102
3171819993429,4cyclictest3328253-21kworker/u8:3+flush-259:010:20:192
3171815993431,2cyclictest3161566-21kworker/u8:0+events_unbound07:45:221
3171815993430,3cyclictest3240503-21kworker/u8:2+flush-259:008:20:001
3171815993428,4cyclictest3418099-21kworker/u8:3+flush-259:011:05:171
3171815993329,3cyclictest3418099-21kworker/u8:3+flush-259:011:50:201
3171815993329,2cyclictest3381637-21kworker/u8:2+events_unbound10:30:231
3171819993227,4cyclictest3328253-21kworker/u8:3+flush-259:010:15:172
3171819993227,3cyclictest3454665-21/usr/sbin/munin11:40:232
3171819993227,3cyclictest3418099-21kworker/u8:3+events_unbound11:50:162
317181199310,29cyclictest1-21systemd10:10:010
3171821993026,3cyclictest3287032-21kworker/u8:0+flush-259:009:15:003
3171815993026,3cyclictest3454464-21kworker/u8:2+events_unbound11:41:311
3171815993026,3cyclictest3171436-21kworker/u8:3+flush-259:007:40:001
3171821992925,3cyclictest3475561-21http12:00:003
3171819992924,3cyclictest3453554-21ntpq11:35:202
3171815992926,2cyclictest3328253-21kworker/u8:3+flush-259:010:05:261
3171815992925,3cyclictest3328253-21kworker/u8:3+events_unbound10:15:191
3171811992926,2cyclictest3418099-21kworker/u8:3+flush-259:012:00:000
3171811992924,3cyclictest335557-21systemd-journal10:29:290
3171811992924,3cyclictest335557-21systemd-journal10:03:290
3171811992923,4cyclictest3402777-21latency_hist10:50:020
3171819992824,3cyclictest3287032-21kworker/u8:0+flush-259:009:10:302
3171815992824,3cyclictest3265859-21kworker/u8:2+events_unbound09:35:011
3171815992824,3cyclictest3265859-21kworker/u8:2+events_unbound09:35:001
3171821992723,3cyclictest3234695-21kworker/u8:1+flush-259:008:10:013
3171815992724,2cyclictest3418099-21kworker/u8:3+flush-259:011:45:211
3171815992722,4cyclictest3470374-21kworker/u8:1+flush-259:012:05:281
3171811992720,5cyclictest3334330-21cp09:45:010
3171821992621,3cyclictest335557-21systemd-journal10:15:013
3171819992621,4cyclictest3392236-21kworker/u8:1+flush-259:010:55:012
3171819992620,4cyclictest509-21rs:main2
3171819992620,4cyclictest3391472-21ntpq10:35:212
3171815992624,1cyclictest3155712-21kworker/u8:1+events_unbound07:10:291
3171815992624,1cyclictest3155712-21kworker/u8:1+events_unbound07:10:291
3171815992621,4cyclictest3229738-21apt-get08:05:151
3171819992521,2cyclictest1-21systemd08:21:302
3171815992522,2cyclictest3418099-21kworker/u8:3+events_unbound12:15:191
3171815992522,2cyclictest3413350-21apt-get11:00:121
3171815992522,2cyclictest3250840-21kworker/u8:4+events_unbound08:30:231
3171815992521,3cyclictest3381637-21kworker/u8:2+events_unbound10:45:141
3171815992520,4cyclictest3187959-21apt-get07:25:111
3171815992520,3cyclictest3333713-21http09:45:011
3171815992520,2cyclictest3470374-21kworker/u8:1+flush-259:012:00:171
3171815992520,2cyclictest3470374-21kworker/u8:1+flush-259:012:00:161
3171815992518,5cyclictest3354828-21latency_hist10:05:001
3171811992511,4cyclictest335557-21systemd-journal07:41:300
3171821992420,3cyclictest3328253-21kworker/u8:3+flush-259:010:40:013
3171821992419,3cyclictest335557-21systemd-journal09:15:293
3171819992420,3cyclictest3265859-21kworker/u8:2+flush-259:008:49:592
3171819992420,3cyclictest1-21systemd11:25:002
3171819992416,5cyclictest3234884-21cat08:10:012
3171815992421,3cyclictest3501550-21kworker/u8:2+events_unbound12:25:031
3171815992421,2cyclictest3392236-21kworker/u8:1+flush-259:010:50:161
3171815992421,2cyclictest3328253-21kworker/u8:3+events_unbound10:30:001
3171815992421,2cyclictest3219337-21kworker/u8:4+flush-259:008:00:261
3171811992419,4cyclictest3287060-21apt-get09:00:110
3171811992417,5cyclictest3301831-21ntpq09:10:210
3171819992320,2cyclictest3307596-21kworker/u8:1+flush-259:009:25:242
3171819992320,2cyclictest3307596-21kworker/u8:1+flush-259:009:25:242
3171819992319,3cyclictest3392236-21kworker/u8:1+flush-259:011:00:222
3171819992319,3cyclictest3265859-21kworker/u8:2+flush-259:008:50:252
3171819992315,5cyclictest3218686-21latency_hist07:55:012
3171815992320,2cyclictest3433755-21kworker/u8:2+flush-259:011:20:131
3171815992319,3cyclictest3501550-21kworker/u8:2+flush-259:012:25:011
3171815992319,3cyclictest3265859-21kworker/u8:2+flush-259:008:55:261
3171815992319,3cyclictest3234695-21kworker/u8:1+events_unbound08:14:331
3171815992319,2cyclictest3297823-21apt-get09:10:111
317181599231,20cyclictest1-21systemd11:56:311
3171811992320,2cyclictest3265859-21kworker/u8:2+flush-259:009:34:350
3171811992320,2cyclictest3265859-21kworker/u8:2+flush-259:009:34:350
3171811992317,5cyclictest3177342-21diskstats07:15:150
3171821992220,2cyclictest3418099-21kworker/u8:3+flush-259:011:40:003
3171821992219,2cyclictest3403043-21apt-get10:50:143
3171821992217,4cyclictest3193298-21diskstats07:30:143
3171819992218,3cyclictest3171436-21kworker/u8:3+flush-259:007:35:312
3171819992216,4cyclictest3292489-21cat09:05:002
3171819992215,5cyclictest335557-21systemd-journal09:40:002
3171815992219,2cyclictest3392236-21kworker/u8:1+flush-259:010:40:151
3171815992219,2cyclictest3234695-21kworker/u8:1+events_unbound08:40:141
3171815992218,3cyclictest3265859-21kworker/u8:2+events_unbound09:25:191
3171815992218,3cyclictest3265859-21kworker/u8:2+events_unbound09:25:191
3171815992218,3cyclictest3265859-21kworker/u8:2+events_unbound09:15:251
3171815992218,3cyclictest3265859-21kworker/u8:2+events_unbound09:00:111
3171815992218,3cyclictest3213769-21kworker/u8:1+events_unbound07:50:181
3171815992217,3cyclictest3171436-21kworker/u8:3+flush-259:007:30:191
3171811992220,1cyclictest3307858-21latency_hist09:20:010
3171811992216,4cyclictest335557-21systemd-journal07:25:300
3171821992115,4cyclictest3359609-21ntpq10:05:233
3171819992115,4cyclictest3460265-21/usr/sbin/munin11:45:202
3171815992118,2cyclictest3496356-21kworker/u8:1+flush-259:012:30:241
3171821992018,1cyclictest0-21swapper/307:50:003
3171819992016,3cyclictest3418099-21kworker/u8:3+flush-259:012:10:252
3171819992016,3cyclictest3418099-21kworker/u8:3+flush-259:011:55:252
3171819992016,3cyclictest3307596-21kworker/u8:1+flush-259:010:10:262
3171819992015,3cyclictest3418099-21kworker/u8:3+flush-259:012:15:002
3171819992015,3cyclictest3307596-21kworker/u8:1+flush-259:009:20:012
3171819992014,4cyclictest335557-21systemd-journal10:45:302
3171819992013,5cyclictest3501764-21latency_hist12:25:012
3171815992016,3cyclictest3449038-21kworker/u8:1+events_unbound11:39:591
3171815992016,3cyclictest3433755-21kworker/u8:2+events_unbound11:25:271
3171815992016,3cyclictest3381637-21kworker/u8:2+events_unbound10:57:311
3171815992016,3cyclictest3344496-21kworker/u8:0+events_unbound09:55:201
3171815992016,3cyclictest3307596-21kworker/u8:1+events_unbound09:46:311
3171815992014,4cyclictest3280704-21ntpq08:50:241
3171811992017,2cyclictest3234674-21gpgv08:10:000
3171811992016,3cyclictest3454464-21kworker/u8:2+flush-259:012:14:590
3171811992015,4cyclictest335557-21systemd-journal10:19:420
3171811992014,4cyclictest3344879-21diskstats09:55:150
3171811992011,8cyclictest0-21swapper/007:15:000
3171811992011,8cyclictest0-21swapper/007:15:000
3171821991914,3cyclictest3408175-21apt-get10:55:133
3171821991913,4cyclictest335557-21systemd-journal08:45:003
3171821991913,4cyclictest3171999-21/usr/sbin/munin07:10:153
3171821991913,4cyclictest3171999-21/usr/sbin/munin07:10:153
3171819991915,3cyclictest3344496-21kworker/u8:0+flush-259:010:00:012
3171819991915,2cyclictest0-21swapper/210:30:002
3171819991914,3cyclictest3418099-21kworker/u8:3+flush-259:012:25:172
3171819991913,4cyclictest3187275-21latency_hist07:25:012
3171815991916,2cyclictest3250840-21kworker/u8:4+events_unbound08:25:161
3171815991915,3cyclictest3328253-21kworker/u8:3+events_unbound10:10:131
3171815991915,3cyclictest3307596-21kworker/u8:1+flush-259:009:50:221
3171815991915,3cyclictest3171436-21kworker/u8:3+events_unbound07:20:181
317181599190,12cyclictest3276496-21munin-plugin-st08:49:591
3171811991915,3cyclictest3328253-21kworker/u8:3+flush-259:010:20:170
3171811991911,6cyclictest3438916-21turbostat11:24:590
3171821991814,3cyclictest335557-21systemd-journal07:55:003
3171821991811,5cyclictest3459789-21cp11:45:003
3171819991813,3cyclictest3328253-21kworker/u8:3+flush-259:010:00:252
3171815991814,3cyclictest3381637-21kworker/u8:2+events_unbound10:35:031
3171811991815,2cyclictest0-21swapper/008:15:000
3171811991813,4cyclictest3481383-21apt-get12:05:120
3171811991813,1cyclictest60350irq/132-enp0s29f1:rx-007:33:320
3171811991812,5cyclictest60350irq/132-enp0s29f1:rx-012:15:190
3171821991713,3cyclictest3397625-21kworker/u8:0+flush-259:011:05:223
3171819991715,1cyclictest3234695-21kworker/u8:1+events_unbound08:40:002
3171819991714,2cyclictest3265859-21kworker/u8:2+flush-259:009:30:222
3171819991714,2cyclictest3265859-21kworker/u8:2+flush-259:009:30:212
3171819991713,3cyclictest3433755-21kworker/u8:2+flush-259:011:25:302
3171819991713,3cyclictest3171436-21kworker/u8:3+flush-259:007:10:012
3171819991713,3cyclictest3171436-21kworker/u8:3+flush-259:007:10:012
3171819991713,2cyclictest0-21swapper/207:25:162
3171815991713,3cyclictest3287032-21kworker/u8:0+flush-259:009:05:171
3171815991713,3cyclictest3150020-21kworker/u8:2+events_unbound07:19:051
3171811991714,2cyclictest60350irq/132-enp0s29f1:rx-009:35:320
3171811991714,2cyclictest60350irq/132-enp0s29f1:rx-008:45:150
3171811991713,3cyclictest3287032-21kworker/u8:0+flush-259:009:05:260
3171811991713,2cyclictest60350irq/132-enp0s29f1:rx-011:30:180
3171811991712,4cyclictest3218679-21apt-get07:55:020
3171811991711,4cyclictest335557-21systemd-journal08:30:000
3171811991711,1cyclictest60350irq/132-enp0s29f1:rx-011:35:140
3171821991612,3cyclictest3517293-21latency_hist12:40:013
3171821991612,3cyclictest3454464-21kworker/u8:2+flush-259:012:05:213
3171821991612,3cyclictest3354945-21gpgv10:05:003
3171821991612,3cyclictest3334301-21cat09:45:013
3171819991613,2cyclictest3334046-21apt-key09:45:012
3171811991614,1cyclictest60350irq/132-enp0s29f1:rx-008:55:240
3171811991613,2cyclictest60350irq/132-enp0s29f1:rx-010:40:380
3171811991613,2cyclictest60350irq/132-enp0s29f1:rx-007:22:410
3171811991612,3cyclictest3240538-21apt-get08:15:130
3171811991610,5cyclictest335557-21systemd-journal10:55:000
3171821991513,1cyclictest509-21rs:main3
3171821991512,1cyclictest3307596-21kworker/u8:1+flush-259:009:45:013
3171821991511,3cyclictest3418099-21kworker/u8:3+flush-259:011:15:223
3171821991511,2cyclictest3469512-21ntp_offset11:50:223
3171819991512,2cyclictest3307596-21kworker/u8:1+flush-259:009:50:202
3171815991512,2cyclictest3229109-21kworker/u8:0+events_unbound08:23:441
3171815991510,4cyclictest3161566-21kworker/u8:0+events_unbound07:43:571
3171811991513,2cyclictest60350irq/132-enp0s29f1:rx-009:40:260
3171811991512,2cyclictest60350irq/132-enp0s29f1:rx-012:35:060
3171811991512,2cyclictest60350irq/132-enp0s29f1:rx-012:25:200
3171811991512,2cyclictest60350irq/132-enp0s29f1:rx-012:20:160
3171811991512,2cyclictest60350irq/132-enp0s29f1:rx-007:50:130
3171811991512,2cyclictest60350irq/132-enp0s29f1:rx-007:45:250
3171811991511,3cyclictest3439179-21apt-get11:25:120
317182199149,4cyclictest3496356-21kworker/u8:1+flush-259:012:25:263
317182199149,4cyclictest3381870-21gpgv10:30:013
3171821991411,2cyclictest3235310-21/usr/sbin/munin08:10:193
3171821991411,2cyclictest3187260-21idleruntime-cro07:25:013
3171821991410,2cyclictest0-21swapper/309:00:003
3171819991411,2cyclictest3206380-21kthreadcore07:40:192
3171815991411,2cyclictest3265859-21kworker/u8:2+events_unbound09:39:061
3171815991410,3cyclictest3208410-21kworker/u8:2+flush-259:007:55:261
317181199149,3cyclictest3387177-21latency_hist10:35:010
3171811991413,1cyclictest60350irq/132-enp0s29f1:rx-011:03:010
3171811991413,1cyclictest60350irq/132-enp0s29f1:rx-008:36:200
3171811991412,2cyclictest60350irq/132-enp0s29f1:rx-008:01:320
3171811991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:150
3171811991412,1cyclictest60350irq/132-enp0s29f1:rx-011:15:020
3171811991412,1cyclictest60350irq/132-enp0s29f1:rx-009:29:070
3171811991412,1cyclictest60350irq/132-enp0s29f1:rx-009:29:060
3171811991412,1cyclictest60350irq/132-enp0s29f1:rx-008:30:280
3171811991411,2cyclictest60350irq/132-enp0s29f1:rx-007:35:250
3171811991411,1cyclictest0-21swapper/011:55:000
3171821991310,2cyclictest3476428-21fschecks_count12:00:143
3171821991310,2cyclictest3476428-21fschecks_count12:00:133
3171821991310,2cyclictest3257092-21kthreadcore08:30:193
3171821991310,2cyclictest3224990-21irqcore08:00:183
317181999137,4cyclictest335557-21systemd-journal10:30:292
3171819991310,2cyclictest3281951-21cpuspeed_turbos08:55:152
317181599139,3cyclictest3418099-21kworker/u8:3+events_unbound11:31:061
3171815991311,2cyclictest3418099-21kworker/u8:3+flush-259:012:10:251
3171811991311,1cyclictest60350irq/132-enp0s29f1:rx-011:40:270
3171811991311,1cyclictest60350irq/132-enp0s29f1:rx-010:55:200
3171811991311,1cyclictest60350irq/132-enp0s29f1:rx-008:50:270
3171811991310,2cyclictest3397625-21kworker/u8:0+flush-259:011:05:170
317182199129,2cyclictest3443596-21unixbench_multi11:25:243
317182199129,2cyclictest3265859-21kworker/u8:2+flush-259:008:50:183
317182199129,2cyclictest3251009-21cpuspeed_turbos08:25:133
317182199129,2cyclictest3203517-21cpuspeed_turbos07:40:133
317182199129,1cyclictest0-21swapper/308:49:593
317182199128,3cyclictest3381637-21kworker/u8:2+flush-259:010:45:173
317182199128,3cyclictest3261273-21apt-get08:35:123
317182199127,4cyclictest3371310-21kworker/u8:0+flush-259:010:30:413
317182199121,3cyclictest3512142-21awk12:34:593
3171821991210,1cyclictest3345128-21irqcore09:55:193
3171821991210,1cyclictest0-21swapper/311:14:593
317181999129,2cyclictest500-21systemd-logind11:14:592
317181999128,3cyclictest3328253-21kworker/u8:3+events_unbound10:05:182
317181999121,9cyclictest3213532-21awk07:50:012
317181999121,10cyclictest0-21swapper/208:15:002
317181599129,2cyclictest3234695-21kworker/u8:1+flush-259:008:35:161
317181599128,3cyclictest3418099-21kworker/u8:3+events_unbound11:16:051
3171811991211,1cyclictest60350irq/132-enp0s29f1:rx-010:35:130
3171811991211,1cyclictest60350irq/132-enp0s29f1:rx-009:20:550
3171811991211,1cyclictest60350irq/132-enp0s29f1:rx-008:40:170
3171811991210,1cyclictest60350irq/132-enp0s29f1:rx-012:30:150
317182199118,2cyclictest3491409-21sh12:15:003
317182199118,1cyclictest0-21swapper/311:50:013
317182199116,4cyclictest3292665-21apt-get09:05:133
317182199110,2cyclictest34487862grep11:30:273
317181999119,1cyclictest0-21swapper/211:15:132
317181999117,3cyclictest3250840-21kworker/u8:4+flush-259:008:25:262
317181999116,3cyclictest3265859-21kworker/u8:2+flush-259:008:45:002
317181999115,4cyclictest513-21gdbus09:20:002
317182199107,2cyclictest3499170-21kthreadcore12:20:183
317182199104,4cyclictest3413350-21apt-get11:00:133
317182199100,3cyclictest3376440-21latency_hist10:25:003
317181999108,1cyclictest0-21swapper/212:30:122
31718219994,3cyclictest3492139-21sed12:15:153
31718219994,3cyclictest3249691-21ntpq08:20:203
31718199997,1cyclictest0-21swapper/211:30:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional