You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 20:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 31, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3955606995046,3cyclictest3960720-21kworker/u8:2+events_unbound07:30:122
3955608994036,3cyclictest3960720-21kworker/u8:2+flush-259:007:35:253
3955608993431,2cyclictest415-21kworker/u8:1+events_unbound12:35:233
3955608993431,2cyclictest12334-21kworker/u8:3+events_unbound11:10:083
3955608993331,2cyclictest3986544-21kworker/u8:0+events_unbound08:00:243
3955601993329,3cyclictest4133657-21apt-get10:00:111
3955601993328,3cyclictest6734-21apt-get11:05:011
3955598993327,4cyclictest90456-21base6412:25:010
3955608993127,3cyclictest4154695-21kworker/u8:2+events_unbound10:45:253
3955606993127,3cyclictest3923131-21kworker/u8:1+events_unbound07:10:102
3955606993124,5cyclictest105807-21latency_hist12:40:012
3955598993026,3cyclictest3902575-21kworker/u8:5+flush-259:007:15:240
3955598993024,4cyclictest4138568-21latency_hist10:05:010
3955608992926,2cyclictest4002232-21kworker/u8:2+flush-259:009:35:003
3955606992926,2cyclictest415-21kworker/u8:1+flush-259:011:30:252
3955606992721,3cyclictest6423-40mandb11:01:212
3955601992722,3cyclictest59194-21apt-get11:55:111
3955598992722,3cyclictest4007850-21/usr/sbin/munin08:00:150
3955606992623,2cyclictest415-21kworker/u8:1+flush-259:010:55:252
3955606992623,2cyclictest4002232-21kworker/u8:2+flush-259:009:45:152
3955606992622,3cyclictest4154695-21kworker/u8:2+flush-259:010:40:212
3955598992620,4cyclictest4138801-21kworker/u8:3+flush-259:010:10:160
3955608992421,2cyclictest509-21rs:main3
3955608992421,2cyclictest12334-21kworker/u8:3+flush-259:011:20:243
3955608992420,3cyclictest4064698-21kworker/u8:0+events_unbound09:50:163
3955608992420,3cyclictest4033561-21kworker/u8:3+flush-259:008:25:243
3955601992420,3cyclictest4033789-21apt-get08:25:111
3955601992417,5cyclictest335557-21systemd-journal08:10:011
3955608992320,2cyclictest4154695-21kworker/u8:2+events_unbound10:30:193
3955608992319,3cyclictest38240-21kworker/u8:2+events_unbound12:21:553
3955606992320,2cyclictest3986544-21kworker/u8:0+events_unbound07:55:242
3955606992318,4cyclictest3955514-21latency_hist07:10:002
3955598992319,3cyclictest79864-21apt-get12:15:120
3955608992218,3cyclictest415-21kworker/u8:1+flush-259:012:10:233
3955601992218,3cyclictest6850-21gpgv11:05:001
3955601992217,4cyclictest4086694-21apt-get09:15:101
3955598992219,2cyclictest43682-21apt-get11:40:120
3955598992217,3cyclictest335557-21systemd-journal10:45:000
3955608992119,2cyclictest3923131-21kworker/u8:1+events_unbound07:10:043
3955608992118,2cyclictest3923131-21kworker/u8:1+events_unbound07:31:553
3955608992117,3cyclictest4002232-21kworker/u8:2+events_unbound08:48:233
3955608992117,2cyclictest415-21kworker/u8:1+flush-259:011:35:173
3955608992115,4cyclictest1813-21apt-get11:00:123
3955606992117,3cyclictest4086434-21base6409:15:012
3955606992117,3cyclictest4054818-21kworker/u8:4+flush-259:009:00:252
3955606992117,2cyclictest4151533-21kthreadcore10:15:172
3955598992116,3cyclictest4039393-21apt-get08:30:130
3955608992017,2cyclictest3996523-21kworker/u8:3+events_unbound07:55:193
3955608992017,2cyclictest3986544-21kworker/u8:0+flush-259:008:35:213
3955608992012,3cyclictest3960720-21kworker/u8:2+events_unbound07:20:213
3955606992017,2cyclictest4054818-21kworker/u8:4+flush-259:008:55:262
3955606992017,2cyclictest4054818-21kworker/u8:4+flush-259:008:55:252
3955606992016,3cyclictest4002232-21kworker/u8:2+events_unbound08:05:112
3955601992016,3cyclictest4128932-21irqcore09:55:161
3955598992016,3cyclictest415-21kworker/u8:1+flush-259:010:55:290
3955598992016,3cyclictest33326-21apt-get11:30:120
3955598992014,5cyclictest509-21rs:main0
3955608991916,2cyclictest4138801-21kworker/u8:3+flush-259:010:05:233
3955608991916,2cyclictest38240-21kworker/u8:2+flush-259:012:15:253
3955608991915,3cyclictest4154695-21kworker/u8:2+events_unbound10:25:123
395560199197,10cyclictest3997218-21cpuspeed_turbos07:50:151
3955601991915,2cyclictest22699-21cron11:20:001
3955598991915,3cyclictest4002232-21kworker/u8:2+flush-259:009:30:140
3955598991912,5cyclictest22701-21latency_hist11:20:010
3955608991815,2cyclictest58412-21kworker/u8:3+flush-259:011:55:353
3955608991815,2cyclictest4154695-21kworker/u8:2+events_unbound11:06:333
3955608991815,2cyclictest4066205-21kthreadcore08:55:173
3955608991815,2cyclictest4066205-21kthreadcore08:55:173
3955608991815,2cyclictest4002232-21kworker/u8:2+flush-259:009:35:203
3955608991815,2cyclictest4002232-21kworker/u8:2+flush-259:008:05:123
3955608991815,2cyclictest3960720-21kworker/u8:2+events_unbound07:41:463
3955608991815,2cyclictest3923131-21kworker/u8:1+events_unbound07:45:193
3955608991815,2cyclictest12334-21kworker/u8:3+flush-259:011:42:363
3955608991813,3cyclictest4070761-21/usr/sbin/munin09:00:163
3955606991815,2cyclictest3986544-21kworker/u8:0+flush-259:008:35:182
3955606991815,1cyclictest0-21swapper/209:40:012
3955606991814,3cyclictest415-21kworker/u8:1+flush-259:012:20:162
3955606991813,4cyclictest4059782-21latency_hist08:50:012
395560199186,9cyclictest211-21jbd2/nvme0n1p2-809:25:101
395560199186,9cyclictest0-21swapper/107:20:121
395560199184,4cyclictest84953-21cat12:20:011
395560199181,5cyclictest4049388-21cron08:39:591
3955601991811,6cyclictest4066200-21kthreadcore08:55:181
3955601991811,6cyclictest4066200-21kthreadcore08:55:171
395560199181,14cyclictest0-21swapper/112:30:131
3955598991813,3cyclictest4070786-21apt-get09:00:120
3955598991811,5cyclictest63229-21ntpq11:55:210
3955608991714,2cyclictest4154695-21kworker/u8:2+events_unbound10:36:313
3955608991714,2cyclictest4054818-21kworker/u8:4+flush-259:009:20:163
3955608991714,2cyclictest3986544-21kworker/u8:0+flush-259:008:20:253
3955608991713,3cyclictest4123057-21kworker/u8:1+events_unbound10:00:113
3955608991713,3cyclictest4054818-21kworker/u8:4+events_unbound09:25:193
3955606991713,3cyclictest4054818-21kworker/u8:4+flush-259:009:10:252
3955606991713,3cyclictest4002232-21kworker/u8:2+flush-259:010:05:152
3955606991713,3cyclictest3996523-21kworker/u8:3+flush-259:008:00:262
395560199176,9cyclictest0-21swapper/110:10:171
395560199175,3cyclictest23232-21uniq11:20:131
395560199171,4cyclictest4080845-21apt09:10:001
395560199171,4cyclictest4055265-21grep08:45:171
3955601991714,2cyclictest38224-21munin-plugin-st11:35:001
395560199171,3cyclictest95499-21cron12:29:591
395560199171,2cyclictest335557-21systemd-journal09:25:011
3955601991711,4cyclictest1553-21latency_hist11:00:011
395560199170,5cyclictest4190308-21cron10:54:591
3955598991714,2cyclictest60350irq/132-enp0s29f1:rx-012:20:190
3955598991714,2cyclictest60350irq/132-enp0s29f1:rx-011:26:500
3955598991714,2cyclictest415-21kworker/u8:1+flush-259:012:05:260
3955608991613,2cyclictest415-21kworker/u8:1+events_unbound12:00:073
3955608991613,2cyclictest4064698-21kworker/u8:0+flush-259:009:05:053
3955608991613,2cyclictest3986544-21kworker/u8:0+events_unbound07:50:053
3955608991613,2cyclictest3923131-21kworker/u8:1+events_unbound07:18:173
3955608991612,3cyclictest3986544-21kworker/u8:0+events_unbound08:32:213
3955606991613,2cyclictest4138801-21kworker/u8:3+flush-259:010:10:152
3955606991613,2cyclictest4023184-21idleruntime-cro08:14:592
3955606991613,2cyclictest3923131-21kworker/u8:1+flush-259:007:45:262
3955606991612,3cyclictest4116874-21needreboot09:40:192
3955606991611,3cyclictest4038811-21gpgv08:30:002
3955606991611,3cyclictest335557-21systemd-journal10:04:552
395560199165,9cyclictest32167-21sshd11:25:231
395560199165,10cyclictest12677-21cpuspeed_turbos11:10:111
395560199164,2cyclictest3992189-21tune2fs07:45:141
395560199162,4cyclictest4081618-21sed09:10:171
395560199162,3cyclictest513-21gdbus08:15:001
395560199162,2cyclictest507-21in:imuxsock07:20:001
395560199161,4cyclictest513-21gdbus08:25:011
395560199161,4cyclictest4154815-21irqcore10:20:181
395560199161,4cyclictest3981382-21awk07:35:001
395560199161,3cyclictest4184690-21sed10:45:261
395560199161,3cyclictest4112265-21cron09:40:011
395560199161,3cyclictest38601-21cpuspeed_turbos11:35:131
395560199161,3cyclictest335557-21systemd-journal11:45:001
395560199161,2cyclictest89958-21https12:25:011
395560199161,2cyclictest0-21swapper/107:55:171
395560199160,5cyclictest4179970-21awk10:44:591
395560199160,5cyclictest4153299-21ntpq10:15:221
395560199160,5cyclictest4049882-21uniq08:40:141
395560199160,5cyclictest3976180-21idleruntime-cro07:30:011
395560199160,4cyclictest4123725-21sed09:50:161
395560199160,3cyclictest69253-21sh12:05:001
395560199160,3cyclictest4169683-21cron10:35:011
395560199160,3cyclictest4075685-21awk09:04:591
395560199160,2cyclictest3960685-21cron07:15:011
3955598991614,1cyclictest60350irq/132-enp0s29f1:rx-012:00:160
3955598991614,1cyclictest60350irq/132-enp0s29f1:rx-009:13:550
3955598991614,1cyclictest60350irq/132-enp0s29f1:rx-007:50:160
3955598991613,2cyclictest61150irq/133-enp0s29f1:tx-012:10:240
3955598991613,2cyclictest60350irq/132-enp0s29f1:rx-009:50:370
3955598991613,2cyclictest60350irq/132-enp0s29f1:rx-009:46:570
3955598991613,2cyclictest60350irq/132-enp0s29f1:rx-008:45:380
3955598991613,2cyclictest60350irq/132-enp0s29f1:rx-007:43:310
3955598991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:280
3955598991612,2cyclictest60350irq/132-enp0s29f1:rx-012:30:110
3955598991612,2cyclictest0-21swapper/010:00:000
3955598991610,4cyclictest335557-21systemd-journal11:03:210
3955608991512,2cyclictest63912-21kworker/u8:0+events_unbound12:05:193
3955608991512,2cyclictest4144037-21kworker/u8:0+events_unbound10:20:033
3955608991512,2cyclictest4138801-21kworker/u8:3+events_unbound10:11:573
3955608991512,2cyclictest4064698-21kworker/u8:0+flush-259:009:15:013
3955608991512,2cyclictest4043305-21kworker/u8:1+events_unbound08:51:393
3955608991512,2cyclictest4002232-21kworker/u8:2+events_unbound09:40:203
3955608991512,2cyclictest3986544-21kworker/u8:0+events_unbound08:19:593
3955608991512,2cyclictest100650-21systemd-run12:35:003
3955608991511,3cyclictest28148-21apt-get11:25:123
3955608991511,2cyclictest4154695-21kworker/u8:2+flush-259:010:50:193
395560699158,5cyclictest4044249-21latency_hist08:35:002
395560699152,7cyclictest69266-21munin-run12:04:592
3955606991512,2cyclictest415-21kworker/u8:1+flush-259:011:13:522
3955606991512,2cyclictest3976156-21sshd07:29:502
3955606991512,2cyclictest3902575-21kworker/u8:5+flush-259:007:15:262
3955606991511,3cyclictest415-21kworker/u8:1+flush-259:011:20:202
395560199155,8cyclictest0-21swapper/112:35:131
395560199152,2cyclictest3981654-21apt-get07:35:121
395560199151,3cyclictest54430-21tr11:50:171
395560199151,2cyclictest74782-21grep12:10:141
395560199151,2cyclictest69938-21grep12:05:171
395560199151,2cyclictest4170360-21sed10:35:171
395560199151,2cyclictest4116998-21ntpq09:40:201
395560199151,2cyclictest0-21swapper/108:00:161
395560199150,4cyclictest4164479-21cron10:30:001
395560199150,3cyclictest4141151-21kthreadcore10:05:171
395560199150,3cyclictest4118275-21cpuspeed_turbos09:45:131
395560199150,3cyclictest4060460-21irqcore08:50:161
395560199150,3cyclictest3991237-21unixbench_singl07:40:251
395560199150,2cyclictest4103213-21tr09:30:141
395560199150,2cyclictest4028357-21dump-pmu-power08:19:591
3955598991514,1cyclictest60350irq/132-enp0s29f1:rx-008:42:580
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:120
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-011:05:120
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-010:53:520
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-010:45:150
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-010:30:270
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-010:25:230
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-010:05:220
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-009:40:240
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-009:35:160
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-009:25:090
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-009:05:150
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-008:25:140
3955598991513,1cyclictest60350irq/132-enp0s29f1:rx-007:49:290
3955598991512,2cyclictest60350irq/132-enp0s29f1:rx-012:35:110
3955598991512,2cyclictest60350irq/132-enp0s29f1:rx-011:22:160
3955598991511,3cyclictest54018-21apt-get11:50:130
3955598991510,3cyclictest60350irq/132-enp0s29f1:rx-007:20:130
3955608991412,2cyclictest4049429-21kworker/u8:3+events_unbound08:40:213
3955608991411,2cyclictest4064698-21kworker/u8:0+events_unbound09:17:543
3955608991411,2cyclictest38240-21kworker/u8:2+events_unbound11:52:243
395560699149,3cyclictest12334-21kworker/u8:3+flush-259:011:41:522
395560699148,4cyclictest100625-21latency_hist12:35:012
3955606991412,1cyclictest0-21swapper/212:15:002
3955606991412,1cyclictest0-21swapper/208:19:592
3955606991411,2cyclictest3960720-21kworker/u8:2+flush-259:007:45:012
3955606991411,2cyclictest3960720-21kworker/u8:2+events_unbound07:35:242
3955606991410,3cyclictest4054818-21kworker/u8:4+events_unbound09:25:152
395560199140,3cyclictest3955659-21latency_hist07:10:001
395559899147,5cyclictest4159315-21cron10:25:000
3955598991412,1cyclictest60350irq/132-enp0s29f1:rx-008:52:180
3955598991412,1cyclictest60350irq/132-enp0s29f1:rx-008:20:160
3955598991412,1cyclictest0-21swapper/009:00:010
3955598991412,1cyclictest0-21swapper/009:00:000
3955598991411,2cyclictest60350irq/132-enp0s29f1:rx-010:16:550
3955598991411,2cyclictest60350irq/132-enp0s29f1:rx-007:35:180
395560899139,3cyclictest415-21kworker/u8:1+events_unbound12:25:153
395560899139,3cyclictest4144037-21kworker/u8:0+events_unbound10:56:223
3955608991311,2cyclictest4002232-21kworker/u8:2+events_unbound09:45:083
3955608991310,2cyclictest4149184-21kworker/u8:4+events_unbound10:15:103
395560699138,4cyclictest11395-21ntpq11:05:202
395560699138,3cyclictest335557-21systemd-journal08:55:002
3955606991310,2cyclictest63912-21kworker/u8:0+flush-259:012:05:162
3955606991310,2cyclictest4154695-21kworker/u8:2+flush-259:010:30:162
3955606991310,2cyclictest4054818-21kworker/u8:4+flush-259:009:30:222
3955606991310,2cyclictest38240-21kworker/u8:2+flush-259:012:15:152
3955606991310,1cyclictest0-21swapper/209:10:002
3955598991312,1cyclictest60350irq/132-enp0s29f1:rx-008:11:000
3955598991312,1cyclictest60350irq/132-enp0s29f1:rx-007:28:400
3955598991311,1cyclictest60350irq/132-enp0s29f1:rx-011:14:400
3955598991311,1cyclictest60350irq/132-enp0s29f1:rx-009:20:140
3955598991311,1cyclictest60350irq/132-enp0s29f1:rx-009:15:090
395560899128,3cyclictest415-21kworker/u8:1+events_unbound11:33:523
395560699129,2cyclictest4170373-21irqcore10:35:172
395560699129,1cyclictest0-21swapper/211:39:592
395560699128,3cyclictest4123057-21kworker/u8:1+flush-259:009:58:532
395560699128,3cyclictest3986544-21kworker/u8:0+events_unbound08:20:192
395560699128,2cyclictest0-21swapper/210:45:222
3955606991210,2cyclictest3902575-21kworker/u8:5+events_unbound07:23:212
3955606991210,1cyclictest0-21swapper/211:50:262
395559899129,2cyclictest4023557-21cpuspeed_turbos08:15:140
3955598991211,1cyclictest60350irq/132-enp0s29f1:rx-008:08:380
3955598991210,1cyclictest60350irq/132-enp0s29f1:rx-011:46:580
3955598991210,1cyclictest60350irq/132-enp0s29f1:rx-008:35:140
3955598991210,1cyclictest60350irq/132-enp0s29f1:rx-007:32:180
395560699119,1cyclictest0-21swapper/210:25:232
395560699118,2cyclictest415-21kworker/u8:1+flush-259:012:25:162
395560699117,3cyclictest4064698-21kworker/u8:0+flush-259:009:20:102
395560699116,4cyclictest53764-21awk11:50:002
395560699114,5cyclictest4185574-21diskstats10:50:152
395560899107,2cyclictest415-21kworker/u8:1+events_unbound11:45:223
395560699108,2cyclictest415-21kworker/u8:1+flush-259:011:55:162
395560699108,1cyclictest0-21swapper/210:25:012
395560699107,2cyclictest4049429-21kworker/u8:3+events_unbound08:40:232
395560699106,2cyclictest21843-21ntpq11:15:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional