You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 00:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jul 12, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3928893993632,3cyclictest5096-21kworker/u8:4+events_unbound11:40:011
3928893993430,3cyclictest5096-21kworker/u8:4+events_unbound12:13:541
3928893993228,3cyclictest4037513-21kworker/u8:2+events_unbound10:03:541
3928893993127,3cyclictest4001026-21kworker/u8:1+events_unbound08:23:481
3928893993026,3cyclictest3896568-21kworker/u8:3+events_unbound07:18:481
3928893992925,3cyclictest4131478-21kworker/u8:1+events_unbound10:55:551
3928893992925,2cyclictest4016841-21latency_hist08:35:001
3928893992825,2cyclictest4001026-21kworker/u8:1+events_unbound08:37:491
3928893992824,3cyclictest4016861-21kworker/u8:0+events_unbound09:09:481
3928902992724,2cyclictest3896568-21kworker/u8:3+flush-259:007:15:213
3928902992723,3cyclictest4037513-21kworker/u8:2+flush-259:009:05:003
3928893992724,2cyclictest4016861-21kworker/u8:0+events_unbound08:47:471
3928893992724,2cyclictest31666-21kworker/u8:0+events_unbound12:05:131
3928893992723,3cyclictest5096-21kworker/u8:4+events_unbound11:39:531
3928893992723,3cyclictest5096-21kworker/u8:4+events_unbound11:32:541
3928893992723,2cyclictest4001026-21kworker/u8:1+events_unbound08:40:191
3928893992720,5cyclictest335557-21systemd-journal07:30:001
3928902992620,4cyclictest4136618-21latency_hist10:30:013
3928897992619,5cyclictest4172667-21latency_hist11:05:002
3928893992623,2cyclictest4172694-21kworker/u8:1+events_unbound11:45:541
3928893992622,3cyclictest3944072-21kworker/u8:2+events_unbound07:59:471
3928893992621,3cyclictest335557-21systemd-journal11:13:531
3928902992521,3cyclictest4001026-21kworker/u8:1+events_unbound08:25:003
3928902992521,3cyclictest31666-21kworker/u8:0+flush-259:012:05:163
3928893992523,2cyclictest4037513-21kworker/u8:2+events_unbound09:21:491
3928893992522,3cyclictest4016861-21kworker/u8:0+events_unbound09:32:491
3928893992522,2cyclictest4172694-21kworker/u8:1+events_unbound11:50:201
3928893992522,2cyclictest4037513-21kworker/u8:2+events_unbound10:07:531
3928893992522,2cyclictest4037513-21kworker/u8:2+events_unbound09:12:491
3928893992520,2cyclictest4131478-21kworker/u8:1+events_unbound10:25:121
3928902992420,3cyclictest4037513-21kworker/u8:2+events_unbound09:25:023
3928897992418,4cyclictest3939177-21latency_hist07:20:022
3928893992421,2cyclictest4074821-21kworker/u8:1+events_unbound09:55:241
3928893992421,2cyclictest3949544-21kworker/u8:3+events_unbound07:35:231
3928893992420,2cyclictest4016861-21kworker/u8:0+events_unbound09:40:151
3928891992421,2cyclictest52040-21kworker/u8:1+flush-259:012:20:240
3928891992419,4cyclictest20328-21latency_hist11:45:010
3928902992316,5cyclictest4027195-21latency_hist08:45:013
3928893992320,2cyclictest4131478-21kworker/u8:1+events_unbound10:50:161
3928893992320,2cyclictest4131478-21kworker/u8:1+events_unbound10:35:171
3928893992320,2cyclictest3995204-21kworker/u8:3+events_unbound08:10:261
3928893992319,3cyclictest4037513-21kworker/u8:2+events_unbound09:25:491
3928893992319,2cyclictest3995204-21kworker/u8:3+events_unbound08:15:131
3928902992219,2cyclictest4188291-21kworker/u8:0+events_unbound11:30:003
3928902992219,2cyclictest4131478-21kworker/u8:1+flush-259:010:40:253
3928902992219,2cyclictest4074821-21kworker/u8:1+flush-259:009:50:173
3928902992219,2cyclictest31666-21kworker/u8:0+events_unbound12:00:013
3928902992218,3cyclictest4080223-21/usr/sbin/munin09:35:163
3928902992218,3cyclictest3949544-21kworker/u8:3+flush-259:007:34:593
3928902992218,2cyclictest4079970-21cron09:35:013
3928897992216,4cyclictest4167505-21latency_hist11:00:012
3928893992220,2cyclictest5096-21kworker/u8:4+events_unbound11:58:541
3928893992219,2cyclictest52040-21kworker/u8:1+events_unbound12:34:561
3928893992219,2cyclictest52040-21kworker/u8:1+events_unbound12:24:331
3928893992219,2cyclictest5096-21kworker/u8:4+events_unbound12:00:141
3928891992219,2cyclictest4172694-21kworker/u8:1+flush-259:011:30:260
3928902992117,3cyclictest4037513-21kworker/u8:2+events_unbound09:59:533
3928902992117,3cyclictest3975693-21kworker/u8:1+events_unbound07:56:473
3928902992117,3cyclictest3949544-21kworker/u8:3+events_unbound07:46:473
3928897992118,2cyclictest0-21swapper/209:05:002
3928893992118,2cyclictest3949544-21kworker/u8:3+events_unbound07:48:471
3928893992118,2cyclictest3918860-21kworker/u8:0+events_unbound07:12:461
3928893992117,3cyclictest4167163-21kworker/u8:2+events_unbound11:00:211
3928893992115,4cyclictest77778-21latency_hist12:40:011
3928891992119,1cyclictest4032361-21basename08:50:010
3928891992117,3cyclictest3944072-21kworker/u8:2+flush-259:008:10:010
3928902992016,3cyclictest3949544-21kworker/u8:3+flush-259:007:50:463
3928902992016,3cyclictest3944072-21kworker/u8:2+events_unbound08:12:483
3928902992015,4cyclictest335557-21systemd-journal10:32:543
3928897992017,2cyclictest4188068-21cut11:20:012
3928893992018,2cyclictest4131478-21kworker/u8:1+events_unbound10:41:541
3928893992017,2cyclictest3975693-21kworker/u8:1+events_unbound08:05:271
3928893992016,3cyclictest4110847-21kworker/u8:3+events_unbound11:22:541
3928893992015,3cyclictest3964995-21gpgv07:45:011
3928893992014,4cyclictest335557-21systemd-journal07:24:591
3928891992016,3cyclictest4110847-21kworker/u8:3+events_unbound10:57:530
3928891992016,3cyclictest36862-21apt-get12:00:120
3928891992015,3cyclictest3918860-21kworker/u8:0+events_unbound07:55:000
3928902991916,2cyclictest52040-21kworker/u8:1+events_unbound12:39:543
3928902991916,2cyclictest4131478-21kworker/u8:1+events_unbound10:49:193
3928902991915,3cyclictest3949544-21kworker/u8:3+events_unbound07:37:463
3928902991915,3cyclictest3918860-21kworker/u8:0+events_unbound07:26:463
3928902991914,4cyclictest4006607-21kworker/u8:3+events_unbound08:30:493
3928902991914,3cyclictest4115985-21latency_hist10:10:003
3928902991913,4cyclictest335557-21systemd-journal11:18:533
3928897991914,3cyclictest4121410-21/usr/sbin/munin10:15:142
3928893991916,2cyclictest3944072-21kworker/u8:2+events_unbound07:34:201
3928893991913,4cyclictest4152279-21/usr/sbin/munin10:45:141
3928891991916,2cyclictest3944072-21kworker/u8:2+flush-259:008:20:170
3928891991915,3cyclictest4037513-21kworker/u8:2+flush-259:010:00:010
3928902991815,2cyclictest4131478-21kworker/u8:1+events_unbound10:50:173
3928902991815,2cyclictest4016861-21kworker/u8:0+events_unbound08:50:003
3928902991814,3cyclictest3944072-21kworker/u8:2+events_unbound08:28:473
3928893991815,2cyclictest4131478-21kworker/u8:1+events_unbound10:34:191
3928893991814,3cyclictest5095-21kworker/u8:2+events_unbound12:29:291
3928893991812,4cyclictest507-21in:imuxsock09:05:011
3928893991811,5cyclictest335557-21systemd-journal10:15:001
3928891991813,3cyclictest3928876-21kworker/u8:1+flush-259:007:15:010
392889199180,16cyclictest1-21systemd12:17:530
392889199180,16cyclictest1-21systemd10:10:000
3928902991714,2cyclictest5096-21kworker/u8:4+flush-259:012:15:163
3928902991713,2cyclictest0-21swapper/307:44:593
3928897991714,2cyclictest4006584-21idleruntime-cro08:25:002
392889399178,1cyclictest191rcu_preempt09:45:231
392889399175,3cyclictest32-21ksoftirqd/108:05:001
3928893991715,2cyclictest31666-21kworker/u8:0+events_unbound12:18:531
3928893991714,2cyclictest4016861-21kworker/u8:0+events_unbound09:36:201
3928893991713,3cyclictest3944072-21kworker/u8:2+events_unbound08:29:301
3928893991713,2cyclictest4121854-21kworker/u8:0+events_unbound10:20:281
3928891991714,2cyclictest60350irq/132-enp0s29f1:rx-010:25:280
3928891991710,6cyclictest4131478-21kworker/u8:1+flush-259:010:40:010
3928902991613,2cyclictest5096-21kworker/u8:4+events_unbound11:40:203
3928902991613,2cyclictest4130539-21ntp_kernel_err10:20:213
3928902991613,2cyclictest4110847-21kworker/u8:3+events_unbound11:23:543
3928902991613,2cyclictest4110847-21kworker/u8:3+events_unbound11:10:003
3928902991610,4cyclictest4054022-21/usr/sbin/munin09:10:133
3928897991613,2cyclictest4074821-21kworker/u8:1+flush-259:009:54:592
3928897991613,2cyclictest0-21swapper/209:15:002
3928897991611,3cyclictest335557-21systemd-journal10:09:592
3928893991613,2cyclictest4016861-21kworker/u8:0+events_unbound09:17:021
3928891991614,1cyclictest60350irq/132-enp0s29f1:rx-012:35:150
3928891991614,1cyclictest60350irq/132-enp0s29f1:rx-009:50:030
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-012:05:220
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-011:38:450
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-011:25:160
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-010:19:590
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-010:02:190
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-009:47:510
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-009:39:540
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-008:31:210
3928891991613,2cyclictest60350irq/132-enp0s29f1:rx-007:47:330
3928891991613,2cyclictest4188291-21kworker/u8:0+events_unbound11:20:260
3928891991613,2cyclictest3975693-21kworker/u8:1+flush-259:008:00:200
3928891991612,3cyclictest4172694-21kworker/u8:1+events_unbound11:50:180
3928891991612,3cyclictest31666-21kworker/u8:0+flush-259:012:10:160
3928891991611,4cyclictest4131478-21kworker/u8:1+events_unbound10:35:000
3928902991512,2cyclictest4110809-21cron10:05:003
3928902991511,3cyclictest4037513-21kworker/u8:2+events_unbound09:15:183
392889799159,5cyclictest335557-21systemd-journal12:25:002
3928897991512,2cyclictest4180366-21sort11:10:172
3928897991512,2cyclictest4019415-21kthreadcore08:35:182
3928897991511,3cyclictest4136861-21/usr/sbin/munin10:30:232
3928897991510,4cyclictest335557-21systemd-journal07:35:442
392889399156,1cyclictest0-21swapper/110:15:171
3928893991512,2cyclictest4172694-21kworker/u8:1+events_unbound11:15:221
3928891991513,1cyclictest60350irq/132-enp0s29f1:rx-009:00:190
3928891991513,1cyclictest60350irq/132-enp0s29f1:rx-008:40:160
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-011:56:210
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-011:10:000
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-011:09:590
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-011:00:140
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-010:50:270
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-010:10:160
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-008:53:560
3928891991512,2cyclictest60350irq/132-enp0s29f1:rx-008:35:120
3928891991512,2cyclictest4110847-21kworker/u8:3+flush-259:010:40:180
3928891991511,3cyclictest4069920-21apt-get09:25:120
3928891991511,3cyclictest3949544-21kworker/u8:3+events_unbound07:40:180
3928902991411,2cyclictest5095-21kworker/u8:2+flush-259:012:30:233
3928902991411,2cyclictest4131478-21kworker/u8:1+events_unbound10:35:223
3928902991411,2cyclictest4001026-21kworker/u8:1+events_unbound08:35:233
3928902991411,2cyclictest31666-21kworker/u8:0+events_unbound12:10:163
3928902991410,3cyclictest4167163-21kworker/u8:2+flush-259:011:00:003
3928902991410,3cyclictest4167163-21kworker/u8:2+events_unbound11:00:143
3928902991410,3cyclictest4074821-21kworker/u8:1+events_unbound09:45:173
3928902991410,3cyclictest4016861-21kworker/u8:0+flush-259:009:25:143
3928902991410,3cyclictest4016861-21kworker/u8:0+flush-259:009:08:583
3928902991410,3cyclictest4016861-21kworker/u8:0+events_unbound08:50:193
3928902991410,3cyclictest3944072-21kworker/u8:2+flush-259:008:00:163
3928902991410,3cyclictest3944072-21kworker/u8:2+events_unbound08:05:233
3928897991411,2cyclictest4022432-21cpuspeed_turbos08:40:122
3928897991411,2cyclictest3970550-21sh07:50:002
3928897991411,2cyclictest36597-21sh12:00:002
3928897991411,2cyclictest317-21irqcore11:25:162
3928897991411,2cyclictest26604-21irqcore11:50:162
392889399143,2cyclictest0-21swapper/108:55:181
392889399142,2cyclictest0-21swapper/108:50:221
3928893991411,2cyclictest4074821-21kworker/u8:1+events_unbound09:53:521
3928893991411,2cyclictest311ktimers/107:50:161
3928891991413,1cyclictest60350irq/132-enp0s29f1:rx-010:24:540
3928891991413,1cyclictest60350irq/132-enp0s29f1:rx-007:17:210
3928891991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:160
3928891991411,2cyclictest0-21swapper/009:30:210
3928891991410,3cyclictest60350irq/132-enp0s29f1:rx-009:40:230
3928891991410,3cyclictest60350irq/132-enp0s29f1:rx-009:05:190
392890299139,3cyclictest5095-21kworker/u8:2+flush-259:012:27:043
392890299139,3cyclictest3996952-21tr08:15:173
392890299138,4cyclictest26186-21apt-get11:50:113
392890299138,3cyclictest4085338-21/usr/sbin/munin09:40:143
3928902991311,1cyclictest5546-21irqcore11:30:183
3928902991310,2cyclictest5096-21kworker/u8:4+events_unbound12:00:133
392889799139,3cyclictest4016861-21kworker/u8:0+flush-259:009:30:172
392889799138,4cyclictest4048429-21cp09:05:022
392889799138,4cyclictest335557-21systemd-journal10:12:542
3928897991311,1cyclictest0-21swapper/211:45:012
3928897991310,2cyclictest3964977-21cut07:45:002
392889799130,6cyclictest4157200-21munin-run10:49:592
392889199139,3cyclictest60350irq/132-enp0s29f1:rx-008:10:210
3928891991311,1cyclictest60350irq/132-enp0s29f1:rx-012:25:110
3928891991310,2cyclictest60350irq/132-enp0s29f1:rx-008:29:190
392890299129,2cyclictest4116319-21cpuspeed_turbos10:10:133
392890299129,2cyclictest3929528-21irqcore07:10:183
392890299129,2cyclictest10386-21cpuspeed_turbos11:35:133
392890299128,3cyclictest4016861-21kworker/u8:0+flush-259:008:55:203
392890299128,3cyclictest3944072-21kworker/u8:2+events_unbound07:24:453
392889799129,2cyclictest4157669-21fschecks_count10:50:162
392889799129,2cyclictest4016861-21kworker/u8:0+flush-259:009:30:002
392889799129,1cyclictest0-21swapper/212:25:232
392889199129,2cyclictest61150irq/133-enp0s29f1:tx-007:20:180
392889199129,2cyclictest60350irq/132-enp0s29f1:rx-010:47:370
392890299119,1cyclictest23268-21kthreadcore11:45:193
392889799118,2cyclictest4074821-21kworker/u8:1+events_unbound10:05:002
392889799118,2cyclictest3949007-21unixbench_multi07:25:242
392889799115,4cyclictest513-21gdbus12:20:012
392890299107,2cyclictest52040-21kworker/u8:1+events_unbound12:20:133
39288979997,1cyclictest0-21swapper/212:30:142
39288979997,1cyclictest0-21swapper/211:05:192
39288979997,1cyclictest0-21swapper/211:05:192
39288979997,1cyclictest0-21swapper/207:50:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional