You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 18:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Sep 04, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4172275996562,2cyclictest75-21kswapd012:17:401
4172283995249,2cyclictest4192786-21kworker/u8:3+flush-259:007:35:223
4172275994844,3cyclictest61012-21kworker/u8:1+flush-259:010:35:251
4172275994037,2cyclictest87132-21kworker/u8:0+flush-259:009:05:111
4172275994036,3cyclictest311091-21apt-get12:30:101
4172278993935,3cyclictest4167125-21kworker/u8:0+flush-259:007:30:222
4172278993935,3cyclictest4161744-21kworker/u8:1+flush-259:007:10:252
4172275993935,3cyclictest232132-21kworker/u8:2+flush-259:011:35:241
4172283993734,2cyclictest75-21kswapd012:17:423
4172273993731,4cyclictest175712-21apt-get10:20:120
4172275993532,2cyclictest24802-21kworker/u8:2+events_unbound07:55:211
4172275993531,3cyclictest61529-21apt-get08:30:121
4172273993530,4cyclictest75-21kswapd012:17:420
4172273993528,5cyclictest335557-21systemd-journal08:14:590
4172283993430,3cyclictest45545-21kworker/u8:3+flush-259:008:55:233
4172283993329,3cyclictest61012-21kworker/u8:1+flush-259:008:45:233
4172275993330,2cyclictest268701-21kworker/u8:1+events_unbound11:50:231
4172275993330,2cyclictest149295-21kworker/u8:2+flush-259:010:05:231
4172283993229,2cyclictest61012-21kworker/u8:1+flush-259:009:10:233
4172278993229,2cyclictest61012-21kworker/u8:1+flush-259:010:10:282
4172278993229,2cyclictest61012-21kworker/u8:1+events_unbound09:35:232
4172278993228,3cyclictest61012-21kworker/u8:1+flush-259:010:00:242
4172278993228,3cyclictest258208-21gpgv11:40:012
4172275993229,2cyclictest24802-21kworker/u8:2+flush-259:008:04:591
4172275993229,2cyclictest175462-21kworker/u8:3+flush-259:011:20:241
4172275993228,3cyclictest9673-21kworker/u8:1+events_unbound07:45:151
4172278993128,2cyclictest45545-21kworker/u8:3+flush-259:008:40:242
4172275993127,3cyclictest4167125-21kworker/u8:0+events_unbound07:25:151
4172275993124,3cyclictest45545-21kworker/u8:3+events_unbound08:40:141
4172283993026,3cyclictest4187982-21apt-get07:25:123
4172278993026,3cyclictest61012-21kworker/u8:1+flush-259:009:10:152
4172275993026,3cyclictest61012-21kworker/u8:1+flush-259:009:50:231
4172275993026,3cyclictest305610-21kworker/u8:1+flush-259:012:35:111
4172275993025,3cyclictest108056-21/usr/sbin/munin09:15:201
4172275992926,2cyclictest61012-21kworker/u8:1+events_unbound10:45:201
4172275992926,2cyclictest45545-21kworker/u8:3+events_unbound08:55:191
4172275992926,2cyclictest232132-21kworker/u8:2+events_unbound12:00:151
4172275992926,2cyclictest175462-21kworker/u8:3+events_unbound11:00:211
4172273992923,5cyclictest335557-21systemd-journal10:15:000
4172273992921,5cyclictest309960-21ntpq12:25:220
4172283992824,3cyclictest232344-21/usr/sbin/munin11:15:193
4172275992825,2cyclictest4161744-21kworker/u8:1+flush-259:007:10:181
4172275992825,2cyclictest35491-21kworker/u8:1+events_unbound08:15:211
4172283992724,2cyclictest35491-21kworker/u8:1+events_unbound08:15:223
4172283992724,2cyclictest232132-21kworker/u8:2+flush-259:011:35:253
4172275992724,2cyclictest61012-21kworker/u8:1+events_unbound09:40:131
4172275992724,2cyclictest232132-21kworker/u8:2+flush-259:011:40:251
4172273992721,4cyclictest279762-21/usr/sbin/munin12:00:210
4172273992721,4cyclictest106978-21ntpq09:10:210
4172283992623,2cyclictest9673-21kworker/u8:1+events_unbound07:50:163
4172278992623,2cyclictest45545-21kworker/u8:3+flush-259:009:00:232
4172278992623,2cyclictest175462-21kworker/u8:3+flush-259:010:25:242
4172275992623,2cyclictest9673-21kworker/u8:1+flush-259:007:50:191
4172275992623,2cyclictest61012-21kworker/u8:1+events_unbound08:45:231
4172275992623,2cyclictest258235-21kworker/u8:3+events_unbound11:45:121
4172275992623,2cyclictest24802-21kworker/u8:2+events_unbound08:10:001
4172275992622,3cyclictest87132-21kworker/u8:0+flush-259:009:35:251
4172275992622,3cyclictest4167125-21kworker/u8:0+events_unbound07:20:231
4172275992620,4cyclictest227176-21/usr/sbin/munin11:10:191
4172275992619,4cyclictest335557-21systemd-journal12:05:011
4172273992622,3cyclictest232132-21kworker/u8:2+flush-259:011:35:210
4172283992521,3cyclictest175462-21kworker/u8:3+flush-259:010:35:183
4172278992520,3cyclictest274083-21cat11:55:022
4172275992522,2cyclictest87132-21kworker/u8:0+flush-259:009:20:131
4172275992522,2cyclictest4192786-21kworker/u8:3+flush-259:007:35:181
4172275992521,3cyclictest4192786-21kworker/u8:3+flush-259:007:40:251
4172283992421,2cyclictest232132-21kworker/u8:2+flush-259:011:45:233
4172278992422,1cyclictest175462-21kworker/u8:3+events_unbound10:50:222
4172278992421,2cyclictest4161744-21kworker/u8:1+flush-259:007:15:122
4172275992421,2cyclictest246661-21kworker/u8:0+events_unbound12:10:221
4172275992420,3cyclictest175462-21kworker/u8:3+events_unbound10:20:161
4172273992419,3cyclictest129104-21apt-get09:35:100
4172275992320,2cyclictest305610-21kworker/u8:1+events_unbound12:27:321
4172275992320,2cyclictest24802-21kworker/u8:2+events_unbound08:10:211
4172275992318,4cyclictest128604-21cp09:35:011
4172273992318,3cyclictest45545-21kworker/u8:3+flush-259:009:00:150
4172283992219,2cyclictest87132-21kworker/u8:0+flush-259:009:25:243
4172283992219,2cyclictest305610-21kworker/u8:1+events_unbound12:35:153
4172283992219,2cyclictest175462-21kworker/u8:3+flush-259:011:20:263
4172283992218,3cyclictest87132-21kworker/u8:0+events_unbound09:20:163
4172283992217,4cyclictest258607-21base6411:40:013
4172283992216,4cyclictest185751-21latency_hist10:30:003
4172278992219,2cyclictest61012-21kworker/u8:1+flush-259:011:05:212
4172278992219,2cyclictest61012-21kworker/u8:1+flush-259:011:05:212
4172278992219,2cyclictest175462-21kworker/u8:3+flush-259:010:20:162
4172278992218,3cyclictest4167125-21kworker/u8:0+events_unbound07:40:182
4172278992218,3cyclictest335557-21systemd-journal10:40:142
4172275992220,2cyclictest175462-21kworker/u8:3+events_unbound10:40:211
4172275992219,2cyclictest61012-21kworker/u8:1+flush-259:011:05:241
4172275992219,2cyclictest61012-21kworker/u8:1+flush-259:011:05:241
4172275992219,2cyclictest268701-21kworker/u8:1+flush-259:011:55:311
4172275992216,4cyclictest335557-21systemd-journal10:30:111
4172283992118,2cyclictest61012-21kworker/u8:1+events_unbound11:34:333
4172283992116,4cyclictest154705-21latency_hist10:00:013
4172278992115,4cyclictest310832-21latency_hist12:30:012
4172275992118,2cyclictest61012-21kworker/u8:1+events_unbound10:15:281
4172275992118,2cyclictest300055-21kworker/u8:4+flush-259:012:20:181
4172275992118,2cyclictest154746-21kworker/u8:0+events_unbound10:00:231
4172275992118,2cyclictest107818-21idleruntime-cro09:15:001
4172275992115,4cyclictest335557-21systemd-journal08:29:311
4172273992118,2cyclictest4080-21gpgv07:35:000
4172273992117,3cyclictest232132-21kworker/u8:2+flush-259:011:45:260
4172273992115,4cyclictest190898-21latency_hist10:35:000
4172273992113,7cyclictest50942-21munin-plugin-st08:20:000
4172283992017,2cyclictest154746-21kworker/u8:0+events_unbound10:00:203
4172278992017,2cyclictest24802-21kworker/u8:2+flush-259:008:25:242
4172278992017,2cyclictest139130-21kworker/u8:3+flush-259:009:45:232
4172278992016,3cyclictest316290-21apt-get12:35:092
4172278992015,4cyclictest4167125-21kworker/u8:0+flush-259:007:25:202
4172275992017,2cyclictest45545-21kworker/u8:3+flush-259:008:54:531
4172275992013,4cyclictest143507-21ntpq09:45:201
4172273992014,4cyclictest335557-21systemd-journal10:02:310
417227399200,18cyclictest1-21systemd08:30:330
4172283991916,2cyclictest61012-21kworker/u8:1+flush-259:011:00:333
4172283991916,2cyclictest4161744-21kworker/u8:1+events_unbound07:22:333
4172283991916,2cyclictest246661-21kworker/u8:0+events_unbound12:30:163
4172283991916,2cyclictest232132-21kworker/u8:2+events_unbound12:00:193
4172283991916,2cyclictest175462-21kworker/u8:3+flush-259:010:20:183
4172283991916,2cyclictest154746-21kworker/u8:0+events_unbound10:10:173
4172278991916,2cyclictest102687-21kworker/u8:2+events_unbound09:30:202
4172278991915,3cyclictest300055-21kworker/u8:4+flush-259:012:20:242
4172278991915,3cyclictest289683-21kworker/u8:3+flush-259:012:17:312
4172278991915,3cyclictest149295-21kworker/u8:2+flush-259:009:55:012
4172275991916,2cyclictest87132-21kworker/u8:0+flush-259:009:04:561
4172275991916,2cyclictest24802-21kworker/u8:2+flush-259:008:20:231
4172275991916,2cyclictest246661-21kworker/u8:0+flush-259:011:26:431
4172273991915,3cyclictest4183194-21irqcore07:20:160
4172273991913,4cyclictest118084-21latency_hist09:25:000
4172273991912,5cyclictest50899-21kworker/u8:0+flush-259:008:20:160
4172273991912,5cyclictest174577-21ntpq10:15:210
4172273991912,5cyclictest123281-21latency_hist09:30:010
4172283991815,2cyclictest45545-21kworker/u8:3+events_unbound08:40:133
4172283991815,2cyclictest268701-21kworker/u8:1+flush-259:011:55:123
4172283991815,2cyclictest175462-21kworker/u8:3+flush-259:010:55:253
4172278991814,3cyclictest102687-21kworker/u8:2+events_unbound09:29:552
4172275991815,2cyclictest61012-21kworker/u8:1+events_unbound09:55:201
4172275991815,2cyclictest175462-21kworker/u8:3+events_unbound10:52:331
4172275991814,3cyclictest154746-21kworker/u8:0+events_unbound10:11:201
4172275991813,4cyclictest102687-21kworker/u8:2+flush-259:009:25:111
4172273991814,3cyclictest134305-21apt-get09:40:110
4172273991814,2cyclictest0-21swapper/009:55:010
4172273991813,3cyclictest60350irq/132-enp0s29f1:rx-008:50:220
4172273991813,1cyclictest60350irq/132-enp0s29f1:rx-009:05:140
4172283991714,2cyclictest4192786-21kworker/u8:3+events_unbound07:30:153
4172283991714,2cyclictest246661-21kworker/u8:0+events_unbound12:10:323
4172283991713,3cyclictest61012-21kworker/u8:1+flush-259:010:19:373
4172283991713,3cyclictest45545-21kworker/u8:3+flush-259:009:00:203
4172283991712,3cyclictest19960-21latency_hist07:50:013
4172278991715,1cyclictest0-21swapper/210:20:002
4172278991714,2cyclictest61012-21kworker/u8:1+flush-259:011:30:282
4172278991714,2cyclictest232132-21kworker/u8:2+flush-259:011:55:232
4172275991715,2cyclictest61012-21kworker/u8:1+events_unbound11:30:191
4172275991714,2cyclictest212156-21irqcore10:55:161
4172273991714,2cyclictest60350irq/132-enp0s29f1:rx-009:47:100
4172273991714,2cyclictest60350irq/132-enp0s29f1:rx-009:19:320
4172273991714,2cyclictest60350irq/132-enp0s29f1:rx-007:50:110
4172283991613,2cyclictest45545-21kworker/u8:3+events_unbound08:38:343
4172283991613,2cyclictest35491-21kworker/u8:1+flush-259:008:13:043
4172283991613,2cyclictest268701-21kworker/u8:1+flush-259:011:50:213
4172283991613,2cyclictest175462-21kworker/u8:3+flush-259:010:52:033
4172283991613,2cyclictest139130-21kworker/u8:3+events_unbound09:48:333
4172283991611,3cyclictest509-21rs:main3
4172278991613,2cyclictest61012-21kworker/u8:1+events_unbound09:05:142
4172278991613,2cyclictest4167125-21kworker/u8:0+events_unbound08:00:112
4172278991613,2cyclictest35491-21kworker/u8:1+flush-259:008:15:332
4172278991613,2cyclictest243115-21irqcore11:25:152
4172278991613,2cyclictest175462-21kworker/u8:3+flush-259:010:45:152
4172278991612,3cyclictest4182757-21/usr/sbin/munin07:20:182
4172278991612,3cyclictest246661-21kworker/u8:0+flush-259:012:30:372
4172278991612,3cyclictest175462-21kworker/u8:3+flush-259:011:20:182
4172278991612,3cyclictest175462-21kworker/u8:3+events_unbound10:35:172
4172273991614,1cyclictest60350irq/132-enp0s29f1:rx-012:35:140
4172273991614,1cyclictest60350irq/132-enp0s29f1:rx-011:40:450
4172273991614,1cyclictest60350irq/132-enp0s29f1:rx-007:44:550
4172273991613,2cyclictest60350irq/132-enp0s29f1:rx-011:27:230
4172273991613,2cyclictest60350irq/132-enp0s29f1:rx-009:33:420
4172273991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:250
4172273991612,3cyclictest45545-21kworker/u8:3+flush-259:008:40:230
4172283991513,1cyclictest61012-21kworker/u8:1+events_unbound11:25:163
4172283991512,3cyclictest4167125-21kworker/u8:0+flush-259:008:05:343
4172283991512,2cyclictest87132-21kworker/u8:0+flush-259:009:35:163
4172283991512,2cyclictest61012-21kworker/u8:1+events_unbound11:10:183
4172283991512,2cyclictest509-21rs:main3
4172283991512,2cyclictest246661-21kworker/u8:0+events_unbound12:05:263
4172283991511,3cyclictest61012-21kworker/u8:1+events_unbound09:54:343
4172283991511,3cyclictest4161744-21kworker/u8:1+events_unbound07:16:333
4172278991513,2cyclictest9673-21kworker/u8:1+flush-259:007:50:242
4172278991513,1cyclictest61012-21kworker/u8:1+flush-259:011:10:212
4172278991512,2cyclictest9673-21kworker/u8:1+flush-259:007:45:332
4172278991512,2cyclictest61012-21kworker/u8:1+events_unbound08:50:192
4172278991512,2cyclictest258235-21kworker/u8:3+flush-259:011:44:322
4172275991512,2cyclictest4167125-21kworker/u8:0+events_unbound07:33:561
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-012:30:200
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:250
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-011:15:200
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-010:41:320
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-010:05:130
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:190
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-008:57:370
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:260
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:250
4172273991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:240
4172273991512,2cyclictest61150irq/133-enp0s29f1:tx-011:20:250
4172273991512,2cyclictest61150irq/133-enp0s29f1:tx-007:15:230
4172273991512,2cyclictest60350irq/132-enp0s29f1:rx-012:25:000
4172273991512,2cyclictest60350irq/132-enp0s29f1:rx-011:59:290
4172273991512,2cyclictest60350irq/132-enp0s29f1:rx-008:00:120
4172273991511,3cyclictest60350irq/132-enp0s29f1:rx-011:10:260
4172273991511,3cyclictest24802-21kworker/u8:2+flush-259:007:55:130
4172283991412,2cyclictest50899-21kworker/u8:0+events_unbound08:24:473
4172283991411,2cyclictest61012-21kworker/u8:1+flush-259:011:05:183
4172283991411,2cyclictest61012-21kworker/u8:1+flush-259:011:05:183
4172283991411,2cyclictest61012-21kworker/u8:1+flush-259:010:40:313
4172283991411,2cyclictest61012-21kworker/u8:1+flush-259:009:43:073
4172283991411,2cyclictest45545-21kworker/u8:3+events_unbound08:52:323
4172283991411,2cyclictest175462-21kworker/u8:3+events_unbound10:48:333
4172283991410,3cyclictest300055-21kworker/u8:4+events_unbound12:20:163
4172283991410,3cyclictest0-21swapper/312:30:003
4172278991412,1cyclictest175462-21kworker/u8:3+flush-259:011:15:132
4172278991411,2cyclictest5160-21irqcore07:35:142
4172278991411,2cyclictest45545-21kworker/u8:3+flush-259:008:32:082
4172278991411,2cyclictest24802-21kworker/u8:2+flush-259:007:55:172
4172278991411,2cyclictest216181-21unixbench_multi10:55:242
4172278991410,3cyclictest4167125-21kworker/u8:0+events_unbound08:05:182
4172278991410,3cyclictest246661-21kworker/u8:0+flush-259:012:05:182
4172275991410,3cyclictest61012-21kworker/u8:1+events_unbound11:15:361
417227399149,4cyclictest8738-21ntpq07:35:200
417227399148,4cyclictest226934-21latency_hist11:10:010
417227399148,4cyclictest226934-21latency_hist11:10:000
4172273991412,1cyclictest60350irq/132-enp0s29f1:rx-010:50:280
4172273991412,1cyclictest60350irq/132-enp0s29f1:rx-008:45:240
4172273991411,2cyclictest60350irq/132-enp0s29f1:rx-012:14:220
4172273991411,2cyclictest60350irq/132-enp0s29f1:rx-010:58:000
4172273991411,2cyclictest60350irq/132-enp0s29f1:rx-010:25:110
417228399131,7cyclictest4172492-21apt-get07:10:133
4172283991311,1cyclictest0-21swapper/309:35:013
4172283991310,2cyclictest24802-21kworker/u8:2+events_unbound07:57:323
4172283991310,2cyclictest154746-21kworker/u8:0+events_unbound10:06:333
417227899139,3cyclictest61012-21kworker/u8:1+flush-259:011:00:432
4172278991310,3cyclictest61012-21kworker/u8:1+flush-259:009:40:242
4172278991310,1cyclictest0-21swapper/212:10:192
417227399139,2cyclictest221798-21sh11:05:000
4172273991311,2cyclictest60350irq/132-enp0s29f1:rx-010:49:380
4172273991311,1cyclictest60350irq/132-enp0s29f1:rx-011:50:270
4172273991311,1cyclictest60350irq/132-enp0s29f1:rx-010:35:200
4172273991310,1cyclictest0-21swapper/007:45:160
417228399129,2cyclictest61595-21cpuspeed_turbos08:30:123
417228399129,2cyclictest24802-21kworker/u8:2+flush-259:008:00:183
417228399128,3cyclictest186009-21apt-get10:30:103
417227899128,3cyclictest61012-21kworker/u8:1+flush-259:008:37:442
417227899128,3cyclictest335557-21systemd-journal09:24:332
4172278991210,2cyclictest149295-21kworker/u8:2+events_unbound10:05:122
4172278991210,1cyclictest41295-21irqcore08:10:162
417227399129,2cyclictest60350irq/132-enp0s29f1:rx-011:35:000
417227399129,2cyclictest60350irq/132-enp0s29f1:rx-008:25:230
417228399118,2cyclictest14315-21unixbench_multi07:40:253
417227899119,1cyclictest258235-21kworker/u8:3+flush-259:011:45:102
417227899118,2cyclictest45545-21kworker/u8:3+flush-259:008:55:332
417227899118,2cyclictest246661-21kworker/u8:0+events_unbound12:02:322
417227899107,2cyclictest186422-21irqcore10:30:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional