You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 21:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Apr 17, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1313474994741,4cyclictest1608651-21latency_hist11:55:010
1313479994643,2cyclictest1566606-21kworker/u8:1+events_unbound11:50:012
1313474994639,5cyclictest1577291-21latency_hist11:25:000
1313474994539,4cyclictest1592899-21cat11:40:010
1313476994239,2cyclictest1338900-21kworker/u8:3+flush-259:007:55:011
1313476993734,2cyclictest1422074-21kworker/u8:0+flush-259:009:00:001
1313484993631,4cyclictest252-21systemd-journal12:20:013
1313484993630,4cyclictest1453103-21latency_hist09:25:003
1313476993430,3cyclictest1422074-21kworker/u8:0+flush-259:009:45:231
1313476993428,4cyclictest1560966-21ntpq11:05:201
1313484993327,4cyclictest1469182-21cat09:40:013
1313479993327,4cyclictest1400595-21ntpq08:30:212
1313484993226,4cyclictest1381126-21apt-get08:15:113
1313479993229,2cyclictest1531044-21kworker/u8:4+events_unbound10:40:172
1313484993125,4cyclictest1332995-21kworker/u8:1+flush-259:007:25:253
1313479993127,3cyclictest1613583-21kworker/u8:1+flush-259:012:10:242
1313479993127,3cyclictest1463452-21kworker/u8:2+flush-259:009:40:162
1313476993128,2cyclictest1531044-21kworker/u8:4+flush-259:010:45:151
1313484993025,3cyclictest1566606-21kworker/u8:1+flush-259:011:15:243
1313479993026,3cyclictest509-21rs:main2
1313479993026,3cyclictest1360505-21/usr/sbin/munin07:55:252
1313476993024,4cyclictest1556663-21latency_hist11:05:011
1313474993025,4cyclictest1567243-21apt-get11:15:110
1313479992924,4cyclictest1499911-21kworker/u8:1+flush-259:010:25:232
1313479992923,4cyclictest1375704-21latency_hist08:10:022
1313476992924,4cyclictest1391040-21kworker/u8:2+events_unbound08:35:181
1313474992922,5cyclictest1462525-21ntpq09:30:200
1313484992823,4cyclictest1624697-21base6412:10:013
1313476992821,5cyclictest252-21systemd-journal12:35:231
1313479992723,3cyclictest1391040-21kworker/u8:2+events_unbound08:35:252
1313479992722,4cyclictest252-21systemd-journal11:54:592
1313476992724,2cyclictest1422074-21kworker/u8:0+events_unbound10:50:241
1313476992723,3cyclictest1540820-21kworker/u8:2+events_unbound10:55:231
1313476992723,3cyclictest1489850-21apt-get10:00:101
1313476992723,3cyclictest1463452-21kworker/u8:2+events_unbound09:40:141
1313476992720,5cyclictest252-21systemd-journal10:31:241
131347499271,25cyclictest1-21systemd11:31:230
1313479992621,3cyclictest1324177-21diskstats07:20:132
1313476992623,2cyclictest1396568-21apt-get08:30:131
1313476992622,3cyclictest1422074-21kworker/u8:0+flush-259:011:10:211
1313476992622,3cyclictest1422074-21kworker/u8:0+events_unbound10:30:001
1313474992622,3cyclictest252-21systemd-journal10:33:590
1313484992519,4cyclictest1546351-21kworker/u8:3+flush-259:011:14:593
1313484992519,4cyclictest1447932-21latency_hist09:20:013
1313484992519,4cyclictest1447932-21latency_hist09:20:013
1313484992519,4cyclictest1391040-21kworker/u8:2+flush-259:008:55:173
1313479992522,2cyclictest1613583-21kworker/u8:1+flush-259:012:30:012
1313479992520,4cyclictest1339721-21cat07:35:012
1313479992520,3cyclictest1468572-21latency_hist09:40:012
1313476992521,3cyclictest1355128-21kworker/u8:0+events_unbound08:00:171
1313474992520,4cyclictest252-21systemd-journal08:50:000
1313474992520,4cyclictest1432377-21latency_hist09:05:010
131347499251,22cyclictest1-21systemd08:13:230
1313484992418,4cyclictest1318610-21latency_hist07:15:003
131348499241,21cyclictest1-21systemd08:49:593
1313479992421,2cyclictest1355128-21kworker/u8:0+flush-259:008:00:212
1313476992421,2cyclictest1396325-21kworker/u8:1+flush-259:009:30:201
1313476992420,3cyclictest1422074-21kworker/u8:0+events_unbound10:23:581
1313476992419,3cyclictest1292136-21kworker/u8:3+events_unbound07:20:161
1313474992420,3cyclictest1437561-21kworker/u8:5+flush-259:010:00:160
1313474992418,5cyclictest1340050-21diskstats07:35:140
1313474992418,4cyclictest1452188-21ntpq09:20:210
1313479992320,2cyclictest1572188-21kworker/u8:2+flush-259:011:35:162
1313479992320,2cyclictest1422074-21kworker/u8:0+flush-259:010:05:162
1313479992319,3cyclictest1540820-21kworker/u8:2+flush-259:011:05:002
1313476992319,3cyclictest1613583-21kworker/u8:1+events_unbound12:14:181
1313476992319,3cyclictest1422074-21kworker/u8:0+events_unbound10:05:231
1313476992319,3cyclictest1422074-21kworker/u8:0+events_unbound09:05:201
1313476992319,3cyclictest1323494-21kworker/u8:0+events_unbound07:18:231
1313476992318,3cyclictest1572188-21kworker/u8:2+flush-259:011:55:211
1313476992318,3cyclictest1391040-21kworker/u8:2+flush-259:008:29:591
1313484992219,2cyclictest1292136-21kworker/u8:3+flush-259:007:20:233
1313484992218,3cyclictest1292136-21kworker/u8:3+flush-259:007:15:163
1313484992218,2cyclictest1540820-21kworker/u8:2+events_unbound11:00:173
1313479992218,3cyclictest1541365-21/usr/sbin/munin10:50:152
1313479992218,3cyclictest1540212-21ntpq10:45:192
1313479992217,3cyclictest1613583-21kworker/u8:1+events_unbound12:00:202
1313476992218,3cyclictest1629274-21kworker/u8:3+flush-259:012:15:151
1313476992218,3cyclictest1422074-21kworker/u8:0+events_unbound09:28:491
1313476992218,3cyclictest1292136-21kworker/u8:3+events_unbound07:11:241
1313474992218,3cyclictest1323494-21kworker/u8:0+events_unbound07:30:130
1313484992118,2cyclictest1422074-21kworker/u8:0+flush-259:011:40:243
1313484992118,2cyclictest1344829-21kworker/u8:2+events_unbound07:55:203
1313479992117,3cyclictest1396325-21kworker/u8:1+events_unbound09:30:222
1313476992117,3cyclictest1603721-21kworker/u8:3+events_unbound11:54:221
1313476992117,3cyclictest1572188-21kworker/u8:2+events_unbound11:30:241
1313476992117,3cyclictest1422074-21kworker/u8:0+events_unbound12:25:161
1313476992117,3cyclictest1275621-21kworker/u8:2+flush-259:007:30:101
1313476992116,3cyclictest1572410-21apt-get11:20:111
1313474992118,2cyclictest1540820-21kworker/u8:2+flush-259:011:00:160
1313474992117,3cyclictest1422074-21kworker/u8:0+events_unbound09:05:180
1313474992117,3cyclictest1275621-21kworker/u8:2+events_unbound07:25:010
1313474992116,4cyclictest1292136-21kworker/u8:3+events_unbound07:15:140
1313484992016,3cyclictest1355128-21kworker/u8:0+flush-259:008:05:233
1313479992017,2cyclictest1463452-21kworker/u8:2+events_unbound09:46:232
1313479992016,3cyclictest1463452-21kworker/u8:2+flush-259:009:50:192
1313476992017,2cyclictest1275621-21kworker/u8:2+events_unbound07:28:281
1313476992016,3cyclictest1396325-21kworker/u8:1+events_unbound09:14:241
1313476992016,3cyclictest1355128-21kworker/u8:0+flush-259:008:05:221
1313476992015,4cyclictest1422074-21kworker/u8:0+events_unbound11:15:121
1313476992014,4cyclictest1332995-21kworker/u8:1+events_unbound07:35:171
1313474992016,3cyclictest1499911-21kworker/u8:1+events_unbound10:15:160
1313474992016,3cyclictest1463452-21kworker/u8:2+events_unbound09:50:140
1313474992016,3cyclictest1437561-21kworker/u8:5+flush-259:009:20:000
1313474992016,3cyclictest1437561-21kworker/u8:5+flush-259:009:20:000
1313474992016,3cyclictest1396325-21kworker/u8:1+flush-259:009:35:240
1313474992015,3cyclictest509-21rs:main0
1313484991915,2cyclictest1489601-21idleruntime-cro10:00:013
1313484991913,4cyclictest1422074-21kworker/u8:0+flush-259:010:15:203
1313484991913,4cyclictest1344795-21latency_hist07:40:013
1313479991916,3cyclictest1338900-21kworker/u8:3+flush-259:008:10:212
1313479991916,2cyclictest1463452-21kworker/u8:2+flush-259:010:00:172
1313479991915,3cyclictest1566606-21kworker/u8:1+events_unbound11:15:162
1313479991915,3cyclictest1505287-21kworker/u8:2+events_unbound10:30:032
1313479991915,3cyclictest1422074-21kworker/u8:0+events_unbound09:24:252
1313479991915,3cyclictest1396325-21kworker/u8:1+events_unbound09:13:482
1313476991916,2cyclictest1572188-21kworker/u8:2+events_unbound11:25:231
1313476991916,2cyclictest1422074-21kworker/u8:0+flush-259:009:00:211
1313476991915,3cyclictest1613583-21kworker/u8:1+events_unbound12:00:141
1313476991915,3cyclictest1531044-21kworker/u8:4+events_unbound10:40:191
1313476991915,3cyclictest1499911-21kworker/u8:1+events_unbound10:13:241
1313476991915,3cyclictest1422074-21kworker/u8:0+flush-259:012:30:201
1313476991915,3cyclictest1422074-21kworker/u8:0+flush-259:009:55:131
1313476991915,3cyclictest1422074-21kworker/u8:0+events_unbound11:41:251
1313476991915,3cyclictest1391040-21kworker/u8:2+events_unbound08:46:241
1313476991915,3cyclictest1338900-21kworker/u8:3+flush-259:007:40:201
1313474991916,2cyclictest1530190-21kworker/u8:1+flush-259:010:45:230
1313474991915,3cyclictest1650570-21apt-get12:35:120
1313474991915,3cyclictest1572188-21kworker/u8:2+flush-259:011:44:360
1313474991915,3cyclictest1531044-21kworker/u8:4+flush-259:010:40:250
1313474991915,3cyclictest1422074-21kworker/u8:0+events_unbound10:53:230
1313474991915,2cyclictest1359302-21needreboot07:50:200
1313474991914,4cyclictest1629920-21apt-get12:15:110
1313474991913,5cyclictest1317722-21ntpq07:10:200
1313484991814,2cyclictest1566606-21kworker/u8:1+flush-259:011:29:593
1313484991812,4cyclictest1422074-21kworker/u8:0+flush-259:010:50:173
1313479991815,2cyclictest1540820-21kworker/u8:2+events_unbound10:59:062
1313479991815,2cyclictest1391040-21kworker/u8:2+events_unbound08:50:112
1313479991815,2cyclictest1338900-21kworker/u8:3+flush-259:007:45:012
1313479991814,3cyclictest1422074-21kworker/u8:0+flush-259:011:10:142
1313479991814,3cyclictest1391040-21kworker/u8:2+events_unbound08:55:172
1313479991814,3cyclictest1380886-21kworker/u8:1+events_unbound08:20:002
1313476991814,3cyclictest1396325-21kworker/u8:1+flush-259:009:35:211
1313476991811,5cyclictest0-21swapper/109:55:011
1313474991815,2cyclictest1618992-21kworker/u8:2+events_unbound12:10:120
1313474991815,2cyclictest1566606-21kworker/u8:1+flush-259:011:45:150
1313474991815,2cyclictest1422074-21kworker/u8:0+events_unbound11:05:130
1313474991815,2cyclictest1355128-21kworker/u8:0+flush-259:008:15:170
1313474991815,2cyclictest1355128-21kworker/u8:0+events_unbound08:30:240
1313474991814,3cyclictest252-21systemd-journal07:43:290
1313484991714,2cyclictest1468912-21latency_hist09:40:003
1313484991712,4cyclictest1618992-21kworker/u8:2+flush-259:012:10:003
1313484991712,4cyclictest1531044-21kworker/u8:4+flush-259:010:40:153
1313484991712,3cyclictest1365664-21/usr/sbin/munin08:00:143
1313484991712,3cyclictest1339205-21apt-get07:35:003
1313479991714,2cyclictest1422074-21kworker/u8:0+events_unbound11:40:202
1313479991714,2cyclictest1416934-21turbostat08:50:002
1313479991713,3cyclictest1530190-21kworker/u8:1+events_unbound10:35:252
1313479991713,3cyclictest1484692-21/usr/sbin/munin09:55:222
1313479991713,3cyclictest1396325-21kworker/u8:1+events_unbound08:40:202
1313476991713,3cyclictest1572188-21kworker/u8:2+events_unbound11:35:271
1313476991713,3cyclictest1505287-21kworker/u8:2+events_unbound10:17:011
1313476991710,5cyclictest1355101-21latency_hist07:50:011
1313474991714,2cyclictest1463452-21kworker/u8:2+flush-259:009:45:000
1313474991714,1cyclictest0-21swapper/008:24:590
1313484991610,4cyclictest252-21systemd-journal10:37:243
1313479991613,2cyclictest1572188-21kworker/u8:2+events_unbound11:30:132
1313479991613,2cyclictest1437561-21kworker/u8:5+flush-259:009:15:202
1313479991613,2cyclictest1437561-21kworker/u8:5+flush-259:009:15:192
1313479991613,2cyclictest1396325-21kworker/u8:1+events_unbound09:00:202
1313479991612,3cyclictest1458247-21latency_hist09:30:012
1313479991612,3cyclictest1437561-21kworker/u8:5+events_unbound10:12:242
1313476991612,3cyclictest1338900-21kworker/u8:3+events_unbound08:11:241
1313476991611,4cyclictest252-21systemd-journal10:40:001
1313476991611,3cyclictest1355128-21kworker/u8:0+flush-259:008:20:161
1313474991614,1cyclictest60350irq/132-enp0s29f1:rx-009:27:380
1313474991613,2cyclictest60350irq/132-enp0s29f1:rx-012:00:220
1313474991613,2cyclictest60350irq/132-enp0s29f1:rx-008:05:220
1313474991611,3cyclictest1474391-21/usr/sbin/munin09:45:150
1313484991513,1cyclictest1432371-21sh09:04:593
1313479991512,3cyclictest1613583-21kworker/u8:1+events_unbound12:39:242
1313479991512,2cyclictest1613583-21kworker/u8:1+flush-259:012:06:272
1313479991512,2cyclictest1566606-21kworker/u8:1+flush-259:011:20:242
1313479991512,2cyclictest1275621-21kworker/u8:2+events_unbound07:10:142
1313479991512,2cyclictest0-21swapper/207:10:002
1313479991512,1cyclictest0-21swapper/211:30:002
1313479991512,1cyclictest0-21swapper/207:35:002
1313479991511,3cyclictest1422074-21kworker/u8:0+events_unbound10:18:572
1313479991510,4cyclictest1634797-21latency_hist12:20:012
1313476991511,3cyclictest1396325-21kworker/u8:1+events_unbound09:23:251
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-012:33:240
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-012:25:240
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-012:23:520
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-011:10:140
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-010:55:230
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:310
1313474991513,1cyclictest60350irq/132-enp0s29f1:rx-008:00:150
1313474991512,2cyclictest60350irq/132-enp0s29f1:rx-010:07:120
1313474991512,2cyclictest60350irq/132-enp0s29f1:rx-009:10:240
1313474991512,2cyclictest1499911-21kworker/u8:1+events_unbound10:25:230
1313474991512,2cyclictest0-21swapper/009:00:000
1313474991511,3cyclictest1391040-21kworker/u8:2+flush-259:008:50:200
1313484991411,2cyclictest1391160-21idleruntime-cro08:25:003
1313484991411,2cyclictest0-21swapper/312:00:143
1313479991411,2cyclictest1613583-21kworker/u8:1+flush-259:012:00:002
1313479991411,2cyclictest1540820-21kworker/u8:2+events_unbound11:05:182
1313479991411,2cyclictest1422074-21kworker/u8:0+flush-259:010:25:012
1313479991411,2cyclictest1338900-21kworker/u8:3+flush-259:007:50:162
1313479991411,2cyclictest1333125-21ntp_kernel_err07:25:232
1313479991410,3cyclictest1613583-21kworker/u8:1+events_unbound12:30:022
1313476991411,2cyclictest1391040-21kworker/u8:2+flush-259:008:50:151
1313476991410,3cyclictest1629274-21kworker/u8:3+events_unbound12:20:251
1313476991410,3cyclictest1380886-21kworker/u8:1+flush-259:008:19:531
1313474991412,1cyclictest60350irq/132-enp0s29f1:rx-008:36:240
1313474991412,1cyclictest60350irq/132-enp0s29f1:rx-008:28:220
1313474991412,1cyclictest60350irq/132-enp0s29f1:rx-007:55:240
1313474991411,2cyclictest60350irq/132-enp0s29f1:rx-010:20:210
1313474991411,2cyclictest1613583-21kworker/u8:1+flush-259:012:05:240
1313474991410,3cyclictest1332995-21kworker/u8:1+events_unbound07:25:220
131348499139,3cyclictest1422074-21kworker/u8:0+flush-259:010:30:243
1313484991310,2cyclictest1583095-21sed11:30:163
1313484991310,2cyclictest1422039-21idleruntime-cro08:55:003
1313484991310,2cyclictest0-21swapper/311:50:003
1313479991310,2cyclictest1629274-21kworker/u8:3+events_unbound12:20:132
1313479991310,2cyclictest1338900-21kworker/u8:3+events_unbound07:45:182
131347699139,3cyclictest1566606-21kworker/u8:1+events_unbound11:45:251
131347699139,3cyclictest1422074-21kworker/u8:0+flush-259:012:05:051
1313476991310,2cyclictest1396325-21kworker/u8:1+flush-259:008:40:141
1313474991311,1cyclictest60350irq/132-enp0s29f1:rx-008:40:140
1313474991311,1cyclictest60350irq/132-enp0s29f1:rx-007:45:200
1313474991310,2cyclictest1613376-21unixbench_singl11:55:240
131348499129,2cyclictest1635146-21cpuspeed_turbos12:20:113
131348499129,2cyclictest1391544-21cpuspeed_turbos08:25:123
131348499129,2cyclictest1350619-21irqcore07:45:143
131348499129,2cyclictest0-21swapper/311:35:253
131348499129,2cyclictest0-21swapper/311:05:223
131348499128,3cyclictest1422074-21kworker/u8:0+flush-259:009:50:353
131348499127,4cyclictest1422074-21kworker/u8:0+flush-259:012:30:333
131348499127,4cyclictest1422074-21kworker/u8:0+flush-259:009:45:243
131348499121,8cyclictest1406595-21awk08:40:003
131347999127,4cyclictest1395403-21ntpq08:25:202
1313474991211,1cyclictest60350irq/132-enp0s29f1:rx-010:36:240
1313474991210,1cyclictest60350irq/132-enp0s29f1:rx-011:25:170
131348499119,1cyclictest0-21swapper/311:50:213
131348499111,8cyclictest1520520-21awk10:30:013
131348499111,2cyclictest1360269-21latency_hist07:55:003
131348499110,3cyclictest25250systemd-journal08:15:013
131347999106,3cyclictest1380886-21kworker/u8:1+flush-259:008:23:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional