You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 01:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 21, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1322372994440,3cyclictest1348256-21kworker/u8:0+flush-259:007:45:012
1322376994236,5cyclictest1577939-21latency_hist11:15:003
1322366993936,2cyclictest1485168-21kworker/u8:3+flush-259:010:00:240
1322376993834,3cyclictest1515965-21kworker/u8:2+flush-259:011:00:143
1322372993831,5cyclictest335557-21systemd-journal10:40:542
1322368993835,2cyclictest1327733-21kworker/u8:3+flush-259:007:30:221
1322372993732,3cyclictest1625089-21apt-get12:00:122
1322366993730,5cyclictest1521551-21diskstats10:20:120
1322376993633,2cyclictest1389786-21kworker/u8:0+flush-259:008:35:173
1322372993630,4cyclictest335557-21systemd-journal08:38:562
1322366993633,2cyclictest1437982-21kworker/u8:1+flush-259:010:10:240
1322368993530,3cyclictest1443352-21/usr/sbin/munin09:05:141
1322376993430,3cyclictest335557-21systemd-journal12:25:563
1322366993330,2cyclictest1411133-21kworker/u8:1+events_unbound08:44:570
1322366993325,6cyclictest1520234-21ntpq10:15:200
1322366993325,6cyclictest1400648-21gpgv08:25:000
1322368993229,2cyclictest1316833-21kworker/u8:2+flush-259:008:10:261
1322368993229,2cyclictest1316833-21kworker/u8:2+flush-259:007:50:161
1322366993229,2cyclictest1389786-21kworker/u8:0+flush-259:009:25:150
1322366993228,3cyclictest1548169-21kworker/u8:0+events_unbound10:45:240
1322366993227,3cyclictest1515965-21kworker/u8:2+flush-259:011:05:140
1322368993128,2cyclictest1327733-21kworker/u8:3+flush-259:007:45:161
1322368993126,4cyclictest335557-21systemd-journal07:15:011
1322366993126,4cyclictest1599328-21apt-get11:35:110
1322366993026,3cyclictest1322334-21kworker/u8:1+events_unbound07:19:560
1322372992924,3cyclictest1500283-40mandb09:58:272
1322366992926,2cyclictest1322334-21kworker/u8:1+events_unbound07:38:580
1322366992926,2cyclictest1316833-21kworker/u8:2+events_unbound08:06:560
1322366992925,3cyclictest1577699-21kworker/u8:3+events_unbound11:30:130
1322372992823,4cyclictest1588309-21apt-get11:25:002
1322366992824,3cyclictest1322334-21kworker/u8:1+flush-259:007:28:560
1322366992823,3cyclictest1624817-21kworker/u8:2+events_unbound12:04:560
1322366992823,3cyclictest1437982-21kworker/u8:1+events_unbound10:07:560
1322366992823,3cyclictest1437982-21kworker/u8:1+events_unbound09:45:130
1322366992823,3cyclictest1437982-21kworker/u8:1+events_unbound09:21:560
1322366992820,5cyclictest1500440-21latency_hist10:00:010
1322372992724,2cyclictest1427414-21kworker/u8:4+flush-259:009:05:232
1322372992720,5cyclictest1459285-21cp09:20:012
1322368992724,2cyclictest1485168-21kworker/u8:3+flush-259:010:00:161
1322368992724,2cyclictest1327733-21kworker/u8:3+flush-259:007:20:181
1322368992721,4cyclictest335557-21systemd-journal12:30:001
1322366992724,2cyclictest1505844-21kworker/u8:0+flush-259:010:30:240
1322366992720,4cyclictest1448531-21apt-get09:10:090
1322376992623,2cyclictest1479851-21kworker/u8:2+flush-259:009:59:033
1322368992623,2cyclictest1479851-21kworker/u8:2+flush-259:009:50:241
1322366992623,1cyclictest1437965-21latency_hist09:00:010
1322376992522,2cyclictest1505844-21kworker/u8:0+events_unbound10:14:073
1322368992522,2cyclictest1437982-21kworker/u8:1+flush-259:009:45:241
1322368992520,3cyclictest1603984-21kworker/u8:3+flush-259:012:15:211
1322366992521,3cyclictest1603984-21kworker/u8:3+events_unbound12:35:560
1322366992520,3cyclictest1389786-21kworker/u8:0+events_unbound08:38:470
1322366992420,3cyclictest1603984-21kworker/u8:3+events_unbound12:20:150
1322366992420,3cyclictest1541809-21kworker/u8:1+events_unbound11:25:170
1322366992420,3cyclictest1422271-21apt-get08:45:110
1322366992420,3cyclictest1389786-21kworker/u8:0+events_unbound08:31:570
1322366992420,3cyclictest1322334-21kworker/u8:1+events_unbound07:20:570
1322366992420,3cyclictest1316833-21kworker/u8:2+events_unbound07:55:180
1322376992320,2cyclictest1541809-21kworker/u8:1+flush-259:011:25:563
1322376992317,4cyclictest335557-21systemd-journal08:27:543
1322368992320,2cyclictest1603984-21kworker/u8:3+flush-259:012:35:151
1322368992319,3cyclictest1619960-21apt-get11:55:141
1322368992319,3cyclictest1437982-21kworker/u8:1+events_unbound09:24:561
1322366992320,2cyclictest1541809-21kworker/u8:1+events_unbound11:22:560
1322366992320,2cyclictest1458670-21kworker/u8:3+events_unbound09:30:140
1322366992320,2cyclictest1389786-21kworker/u8:0+events_unbound09:17:570
1322366992319,3cyclictest1515965-21kworker/u8:2+events_unbound10:37:550
1322366992319,3cyclictest1316833-21kworker/u8:2+events_unbound08:10:150
1322366992319,3cyclictest1316833-21kworker/u8:2+events_unbound07:50:120
1322376992219,2cyclictest1389786-21kworker/u8:0+events_unbound08:45:013
1322376992219,2cyclictest1327733-21kworker/u8:3+flush-259:007:20:153
1322376992217,4cyclictest1614830-21apt-get11:50:133
1322372992217,3cyclictest1603984-21kworker/u8:3+flush-259:011:50:182
1322368992219,2cyclictest1548169-21kworker/u8:0+events_unbound10:50:221
1322368992218,3cyclictest1603984-21kworker/u8:3+events_unbound12:10:141
1322368992218,3cyclictest1505879-21apt-get10:05:121
1322368992218,3cyclictest1474435-21kworker/u8:0+events_unbound09:39:571
1322366992219,2cyclictest1609427-21kworker/u8:0+flush-259:012:30:180
1322366992218,3cyclictest1327733-21kworker/u8:3+events_unbound07:43:550
1322366992217,4cyclictest1490351-21/usr/sbin/munin09:50:220
1322376992118,2cyclictest1609427-21kworker/u8:0+flush-259:012:15:263
1322376992118,2cyclictest1521786-21kworker/u8:3+flush-259:010:40:243
1322376992118,2cyclictest1479851-21kworker/u8:2+events_unbound09:50:183
1322376992118,2cyclictest1474435-21kworker/u8:0+flush-259:009:35:193
1322368992119,1cyclictest1541809-21kworker/u8:1+flush-259:011:29:161
1322368992118,2cyclictest1453712-21apt-get09:15:111
1322368992118,2cyclictest1411133-21kworker/u8:1+events_unbound08:39:561
1322366992117,3cyclictest1541809-21kworker/u8:1+flush-259:011:10:240
1322366992117,3cyclictest1427414-21kworker/u8:4+flush-259:009:05:210
1322366992117,3cyclictest1401102-21kworker/u8:4+events_unbound08:28:450
1322376992019,1cyclictest1541809-21kworker/u8:1+events_unbound11:20:253
1322376992017,2cyclictest1603984-21kworker/u8:3+flush-259:012:20:213
1322376992016,3cyclictest1389786-21kworker/u8:0+flush-259:008:30:203
1322368992017,2cyclictest1572785-21idleruntime-cro11:10:001
1322368992016,3cyclictest335557-21systemd-journal10:39:551
1322368992016,3cyclictest1541809-21kworker/u8:1+flush-259:011:19:161
1322368992014,4cyclictest335557-21systemd-journal11:03:551
1322368992014,4cyclictest1526541-21/usr/sbin/munin10:25:121
1322368992013,5cyclictest1484059-21ntpq09:40:221
1322366992016,3cyclictest1515965-21kworker/u8:2+flush-259:010:50:140
1322376991916,3cyclictest1427414-21kworker/u8:4+events_unbound08:52:573
1322376991916,3cyclictest1427414-21kworker/u8:4+events_unbound08:52:563
1322376991915,3cyclictest1485168-21kworker/u8:3+events_unbound10:05:253
1322376991915,3cyclictest1389786-21kworker/u8:0+events_unbound08:55:243
1322372991915,2cyclictest0-21swapper/209:45:002
1322372991914,3cyclictest1588974-21/usr/sbin/munin11:25:222
1322368991915,3cyclictest1389786-21kworker/u8:0+events_unbound08:58:511
1322366991916,3cyclictest1427414-21kworker/u8:4+events_unbound08:50:150
1322366991916,3cyclictest1427414-21kworker/u8:4+events_unbound08:50:140
1322366991915,3cyclictest1603984-21kworker/u8:3+events_unbound12:06:570
1322366991913,4cyclictest1378889-21ntpq08:00:210
1322376991816,1cyclictest1458670-21kworker/u8:3+events_unbound09:30:173
1322376991815,2cyclictest1548169-21kworker/u8:0+events_unbound10:49:563
1322376991815,2cyclictest1427414-21kworker/u8:4+events_unbound09:07:553
1322376991815,2cyclictest1389786-21kworker/u8:0+flush-259:009:10:213
1322376991815,2cyclictest1327733-21kworker/u8:3+events_unbound07:45:163
1322376991814,3cyclictest1577699-21kworker/u8:3+events_unbound11:15:103
1322376991814,3cyclictest1438224-21apt-get09:00:123
1322376991814,3cyclictest1316833-21kworker/u8:2+events_unbound08:10:183
1322372991815,2cyclictest1614564-21idleruntime-cro11:50:002
1322372991812,4cyclictest1521130-21latency_hist10:20:012
1322368991813,3cyclictest335557-21systemd-journal12:03:551
132236899180,2cyclictest1552123-21cron10:50:001
1322366991815,1cyclictest0-21swapper/007:50:010
1322376991714,3cyclictest1548169-21kworker/u8:0+events_unbound10:54:123
1322376991714,3cyclictest1316833-21kworker/u8:2+events_unbound07:10:143
1322376991714,2cyclictest1327733-21kworker/u8:3+flush-259:007:25:213
1322376991713,3cyclictest1541809-21kworker/u8:1+flush-259:011:35:203
1322376991713,3cyclictest1374863-21apt-get08:00:113
1322368991714,2cyclictest1557330-21kworker/u8:3+events_unbound10:55:191
1322368991712,4cyclictest1635209-21latency_hist12:10:011
1322366991713,2cyclictest0-21swapper/011:45:000
1322376991613,2cyclictest1603984-21kworker/u8:3+events_unbound11:45:223
1322376991613,2cyclictest1474435-21kworker/u8:0+flush-259:009:40:203
1322376991613,2cyclictest1353661-21apt-get07:40:113
1322376991613,2cyclictest1322334-21kworker/u8:1+flush-259:007:30:103
1322376991613,2cyclictest1322334-21kworker/u8:1+events_unbound07:35:193
1322376991612,3cyclictest1603984-21kworker/u8:3+flush-259:011:40:143
1322376991612,3cyclictest1458652-21apt-get09:20:013
1322376991612,2cyclictest1603984-21kworker/u8:3+flush-259:011:55:203
1322376991611,3cyclictest1379840-21kworker/u8:1+flush-259:008:20:163
1322372991613,2cyclictest1316833-21kworker/u8:2+events_unbound08:10:132
1322368991614,2cyclictest1603984-21kworker/u8:3+flush-259:012:24:311
1322368991614,1cyclictest0-21swapper/107:45:001
1322368991613,2cyclictest335557-21systemd-journal07:18:551
1322368991613,2cyclictest0-21swapper/111:45:001
1322368991612,3cyclictest509-21rs:main1
1322368991611,4cyclictest1505844-21kworker/u8:0+events_unbound10:18:571
132236699169,5cyclictest1530599-21ntpq10:25:200
1322366991614,1cyclictest60350irq/132-enp0s29f1:rx-007:10:140
1322366991612,2cyclictest60350irq/132-enp0s29f1:rx-012:15:110
1322376991513,1cyclictest1528871-21kthreadcore10:25:173
1322376991512,2cyclictest1603984-21kworker/u8:3+events_unbound12:35:163
1322376991511,3cyclictest1327733-21kworker/u8:3+flush-259:007:52:323
132237299159,4cyclictest1401296-21diskstats08:25:122
1322372991511,3cyclictest1573059-21apt-get11:10:122
132237299150,8cyclictest1374608-21awk08:00:002
1322368991513,2cyclictest1316833-21kworker/u8:2+events_unbound07:55:241
1322368991512,2cyclictest1588298-21idleruntime-cro11:25:001
1322368991512,2cyclictest1505844-21kworker/u8:0+flush-259:010:20:161
1322368991512,2cyclictest1505844-21kworker/u8:0+events_unbound10:30:231
1322368991512,2cyclictest1406747-21grep08:30:161
1322368991512,2cyclictest1316833-21kworker/u8:2+events_unbound08:00:181
1322368991511,3cyclictest1609653-21apt-get11:45:121
132236699159,4cyclictest1635440-21/usr/sbin/munin12:10:130
1322366991512,2cyclictest1438422-21fschecks_count09:00:130
1322376991411,2cyclictest1557330-21kworker/u8:3+events_unbound10:57:563
1322376991411,2cyclictest1521786-21kworker/u8:3+events_unbound10:35:213
1322376991410,3cyclictest335557-21systemd-journal09:50:003
1322376991410,3cyclictest1635468-21kworker/u8:1+events_unbound12:11:573
1322376991410,3cyclictest1316833-21kworker/u8:2+events_unbound07:55:153
1322376991410,2cyclictest0-21swapper/312:35:003
132237299149,3cyclictest1364328-21cat07:50:022
132237299148,4cyclictest1410368-21ntpq08:30:212
1322372991412,1cyclictest1515965-21kworker/u8:2+flush-259:010:30:162
1322372991412,1cyclictest1427414-21kworker/u8:4+events_unbound08:50:172
1322372991412,1cyclictest1427414-21kworker/u8:4+events_unbound08:50:162
1322372991411,2cyclictest1363915-21gpgv07:50:002
132236899149,4cyclictest1656239-21diskstats12:30:121
132236899148,4cyclictest1353395-21latency_hist07:40:011
1322368991411,2cyclictest1395623-21cpuspeed_turbos08:20:121
1322366991413,1cyclictest60350irq/132-enp0s29f1:rx-011:59:320
1322366991412,2cyclictest60350irq/132-enp0s29f1:rx-010:40:190
1322366991412,1cyclictest60350irq/132-enp0s29f1:rx-011:52:010
1322366991412,1cyclictest60350irq/132-enp0s29f1:rx-011:18:580
1322366991412,1cyclictest60350irq/132-enp0s29f1:rx-009:35:240
1322366991412,1cyclictest60350irq/132-enp0s29f1:rx-008:15:270
132237699139,3cyclictest1624817-21kworker/u8:2+events_unbound12:04:253
1322376991310,2cyclictest1316833-21kworker/u8:2+events_unbound08:05:243
1322372991310,2cyclictest1515965-21kworker/u8:2+flush-259:011:05:002
1322372991310,2cyclictest1448643-21cpuspeed_turbos09:10:112
1322372991310,2cyclictest0-21swapper/209:30:002
1322372991310,1cyclictest0-21swapper/209:34:592
1322368991310,2cyclictest1316833-21kworker/u8:2+events_unbound08:05:201
132236699138,3cyclictest60350irq/132-enp0s29f1:rx-010:55:120
1322366991311,2cyclictest60350irq/132-enp0s29f1:rx-012:25:320
1322366991311,1cyclictest60350irq/132-enp0s29f1:rx-011:00:210
1322366991310,2cyclictest60350irq/132-enp0s29f1:rx-009:43:030
1322366991310,2cyclictest1327733-21kworker/u8:3+events_unbound07:33:320
132237699128,3cyclictest1485168-21kworker/u8:3+events_unbound10:04:563
1322376991210,2cyclictest1505844-21kworker/u8:0+events_unbound10:31:563
132237299129,2cyclictest1316833-21kworker/u8:2+flush-259:008:05:322
132237299128,2cyclictest1400447-21awk08:25:002
132237299127,3cyclictest1389786-21kworker/u8:0+flush-259:009:00:172
132236899129,2cyclictest1521786-21kworker/u8:3+events_unbound10:40:201
132236899127,4cyclictest1395298-21latency_hist08:20:011
1322368991210,1cyclictest0-21swapper/109:35:001
132237699119,1cyclictest0-21swapper/311:05:233
132237699118,2cyclictest1505844-21kworker/u8:0+events_unbound10:15:153
132237699117,3cyclictest1416693-21apt-get08:40:103
132237299117,3cyclictest1609381-21basename11:45:002
132237299110,5cyclictest1541792-21awk10:40:012
132237299108,1cyclictest0-21swapper/212:05:202
132237299106,3cyclictest1609427-21kworker/u8:0+flush-259:012:25:122
132237299106,3cyclictest1389786-21kworker/u8:0+flush-259:008:55:522
132237299100,8cyclictest1514286-21tr10:10:182
132236899108,1cyclictest0-21swapper/111:50:221
132236899107,2cyclictest301rcuc/109:55:151
132236899107,2cyclictest1464716-21kworker/u8:2+flush-259:009:25:261
13223729996,2cyclictest1322334-21kworker/u8:1+flush-259:007:29:022
13223729995,3cyclictest1594976-21sed11:30:152
13223689995,3cyclictest1327733-21kworker/u8:3+events_unbound07:25:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional