You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 23:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jul 19, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1225405994945,3cyclictest1303495-21gpgv08:25:012
1225405994945,3cyclictest1303495-21gpgv08:25:002
1225401994642,3cyclictest1283245-21kworker/u8:0+flush-259:009:50:231
1225401994642,2cyclictest3354392-21kworker/u8:2+flush-259:008:10:231
1225405993832,4cyclictest1366192-21latency_hist09:25:002
1225398993834,3cyclictest3354392-21kworker/u8:2+flush-259:007:10:190
1225408993630,4cyclictest1277756-21/usr/sbin/munin08:00:153
1225408993629,5cyclictest1277516-21latency_hist08:00:003
1225401993632,3cyclictest1469762-21kworker/u8:2+events_unbound11:30:171
1225401993631,3cyclictest335557-21systemd-journal12:35:351
1225398993631,4cyclictest1454037-21kworker/u8:1+flush-259:010:50:180
1225398993630,3cyclictest1241219-21apt-get07:25:120
1225401993531,3cyclictest1283245-21kworker/u8:0+flush-259:008:35:161
1225401993430,3cyclictest1454282-21apt-get10:50:111
1225401993429,4cyclictest335557-21systemd-journal09:35:001
1225401993330,2cyclictest1220204-21kworker/u8:3+flush-259:008:00:211
1225398993328,3cyclictest1355829-21kworker/u8:3+events_unbound11:05:170
1225398993328,3cyclictest1355829-21kworker/u8:3+events_unbound11:05:160
1225405993228,3cyclictest1182136-21kworker/u8:1+events_unbound07:34:492
1225401993229,2cyclictest1318925-21kworker/u8:1+flush-259:009:10:241
1225401993229,2cyclictest1182136-21kworker/u8:1+flush-259:007:35:241
122539899320,30cyclictest1-21systemd09:55:010
1225408993124,5cyclictest335557-21systemd-journal10:58:303
1225405993128,2cyclictest1355829-21kworker/u8:3+flush-259:011:05:312
1225405993128,2cyclictest1355829-21kworker/u8:3+flush-259:011:05:302
1225405993127,3cyclictest1392088-21kworker/u8:1+events_unbound09:56:302
1225405993126,3cyclictest1454037-21kworker/u8:1+events_unbound10:55:002
1225398993125,4cyclictest335557-21systemd-journal08:35:010
1225405993027,2cyclictest1355829-21kworker/u8:3+flush-259:011:00:182
1225405993026,3cyclictest1442734-21kworker/u8:0+flush-259:010:45:222
1225405993026,3cyclictest1283245-21kworker/u8:0+flush-259:009:45:262
1225405993025,3cyclictest509-21rs:main2
1225405993024,2cyclictest1220204-21kworker/u8:3+events_unbound07:40:182
1225401993027,2cyclictest1318925-21kworker/u8:1+events_unbound08:57:321
1225401993026,3cyclictest1355829-21kworker/u8:3+events_unbound11:00:211
1225398993023,5cyclictest1495989-21cat11:30:010
1225408992925,3cyclictest1318925-21kworker/u8:1+flush-259:009:15:173
1225405992926,2cyclictest1402369-21kworker/u8:4+events_unbound11:29:322
1225405992825,2cyclictest1516797-21kworker/u8:0+flush-259:011:55:162
1225405992825,2cyclictest1277781-21apt-get08:00:112
1225401992825,2cyclictest3354392-21kworker/u8:2+flush-259:008:30:171
1225401992825,2cyclictest1501436-21kworker/u8:1+flush-259:012:10:211
1225398992822,4cyclictest1350237-21latency_hist09:10:000
1225398992821,5cyclictest1293042-21latency_hist08:15:000
1225405992723,3cyclictest1402369-21kworker/u8:4+events_unbound11:45:222
1225401992725,2cyclictest1469762-21kworker/u8:2+events_unbound11:25:121
1225401992724,2cyclictest1501436-21kworker/u8:1+events_unbound12:00:111
1225401992724,2cyclictest1402369-21kworker/u8:4+flush-259:011:35:131
1225401992724,2cyclictest1318925-21kworker/u8:1+events_unbound09:03:311
1225401992723,3cyclictest1522311-21/usr/sbin/munin11:55:141
1225398992724,2cyclictest1182136-21kworker/u8:1+flush-259:007:20:000
1225398992722,3cyclictest509-21rs:main0
1225405992622,3cyclictest1501436-21kworker/u8:1+flush-259:012:00:242
1225405992622,3cyclictest1318925-21kworker/u8:1+flush-259:008:50:012
1225401992623,2cyclictest1283245-21kworker/u8:0+flush-259:009:25:321
1225408992521,3cyclictest1318925-21kworker/u8:1+flush-259:009:00:313
1225405992521,3cyclictest1469762-21kworker/u8:2+flush-259:011:50:262
1225405992521,3cyclictest1355829-21kworker/u8:3+events_unbound09:25:182
1225405992520,4cyclictest1334701-21latency_hist08:55:012
1225401992522,2cyclictest1318925-21kworker/u8:1+flush-259:008:40:251
1225401992522,2cyclictest1283245-21kworker/u8:0+flush-259:009:55:171
1225401992520,3cyclictest1438822-21apt-get10:35:121
1225408992420,3cyclictest3354392-21kworker/u8:2+flush-259:008:30:013
1225408992420,3cyclictest3354392-21kworker/u8:2+flush-259:008:15:103
1225408992419,4cyclictest335557-21systemd-journal12:40:003
1225408992418,4cyclictest1469536-21latency_hist11:05:003
1225405992421,2cyclictest1355829-21kworker/u8:3+events_unbound10:05:232
1225405992421,2cyclictest1308975-21kworker/u8:3+flush-259:008:40:162
1225405992420,3cyclictest1182136-21kworker/u8:1+events_unbound07:55:212
1225405992420,3cyclictest1182136-21kworker/u8:1+events_unbound07:25:142
1225401992421,2cyclictest1485525-21kworker/u8:0+events_unbound11:20:241
1225401992420,3cyclictest1501436-21kworker/u8:1+events_unbound12:20:211
1225401992420,3cyclictest1501436-21kworker/u8:1+events_unbound11:40:281
1225401992420,3cyclictest1283245-21kworker/u8:0+events_unbound08:05:241
1225401992420,3cyclictest1220204-21kworker/u8:3+events_unbound07:40:141
1225401992420,3cyclictest1182136-21kworker/u8:1+flush-259:007:20:211
1225398992420,3cyclictest1485525-21kworker/u8:0+flush-259:011:20:250
1225398992420,3cyclictest1283245-21kworker/u8:0+flush-259:009:30:170
1225398992417,5cyclictest1271918-21latency_hist07:55:010
1225398992417,5cyclictest1250441-21ntpq07:30:230
1225408992318,3cyclictest1329816-21apt-get08:50:113
1225405992319,3cyclictest1376235-21kworker/u8:2+events_unbound09:33:312
1225405992319,3cyclictest1182136-21kworker/u8:1+events_unbound07:45:132
1225401992320,2cyclictest1318925-21kworker/u8:1+events_unbound09:20:201
1225401992318,4cyclictest1454015-21latency_hist10:50:011
1225398992314,7cyclictest1501436-21kworker/u8:1+flush-259:012:20:010
1225405992220,2cyclictest1220204-21kworker/u8:3+events_unbound07:54:292
1225405992219,2cyclictest1283245-21kworker/u8:0+flush-259:009:50:152
1225405992218,3cyclictest1182136-21kworker/u8:1+events_unbound07:35:202
1225405992216,4cyclictest1557324-21ntpq12:25:222
1225401992220,2cyclictest1501436-21kworker/u8:1+events_unbound12:30:251
1225401992219,3cyclictest1516797-21kworker/u8:0+events_unbound12:05:361
1225398992217,4cyclictest1220204-21kworker/u8:3+flush-259:007:45:300
1225398992216,5cyclictest335557-21systemd-journal12:05:010
1225398992216,4cyclictest1506804-21/usr/sbin/munin11:40:140
1225408992117,3cyclictest3354392-21kworker/u8:2+flush-259:008:10:263
1225408992117,3cyclictest1283245-21kworker/u8:0+flush-259:008:05:183
1225408992117,3cyclictest1182136-21kworker/u8:1+events_unbound07:30:213
1225405992118,2cyclictest3354392-21kworker/u8:2+events_unbound08:10:142
1225405992118,2cyclictest1501436-21kworker/u8:1+events_unbound12:24:302
1225405992118,2cyclictest1469762-21kworker/u8:2+flush-259:011:30:172
1225405992118,2cyclictest1283245-21kworker/u8:0+events_unbound08:25:262
1225405992117,3cyclictest1480592-21apt-get11:15:112
1225405992117,3cyclictest1324416-21kworker/u8:2+flush-259:009:00:002
1225401992118,2cyclictest1402369-21kworker/u8:4+events_unbound10:40:201
1225401992118,2cyclictest1225392-21cyclictest11:10:001
1225401992118,2cyclictest1225392-21cyclictest11:10:001
1225401992117,3cyclictest1355829-21kworker/u8:3+events_unbound11:17:311
1225401992117,3cyclictest1220204-21kworker/u8:3+flush-259:007:15:261
1225398992117,3cyclictest1318925-21kworker/u8:1+flush-259:009:00:180
1225398992117,2cyclictest1-21systemd07:25:000
1225398992112,6cyclictest1484616-21ntpq11:15:200
1225408992017,2cyclictest1495843-21apt-key11:30:003
1225405992017,2cyclictest1516797-21kworker/u8:0+events_unbound12:15:232
1225405992017,2cyclictest1220204-21kworker/u8:3+events_unbound08:05:152
1225405992017,2cyclictest1220204-21kworker/u8:3+events_unbound07:15:242
1225405992016,3cyclictest3354392-21kworker/u8:2+flush-259:007:10:242
1225405992016,3cyclictest1558265-21kworker/u8:2+flush-259:012:35:222
1225401992017,2cyclictest1501436-21kworker/u8:1+events_unbound12:25:231
1225401992017,2cyclictest1428415-21kworker/u8:2+flush-259:010:25:221
1225401992017,2cyclictest1324416-21kworker/u8:2+flush-259:009:05:231
1225401992017,2cyclictest1283245-21kworker/u8:0+events_unbound09:35:241
1225401992017,2cyclictest1220204-21kworker/u8:3+events_unbound07:50:281
1225401992016,3cyclictest1225643-21apt-get07:10:121
1225401992016,3cyclictest1220204-21kworker/u8:3+events_unbound07:46:321
1225398992016,2cyclictest1318925-21kworker/u8:1+flush-259:008:55:250
1225398992015,3cyclictest1558265-21kworker/u8:2+flush-259:012:35:010
1225398992014,4cyclictest335557-21systemd-journal10:03:300
1225408991916,2cyclictest1355803-21cron09:15:003
1225408991913,4cyclictest1447976-21ntpq10:40:213
1225405991917,2cyclictest1283245-21kworker/u8:0+events_unbound10:20:242
1225405991916,2cyclictest1402369-21kworker/u8:4+events_unbound10:40:232
1225405991915,3cyclictest1469762-21kworker/u8:2+flush-259:011:35:302
1225405991915,3cyclictest1428415-21kworker/u8:2+events_unbound10:25:222
1225405991915,3cyclictest1283245-21kworker/u8:0+events_unbound08:15:192
1225401991916,2cyclictest1402369-21kworker/u8:4+flush-259:011:45:251
1225401991916,2cyclictest1318925-21kworker/u8:1+events_unbound08:50:201
1225401991916,2cyclictest1283245-21kworker/u8:0+flush-259:010:20:311
1225398991915,3cyclictest3354392-21kworker/u8:2+events_unbound08:20:190
1225398991915,3cyclictest3354392-21kworker/u8:2+events_unbound08:20:180
1225408991816,1cyclictest1516921-21latency_hist11:50:003
1225408991815,2cyclictest1516797-21kworker/u8:0+flush-259:012:15:223
1225408991813,4cyclictest1387140-21/usr/sbin/munin09:45:173
1225405991815,2cyclictest1501436-21kworker/u8:1+flush-259:012:05:212
1225405991815,2cyclictest1350447-21latency_hist09:10:002
1225405991815,1cyclictest0-21swapper/208:35:002
1225401991816,1cyclictest1392088-21kworker/u8:1+events_unbound10:04:311
1225401991815,2cyclictest1418544-21irqcore10:15:151
1225401991815,2cyclictest1376235-21kworker/u8:2+flush-259:009:40:241
1225401991815,2cyclictest1283245-21kworker/u8:0+events_unbound08:24:571
1225401991815,2cyclictest1283245-21kworker/u8:0+events_unbound08:24:561
1225401991814,3cyclictest1356081-21apt-get09:15:121
1225401991814,3cyclictest1182136-21kworker/u8:1+events_unbound07:59:311
1225398991814,3cyclictest2971-21cron07:39:590
1225398991814,1cyclictest60350irq/132-enp0s29f1:rx-008:00:140
122540899176,8cyclictest1501436-21kworker/u8:1+flush-259:012:30:013
1225408991714,2cyclictest0-21swapper/309:25:013
1225408991712,4cyclictest1402369-21kworker/u8:4+flush-259:010:45:163
1225408991712,3cyclictest509-21rs:main3
1225405991715,1cyclictest0-21swapper/209:15:012
1225405991714,2cyclictest1501436-21kworker/u8:1+events_unbound11:40:262
1225405991714,2cyclictest1283245-21kworker/u8:0+flush-259:009:35:162
1225405991713,3cyclictest335557-21systemd-journal09:01:312
1225401991714,2cyclictest1355829-21kworker/u8:3+events_unbound10:59:591
1225401991713,3cyclictest1517185-21apt-get11:50:131
1225401991713,3cyclictest1475015-21apt-get11:10:111
1225398991714,2cyclictest61150irq/133-enp0s29f1:tx-008:45:210
1225398991712,3cyclictest60350irq/132-enp0s29f1:rx-012:20:210
122539899171,14cyclictest1-21systemd11:47:300
1225408991614,1cyclictest0-21swapper/307:25:003
1225408991612,3cyclictest509-21rs:main3
1225408991612,3cyclictest509-21rs:main3
1225408991612,3cyclictest1516797-21kworker/u8:0+flush-259:012:05:003
1225408991610,4cyclictest500-21systemd-logind08:25:013
1225408991610,4cyclictest500-21systemd-logind08:25:003
1225405991613,2cyclictest1355829-21kworker/u8:3+events_unbound10:30:192
1225405991612,3cyclictest1318925-21kworker/u8:1+events_unbound08:39:322
1225401991613,2cyclictest1416961-21ntp_kernel_pll_10:10:211
1225401991613,2cyclictest1283245-21kworker/u8:0+events_unbound08:46:271
1225398991613,2cyclictest60350irq/132-enp0s29f1:rx-008:40:140
1225398991612,3cyclictest60350irq/132-enp0s29f1:rx-012:25:230
1225398991612,3cyclictest60350irq/132-enp0s29f1:rx-009:40:210
1225398991612,2cyclictest0-21swapper/011:15:000
1225398991611,3cyclictest1272606-21apt-get07:55:120
1225408991513,2cyclictest1225392-21cyclictest09:10:013
1225408991511,3cyclictest1428415-21kworker/u8:2+flush-259:010:25:203
1225408991511,3cyclictest1283245-21kworker/u8:0+flush-259:010:15:253
1225408991511,3cyclictest1283245-21kworker/u8:0+flush-259:009:35:013
1225405991512,2cyclictest1283245-21kworker/u8:0+flush-259:009:40:112
1225401991512,2cyclictest1283245-21kworker/u8:0+flush-259:009:45:261
1225401991512,2cyclictest1283245-21kworker/u8:0+events_unbound08:25:281
1225401991512,2cyclictest1182136-21kworker/u8:1+flush-259:007:25:171
122539899159,4cyclictest1308026-21ntpq08:25:220
1225398991513,1cyclictest60350irq/132-enp0s29f1:rx-012:35:140
1225398991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:220
1225398991513,1cyclictest60350irq/132-enp0s29f1:rx-009:20:190
1225398991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:210
1225398991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:230
1225398991512,2cyclictest60350irq/132-enp0s29f1:rx-010:30:130
1225398991512,2cyclictest60350irq/132-enp0s29f1:rx-009:15:120
1225398991512,2cyclictest1443676-21cron10:40:000
1225398991512,1cyclictest60350irq/132-enp0s29f1:rx-010:10:010
1225398991511,3cyclictest60350irq/132-enp0s29f1:rx-011:55:120
1225398991511,3cyclictest1318925-21kworker/u8:1+flush-259:008:50:140
122539899151,12cyclictest509-21rs:main0
1225408991411,2cyclictest1506551-21cron11:40:003
1225408991411,2cyclictest0-21swapper/310:35:003
1225408991410,3cyclictest1220204-21kworker/u8:3+flush-259:007:15:263
1225405991410,3cyclictest1355829-21kworker/u8:3+events_unbound11:10:112
1225401991411,2cyclictest1435963-21sort10:30:201
1225398991412,1cyclictest60350irq/132-enp0s29f1:rx-010:45:150
1225398991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:150
1225398991412,1cyclictest60350irq/132-enp0s29f1:rx-007:40:170
1225398991411,2cyclictest60350irq/132-enp0s29f1:rx-010:41:080
1225398991411,2cyclictest60350irq/132-enp0s29f1:rx-010:20:120
1225398991411,2cyclictest60350irq/132-enp0s29f1:rx-009:55:260
1225398991410,2cyclictest60350irq/132-enp0s29f1:rx-009:35:160
122540899137,5cyclictest335557-21systemd-journal12:20:403
1225408991311,1cyclictest0-21swapper/307:44:593
1225408991310,2cyclictest1407989-21fschecks_count10:05:133
122540199138,4cyclictest335557-21systemd-journal07:31:291
1225401991310,2cyclictest1516797-21kworker/u8:0+events_unbound12:18:321
1225401991310,2cyclictest1283245-21kworker/u8:0+flush-259:008:15:151
122539899139,3cyclictest60350irq/132-enp0s29f1:rx-012:14:590
122539899138,3cyclictest1412990-21apt-get10:10:110
122540899129,2cyclictest1251636-21cpuspeed_turbos07:35:133
122540899129,2cyclictest0-21swapper/310:24:593
122540899129,2cyclictest0-21swapper/309:55:003
122540899128,3cyclictest1318925-21kworker/u8:1+flush-259:008:40:303
122540899127,3cyclictest335557-21systemd-journal09:43:303
122540899125,5cyclictest1339044-21ntpq08:55:233
1225408991210,1cyclictest0-21swapper/307:54:593
122540599129,2cyclictest335557-21systemd-journal11:23:192
122540599129,2cyclictest1442734-21kworker/u8:0+events_unbound10:55:162
122540599129,2cyclictest1283245-21kworker/u8:0+flush-259:010:15:182
122540599128,3cyclictest335557-21systemd-journal10:10:132
1225405991210,2cyclictest1283245-21kworker/u8:0+events_unbound10:01:302
122539899129,2cyclictest60350irq/132-enp0s29f1:rx-010:55:220
122539899129,2cyclictest60350irq/132-enp0s29f1:rx-009:25:240
1225398991210,1cyclictest60350irq/132-enp0s29f1:rx-011:35:200
1225398991210,1cyclictest60350irq/132-enp0s29f1:rx-008:08:100
122540899118,2cyclictest1438888-21cpuspeed_turbos10:35:133
122540899118,2cyclictest1397564-21cpuspeed_turbos09:55:143
122540899116,4cyclictest1501436-21kworker/u8:1+flush-259:012:05:253
122540599118,2cyclictest1355829-21kworker/u8:3+events_unbound10:35:252
122540599118,2cyclictest1240478-21unixbench_multi07:20:252
122540599117,3cyclictest1538025-21diskstats12:10:132
122540199118,2cyclictest1402369-21kworker/u8:4+events_unbound10:08:321
122539899118,2cyclictest1464698-21cpuspeed_turbos11:00:110
122540899107,2cyclictest1558678-21fschecks_count12:30:143
122540899107,2cyclictest1324835-21fschecks_count08:45:143
122539899108,2cyclictest60350irq/132-enp0s29f1:rx-011:50:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional