You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 10:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Aug 09, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1318909993935,3cyclictest1589188-21kworker/u8:0+events_unbound23:59:591
1318909993935,3cyclictest1517119-21apt-get22:20:131
1318905993833,3cyclictest335557-21systemd-journal19:25:000
1318915993733,3cyclictest1620952-21kworker/u8:1+flush-259:000:29:593
1318909993733,3cyclictest1620952-21kworker/u8:1+flush-259:000:24:591
1318905993730,5cyclictest1339514-21latency_hist19:30:010
1318905993630,4cyclictest1319112-21apt-get19:10:130
1318915993531,3cyclictest1344304-21kworker/u8:1+events_unbound19:35:243
1318913993529,4cyclictest1563388-21latency_hist23:05:002
1318905993428,4cyclictest1339935-21diskstats19:30:120
1318915993329,3cyclictest1506511-21kworker/u8:1+flush-259:022:25:273
1318915993328,3cyclictest1464735-21kworker/u8:2+events_unbound22:15:003
1318905993326,5cyclictest335557-21systemd-journal00:09:590
1318915993226,4cyclictest1522008-21latency_hist22:25:003
1318909993228,3cyclictest1475044-21kworker/u8:0+flush-259:022:19:591
1318905993215,4cyclictest1402375-21gpgv20:30:000
1318915993127,3cyclictest1532382-21kworker/u8:4+events_unbound22:50:013
1318915993127,3cyclictest1365074-21kworker/u8:2+flush-259:020:25:173
1318905993125,4cyclictest335557-21systemd-journal21:50:020
1318909993025,3cyclictest1334379-21kworker/u8:3+flush-259:019:50:191
1318909993023,5cyclictest335557-21systemd-journal19:20:011
1318915992925,3cyclictest1516900-21kworker/u8:3+flush-259:023:45:403
1318913992926,2cyclictest1308241-21kworker/u8:0+events_unbound20:10:012
1318913992925,3cyclictest1308241-21kworker/u8:0+flush-259:019:35:002
1318909992925,3cyclictest1516900-21kworker/u8:3+flush-259:023:05:261
1318909992922,5cyclictest1396778-21latency_hist20:25:001
1318913992824,3cyclictest1422716-21kworker/u8:1+flush-259:021:30:222
1318913992823,4cyclictest1365074-21kworker/u8:2+flush-259:020:50:012
1318909992825,2cyclictest1365074-21kworker/u8:2+flush-259:020:50:241
1318909992825,2cyclictest1308241-21kworker/u8:0+events_unbound20:30:111
1318909992824,3cyclictest1506511-21kworker/u8:1+events_unbound22:14:401
1318909992824,3cyclictest1334379-21kworker/u8:3+flush-259:019:40:241
1318909992821,5cyclictest1495265-21ntpq21:55:221
1318915992721,4cyclictest1542721-21latency_hist22:45:013
1318915992720,5cyclictest1490996-21latency_hist21:55:003
1318913992723,3cyclictest1516900-21kworker/u8:3+flush-259:023:10:212
1318909992723,3cyclictest1412705-21kworker/u8:3+events_unbound20:45:261
1318909992723,2cyclictest1308241-21kworker/u8:0+flush-259:020:05:141
1318915992623,2cyclictest1532382-21kworker/u8:4+flush-259:022:50:163
1318915992622,3cyclictest1422716-21kworker/u8:1+flush-259:021:15:163
1318913992620,4cyclictest1496586-21diskstats22:00:152
1318909992622,3cyclictest1365074-21kworker/u8:2+events_unbound19:58:281
1318909992622,3cyclictest1365074-21kworker/u8:2+events_unbound19:58:271
1318909992622,3cyclictest1334379-21kworker/u8:3+events_unbound19:47:051
1318909992622,3cyclictest1308241-21kworker/u8:0+flush-259:020:16:391
1318909992622,2cyclictest1516900-21kworker/u8:3+flush-259:023:35:261
1318905992622,3cyclictest335557-21systemd-journal21:56:540
1318915992521,3cyclictest1480217-21kworker/u8:4+events_unbound22:00:193
1318915992520,4cyclictest1480217-21kworker/u8:4+flush-259:022:09:593
1318915992519,4cyclictest1568540-21latency_hist23:10:013
1318909992522,2cyclictest1365074-21kworker/u8:2+flush-259:020:55:211
1318905992521,3cyclictest1308241-21kworker/u8:0+flush-259:020:30:180
1318905992519,4cyclictest1407774-21apt-get20:35:110
1318915992420,3cyclictest1516900-21kworker/u8:3+flush-259:022:35:153
1318915992420,3cyclictest1365074-21kworker/u8:2+events_unbound20:20:163
1318915992420,2cyclictest1578878-21idleruntime-cro23:20:003
1318913992420,2cyclictest1610879-21apt-get23:50:112
1318913992418,4cyclictest509-21rs:main2
1318909992422,2cyclictest1308241-21kworker/u8:0+events_unbound20:10:221
1318909992421,2cyclictest1589188-21kworker/u8:0+flush-259:023:45:211
1318909992420,3cyclictest1516900-21kworker/u8:3+flush-259:023:00:251
1318909992418,4cyclictest1527400-21/usr/sbin/munin22:30:131
1318905992418,4cyclictest1594324-21latency_hist23:35:010
1318915992320,2cyclictest1308241-21kworker/u8:0+events_unbound20:10:173
1318915992318,3cyclictest1370762-21gpgv20:00:013
1318915992318,3cyclictest1370762-21gpgv20:00:003
1318913992319,3cyclictest335557-21systemd-journal21:42:372
1318913992317,4cyclictest1599676-21store23:40:012
1318909992320,2cyclictest1438979-21kworker/u8:0+events_unbound21:16:511
1318909992320,2cyclictest1308241-21kworker/u8:0+flush-259:020:00:261
1318909992319,3cyclictest1308241-21kworker/u8:0+events_unbound19:39:381
1318909992319,2cyclictest1422716-21kworker/u8:1+flush-259:021:20:181
1318909992317,4cyclictest335557-21systemd-journal22:38:381
1318909992317,4cyclictest1334598-21/usr/sbin/munin19:25:221
1318909992315,6cyclictest335557-21systemd-journal00:35:001
1318905992317,4cyclictest1449250-21latency_hist21:15:020
1318915992219,3cyclictest1516900-21kworker/u8:3+flush-259:023:10:243
1318913992219,2cyclictest1641584-21idleruntime-cro00:20:002
1318913992219,2cyclictest1365074-21kworker/u8:2+flush-259:020:40:142
1318913992216,4cyclictest335557-21systemd-journal23:35:012
1318913992215,5cyclictest335557-21systemd-journal23:20:012
1318913992215,5cyclictest1505601-21ntpq22:05:192
1318909992219,2cyclictest1589188-21kworker/u8:0+events_unbound23:53:411
1318909992219,2cyclictest1516900-21kworker/u8:3+events_unbound23:30:261
1318909992217,4cyclictest1605172-21gpgv23:45:001
1318909992217,3cyclictest1532382-21kworker/u8:4+flush-259:022:40:191
1318909992217,3cyclictest1308241-21kworker/u8:0+events_unbound20:40:211
1318909992216,4cyclictest335557-21systemd-journal21:45:371
1318905992219,2cyclictest1365074-21kworker/u8:2+flush-259:020:05:010
1318915992118,2cyclictest1589188-21kworker/u8:0+flush-259:000:00:153
1318915992118,2cyclictest1318879-21kworker/u8:2+events_unbound19:24:403
1318915992118,2cyclictest1308241-21kworker/u8:0+flush-259:019:25:203
1318915992117,3cyclictest1449273-21kworker/u8:3+events_unbound21:27:253
1318915992117,3cyclictest1308241-21kworker/u8:0+events_unbound20:41:393
1318913992116,3cyclictest1428866-21apt-get20:55:112
1318909992119,1cyclictest1434044-21apt-get21:00:131
1318909992118,2cyclictest1620952-21kworker/u8:1+events_unbound00:05:191
1318909992118,2cyclictest1365074-21kworker/u8:2+flush-259:020:25:201
1318909992118,2cyclictest1365074-21kworker/u8:2+events_unbound21:05:201
1318909992117,3cyclictest1506511-21kworker/u8:1+flush-259:022:25:211
1318909992117,3cyclictest1449273-21kworker/u8:3+events_unbound21:50:221
1318909992117,2cyclictest1449273-21kworker/u8:3+flush-259:021:35:201
1318905992115,4cyclictest1657351-21/usr/sbin/munin00:35:150
1318915992017,3cyclictest1308241-21kworker/u8:0+events_unbound20:05:183
1318915992017,2cyclictest1365074-21kworker/u8:2+flush-259:020:35:253
1318915992017,2cyclictest1365074-21kworker/u8:2+events_unbound21:00:383
1318915992017,2cyclictest1365074-21kworker/u8:2+events_unbound20:05:003
1318915992016,3cyclictest1516900-21kworker/u8:3+flush-259:023:50:193
1318915992016,3cyclictest1438979-21kworker/u8:0+flush-259:021:11:483
1318913992015,4cyclictest1423605-21base6420:50:012
1318909992014,4cyclictest1542956-21/usr/sbin/munin22:45:141
1318909992012,6cyclictest335557-21systemd-journal23:23:391
1318905992014,4cyclictest1475261-21/usr/sbin/munin21:40:160
1318915991916,2cyclictest1365074-21kworker/u8:2+flush-259:020:50:263
1318915991915,3cyclictest1506511-21kworker/u8:1+events_unbound23:03:383
1318915991915,3cyclictest1475044-21kworker/u8:0+flush-259:021:45:163
1318915991915,3cyclictest1308241-21kworker/u8:0+flush-259:020:15:273
1318915991914,4cyclictest1516900-21kworker/u8:3+events_unbound23:40:153
1318915991914,4cyclictest1423000-21latency_hist20:50:003
1318913991915,3cyclictest1532382-21kworker/u8:4+flush-259:022:40:252
1318913991911,5cyclictest1657109-21latency_hist00:35:012
1318909991916,2cyclictest1631234-21kworker/u8:2+events_unbound00:15:231
1318909991916,2cyclictest1449273-21kworker/u8:3+events_unbound21:25:531
1318909991915,3cyclictest1620952-21kworker/u8:1+events_unbound00:35:141
1318909991913,4cyclictest335557-21systemd-journal22:50:391
1318909991910,8cyclictest1506499-21munin-run22:09:591
1318905991916,2cyclictest509-21rs:main0
1318905991915,3cyclictest1616056-21apt-get23:55:120
1318905991915,3cyclictest1506511-21kworker/u8:1+flush-259:022:35:230
1318905991915,3cyclictest1381554-21apt-get20:10:120
1318905991915,3cyclictest1365074-21kworker/u8:2+flush-259:020:20:160
1318905991912,5cyclictest1552132-21ntpq22:50:210
1318905991912,5cyclictest1422099-21ntpq20:45:210
1318915991815,2cyclictest1449273-21kworker/u8:3+events_unbound21:40:213
1318915991815,2cyclictest1422716-21kworker/u8:1+flush-259:020:56:483
1318915991815,2cyclictest1308241-21kworker/u8:0+flush-259:019:30:193
1318915991814,3cyclictest1449273-21kworker/u8:3+flush-259:021:35:253
1318915991812,4cyclictest1598565-21ntpq23:35:223
1318909991814,3cyclictest1620952-21kworker/u8:1+events_unbound00:25:221
1318909991814,3cyclictest1589188-21kworker/u8:0+flush-259:000:00:181
1318915991714,2cyclictest1422716-21kworker/u8:1+flush-259:021:05:123
1318915991714,2cyclictest1334379-21kworker/u8:3+events_unbound19:40:123
1318915991711,4cyclictest1642009-21diskstats00:20:143
1318913991714,2cyclictest1606155-21irqcore23:45:182
1318913991713,3cyclictest1308241-21kworker/u8:0+flush-259:019:55:002
1318913991711,4cyclictest335557-21systemd-journal20:40:002
1318913991711,4cyclictest1464722-21latency_hist21:30:012
1318913991710,4cyclictest335557-21systemd-journal20:33:382
1318909991714,2cyclictest1516900-21kworker/u8:3+flush-259:023:25:201
1318909991714,2cyclictest1516900-21kworker/u8:3+flush-259:023:10:131
1318909991714,2cyclictest1365074-21kworker/u8:2+events_unbound20:39:561
1318909991711,4cyclictest1620952-21kworker/u8:1+events_unbound00:10:131
1318905991714,2cyclictest60350irq/132-enp0s29f1:rx-022:18:090
1318905991714,2cyclictest1584722-21irqcore23:25:160
1318905991711,5cyclictest335557-21systemd-journal00:14:550
1318905991711,5cyclictest1572835-21ntpq23:10:200
1318905991710,5cyclictest1526283-21ntpq22:25:240
1318915991613,2cyclictest1516900-21kworker/u8:3+flush-259:023:55:253
1318915991613,2cyclictest1318879-21kworker/u8:2+events_unbound19:12:393
1318915991612,3cyclictest1636442-21kworker/u8:0+events_unbound00:18:113
1318915991612,3cyclictest1422716-21kworker/u8:1+flush-259:021:20:143
1318915991611,4cyclictest1516900-21kworker/u8:3+events_unbound23:25:183
131891599160,15cyclictest1-21systemd23:23:393
131891399163,7cyclictest1522019-21munin-run22:24:592
1318913991612,2cyclictest0-21swapper/219:24:592
1318909991613,2cyclictest1318879-21kworker/u8:2+flush-259:019:20:191
1318909991612,3cyclictest1308241-21kworker/u8:0+flush-259:019:30:461
1318909991610,5cyclictest1501365-21latency_hist22:05:001
1318905991614,1cyclictest60350irq/132-enp0s29f1:rx-023:50:220
1318905991614,1cyclictest60350irq/132-enp0s29f1:rx-022:55:240
1318905991614,1cyclictest60350irq/132-enp0s29f1:rx-020:44:240
1318905991614,1cyclictest60350irq/132-enp0s29f1:rx-019:15:120
1318905991614,1cyclictest60350irq/132-enp0s29f1:rx-000:25:180
1318905991613,2cyclictest60350irq/132-enp0s29f1:rx-022:40:160
1318905991613,2cyclictest60350irq/132-enp0s29f1:rx-019:36:290
1318905991612,2cyclictest60350irq/132-enp0s29f1:rx-023:37:390
1318905991612,2cyclictest1584045-21turbostat23:25:000
1318915991512,2cyclictest1620952-21kworker/u8:1+flush-259:000:35:253
1318915991512,2cyclictest1516900-21kworker/u8:3+events_unbound23:30:153
1318915991512,2cyclictest1308241-21kworker/u8:0+events_unbound20:30:183
131891399159,4cyclictest335557-21systemd-journal22:30:372
1318913991511,3cyclictest1397111-21cpuspeed_turbos20:25:142
1318913991511,3cyclictest1391865-21apt-get20:20:122
1318913991510,4cyclictest1334379-21kworker/u8:3+flush-259:019:40:172
1318909991511,3cyclictest1449273-21kworker/u8:3+flush-259:021:40:191
1318909991511,3cyclictest1422716-21kworker/u8:1+flush-259:021:10:451
1318909991510,3cyclictest1318879-21kworker/u8:2+events_unbound19:11:491
131890599159,4cyclictest1547877-21latency_hist22:50:010
131890599158,5cyclictest1380437-21ntpq20:05:220
1318905991513,2cyclictest60350irq/132-enp0s29f1:rx-021:38:180
1318905991513,1cyclictest60350irq/132-enp0s29f1:rx-022:30:240
1318905991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:260
1318905991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:060
1318905991513,1cyclictest60350irq/132-enp0s29f1:rx-021:05:030
1318905991513,1cyclictest60350irq/132-enp0s29f1:rx-000:01:370
1318905991512,2cyclictest61150irq/133-enp0s29f1:tx-020:15:200
1318905991512,2cyclictest61150irq/133-enp0s29f1:tx-019:45:130
1318905991512,2cyclictest60350irq/132-enp0s29f1:rx-023:44:410
1318905991512,2cyclictest60350irq/132-enp0s29f1:rx-022:00:160
1318905991512,2cyclictest60350irq/132-enp0s29f1:rx-020:54:430
131891599149,3cyclictest1334379-21kworker/u8:3+flush-259:019:45:183
1318915991410,3cyclictest1449273-21kworker/u8:3+events_unbound21:30:153
131891399149,3cyclictest1422716-21kworker/u8:1+flush-259:021:10:172
131890599148,4cyclictest1605061-21apt-get23:45:020
1318905991413,1cyclictest60350irq/132-enp0s29f1:rx-000:15:250
1318905991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:170
1318905991411,2cyclictest60350irq/132-enp0s29f1:rx-021:20:120
1318905991411,2cyclictest1370598-21systemd-run20:00:010
1318905991411,2cyclictest1370598-21systemd-run20:00:000
1318905991410,3cyclictest1516900-21kworker/u8:3+flush-259:023:20:010
131891599139,3cyclictest2482194-21kworker/u8:1+events_unbound19:15:383
131891599139,3cyclictest1475044-21kworker/u8:0+events_unbound22:17:343
1318915991311,1cyclictest0-21swapper/300:35:003
1318915991310,2cyclictest1506511-21kworker/u8:1+events_unbound22:33:393
131891399139,3cyclictest1318879-21kworker/u8:2+flush-259:019:10:202
131891399137,4cyclictest1328280-21ntpq19:15:212
1318913991310,2cyclictest1651457-21unixbench_multi00:25:262
1318913991310,2cyclictest0-21swapper/223:25:012
1318913991310,1cyclictest0-21swapper/222:50:142
1318909991310,2cyclictest1516900-21kworker/u8:3+events_unbound23:15:171
1318905991312,1cyclictest60350irq/132-enp0s29f1:rx-019:51:380
1318905991311,1cyclictest60350irq/132-enp0s29f1:rx-022:05:240
1318905991311,1cyclictest60350irq/132-enp0s29f1:rx-000:30:130
1318905991310,2cyclictest60350irq/132-enp0s29f1:rx-021:45:180
1318905991310,2cyclictest60350irq/132-enp0s29f1:rx-021:25:030
1318905991310,2cyclictest1454403-21sh21:20:000
131891599129,2cyclictest1532382-21kworker/u8:4+flush-259:022:55:213
131891599129,2cyclictest1334379-21kworker/u8:3+flush-259:019:50:263
131891599127,4cyclictest1620952-21kworker/u8:1+flush-259:000:10:143
131891599126,4cyclictest1496145-21cron21:59:593
131891399129,2cyclictest1604590-21unixbench_multi23:40:242
131891399127,4cyclictest1438979-21kworker/u8:0+flush-259:021:15:262
131891399127,3cyclictest1485399-21gpgv21:50:002
131890599129,2cyclictest60350irq/132-enp0s29f1:rx-000:20:200
1318905991210,1cyclictest60350irq/132-enp0s29f1:rx-019:40:260
131891599117,3cyclictest1620952-21kworker/u8:1+flush-259:000:07:153
131891399119,1cyclictest0-21swapper/223:05:272
131891399119,1cyclictest0-21swapper/200:14:592
131891399118,2cyclictest1620952-21kworker/u8:1+flush-259:000:40:002
131891399118,1cyclictest0-21swapper/222:25:202
131891399117,3cyclictest1533053-21irqcore22:35:182
131891399117,3cyclictest1318879-21kworker/u8:2+flush-259:019:26:432
131891399116,4cyclictest1365620-21apt-get19:55:122
131891399116,4cyclictest1365620-21apt-get19:55:122
131891399116,3cyclictest335557-21systemd-journal00:07:232
131891399116,3cyclictest1490725-21sshd21:51:532
131890599118,2cyclictest60350irq/132-enp0s29f1:rx-021:30:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional