You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 14:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Jun 03, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1243219994036,3cyclictest1365151-21gpgv21:20:002
1243219993835,2cyclictest1489375-21kworker/u8:2+flush-259:023:50:002
1243219993834,3cyclictest1463812-21kworker/u8:3+events_unbound23:05:012
1243219993832,4cyclictest1499932-21latency_hist23:30:022
1243219993429,4cyclictest335557-21systemd-journal19:57:272
1243216993428,4cyclictest509-21rs:main1
1243216993428,4cyclictest509-21rs:main1
1243214993428,4cyclictest1395854-21ntpq21:45:200
1243224993330,2cyclictest1254771-21kworker/u8:1+events_unbound19:55:253
1243224993229,2cyclictest1254771-21kworker/u8:1+flush-259:019:50:153
1243224993228,3cyclictest1505509-21gpgv23:35:003
1243216993225,4cyclictest1344856-21diskstats21:00:151
1243214993228,3cyclictest1526720-21apt-get23:55:120
1243216993125,4cyclictest1401429-21kworker/u8:0+flush-259:022:00:171
1243214992926,2cyclictest1260788-21kworker/u8:0+events_unbound19:40:170
1243214992924,4cyclictest1427661-21latency_hist22:20:000
1243219992724,2cyclictest1463812-21kworker/u8:3+flush-259:000:00:282
1243219992721,5cyclictest1323836-21latency_hist20:40:012
1243216992721,4cyclictest1354734-21latency_hist21:10:011
1243224992622,3cyclictest1232529-21kworker/u8:2+events_unbound19:26:273
1243219992622,3cyclictest1551439-21kworker/u8:1+flush-259:000:20:002
1243219992622,3cyclictest1401429-21kworker/u8:0+flush-259:022:15:002
1243216992620,4cyclictest335557-21systemd-journal00:16:301
1243216992620,4cyclictest1437158-21ntpq22:25:221
1243216992620,4cyclictest1254771-21kworker/u8:1+flush-259:020:05:001
1243216992618,5cyclictest1531585-21latency_hist00:00:001
1243214992622,3cyclictest1302555-21apt-get20:20:110
1243216992520,3cyclictest1547060-21sh00:14:591
1243216992519,4cyclictest1495035-21apt-get23:25:121
1243214992520,3cyclictest1249201-21apt-get19:20:070
1243224992422,1cyclictest1495010-21/usr/sbin/munin23:25:153
1243224992421,2cyclictest1427402-21kworker/u8:2+flush-259:022:55:173
1243224992421,2cyclictest1370825-21kworker/u8:4+flush-259:021:45:243
1243224992421,2cyclictest1318268-21https20:35:003
1243224992420,3cyclictest335557-21systemd-journal20:20:003
1243224992420,3cyclictest1272147-21kworker/u8:0+events_unbound20:05:173
1243214992421,2cyclictest1463812-21kworker/u8:3+events_unbound23:05:200
1243214992418,4cyclictest1499935-21apt-get23:30:010
1243224992320,2cyclictest1401429-21kworker/u8:0+flush-259:022:05:213
1243224992320,2cyclictest1401429-21kworker/u8:0+events_unbound22:40:273
1243224992320,2cyclictest1205289-21kworker/u8:3+events_unbound19:20:123
1243224992319,3cyclictest335557-21systemd-journal22:27:333
1243216992319,3cyclictest1254771-21kworker/u8:1+flush-259:019:59:591
1243216992316,5cyclictest1401429-21kworker/u8:0+flush-259:022:05:171
1243214992320,2cyclictest1376039-21apt-get21:30:270
1243214992317,4cyclictest335557-21systemd-journal20:05:010
1243224992219,2cyclictest1427402-21kworker/u8:2+events_unbound23:05:233
1243224992218,3cyclictest1292206-21apt-get20:10:113
1243224992216,4cyclictest1473243-21ntpq23:00:223
1243219992219,2cyclictest1531830-21kworker/u8:0+events_unbound00:10:172
1243219992219,2cyclictest1318902-21kworker/u8:3+events_unbound21:00:192
1243219992218,3cyclictest1479307-21kworker/u8:0+flush-259:023:15:152
1243216992216,4cyclictest1422805-21apt-get22:15:111
1243214992217,4cyclictest1286472-21gpgv20:05:000
1243224992118,2cyclictest1479307-21kworker/u8:0+events_unbound23:10:133
1243224992117,3cyclictest1318902-21kworker/u8:3+flush-259:020:50:253
1243224992117,3cyclictest1272147-21kworker/u8:0+events_unbound20:57:283
1243224992115,4cyclictest1427900-21/usr/sbin/munin22:20:153
1243224992115,4cyclictest1365724-21apt-get21:20:123
1243219992118,2cyclictest1370825-21kworker/u8:4+flush-259:021:40:202
1243219992116,4cyclictest1500620-21apt-get23:30:122
1243216992118,2cyclictest75-21kswapd020:05:021
1243216992115,4cyclictest1453710-21apt-get22:45:121
1243216992115,4cyclictest1329021-21latency_hist20:45:011
1243214992118,2cyclictest1232529-21kworker/u8:2+flush-259:019:45:260
1243214992118,2cyclictest1232529-21kworker/u8:2+flush-259:019:45:260
1243214992117,3cyclictest1463812-21kworker/u8:3+flush-259:023:35:160
1243214992117,3cyclictest1334084-21kworker/u8:1+events_unbound20:50:150
1243214992117,3cyclictest1318902-21kworker/u8:3+flush-259:020:55:110
1243224992018,2cyclictest1551439-21kworker/u8:1+events_unbound00:18:293
1243224992017,2cyclictest1401429-21kworker/u8:0+events_unbound22:00:143
1243224992017,2cyclictest1232529-21kworker/u8:2+events_unbound19:14:283
1243224992016,3cyclictest1463812-21kworker/u8:3+flush-259:023:45:003
1243224992016,3cyclictest1391643-21kworker/u8:1+flush-259:021:55:253
1243224992016,3cyclictest1318902-21kworker/u8:3+flush-259:020:40:003
1243224992016,3cyclictest1292173-21kworker/u8:4+events_unbound20:23:283
1243219992016,3cyclictest1401429-21kworker/u8:0+events_unbound22:35:202
1243219992016,3cyclictest1391643-21kworker/u8:1+flush-259:021:55:212
1243219992016,3cyclictest1370825-21kworker/u8:4+events_unbound21:45:232
1243216992016,3cyclictest1401429-21kworker/u8:0+flush-259:022:30:251
1243216992016,3cyclictest1318902-21kworker/u8:3+flush-259:020:35:171
1243216992015,3cyclictest1297368-21apt-get20:15:121
1243216992014,4cyclictest335557-21systemd-journal19:16:281
1243216992013,5cyclictest1318250-21latency_hist20:35:011
1243214992018,2cyclictest1489375-21kworker/u8:2+flush-259:023:20:210
1243214992016,3cyclictest1432843-21kworker/u8:3+flush-259:022:45:000
1243214992016,3cyclictest1417645-21apt-get22:10:120
1243214992014,5cyclictest1359011-21ntpq21:10:220
1243224991916,2cyclictest1489375-21kworker/u8:2+events_unbound23:55:233
1243224991916,2cyclictest1463812-21kworker/u8:3+flush-259:023:35:233
1243224991916,2cyclictest1370825-21kworker/u8:4+flush-259:021:25:153
1243224991916,2cyclictest1292173-21kworker/u8:4+events_unbound20:25:233
1243224991915,3cyclictest1318016-21kworker/u8:2+flush-259:020:45:163
1243224991915,2cyclictest1365047-21idleruntime-cro21:19:593
1243224991913,5cyclictest335557-21systemd-journal22:40:003
1243219991916,2cyclictest1511050-21latency_hist23:40:002
1243219991916,2cyclictest1272147-21kworker/u8:0+flush-259:020:00:212
1243219991916,2cyclictest1205289-21kworker/u8:3+events_unbound19:25:002
1243219991915,3cyclictest1254771-21kworker/u8:1+events_unbound19:50:022
1243216991916,2cyclictest1562565-21cron00:29:591
1243216991915,3cyclictest1232529-21kworker/u8:2+flush-259:019:35:001
1243216991914,4cyclictest335557-21systemd-journal23:37:291
1243214991916,2cyclictest1272147-21kworker/u8:0+flush-259:021:05:250
1243214991915,3cyclictest1370825-21kworker/u8:4+flush-259:021:35:200
1243224991816,1cyclictest1551439-21kworker/u8:1+events_unbound00:20:193
1243224991816,1cyclictest1531830-21kworker/u8:0+events_unbound00:00:133
1243224991815,2cyclictest1557616-21kworker/u8:4+events_unbound00:25:223
1243224991815,2cyclictest1443170-21kworker/u8:1+events_unbound23:15:263
1243224991815,2cyclictest1353767-21needreboot21:05:203
1243224991815,2cyclictest1272147-21kworker/u8:0+events_unbound21:00:133
1243224991813,4cyclictest1260819-21apt-get19:40:083
1243224991813,3cyclictest1254771-21kworker/u8:1+events_unbound19:50:003
1243224991813,3cyclictest1254771-21kworker/u8:1+events_unbound19:49:593
1243224991811,5cyclictest1457760-21ntpq22:45:233
1243219991815,2cyclictest1552871-21irqcore00:20:192
1243219991815,2cyclictest1427402-21kworker/u8:2+events_unbound22:45:142
1243219991815,2cyclictest1401429-21kworker/u8:0+events_unbound22:15:162
1243219991815,2cyclictest1272147-21kworker/u8:0+events_unbound21:05:222
1243219991815,2cyclictest1232529-21kworker/u8:2+flush-259:019:30:202
1243219991814,3cyclictest1463812-21kworker/u8:3+flush-259:023:50:162
1243216991815,2cyclictest1490317-21irqcore23:20:171
1243216991814,3cyclictest1401429-21kworker/u8:0+flush-259:022:35:241
1243216991814,3cyclictest1308018-21gpgv20:25:011
1243214991815,2cyclictest1489375-21kworker/u8:2+flush-259:000:35:240
1243214991815,2cyclictest1370825-21kworker/u8:4+flush-259:021:50:210
1243214991814,3cyclictest1531830-21kworker/u8:0+events_unbound00:18:020
1243214991814,3cyclictest1402206-21apt-get21:55:120
1243224991714,2cyclictest1349613-21kworker/u8:2+flush-259:021:40:153
1243224991714,2cyclictest1205289-21kworker/u8:3+events_unbound19:37:283
1243224991713,3cyclictest1562807-21kworker/u8:0+events_unbound00:30:193
1243219991714,2cyclictest1531830-21kworker/u8:0+events_unbound00:25:002
1243219991714,2cyclictest1288033-21kworker/u8:3+flush-259:020:15:202
1243219991712,4cyclictest335557-21systemd-journal22:43:282
1243216991715,1cyclictest1365364-21apt-key21:20:001
1243216991714,2cyclictest1566836-21ntp_kernel_pll_00:30:231
1243216991713,3cyclictest1463812-21kworker/u8:3+flush-259:023:45:251
1243216991712,4cyclictest1307672-21gpgv20:25:011
124321699171,14cyclictest1557412-21unin-run00:25:011
1243214991713,3cyclictest1272147-21kworker/u8:0+flush-259:019:50:180
1243214991712,4cyclictest1541031-21ntpq00:05:250
124322499168,6cyclictest1381744-21diskstats21:35:143
1243224991613,2cyclictest1417281-21kworker/u8:3+events_unbound22:10:213
1243224991613,2cyclictest1318902-21kworker/u8:3+flush-259:021:10:163
1243224991613,2cyclictest0-21swapper/320:05:003
1243224991612,3cyclictest1489375-21kworker/u8:2+events_unbound23:22:473
1243224991612,3cyclictest1427402-21kworker/u8:2+events_unbound22:33:293
1243219991613,2cyclictest1562807-21kworker/u8:0+flush-259:000:30:162
1243219991613,2cyclictest1427402-21kworker/u8:2+events_unbound22:50:222
1243219991613,2cyclictest1401933-21idleruntime-cro21:55:002
1243219991612,3cyclictest335557-21systemd-journal23:57:282
1243219991612,3cyclictest1427402-21kworker/u8:2+flush-259:022:55:212
1243219991612,3cyclictest1407149-21kworker/u8:2+events_unbound22:00:232
1243216991613,2cyclictest75-21kswapd021:20:021
1243216991612,3cyclictest1318016-21kworker/u8:2+flush-259:020:46:321
1243214991614,1cyclictest60350irq/132-enp0s29f1:rx-021:25:240
1243214991614,1cyclictest60350irq/132-enp0s29f1:rx-019:34:380
1243214991613,2cyclictest1551439-21kworker/u8:1+events_unbound00:20:160
1243214991613,2cyclictest1479961-21irqcore23:10:160
1243214991613,2cyclictest1427402-21kworker/u8:2+flush-259:022:20:190
1243214991613,2cyclictest1427402-21kworker/u8:2+events_unbound22:55:120
1243214991613,2cyclictest1318902-21kworker/u8:3+flush-259:021:00:200
1243214991612,3cyclictest1401429-21kworker/u8:0+flush-259:022:30:190
1243214991611,4cyclictest335557-21systemd-journal23:30:000
1243214991611,4cyclictest1511307-21apt-get23:40:110
1243224991511,3cyclictest1427402-21kworker/u8:2+flush-259:022:50:253
1243224991511,3cyclictest1427402-21kworker/u8:2+flush-259:022:18:573
1243219991513,2cyclictest1427402-21kworker/u8:2+flush-259:022:20:252
1243219991513,2cyclictest1401429-21kworker/u8:0+events_unbound22:05:142
1243219991513,2cyclictest1292173-21kworker/u8:4+events_unbound20:21:292
1243219991512,2cyclictest1493872-21ntp_kernel_pll_23:20:212
1243219991512,2cyclictest1443170-21kworker/u8:1+flush-259:023:10:172
1243219991512,2cyclictest1401429-21kworker/u8:0+flush-259:022:30:212
1243219991512,2cyclictest1313750-21grep20:30:182
1243219991511,3cyclictest1318902-21kworker/u8:3+events_unbound21:11:292
1243219991511,3cyclictest1272147-21kworker/u8:0+events_unbound21:20:242
1243216991510,3cyclictest335557-21systemd-journal21:56:271
1243214991513,2cyclictest1401429-21kworker/u8:0+events_unbound22:00:240
1243214991513,2cyclictest1232529-21kworker/u8:2+events_unbound19:10:230
1243214991513,1cyclictest60350irq/132-enp0s29f1:rx-020:43:330
1243214991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:390
1243214991512,2cyclictest60350irq/132-enp0s29f1:rx-022:05:140
1243214991512,2cyclictest1318016-21kworker/u8:2+flush-259:020:48:580
1243214991512,2cyclictest1272147-21kworker/u8:0+flush-259:020:10:240
1243214991511,3cyclictest1531830-21kworker/u8:0+events_unbound00:10:130
1243214991511,3cyclictest1516466-21apt-get23:45:110
1243214991510,4cyclictest335557-21systemd-journal20:30:000
124322499148,4cyclictest1542162-21/usr/sbin/munin00:10:163
1243224991410,2cyclictest1526467-21turbostat23:54:593
1243219991411,3cyclictest1260788-21kworker/u8:0+events_unbound19:43:292
1243219991411,2cyclictest1531830-21kworker/u8:0+events_unbound00:05:222
1243219991411,2cyclictest1427402-21kworker/u8:2+events_unbound22:30:002
1243219991410,3cyclictest1562807-21kworker/u8:0+events_unbound00:36:312
1243219991410,3cyclictest1349613-21kworker/u8:2+events_unbound21:35:142
1243219991410,3cyclictest1272147-21kworker/u8:0+events_unbound20:55:132
124321999140,1cyclictest1254737-21munin-run19:30:002
1243216991411,2cyclictest1297088-21cron20:15:001
1243216991410,3cyclictest1370825-21kworker/u8:4+flush-259:021:40:171
124321499149,4cyclictest1448289-21latency_hist22:40:000
1243214991413,1cyclictest60350irq/132-enp0s29f1:rx-023:04:440
1243214991413,1cyclictest60350irq/132-enp0s29f1:rx-022:46:520
1243214991413,1cyclictest60350irq/132-enp0s29f1:rx-000:30:080
1243214991412,1cyclictest60350irq/132-enp0s29f1:rx-020:16:060
1243214991411,2cyclictest1432843-21kworker/u8:3+flush-259:022:25:160
1243214991411,2cyclictest1427402-21kworker/u8:2+events_unbound22:50:200
1243214991411,2cyclictest1359660-21kworker/u8:1+events_unbound21:15:190
124322499139,3cyclictest1489375-21kworker/u8:2+events_unbound00:39:303
124322499139,3cyclictest1463812-21kworker/u8:3+flush-259:000:05:163
124322499139,3cyclictest1272147-21kworker/u8:0+events_unbound21:30:303
124322499139,2cyclictest1326949-21kthreadcore20:40:193
124321999137,4cyclictest1334128-21latency_hist20:50:012
1243219991310,2cyclictest500-21systemd-logind20:15:002
1243216991310,2cyclictest1370995-21cpuspeed_turbos21:25:131
1243216991310,2cyclictest0-21swapper/121:55:001
1243216991310,1cyclictest0-21swapper/123:00:011
1243214991312,1cyclictest60350irq/132-enp0s29f1:rx-019:55:340
1243214991312,1cyclictest60350irq/132-enp0s29f1:rx-019:16:560
1243214991312,1cyclictest60350irq/132-enp0s29f1:rx-000:25:130
1243214991311,1cyclictest60350irq/132-enp0s29f1:rx-023:15:150
124322499128,2cyclictest1370825-21kworker/u8:4+flush-259:021:50:203
124321999129,2cyclictest1370935-21cpuspeed_turbos21:25:132
124321999129,2cyclictest1288033-21kworker/u8:3+flush-259:020:05:282
124321999128,3cyclictest1489375-21kworker/u8:2+events_unbound23:42:312
1243219991211,1cyclictest1318902-21kworker/u8:3+events_unbound20:51:292
1243219991210,2cyclictest1272147-21kworker/u8:0+flush-259:020:40:202
124321699129,2cyclictest0-21swapper/123:05:141
124321699126,4cyclictest335557-21systemd-journal23:53:301
124321699121,9cyclictest1254084-21awk19:25:001
124321699121,3cyclictest1381144-21cat21:35:001
1243216991210,1cyclictest0-21swapper/100:00:141
124321499129,2cyclictest1463812-21kworker/u8:3+events_unbound23:50:130
1243214991211,1cyclictest60350irq/132-enp0s29f1:rx-021:20:570
124322499115,4cyclictest1516627-21diskstats23:45:123
124321999118,2cyclictest1272147-21kworker/u8:0+flush-259:020:29:582
124321999118,2cyclictest1232529-21kworker/u8:2+flush-259:019:10:192
124321999118,2cyclictest1205289-21kworker/u8:3+events_unbound19:18:292
124321699118,2cyclictest1479745-21fschecks_count23:10:151
124321699118,2cyclictest1427402-21kworker/u8:2+flush-259:022:21:321
124321699118,2cyclictest0-21swapper/123:44:591
124321699117,3cyclictest1260788-21kworker/u8:0+flush-259:019:40:211
124321499119,1cyclictest60350irq/132-enp0s29f1:rx-019:38:050
124321499119,1cyclictest60350irq/132-enp0s29f1:rx-019:29:500
124322499106,2cyclictest0-21swapper/319:35:003
124321999107,2cyclictest1265950-21kworker/u8:4+flush-259:019:45:212
124321999107,2cyclictest1265950-21kworker/u8:4+flush-259:019:45:212
124321999106,3cyclictest1205289-21kworker/u8:3+events_unbound19:38:282
124321699104,4cyclictest335557-21systemd-journal19:55:001
124321699100,1cyclictest13349291irqcore20:50:171
124321499108,1cyclictest0-21swapper/020:35:140
12432249995,3cyclictest1232529-21kworker/u8:2+flush-259:019:17:013
12432169995,3cyclictest1254462-21sshd19:26:591
12432169990,2cyclictest1260557-21latency_hist19:40:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional