You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 05:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Jun 27, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2684407995739,13cyclictest2923359-21latency_hist23:00:013
2684403994942,5cyclictest2902807-21latency_hist22:40:012
2684397994942,5cyclictest335557-21systemd-journal20:20:000
2684403994743,3cyclictest2840696-21kworker/u8:2+events_unbound21:45:242
2684400994744,2cyclictest2985478-21kworker/u8:2+events_unbound00:05:161
2684400994741,4cyclictest2792299-21ntpq20:50:201
2684400994643,2cyclictest2949141-21kworker/u8:1+events_unbound23:30:141
2684400994542,2cyclictest2776793-21kworker/u8:1+events_unbound20:44:341
2684400994541,3cyclictest2761857-21kworker/u8:3+events_unbound22:12:331
2684403994441,2cyclictest2918217-21kworker/u8:2+events_unbound23:35:212
2684407994337,4cyclictest2699869-21latency_hist19:25:013
2684400994341,2cyclictest2761857-21kworker/u8:3+events_unbound22:25:231
2684400994340,2cyclictest2933649-21kworker/u8:4+events_unbound23:54:331
2684400994340,2cyclictest2856028-21kworker/u8:1+events_unbound23:05:221
2684400994340,2cyclictest2746386-21kworker/u8:0+events_unbound20:30:321
2684400994337,5cyclictest2730875-21latency_hist19:55:001
2684400994239,2cyclictest2959624-21kworker/u8:3+events_unbound23:45:211
2684400994239,2cyclictest2776793-21kworker/u8:1+events_unbound21:05:141
2684400994239,2cyclictest2776793-21kworker/u8:1+events_unbound21:00:021
2684400994239,2cyclictest2761857-21kworker/u8:3+events_unbound22:50:171
2684400994239,2cyclictest2761857-21kworker/u8:3+events_unbound21:28:321
2684403994135,4cyclictest2825243-21/usr/sbin/munin21:25:162
2684400994138,2cyclictest2777951-21kworker/u8:4+events_unbound20:47:321
2684400994137,3cyclictest2761857-21kworker/u8:3+events_unbound22:22:341
2684397994134,5cyclictest2855158-21ntpq21:50:210
2684397994134,5cyclictest2855158-21ntpq21:50:200
2684397994134,5cyclictest2720527-21latency_hist19:45:010
2684397994134,4cyclictest2985478-21kworker/u8:2+flush-259:000:15:170
2684400994037,2cyclictest2856028-21kworker/u8:1+events_unbound23:00:201
2684400994037,2cyclictest2809114-21kworker/u8:0+events_unbound21:46:331
2684400994037,2cyclictest2705274-21kworker/u8:1+events_unbound19:33:341
2684400994034,2cyclictest2856028-21kworker/u8:1+events_unbound22:05:131
2684403993932,5cyclictest2777300-21latency_hist20:40:012
2684400993936,2cyclictest2985478-21kworker/u8:2+events_unbound00:30:211
2684400993932,6cyclictest2689558-21latency_hist19:15:001
2684407993833,4cyclictest3021967-21/usr/sbin/munin00:35:133
2684407993833,3cyclictest335557-21systemd-journal21:24:593
2684407993830,6cyclictest335557-21systemd-journal19:20:003
2684400993835,2cyclictest2809114-21kworker/u8:0+events_unbound21:15:231
2684400993835,2cyclictest2761857-21kworker/u8:3+events_unbound22:49:331
2684397993833,3cyclictest2830406-21apt-get21:30:110
2684403993734,2cyclictest2856028-21kworker/u8:1+events_unbound22:50:232
2684403993733,3cyclictest2856028-21kworker/u8:1+events_unbound22:00:342
2684400993734,2cyclictest2897850-21kworker/u8:0+events_unbound22:39:341
2684400993734,2cyclictest2856028-21kworker/u8:1+events_unbound23:11:221
2684400993734,2cyclictest2705274-21kworker/u8:1+events_unbound20:04:331
2684400993734,2cyclictest2699820-21kworker/u8:3+events_unbound19:29:331
2684400993733,3cyclictest2861375-21kworker/u8:2+events_unbound22:19:321
2684400993732,4cyclictest2663465-21kworker/u8:1+events_unbound19:19:331
2684397993729,6cyclictest335557-21systemd-journal00:25:000
2684403993632,3cyclictest3001112-21kworker/u8:0+events_unbound00:31:332
2684400993633,3cyclictest2979700-21kworker/u8:1+events_unbound23:58:341
2684400993632,3cyclictest2933649-21kworker/u8:4+events_unbound00:10:331
2684403993531,3cyclictest2809114-21kworker/u8:0+events_unbound21:23:342
2684400993532,2cyclictest2933649-21kworker/u8:4+events_unbound00:00:141
2684403993431,2cyclictest2918217-21kworker/u8:2+flush-259:023:15:232
2684400993431,2cyclictest2856028-21kworker/u8:1+events_unbound21:55:271
2684400993431,2cyclictest2720549-21kworker/u8:2+events_unbound20:14:331
2684400993430,3cyclictest2856028-21kworker/u8:1+events_unbound22:40:151
2684400993429,4cyclictest335557-21systemd-journal20:05:311
2684397993430,3cyclictest2804215-21apt-get21:05:120
2684403993329,3cyclictest2840696-21kworker/u8:2+events_unbound21:42:322
2684403993329,3cyclictest2809322-21kworker/u8:4+events_unbound21:37:352
2684403993329,3cyclictest2809322-21kworker/u8:4+events_unbound21:12:332
2684403993328,4cyclictest2663465-21kworker/u8:1+events_unbound19:15:372
2684403993328,3cyclictest2756708-21latency_hist20:20:012
2684400993330,2cyclictest2761857-21kworker/u8:3+events_unbound21:40:231
2684400993330,2cyclictest2761857-21kworker/u8:3+events_unbound20:55:151
2684400993330,2cyclictest2705274-21kworker/u8:1+events_unbound19:45:441
2684400993329,3cyclictest3001112-21kworker/u8:0+events_unbound00:38:331
2684407993226,4cyclictest3005366-21ntpq00:15:223
2684403993229,2cyclictest2918217-21kworker/u8:2+events_unbound23:10:232
2684403993228,3cyclictest3001112-21kworker/u8:0+events_unbound00:28:362
2684403993228,3cyclictest2809114-21kworker/u8:0+events_unbound21:51:332
2684403993228,3cyclictest2809114-21kworker/u8:0+events_unbound21:51:322
2684403993228,3cyclictest2798999-21kworker/u8:2+events_unbound21:04:322
2684403993228,3cyclictest2761857-21kworker/u8:3+events_unbound22:34:332
2684400993226,5cyclictest2767016-21latency_hist20:30:021
2684397993227,3cyclictest2959624-21kworker/u8:3+flush-259:023:40:130
2684403993128,2cyclictest2933649-21kworker/u8:4+flush-259:023:25:232
2684403993128,2cyclictest2663465-21kworker/u8:1+flush-259:019:15:002
2684403993127,3cyclictest3001112-21kworker/u8:0+events_unbound00:21:322
2684403993127,3cyclictest2918217-21kworker/u8:2+events_unbound23:22:332
2684400993128,2cyclictest2746386-21kworker/u8:0+events_unbound20:16:331
2684400993125,2cyclictest2798999-21kworker/u8:2+events_unbound21:10:231
2684400993124,5cyclictest2776394-21ntpq20:35:201
2684397993124,5cyclictest2741190-21latency_hist20:05:000
2684403993027,2cyclictest2777951-21kworker/u8:4+events_unbound20:58:322
2684400993028,2cyclictest2985478-21kworker/u8:2+events_unbound00:15:141
2684397993024,4cyclictest335557-21systemd-journal19:54:320
2684403992926,2cyclictest2830182-21kworker/u8:1+events_unbound21:33:322
2684403992925,3cyclictest2856028-21kworker/u8:1+events_unbound22:05:332
2684400992927,2cyclictest2918217-21kworker/u8:2+events_unbound23:15:251
2684400992926,2cyclictest2761857-21kworker/u8:3+events_unbound22:30:251
2684400992926,2cyclictest2720549-21kworker/u8:2+events_unbound20:20:191
2684400992925,3cyclictest2809322-21kworker/u8:4+events_unbound21:35:261
2684397992924,4cyclictest2761857-21kworker/u8:3+flush-259:022:25:170
2684397992923,4cyclictest2776793-21kworker/u8:1+flush-259:020:40:010
2684407992824,2cyclictest2985478-21kworker/u8:2+events_unbound00:25:183
2684407992823,3cyclictest2814906-21/usr/sbin/munin21:15:143
2684407992815,12cyclictest335557-21systemd-journal00:10:003
2684403992825,2cyclictest2761857-21kworker/u8:3+flush-259:020:40:222
2684403992824,3cyclictest2969709-21kworker/u8:0+flush-259:023:55:162
2684403992824,3cyclictest2959624-21kworker/u8:3+flush-259:023:50:192
2684403992824,3cyclictest2705274-21kworker/u8:1+events_unbound20:10:492
2684400992825,2cyclictest2809114-21kworker/u8:0+events_unbound21:50:251
2684400992825,2cyclictest2809114-21kworker/u8:0+events_unbound21:50:241
2684400992825,2cyclictest2699820-21kworker/u8:3+events_unbound19:35:261
2684397992823,3cyclictest2933649-21kworker/u8:4+flush-259:023:25:260
2684397992823,3cyclictest2866280-21apt-get22:05:010
2684407992723,3cyclictest2777951-21kworker/u8:4+flush-259:020:55:173
2684407992720,5cyclictest2934055-21diskstats23:10:143
2684403992724,2cyclictest3021736-21kworker/u8:1+events_unbound00:38:472
2684403992724,2cyclictest2761857-21kworker/u8:3+events_unbound22:41:172
2684403992723,3cyclictest2761857-21kworker/u8:3+events_unbound22:50:002
2684403992720,5cyclictest335557-21systemd-journal22:15:002
2684397992723,2cyclictest3026918-21unin-run00:40:000
2684397992722,4cyclictest2746386-21kworker/u8:0+flush-259:020:30:260
2684397992722,3cyclictest2705274-21kworker/u8:1+flush-259:020:10:240
2684397992721,4cyclictest2762100-21apt-get20:25:120
2684397992720,5cyclictest2705274-21kworker/u8:1+flush-259:020:05:150
2684407992622,3cyclictest2933649-21kworker/u8:4+flush-259:000:10:213
2684407992621,4cyclictest335557-21systemd-journal21:09:323
2684407992620,5cyclictest2907055-21ntpq22:40:203
2684403992622,3cyclictest2699820-21kworker/u8:3+events_unbound19:49:342
2684397992623,2cyclictest2996066-21gpgv00:10:010
2684397992621,4cyclictest3001112-21kworker/u8:0+flush-259:000:34:590
2684407992519,4cyclictest2700107-21/usr/sbin/munin19:25:153
2684403992521,3cyclictest2856028-21kworker/u8:1+flush-259:023:05:212
2684403992521,3cyclictest2856028-21kworker/u8:1+flush-259:023:00:012
2684397992519,5cyclictest2814271-21gpgv21:14:590
2684403992421,2cyclictest3001112-21kworker/u8:0+events_unbound00:17:332
2684403992421,2cyclictest2856028-21kworker/u8:1+flush-259:022:00:002
2684403992421,2cyclictest2699820-21kworker/u8:3+flush-259:019:25:232
2684403992420,3cyclictest2699820-21kworker/u8:3+events_unbound19:53:332
2684403992420,3cyclictest2699820-21kworker/u8:3+events_unbound19:39:342
2684400992421,2cyclictest2699820-21kworker/u8:3+events_unbound19:40:141
2684397992418,4cyclictest2970139-21diskstats23:45:120
2684407992319,3cyclictest2954518-21apt-get23:30:103
2684403992321,1cyclictest2985478-21kworker/u8:2+events_unbound00:01:332
2684403992319,3cyclictest2933649-21kworker/u8:4+events_unbound23:47:322
2684403992319,3cyclictest2798999-21kworker/u8:2+events_unbound21:06:342
2684400992320,2cyclictest2985478-21kworker/u8:2+events_unbound00:29:571
2684400992320,2cyclictest2933649-21kworker/u8:4+events_unbound23:20:261
2684397992319,3cyclictest2761857-21kworker/u8:3+flush-259:021:25:170
268440799229,2cyclictest2776883-21unixbench_singl20:35:243
2684403992219,2cyclictest2705274-21kworker/u8:1+flush-259:020:05:122
2684403992219,2cyclictest2705274-21kworker/u8:1+flush-259:019:55:462
2684403992219,2cyclictest2705274-21kworker/u8:1+events_unbound19:30:232
2684403992218,3cyclictest2949141-21kworker/u8:1+events_unbound23:30:162
2684403992218,3cyclictest2776793-21kworker/u8:1+flush-259:020:50:152
2684400992220,2cyclictest2933649-21kworker/u8:4+events_unbound23:25:131
2684400992219,2cyclictest2861375-21kworker/u8:2+events_unbound22:02:341
2684400992218,3cyclictest2705274-21kworker/u8:1+events_unbound19:55:241
2684400992217,2cyclictest2663465-21kworker/u8:1+events_unbound19:21:331
2684400992216,4cyclictest2964789-21/usr/sbin/munin23:40:201
2684400992216,4cyclictest2918455-21apt-get22:55:091
2684400992215,5cyclictest2825008-21latency_hist21:25:011
2684397992219,2cyclictest2761857-21kworker/u8:3+events_unbound22:50:150
2684407992117,3cyclictest500-21systemd-logind23:19:593
2684407992116,4cyclictest2840696-21kworker/u8:2+flush-259:021:45:253
2684403992117,3cyclictest2959624-21kworker/u8:3+flush-259:023:40:162
2684403992117,3cyclictest2663465-21kworker/u8:1+flush-259:019:20:252
2684400992118,2cyclictest2918217-21kworker/u8:2+flush-259:023:35:101
2684397992117,3cyclictest2985478-21kworker/u8:2+flush-259:000:25:170
2684397992115,4cyclictest2928708-21/usr/sbin/munin23:05:140
2684407992016,3cyclictest2761857-21kworker/u8:3+flush-259:022:10:173
2684407992015,3cyclictest335557-21systemd-journal20:35:013
2684407992014,4cyclictest335557-21systemd-journal23:30:003
2684403992016,3cyclictest2985478-21kworker/u8:2+events_unbound00:05:132
268440799199,2cyclictest2684842-21fschecks_time19:10:133
2684407991915,3cyclictest2710483-21apt-get19:35:123
2684407991915,3cyclictest2705274-21kworker/u8:1+flush-259:019:30:163
2684407991911,6cyclictest2705274-21kworker/u8:1+flush-259:019:45:003
2684403991913,5cyclictest2684326-21latency_hist19:10:012
2684400991914,4cyclictest3006466-21/usr/sbin/munin00:20:211
2684397991912,4cyclictest2803949-21latency_hist21:05:000
2684407991815,2cyclictest2923618-21apt-get23:00:123
2684407991815,2cyclictest2741858-21irqcore20:05:153
2684407991813,3cyclictest335557-21systemd-journal21:38:333
2684403991814,3cyclictest2699820-21kworker/u8:3+events_unbound20:00:032
2684397991814,3cyclictest2699820-21kworker/u8:3+events_unbound19:25:170
2684397991813,3cyclictest2793186-21latency_hist20:55:020
2684397991812,4cyclictest2689796-21/usr/sbin/munin19:15:150
2684397991810,6cyclictest0-21swapper/020:00:010
2684397991810,5cyclictest335557-21systemd-journal19:25:000
2684403991713,3cyclictest2856028-21kworker/u8:1+events_unbound23:00:272
2684397991713,2cyclictest0-21swapper/023:00:000
2684397991711,4cyclictest335557-21systemd-journal19:35:000
2684397991711,4cyclictest2760916-21ntpq20:20:190
2684407991613,2cyclictest2853397-21kthreadcore21:50:173
2684407991613,2cyclictest2853397-21kthreadcore21:50:173
2684407991613,1cyclictest0-21swapper/322:40:003
2684407991612,3cyclictest2776793-21kworker/u8:1+flush-259:021:01:023
2684407991611,4cyclictest2985478-21kworker/u8:2+flush-259:000:30:243
2684403991613,2cyclictest2746386-21kworker/u8:0+events_unbound20:34:012
2684403991610,2cyclictest2720549-21kworker/u8:2+events_unbound20:25:192
268439799169,5cyclictest2798462-21gpgv21:00:000
268439799161,5cyclictest28381292kthreadcore21:35:180
2684397991614,1cyclictest60350irq/132-enp0s29f1:rx-023:10:150
2684397991614,1cyclictest60350irq/132-enp0s29f1:rx-020:40:250
2684397991613,2cyclictest60350irq/132-enp0s29f1:rx-023:55:170
2684397991613,2cyclictest60350irq/132-enp0s29f1:rx-023:50:160
2684397991613,2cyclictest2824031-21needreboot21:20:190
2684397991613,2cyclictest2705274-21kworker/u8:1+flush-259:019:45:370
2684397991611,3cyclictest60350irq/132-enp0s29f1:rx-022:20:210
2684407991511,3cyclictest2777951-21kworker/u8:4+flush-259:020:45:003
268440799150,14cyclictest2964242-21sshd23:36:233
2684403991512,2cyclictest2882389-21kworker/u8:4+flush-259:022:25:142
2684403991512,2cyclictest2746386-21kworker/u8:0+events_unbound20:23:332
2684403991511,3cyclictest2809114-21kworker/u8:0+events_unbound21:15:132
2684403991511,3cyclictest2761857-21kworker/u8:3+events_unbound22:20:262
2684397991513,1cyclictest2818877-21needreboot21:15:200
2684397991512,2cyclictest60350irq/132-enp0s29f1:rx-023:19:410
2684397991512,2cyclictest60350irq/132-enp0s29f1:rx-022:45:120
2684397991512,2cyclictest60350irq/132-enp0s29f1:rx-021:55:160
2684397991512,2cyclictest2861375-21kworker/u8:2+flush-259:022:10:030
2684397991511,3cyclictest60350irq/132-enp0s29f1:rx-022:15:100
2684397991511,3cyclictest2949141-21kworker/u8:1+flush-259:023:30:150
2684397991511,3cyclictest2776793-21kworker/u8:1+flush-259:020:45:170
2684397991511,3cyclictest17250irq/128-nvme0q100:10:000
2684403991411,2cyclictest2761857-21kworker/u8:3+flush-259:022:15:182
2684403991411,2cyclictest2705274-21kworker/u8:1+events_unbound19:41:332
2684403991410,3cyclictest335557-21systemd-journal20:49:552
2684397991412,1cyclictest60350irq/132-enp0s29f1:rx-022:33:500
2684397991412,1cyclictest60350irq/132-enp0s29f1:rx-019:30:150
2684397991411,2cyclictest60350irq/132-enp0s29f1:rx-021:40:120
2684397991411,2cyclictest60350irq/132-enp0s29f1:rx-000:02:530
268440799139,3cyclictest2861407-21apt-get22:00:123
268440799139,3cyclictest2813809-21unixbench_singl21:10:253
268440799139,3cyclictest2720549-21kworker/u8:2+flush-259:020:24:373
268440799139,2cyclictest2897602-21cron22:35:013
268440799137,4cyclictest2892462-21latency_hist22:30:013
268439799131,3cyclictest2866275-21awk22:04:590
2684397991311,1cyclictest60350irq/132-enp0s29f1:rx-022:35:130
2684397991310,2cyclictest2946520-21kthreadcore23:20:170
268440799129,2cyclictest0-21swapper/321:25:223
268440799129,2cyclictest0-21swapper/319:55:013
268439799129,2cyclictest60350irq/132-enp0s29f1:rx-021:45:230
268440799119,1cyclictest0-21swapper/300:25:003
268440799118,2cyclictest2787572-21unixbench_singl20:45:253
268440799118,2cyclictest0-21swapper/323:45:153
268439799118,2cyclictest60350irq/132-enp0s29f1:rx-023:00:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional