You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 20:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Sep 08, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2580221160,2sleep20-21swapper/209:24:302
2580221160,2sleep20-21swapper/209:24:302
2365421010,3sleep20-21swapper/207:54:132
305552940,2chrt0-21swapper/211:04:272
305552940,2chrt0-21swapper/211:04:272
233462690,3sleep20-21swapper/210:44:292
233462690,3sleep20-21swapper/210:44:292
79822670,2sleep07985-21grep10:04:240
254522660,3sleep20-21swapper/210:49:322
301722640,2sleep129419-21/usr/sbin/munin08:09:321
301722640,2sleep129419-21/usr/sbin/munin08:09:321
310582600,3sleep30-21swapper/308:14:123
310582600,3sleep30-21swapper/308:14:123
282372590,2chrt0-21swapper/010:59:190
15092580,2chrt0-21swapper/312:39:283
15092580,2chrt0-21swapper/312:39:283
190152570,3chrt0-21swapper/007:39:310
190152570,3chrt0-21swapper/007:39:310
203062530,2sleep30-21swapper/307:44:253
203062530,2sleep30-21swapper/307:44:253
14412530,3sleep20-21swapper/209:44:362
75882520,6sleep07592-21kernelversion11:29:260
226452510,9sleep0171ktimers/009:14:350
226452510,9sleep0171ktimers/009:14:350
103082510,3chrt0-21swapper/010:09:300
201982480,4sleep20-21swapper/207:44:242
201982480,4sleep20-21swapper/207:44:242
915699470,2cyclictest700-21192.168.115.40-manager09:52:301
915699460,8cyclictest8630-21taskset11:32:591
915699451,7cyclictest26061-21taskset10:52:481
915699451,7cyclictest21597-21taskset12:05:481
915699451,7cyclictest21597-21taskset12:05:481
220502450,3chrt0-21swapper/209:14:292
220502450,3chrt0-21swapper/209:14:292
9156994426,16cyclictest2500-21latency_hist12:44:121
9156994426,16cyclictest2500-21latency_hist12:44:121
915699441,7cyclictest28330-21taskset09:30:191
915699441,7cyclictest28330-21taskset09:30:191
915699441,29cyclictest20905-21taskset09:11:131
915699441,29cyclictest20905-21taskset09:11:131
915699441,27cyclictest19602-21taskset07:41:081
915699441,27cyclictest19602-21taskset07:41:081
915699441,26cyclictest0-21swapper/110:33:371
291572440,2sleep20-21swapper/210:59:332
291572440,2sleep20-21swapper/210:59:332
291572440,2sleep20-21swapper/210:59:332
127172440,3sleep00-21swapper/008:49:300
915699431,8cyclictest6643-21taskset11:26:241
915699431,8cyclictest6643-21taskset11:26:241
915699431,7cyclictest15428-21taskset08:57:571
915699431,6cyclictest368-21runrttasks08:18:111
915699421,4cyclictest13571-21seq08:53:241
915699421,2cyclictest700-21192.168.115.40-manager10:57:151
915699421,2cyclictest700-21192.168.115.40-manager10:57:151
915699420,2cyclictest700-21192.168.115.40-manager10:28:021
915699416,20cyclictest749-21runrttasks08:36:331
915699416,20cyclictest749-21runrttasks08:36:331
915699411,2cyclictest0-21swapper/111:49:351
915699411,2cyclictest0-21swapper/111:49:351
915699410,3cyclictest700-21192.168.115.40-manager12:16:431
915699410,3cyclictest700-21192.168.115.40-manager12:16:431
915699410,3cyclictest700-21192.168.115.40-manager10:37:061
915699410,3cyclictest700-21192.168.115.40-manager10:37:061
915699410,3cyclictest700-21192.168.115.40-manager09:16:321
915699410,3cyclictest700-21192.168.115.40-manager09:16:321
915699401,28cyclictest5272-21seq09:55:271
915699401,28cyclictest5272-21seq09:55:271
915699401,24cyclictest23239-21taskset07:49:431
915699401,1cyclictest0-21swapper/110:23:321
915699401,1cyclictest0-21swapper/110:23:321
915699400,3cyclictest700-21192.168.115.40-manager12:33:321
915699400,3cyclictest700-21192.168.115.40-manager11:00:141
915699400,3cyclictest700-21192.168.115.40-manager11:00:141
915699400,3cyclictest700-21192.168.115.40-manager11:00:141
915699400,3cyclictest700-21192.168.115.40-manager09:03:151
915699400,3cyclictest700-21192.168.115.40-manager09:03:151
915699400,2cyclictest700-21192.168.115.40-manager10:09:571
110122400,3sleep20-21swapper/211:39:262
110122400,3sleep20-21swapper/211:39:262
915699397,22cyclictest0-21swapper/111:21:261
915699397,22cyclictest0-21swapper/111:21:261
915699397,22cyclictest0-21swapper/111:21:261
915699391,4cyclictest9302-21taskset10:08:411
915699391,4cyclictest0-21swapper/111:55:431
915699391,27cyclictest749-21runrttasks10:00:041
915699391,27cyclictest749-21runrttasks10:00:041
915699391,26cyclictest10372-21taskset11:36:001
915699391,26cyclictest10372-21taskset11:36:001
915699390,7cyclictest3033-21seq11:18:361
915699390,3cyclictest700-21192.168.115.40-manager12:21:551
915699390,3cyclictest700-21192.168.115.40-manager12:21:551
915699390,3cyclictest700-21192.168.115.40-manager12:04:171
915699390,3cyclictest700-21192.168.115.40-manager12:04:171
11542390,4chrt0-21swapper/211:13:322
11542390,4chrt0-21swapper/211:13:322
915699381,9cyclictest23988-21taskset10:45:001
915699381,9cyclictest23988-21taskset10:45:001
915699380,2cyclictest700-21192.168.115.40-manager10:41:481
915699380,2cyclictest700-21192.168.115.40-manager10:41:481
915699371,8cyclictest23729-21irqstats09:19:271
915699371,8cyclictest23729-21irqstats09:19:271
9156993716,19cyclictest0-21swapper/108:24:361
915699371,3cyclictest14360-21runrttasks11:48:511
915699371,26cyclictest0-21swapper/109:36:571
915699371,26cyclictest0-21swapper/109:36:571
915699371,1cyclictest0-21swapper/108:04:331
915699370,3cyclictest700-21192.168.115.40-manager12:25:161
915699370,3cyclictest700-21192.168.115.40-manager12:25:161
915699370,2cyclictest700-21192.168.115.40-manager12:37:321
915699370,2cyclictest700-21192.168.115.40-manager08:48:101
915699370,2cyclictest700-21192.168.115.40-manager08:48:101
9149993730,5cyclictest29900-21latency_hist11:04:120
9149993730,5cyclictest29900-21latency_hist11:04:120
9149993730,5cyclictest29900-21latency_hist11:04:120
9149993728,7cyclictest27104-21netstat10:54:300
915699367,27cyclictest8931-21awk08:39:301
915699367,27cyclictest8931-21awk08:39:301
915699361,1cyclictest0-21swapper/111:42:061
915699361,1cyclictest0-21swapper/111:42:061
915699361,1cyclictest0-21swapper/110:16:321
915699361,1cyclictest0-21swapper/109:44:421
915699360,4cyclictest700-21192.168.115.40-manager07:46:231
915699360,4cyclictest700-21192.168.115.40-manager07:46:231
915699360,2cyclictest700-21192.168.115.40-manager09:04:261
24922360,3sleep20-21swapper/211:14:322
915699351,3cyclictest0-21swapper/108:22:021
915699351,3cyclictest0-21swapper/108:22:021
915699351,31cyclictest23349-21users12:09:351
915699351,2cyclictest0-21swapper/108:00:261
915699351,2cyclictest0-21swapper/108:00:261
915699351,1cyclictest0-21swapper/109:24:361
915699351,1cyclictest0-21swapper/109:24:361
915699351,11cyclictest304-21open_files11:09:301
915699351,11cyclictest304-21open_files11:09:301
9149993527,6cyclictest22651-21netstat07:49:290
9149993526,7cyclictest1412-21netstat08:19:280
9149993526,7cyclictest1412-21netstat08:19:280
915699341,4cyclictest24554-21ntp_states07:54:291
915699341,3cyclictest0-21swapper/109:40:121
915699341,3cyclictest0-21swapper/109:40:121
915699331,3cyclictest0-21swapper/111:05:041
915699331,3cyclictest0-21swapper/111:05:041
915699331,11cyclictest5249-21ntp_states08:29:321
302742330,4sleep20-21swapper/208:09:322
302742330,4sleep20-21swapper/208:09:322
112412330,2sleep011242-21cat08:44:360
112412330,2sleep011242-21cat08:44:360
9149993225,5cyclictest25878-21fschecks_time07:59:250
9149993225,5cyclictest25878-21fschecks_time07:59:250
205472320,2sleep20-21swapper/212:04:252
205472320,2sleep20-21swapper/212:04:252
9149993124,5cyclictest735-21systemd-logind08:14:330
9149993124,5cyclictest25441-21sshd10:49:320
9149993124,4cyclictest0-21swapper/012:04:280
9149993124,4cyclictest0-21swapper/012:04:280
9149993123,5cyclictest12270-21sshd11:41:310
9149993123,5cyclictest12270-21sshd11:41:310
9149993121,7cyclictest6978-21latency_hist11:29:150
9149993121,7cyclictest6978-21latency_hist11:29:150
9149993022,6cyclictest8725-21kernelversion08:39:280
9149993022,6cyclictest8725-21kernelversion08:39:280
9149992924,3cyclictest0-21swapper/012:34:110
9149992924,3cyclictest0-21swapper/012:19:310
9149992924,3cyclictest0-21swapper/012:19:310
9149992923,4cyclictest27357-21gltestperf09:29:250
9149992923,4cyclictest27357-21gltestperf09:29:250
9149992922,6cyclictest15671-21if_wlan010:24:250
9149992922,4cyclictest20449-21cut07:44:260
9149992922,4cyclictest20449-21cut07:44:260
9149992921,6cyclictest18337-21/usr/sbin/munin11:59:300
9149992921,6cyclictest18337-21/usr/sbin/munin11:59:300
9149992920,7cyclictest24322-21latency_hist10:49:110
9149992920,7cyclictest24322-21latency_hist10:49:110
9149992820,6cyclictest749-21runrttasks11:19:150
9149992721,4cyclictest550-21cron08:04:200
9149992720,4cyclictest0-21swapper/012:34:270
9149992719,6cyclictest11633-21cut10:14:280
9149992718,7cyclictest30818-21ls09:39:240
9149992718,7cyclictest30818-21ls09:39:240
183052270,4sleep20-21swapper/209:04:282
9149992620,4cyclictest0-21swapper/012:24:230
9149992620,4cyclictest0-21swapper/012:24:230
9149992619,5cyclictest31019-21wc11:04:340
9149992619,5cyclictest31019-21wc11:04:340
9149992619,5cyclictest26777-21latency_hist09:29:110
9149992619,5cyclictest26777-21latency_hist09:29:110
9149992619,4cyclictest0-21swapper/008:14:150
9149992619,4cyclictest0-21swapper/008:14:150
9149992618,6cyclictest22083-21/usr/sbin/munin12:09:300
244432260,3sleep20-21swapper/212:14:262
244432260,3sleep20-21swapper/212:14:262
9149992521,2cyclictest0-21swapper/011:24:110
9149992521,2cyclictest0-21swapper/011:24:110
9149992521,2cyclictest0-21swapper/011:24:110
9149992521,2cyclictest0-21swapper/009:19:320
9149992521,2cyclictest0-21swapper/009:19:320
9149992520,3cyclictest0-21swapper/009:54:330
9149992520,3cyclictest0-21swapper/009:54:330
9149992519,4cyclictest9130-21cyclictest08:24:310
9149992519,4cyclictest0-21swapper/008:54:230
9149992419,3cyclictest0-21swapper/011:14:110
9149992419,3cyclictest0-21swapper/011:14:110
9149992419,3cyclictest0-21swapper/010:29:310
9149992419,3cyclictest0-21swapper/010:04:110
9149992419,3cyclictest0-21swapper/010:04:110
9149992418,5cyclictest21139-21latency_hist09:14:130
9149992418,5cyclictest21139-21latency_hist09:14:130
9149992418,5cyclictest18129-21kernelversion09:04:260
9149992418,4cyclictest5209-21ntp_kernel_err08:29:300
9149992418,3cyclictest0-21swapper/008:34:310
9149992418,3cyclictest0-21swapper/008:34:310
9149992417,5cyclictest29349-21kernelversion09:34:280
9149992417,5cyclictest29349-21kernelversion09:34:280
9149992417,5cyclictest24300-21kernelversion07:54:250
9149992417,5cyclictest17201-21ntp_kernel_pll_11:54:290
9149992417,5cyclictest13220-21kernelversion11:44:270
9149992318,3cyclictest595-21sshd12:43:320
9149992318,3cyclictest595-21sshd12:43:320
9149992317,3cyclictest0-21swapper/012:14:250
9149992317,3cyclictest0-21swapper/012:14:250
9149992316,5cyclictest9269-21gltestperf11:34:250
9149992316,5cyclictest9269-21gltestperf11:34:250
9149992315,6cyclictest19538-21sort10:34:300
9149992315,6cyclictest19538-21sort10:34:300
9149992218,2cyclictest0-21swapper/009:49:250
9149992216,5cyclictest22002-21unixbench_multi10:39:360
9149992216,5cyclictest22002-21unixbench_multi10:39:360
9149992212,8cyclictest14678-21systemd-journal11:54:110
9149992212,8cyclictest14678-21systemd-journal11:54:110
914999212,4cyclictest700-21192.168.115.40-manager10:20:020
914999212,4cyclictest700-21192.168.115.40-manager10:20:020
9149992116,3cyclictest0-21swapper/008:59:300
9149992116,3cyclictest0-21swapper/008:59:300
9149992015,3cyclictest90-1pr/ttyS009:44:270
915999191,14cyclictest23920-21chrt07:54:223
915999181,11cyclictest26353-21taskset12:19:263
915999181,11cyclictest26353-21taskset12:19:263
915899181,12cyclictest24966-21taskset07:54:332
915999172,10cyclictest0-21swapper/309:04:263
915999171,11cyclictest9838-21chrt11:34:313
915999171,11cyclictest9838-21chrt11:34:313
915999171,11cyclictest9527-21chrt08:39:363
915999171,11cyclictest9527-21chrt08:39:363
915999171,11cyclictest6638-21chrt09:59:323
915999171,11cyclictest6638-21chrt09:59:323
915999171,11cyclictest0-21swapper/310:34:303
915999171,11cyclictest0-21swapper/310:34:303
915899171,12cyclictest7054-21taskset09:59:352
915899171,12cyclictest7054-21taskset09:59:352
915899171,11cyclictest3073-21chrt08:24:282
268532170,3sleep20-21swapper/210:54:262
268532170,3sleep20-21swapper/210:54:262
915999162,10cyclictest0-21swapper/309:04:123
915999162,10cyclictest0-21swapper/309:04:123
915999161,11cyclictest5848-21chrt08:30:323
915999161,11cyclictest4259-21chrt09:54:263
915999161,11cyclictest4259-21chrt09:54:263
915999161,11cyclictest387-21chrt11:09:313
915999161,11cyclictest387-21chrt11:09:313
915999161,11cyclictest3164-21chrt08:24:293
915999161,11cyclictest19145-21chrt11:59:323
915999161,11cyclictest19145-21chrt11:59:323
915999161,11cyclictest16387-21chrt11:54:173
915999161,11cyclictest16387-21chrt11:54:173
915999161,11cyclictest10388-21taskset08:44:273
915999161,11cyclictest10388-21taskset08:44:273
915999161,11cyclictest0-21swapper/312:29:333
915999161,11cyclictest0-21swapper/312:04:343
915999161,11cyclictest0-21swapper/312:04:343
915999161,11cyclictest0-21swapper/311:29:223
915999161,10cyclictest25139-21chrt09:24:233
915999161,10cyclictest25139-21chrt09:24:233
915999161,10cyclictest18790-21chrt07:39:263
915999161,10cyclictest18790-21chrt07:39:263
915999161,10cyclictest13441-21chrt10:19:263
915999161,10cyclictest13441-21chrt10:19:263
915999161,10cyclictest0-21swapper/312:14:253
915999161,10cyclictest0-21swapper/312:14:253
915999161,10cyclictest0-21swapper/310:29:233
915899161,11cyclictest9493-21chrt11:34:262
915899161,11cyclictest9493-21chrt11:34:262
915899161,11cyclictest27195-21chrt09:29:242
915899161,11cyclictest27195-21chrt09:29:242
915899161,11cyclictest21172-21chrt10:39:272
915899161,11cyclictest21172-21chrt10:39:272
915899161,11cyclictest17334-21taskset09:03:312
915899161,11cyclictest17334-21taskset09:03:312
915899161,11cyclictest0-21swapper/210:04:262
915899161,11cyclictest0-21swapper/208:39:352
915899161,11cyclictest0-21swapper/208:39:352
915899161,10cyclictest5782-21chrt09:59:192
915899161,10cyclictest2448-21taskset09:49:262
915899161,10cyclictest12170-21chrt08:49:242
915899161,10cyclictest0-21swapper/208:54:232
915999151,9cyclictest11549-21taskset10:14:283
915999151,9cyclictest0-21swapper/309:44:283
915999151,9cyclictest0-21swapper/308:14:253
915999151,8cyclictest0-21swapper/310:14:183
915999151,10cyclictest23357-21chrt09:19:243
915999151,10cyclictest23357-21chrt09:19:243
915999151,10cyclictest23107-21chrt10:44:263
915999151,10cyclictest23107-21chrt10:44:263
915999151,10cyclictest1438-21chrt11:14:213
915999151,10cyclictest0-21swapper/308:54:323
915999151,10cyclictest0-21swapper/308:34:213
915999151,10cyclictest0-21swapper/308:34:213
915999151,10cyclictest0-21swapper/307:49:233
915999150,11cyclictest28919-21taskset09:34:243
915999150,11cyclictest28919-21taskset09:34:243
915899151,9cyclictest8000-21chrt11:29:322
915899151,9cyclictest3856-21taskset11:19:272
915899151,9cyclictest3856-21taskset11:19:272
915899151,9cyclictest3856-21taskset11:19:272
915899151,9cyclictest12188-21taskset10:14:352
915899151,9cyclictest0-21swapper/209:34:252
915899151,9cyclictest0-21swapper/209:34:252
915899151,12cyclictest10734-21chrt08:44:302
915899151,12cyclictest10734-21chrt08:44:302
915899151,10cyclictest5559-21chrt08:29:342
915899151,10cyclictest4786-21chrt09:54:332
915899151,10cyclictest28031-21chrt08:04:262
915899151,10cyclictest18437-21chrt11:59:232
915899151,10cyclictest18437-21chrt11:59:232
915899151,10cyclictest17176-21chrt10:29:222
915899151,10cyclictest12771-21taskset11:44:232
915899151,10cyclictest0-21swapper/208:14:262
228922150,3sleep20-21swapper/212:09:322
915999143,7cyclictest0-21swapper/308:20:023
915999143,7cyclictest0-21swapper/308:20:023
915999141,9cyclictest8980-21chrt10:04:553
915999141,9cyclictest5711-21chrt11:24:263
915999141,9cyclictest5711-21chrt11:24:263
915999141,9cyclictest30637-21taskset11:04:283
915999141,9cyclictest30637-21taskset11:04:283
915999141,9cyclictest27663-21chrt08:04:233
915999141,9cyclictest2529-21chrt09:49:273
915999141,9cyclictest20768-21taskset09:09:353
915999141,9cyclictest20768-21taskset09:09:353
915999141,9cyclictest12843-21chrt11:44:243
915999141,8cyclictest28159-21chrt12:24:243
915999141,8cyclictest28159-21chrt12:24:243
915899149,3cyclictest166172chrt10:26:162
915899142,8cyclictest0-21swapper/209:39:352
915899142,8cyclictest0-21swapper/209:39:352
915999138,3cyclictest296862chrt11:01:313
915999138,3cyclictest296862chrt11:01:313
915999138,3cyclictest296862chrt11:01:313
915999131,9cyclictest32139-21chrt12:34:293
915999131,9cyclictest27154-21taskset10:54:313
915999131,9cyclictest27154-21taskset10:54:313
915999131,9cyclictest16341-21chrt10:24:333
915999131,8cyclictest31000-21taskset09:39:263
915999131,8cyclictest31000-21taskset09:39:263
915999131,8cyclictest28283-21chrt09:29:413
915999131,8cyclictest28283-21chrt09:29:413
915999131,8cyclictest25786-21chrt07:59:243
915999131,8cyclictest25786-21chrt07:59:243
915999131,8cyclictest12669-21chrt08:49:293
915999131,7cyclictest0-21swapper/311:54:333
915899138,3cyclictest196552chrt10:34:332
915899138,3cyclictest196552chrt10:34:332
915899137,3cyclictest167982chrt11:54:242
915899132,8cyclictest26939-21chrt07:59:352
915899132,8cyclictest26939-21chrt07:59:352
915899131,9cyclictest31663-21taskset12:34:242
915899131,9cyclictest23732-21chrt09:19:272
915899131,9cyclictest23732-21chrt09:19:272
915899131,8cyclictest28007-21chrt12:24:232
915899131,8cyclictest28007-21chrt12:24:232
915899131,8cyclictest19501-21taskset09:09:222
915899131,8cyclictest19501-21taskset09:09:222
915899131,8cyclictest0-21swapper/212:29:312
915899131,10cyclictest701-21chrt08:19:212
915899131,10cyclictest701-21chrt08:19:212
915899131,10cyclictest2290-21chrt12:41:322
915899131,10cyclictest2290-21chrt12:41:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional