You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-06 - 19:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Mar 06, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
115649911338,13cyclictest0-21swapper/207:21:592
11564991036,12cyclictest7880-21unixbench_singl08:42:102
11559999725,55cyclictest0-21swapper/010:31:450
11559999723,9cyclictest7073-21crond09:31:340
1155999964,28cyclictest0-21swapper/010:36:460
1155999964,27cyclictest0-21swapper/009:01:510
1155999963,26cyclictest12553-21fschecks_time05:52:020
11565999531,13cyclictest0-21swapper/309:40:203
11565999531,13cyclictest0-21swapper/309:40:203
1155999954,28cyclictest0-21swapper/005:57:160
1155999954,27cyclictest0-21swapper/008:15:140
1155999954,27cyclictest0-21swapper/008:15:140
1155999954,27cyclictest0-21swapper/008:03:250
1155999954,26cyclictest0-21swapper/007:47:000
1155999954,12cyclictest0-21swapper/009:56:030
11559999520,12cyclictest0-21swapper/008:31:390
11559999419,13cyclictest0-21swapper/007:56:580
1155999924,27cyclictest0-21swapper/010:43:460
11559999223,51cyclictest0-21swapper/009:41:490
11559999220,12cyclictest0-21swapper/009:36:490
11559999220,12cyclictest0-21swapper/009:36:490
1155999916,14cyclictest0-21swapper/010:13:300
1155999915,26cyclictest0-21swapper/008:07:030
1155999914,27cyclictest0-21swapper/007:37:230
11559999119,12cyclictest0-21swapper/010:02:350
11559999119,12cyclictest0-21swapper/008:36:500
11559999118,11cyclictest5030-21unixbench_multi11:02:040
11559999118,11cyclictest5030-21unixbench_multi11:02:040
1156599903,12cyclictest0-21swapper/310:16:583
1156599903,12cyclictest0-21swapper/310:16:583
1155999906,13cyclictest0-21swapper/010:21:560
1155999904,28cyclictest0-21swapper/010:46:480
1155999904,27cyclictest0-21swapper/010:16:520
1155999904,27cyclictest0-21swapper/010:16:520
1155999904,26cyclictest0-21swapper/008:49:560
1155999895,25cyclictest0-21swapper/008:45:110
1155999894,28cyclictest0-21swapper/009:10:040
1155999894,27cyclictest0-21swapper/009:11:500
1155999894,26cyclictest0-21swapper/009:56:580
1155999893,27cyclictest0-21swapper/006:36:420
1155999884,27cyclictest0-21swapper/010:27:570
1155999884,23cyclictest0-21swapper/008:53:110
11559998821,13cyclictest0-21swapper/009:21:460
11559998819,14cyclictest0-21swapper/007:21:560
11559998817,11cyclictest0-21swapper/006:51:520
11559998817,11cyclictest0-21swapper/006:51:520
248599870,5rtkit-daemon2484-21rtkit-daemon10:24:283
1155999875,26cyclictest0-21swapper/011:01:180
1155999874,25cyclictest0-21swapper/008:24:570
1155999874,23cyclictest0-21swapper/010:51:490
11559998720,13cyclictest0-21swapper/009:31:490
1155999863,28cyclictest7929-21ssh11:06:590
1155999863,26cyclictest0-21swapper/009:50:450
1155999863,24cyclictest21531-21munin-node08:16:530
1155999854,73cyclictest0-21swapper/007:05:460
1155999854,25cyclictest0-21swapper/008:59:470
1155999854,14cyclictest0-21swapper/008:33:480
1155999853,73cyclictest0-21swapper/007:55:320
1155999853,12cyclictest0-21swapper/011:16:420
1155999844,15cyclictest0-21swapper/011:12:340
1155999844,12cyclictest0-21swapper/009:17:250
11559998422,13cyclictest0-21swapper/010:06:570
248599830,4rtkit-daemon2484-21rtkit-daemon11:09:193
248599830,4rtkit-daemon2484-21rtkit-daemon05:53:543
1155999833,24cyclictest0-21swapper/006:22:020
248599820,6rtkit-daemon2484-21rtkit-daemon08:56:393
248599820,4rtkit-daemon2484-21rtkit-daemon10:32:062
1155999823,21cyclictest21425-21head06:11:550
1155999823,20cyclictest27248-21munin-node07:32:000
1155999823,10cyclictest19282-21cpuspeed_turbos06:06:560
1155999823,10cyclictest19282-21cpuspeed_turbos06:06:560
11559998219,10cyclictest1052-21rsyslogd06:51:410
1155999817,11cyclictest17846-21aten_r1power_vo07:11:540
1155999814,32cyclictest0-21swapper/006:36:590
1155999814,24cyclictest0-21swapper/006:59:490
1155999794,68cyclictest0-21swapper/007:07:010
1155999794,25cyclictest0-21swapper/007:20:490
1155999794,14cyclictest0-21swapper/006:16:540
1155999774,15cyclictest0-21swapper/007:42:000
1155999774,14cyclictest0-21swapper/006:26:530
248599760,6rtkit-daemon2484-21rtkit-daemon09:02:323
1155999753,15cyclictest0-21swapper/006:02:140
248599740,4rtkit-daemon2484-21rtkit-daemon08:55:543
1155999743,22cyclictest0-21swapper/006:42:150
248599730,4rtkit-daemon2484-21rtkit-daemon10:32:213
248599720,4rtkit-daemon2484-21rtkit-daemon09:10:463
1013827112,49sleep20-21swapper/205:47:092
248599680,5rtkit-daemon2484-21rtkit-daemon10:05:441
248599670,5rtkit-daemon2484-21rtkit-daemon08:08:041
248599670,5rtkit-daemon2484-21rtkit-daemon07:57:271
1155999673,30cyclictest0-21swapper/007:30:110
248599660,5rtkit-daemon2484-21rtkit-daemon09:39:151
248599660,5rtkit-daemon2484-21rtkit-daemon09:39:151
248599660,5rtkit-daemon2484-21rtkit-daemon09:01:171
248599660,5rtkit-daemon2484-21rtkit-daemon05:55:091
248599650,5rtkit-daemon2484-21rtkit-daemon10:24:581
248599650,4rtkit-daemon2484-21rtkit-daemon10:33:351
248599650,4rtkit-daemon2484-21rtkit-daemon09:34:531
248599650,4rtkit-daemon2484-21rtkit-daemon09:11:391
248599650,4rtkit-daemon2484-21rtkit-daemon07:43:051
1156499655,51cyclictest0-21swapper/209:32:082
248599640,9rtkit-daemon0-21swapper/108:04:411
248599640,8rtkit-daemon0-21swapper/107:38:351
248599640,8rtkit-daemon0-21swapper/106:27:081
248599640,2rtkit-daemon0-21swapper/110:14:511
248599640,12rtkit-daemon0-21swapper/109:45:521
248599640,12rtkit-daemon0-21swapper/105:59:091
248599640,11rtkit-daemon0-21swapper/110:30:511
1156499647,50cyclictest0-21swapper/208:41:372
248599630,9rtkit-daemon0-21swapper/109:16:461
248599630,9rtkit-daemon0-21swapper/106:50:591
248599630,8rtkit-daemon0-21swapper/110:51:501
248599630,8rtkit-daemon0-21swapper/107:33:051
248599630,8rtkit-daemon0-21swapper/106:16:161
248599630,7rtkit-daemon0-21swapper/109:30:231
248599630,7rtkit-daemon0-21swapper/108:16:111
248599630,7rtkit-daemon0-21swapper/108:16:111
248599630,6rtkit-daemon0-21swapper/108:42:321
248599630,6rtkit-daemon0-21swapper/108:35:031
248599630,6rtkit-daemon0-21swapper/106:42:521
248599630,5rtkit-daemon26619-21unixbench-2d08:22:111
248599630,4rtkit-daemon2484-21rtkit-daemon09:03:021
248599630,4rtkit-daemon2484-21rtkit-daemon08:29:551
248599630,12rtkit-daemon0-21swapper/106:19:381
248599630,11rtkit-daemon0-21swapper/109:10:161
248599630,11rtkit-daemon0-21swapper/107:51:421
248599630,11rtkit-daemon0-21swapper/106:33:521
248599620,8rtkit-daemon0-21swapper/110:47:351
248599620,8rtkit-daemon0-21swapper/108:19:111
248599620,8rtkit-daemon0-21swapper/106:11:381
248599620,8rtkit-daemon0-21swapper/106:11:381
248599620,8rtkit-daemon0-21swapper/106:02:091
248599620,7rtkit-daemon0-21swapper/107:07:591
248599620,6rtkit-daemon0-21swapper/111:02:491
248599620,6rtkit-daemon0-21swapper/111:02:491
248599620,6rtkit-daemon0-21swapper/107:20:061
248599620,3rtkit-daemon0-21swapper/110:09:361
248599620,3rtkit-daemon0-21swapper/106:24:301
1156499625,15cyclictest0-21swapper/209:56:342
248599610,7rtkit-daemon0-21swapper/110:39:431
248599610,7rtkit-daemon0-21swapper/110:17:291
248599610,7rtkit-daemon0-21swapper/110:17:291
248599610,7rtkit-daemon0-21swapper/107:48:271
248599610,5rtkit-daemon7251-21fschecks_count11:06:491
248599610,4rtkit-daemon4299-21diskmemload11:00:571
248599610,3rtkit-daemon0-21swapper/109:21:461
248599610,3rtkit-daemon0-21swapper/106:57:061
248599610,2rtkit-daemon0-21swapper/108:54:321
248599610,12rtkit-daemon0-21swapper/108:46:551
11565996131,13cyclictest0-21swapper/311:11:513
1156599613,20cyclictest0-21swapper/309:56:073
1156499614,50cyclictest14751-21munin-node08:07:082
1156499614,50cyclictest0-21swapper/209:47:032
1156499614,49cyclictest1419-21runrttasks07:57:522
248599600,7rtkit-daemon0-21swapper/110:41:431
248599600,6rtkit-daemon0-21swapper/109:48:151
248599600,6rtkit-daemon0-21swapper/108:37:251
248599600,5rtkit-daemon14083-21perl11:16:491
248599600,12rtkit-daemon0-21swapper/109:59:141
248599600,11rtkit-daemon0-21swapper/106:54:071
248599600,11rtkit-daemon0-21swapper/106:54:071
11565996033,13cyclictest0-21swapper/306:32:003
1156499605,47cyclictest0-21swapper/210:26:542
1156499604,50cyclictest0-21swapper/211:04:252
1156499604,50cyclictest0-21swapper/211:04:252
1156499604,50cyclictest0-21swapper/210:16:592
1156499604,50cyclictest0-21swapper/210:16:592
1156499604,49cyclictest0-21swapper/210:57:482
1156499604,49cyclictest0-21swapper/210:42:582
1156499604,49cyclictest0-21swapper/210:12:392
1156499604,49cyclictest0-21swapper/209:08:222
1156499604,49cyclictest0-21swapper/206:42:152
1156499604,48cyclictest0-21swapper/208:33:502
1156499603,49cyclictest0-21swapper/209:26:592
248599590,3rtkit-daemon22047-21ssh09:52:001
248599590,2rtkit-daemon0-21swapper/107:26:581
191562593,48sleep20-21swapper/209:01:202
11565995930,11cyclictest0-21swapper/309:19:063
1156499595,45cyclictest0-21swapper/210:06:492
1156499594,49cyclictest0-21swapper/209:12:062
1156499594,48cyclictest0-21swapper/210:48:382
1156499594,48cyclictest0-21swapper/209:06:192
1156499594,48cyclictest0-21swapper/208:27:262
1156499594,48cyclictest0-21swapper/208:02:102
1156499594,47cyclictest26203-21ssh08:22:042
1156499593,50cyclictest10308-21gltestperf08:46:562
248599580,5rtkit-daemon22608-21munin-node07:21:501
248599580,2rtkit-daemon0-21swapper/111:12:111
11565995830,13cyclictest0-21swapper/306:51:423
1156499584,48cyclictest0-21swapper/211:16:142
1156499584,48cyclictest0-21swapper/210:23:502
1156499584,48cyclictest0-21swapper/210:01:052
1156499584,47cyclictest21794-21turbostat.cron10:41:312
1156499584,47cyclictest0-21swapper/207:54:332
1156499583,49cyclictest0-21swapper/208:12:012
1156499583,49cyclictest0-21swapper/208:12:012
1156499583,48cyclictest0-21swapper/209:43:492
208372578,42sleep30-21swapper/308:15:053
208372578,42sleep30-21swapper/308:15:053
11565995730,13cyclictest0-21swapper/310:39:093
11565995730,13cyclictest0-21swapper/309:57:283
11565995730,13cyclictest0-21swapper/308:00:553
11565995728,12cyclictest0-21swapper/308:31:093
1156499575,45cyclictest0-21swapper/209:19:232
1156499574,47cyclictest0-21swapper/210:54:002
1156499574,47cyclictest0-21swapper/210:04:082
1156499574,46cyclictest9135-21kworker/2:108:16:482
1156499574,46cyclictest14274-21sensors08:52:062
1156499574,46cyclictest10704-21ssh09:36:452
1156499574,46cyclictest10704-21ssh09:36:452
1156499574,46cyclictest0-21swapper/206:46:572
1156499574,46cyclictest0-21swapper/206:06:432
1156499573,47cyclictest0-21swapper/211:06:532
1156499573,47cyclictest0-21swapper/209:25:332
1156499554,45cyclictest0-21swapper/211:18:132
1156499554,45cyclictest0-21swapper/206:22:132
261422532,9sleep30-21swapper/307:27:093
1156599534,41cyclictest0-21swapper/309:22:053
11565995325,12cyclictest0-21swapper/308:40:273
1156599532,9cyclictest27470-21needreboot09:12:013
11565995314,32cyclictest3297-21aten2.4-expect11:01:423
11565995314,32cyclictest3297-21aten2.4-expect11:01:423
1156499533,44cyclictest281ktimersoftd/206:31:532
1156299535,29cyclictest0-21swapper/107:01:541
64462522,43sleep30-21swapper/309:29:183
248599520,5rtkit-daemon2484-21rtkit-daemon05:50:023
180252523,42sleep318128-21grep09:46:523
1156599525,32cyclictest0-21swapper/308:23:443
1156599523,30cyclictest0-21swapper/310:48:583
1156599523,11cyclictest0-21swapper/311:16:523
198302512,9sleep30-21swapper/307:16:243
186012512,10sleep30-21swapper/306:05:233
155132514,39sleep20-21swapper/205:57:112
1156599514,12cyclictest0-21swapper/307:52:073
11565995135,10cyclictest1673-21tail06:37:003
11565995122,25cyclictest0-21swapper/308:03:393
257692502,9sleep20-21swapper/206:20:332
195362502,42sleep20-21swapper/207:12:322
167272503,7sleep316763-21python07:07:093
148672502,42sleep30-21swapper/307:03:593
1156599504,23cyclictest1419-21runrttasks08:34:493
11565995024,20cyclictest30678-21munin-node10:52:063
11565995024,12cyclictest0-21swapper/308:50:583
11565995021,13cyclictest0-21swapper/310:11:283
1156499505,38cyclictest0-21swapper/206:51:582
1156499505,38cyclictest0-21swapper/206:51:582
1156499505,28cyclictest0-21swapper/206:57:052
1156299504,26cyclictest0-21swapper/105:51:441
1156499495,30cyclictest0-21swapper/205:52:082
11564994931,12cyclictest0-21swapper/207:02:132
11564994919,12cyclictest0-21swapper/207:20:492
248599480,5rtkit-daemon2484-21rtkit-daemon07:11:581
11565994822,11cyclictest7321-21netstat08:42:023
1156499485,26cyclictest0-21swapper/206:11:432
1156499485,26cyclictest0-21swapper/206:11:432
1156499484,37cyclictest0-21swapper/207:36:532
1156499484,29cyclictest0-21swapper/207:42:052
1156499484,26cyclictest0-21swapper/207:06:502
11564994819,10cyclictest800-21munin-node06:37:042
11562994832,10cyclictest2675-21unixbench_multi06:37:131
266842473,10sleep20-21swapper/207:27:282
1156599474,37cyclictest0-21swapper/306:01:433
1156599474,36cyclictest0-21swapper/308:16:563
1156599473,18cyclictest0-21swapper/309:34:403
11565994729,12cyclictest0-21swapper/310:56:433
11565994722,12cyclictest0-21swapper/310:45:543
11565994722,12cyclictest0-21swapper/310:03:073
11565994721,9cyclictest30818-21cat06:31:423
1156499475,28cyclictest0-21swapper/207:32:002
11564994722,10cyclictest0-21swapper/206:12:102
11564994710,21cyclictest0-21swapper/207:46:502
11565994631,9cyclictest27821-21unixbench_multi06:22:143
11565994630,11cyclictest3344-21tr07:47:053
1156599463,27cyclictest0-21swapper/310:12:083
1156599463,27cyclictest0-21swapper/306:07:083
1156599463,27cyclictest0-21swapper/306:07:083
11565994625,10cyclictest0-21swapper/306:54:443
11565994625,10cyclictest0-21swapper/306:54:443
1156599454,34cyclictest0-21swapper/308:06:493
11565994531,9cyclictest12242-21sed06:57:133
11565994519,21cyclictest0-21swapper/310:31:073
11564994518,11cyclictest0-21swapper/206:26:562
220792442,35sleep30-21swapper/307:19:393
1156599445,31cyclictest32026-21munin-node07:42:043
1156599444,34cyclictest0-21swapper/307:21:523
1156599442,36cyclictest0-21swapper/309:42:043
1156599435,8cyclictest30754-21load07:37:023
1156599433,24cyclictest4385-21iostat_ios06:42:053
1156599433,23cyclictest26079-21cat06:21:443
1156599422,35cyclictest0-21swapper/306:12:163
1156599414,32cyclictest0-21swapper/307:32:063
11559993511,11cyclictest0-21swapper/005:51:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional