You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 18:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Mar 22, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277482950,3sleep2281ktimersoftd/206:11:552
77622800,5sleep226-21rcuc/206:36:542
98582789,56sleep20-21swapper/205:32:072
251122740,7sleep325111-21sensors_temp09:42:033
48022730,12sleep21060499cyclictest09:12:062
248599710,4rtkit-daemon2484-21rtkit-daemon06:16:081
248599680,4rtkit-daemon2484-21rtkit-daemon08:28:031
1060599662,59cyclictest0-21swapper/307:52:193
187602653,54sleep00-21swapper/007:57:030
187602653,54sleep00-21swapper/007:57:030
1060599655,54cyclictest0-21swapper/308:19:273
1060599654,55cyclictest0-21swapper/310:41:583
1060599654,55cyclictest0-21swapper/310:41:583
1060599654,55cyclictest0-21swapper/308:06:583
1060299655,53cyclictest0-21swapper/109:06:501
10602996513,45cyclictest0-21swapper/108:33:481
10602996510,48cyclictest0-21swapper/110:10:371
1060099654,53cyclictest0-21swapper/010:05:100
1060099653,55cyclictest0-21swapper/008:37:060
1060099653,55cyclictest0-21swapper/008:37:060
248599640,6rtkit-daemon0-21swapper/209:18:383
1060599644,54cyclictest0-21swapper/310:01:513
1060599643,55cyclictest25925-21grep10:31:503
10605996426,11cyclictest2915-21aten_r1power_vo10:46:413
1060599634,53cyclictest0-21swapper/308:41:463
1060599633,52cyclictest11628-21fgrep09:22:013
1060599633,52cyclictest11628-21fgrep09:22:013
10602996317,38cyclictest21616-21cut08:01:531
261682627,12sleep20-21swapper/206:07:042
248599620,7rtkit-daemon2484-21rtkit-daemon09:50:371
1060599625,50cyclictest0-21swapper/308:37:053
1060599625,50cyclictest0-21swapper/308:37:053
1060599624,28cyclictest0-21swapper/308:55:503
10605996235,9cyclictest23506-21sed09:41:323
10602996214,42cyclictest26001-21unixbench-2d08:07:081
10602996211,44cyclictest0-21swapper/106:21:531
1060099623,52cyclictest0-21swapper/007:37:010
1060099623,51cyclictest0-21swapper/008:51:570
312722613,11sleep30-21swapper/309:51:553
212982613,51sleep20-21swapper/210:26:292
1060599614,50cyclictest0-21swapper/309:57:013
10605996121,24cyclictest1419-21runrttasks09:28:563
10602996116,36cyclictest1574-21cpuspeed_turbos09:56:451
10602996114,28cyclictest18628-21grep05:52:011
1060099613,53cyclictest0-21swapper/009:54:520
1060099613,51cyclictest0-21swapper/007:46:500
248599600,6rtkit-daemon2484-21rtkit-daemon09:41:451
248599600,5rtkit-daemon2484-21rtkit-daemon09:06:161
248599600,4rtkit-daemon2484-21rtkit-daemon11:05:043
22392603,12sleep20-21swapper/209:08:242
115032604,13sleep00-21swapper/008:35:090
1060599604,50cyclictest0-21swapper/310:56:303
1060599604,50cyclictest0-21swapper/307:38:583
1060599603,50cyclictest0-21swapper/308:04:523
1060299608,33cyclictest0-21swapper/111:01:471
10602996024,21cyclictest8397-21processes07:42:051
10602996019,34cyclictest26346-21fschecks_time08:56:511
1060099604,49cyclictest0-21swapper/009:03:010
1060099603,51cyclictest0-21swapper/010:21:430
1060099603,50cyclictest26038-21kernelversion10:31:530
1060099603,27cyclictest0-21swapper/008:09:270
248599590,4rtkit-daemon2484-21rtkit-daemon09:17:461
1060599595,49cyclictest0-21swapper/307:42:083
1060299599,31cyclictest0-21swapper/108:42:081
1060299598,42cyclictest0-21swapper/108:20:291
1060299596,46cyclictest0-21swapper/110:11:481
1060299595,31cyclictest0-21swapper/110:46:461
10602995913,38cyclictest20726-21ssh09:36:481
10600995941,11cyclictest2670-21grep08:21:510
1060099593,49cyclictest0-21swapper/009:21:460
1060099593,49cyclictest0-21swapper/009:21:460
10600995917,24cyclictest0-21swapper/010:57:020
1060599584,47cyclictest15929-21ssh10:16:543
1060599584,38cyclictest0-21swapper/308:24:473
1060599584,29cyclictest0-21swapper/309:11:563
1060599584,24cyclictest0-21swapper/310:23:083
1060599584,24cyclictest0-21swapper/307:50:123
10604995828,13cyclictest0-21swapper/211:06:292
1060299588,38cyclictest0-21swapper/107:40:481
1060299587,43cyclictest14096-21diskstats09:26:481
1060299584,47cyclictest0-21swapper/107:54:471
10602995817,34cyclictest14892-21aten_r1power_cu10:16:421
10602995814,37cyclictest0-21swapper/109:22:311
10602995814,37cyclictest0-21swapper/109:22:311
10602995812,29cyclictest4497-21iostat_ios09:11:591
1060099584,47cyclictest0-21swapper/010:11:550
1060099583,49cyclictest15468-21diskstats10:16:480
1060099583,49cyclictest0-21swapper/010:36:350
1060099583,49cyclictest0-21swapper/009:11:170
1060099583,49cyclictest0-21swapper/008:56:580
1060099583,48cyclictest0-21swapper/010:51:420
1060099583,48cyclictest0-21swapper/008:26:490
1060099582,50cyclictest0-21swapper/008:01:510
10600995812,28cyclictest0-21swapper/009:31:090
1060599575,47cyclictest0-21swapper/309:32:033
1060599574,29cyclictest0-21swapper/308:13:183
1060599573,46cyclictest31437-21idleruntime-cro10:41:293
1060499573,47cyclictest0-21swapper/208:21:242
1060299579,28cyclictest0-21swapper/108:51:521
1060299576,44cyclictest0-21swapper/108:41:351
1060299576,44cyclictest0-21swapper/108:41:351
1060299574,36cyclictest0-21swapper/107:47:331
1060299574,34cyclictest0-21swapper/110:32:051
1060299573,48cyclictest0-21swapper/107:58:011
1060299573,48cyclictest0-21swapper/107:58:011
10602995716,34cyclictest28804-21aten_r1power_po07:21:501
1060099574,35cyclictest0-21swapper/008:49:120
1060099573,49cyclictest0-21swapper/009:40:350
1060099573,48cyclictest9515-21yum-updatesd-he09:20:230
1060099573,47cyclictest0-21swapper/010:43:140
1060099573,47cyclictest0-21swapper/010:43:140
1060099573,47cyclictest0-21swapper/009:47:200
1060099573,39cyclictest0-21swapper/009:57:300
1060099573,11cyclictest0-21swapper/009:14:530
1060599564,28cyclictest0-21swapper/307:57:083
1060599564,28cyclictest0-21swapper/307:57:083
1060599564,27cyclictest0-21swapper/308:30:463
1060599563,49cyclictest0-21swapper/309:49:493
1060299569,30cyclictest0-21swapper/108:14:031
1060299567,43cyclictest0-21swapper/108:46:391
10602995616,32cyclictest1058-21grep10:42:041
10602995616,32cyclictest1058-21grep10:42:041
10602995612,38cyclictest11089-21switchtime10:57:011
10602995611,40cyclictest0-21swapper/108:25:131
10602995610,39cyclictest0-21swapper/110:51:451
1060099564,45cyclictest0-21swapper/006:31:520
1060099564,45cyclictest0-21swapper/006:31:520
1060099563,47cyclictest0-21swapper/009:43:100
1060099563,46cyclictest1419-21runrttasks08:19:370
1060099563,38cyclictest0-21swapper/007:46:370
1060099563,35cyclictest0-21swapper/010:46:450
1060099562,48cyclictest0-21swapper/010:26:440
105802563,11sleep00-21swapper/010:09:140
248599550,5rtkit-daemon2484-21rtkit-daemon10:20:212
12092552,45sleep20-21swapper/207:31:532
1060599555,29cyclictest0-21swapper/306:47:123
1060599554,26cyclictest0-21swapper/308:31:543
1060599554,15cyclictest0-21swapper/310:11:493
10605995539,9cyclictest11172-21tr05:36:563
1060599553,46cyclictest0-21swapper/309:10:203
1060299558,29cyclictest0-21swapper/110:38:271
1060299558,27cyclictest0-21swapper/109:55:531
1060299554,37cyclictest0-21swapper/109:35:521
10602995512,37cyclictest18451-21unixbench_multi06:57:111
1060099554,43cyclictest0-21swapper/006:42:130
1060099554,31cyclictest0-21swapper/008:45:440
1060099553,47cyclictest0-21swapper/008:14:250
1060099553,47cyclictest0-21swapper/007:53:380
1060099553,45cyclictest0-21swapper/007:01:520
248599540,5rtkit-daemon2484-21rtkit-daemon07:20:281
248599540,5rtkit-daemon2484-21rtkit-daemon07:20:281
140132542,9sleep20-21swapper/210:14:282
1060599545,29cyclictest0-21swapper/307:31:503
1060599545,28cyclictest0-21swapper/307:06:093
1060599544,30cyclictest0-21swapper/306:41:593
10605995424,11cyclictest23465-21yum10:27:063
10605995414,24cyclictest0-21swapper/309:02:513
1060299545,33cyclictest0-21swapper/106:51:511
10602995418,30cyclictest21583-21munin-node10:26:501
10602995413,34cyclictest31732-21cut07:26:541
1060099545,26cyclictest0-21swapper/006:56:500
1060099544,41cyclictest0-21swapper/005:41:550
1060099543,23cyclictest0-21swapper/007:17:060
1060099543,23cyclictest0-21swapper/007:17:060
10600995411,26cyclictest0-21swapper/011:01:520
1060599535,28cyclictest0-21swapper/307:21:543
1060599534,43cyclictest0-21swapper/308:58:133
1060599534,29cyclictest0-21swapper/307:17:223
1060599534,29cyclictest0-21swapper/307:17:223
1060599534,29cyclictest0-21swapper/306:20:233
10605995321,13cyclictest0-21swapper/307:07:073
10605995320,16cyclictest0-21swapper/310:58:133
1060599532,9cyclictest0-21swapper/310:06:343
10605995312,32cyclictest27870-21cpuspeed_turbos06:11:563
1060499535,41cyclictest0-21swapper/210:56:302
10604995328,9cyclictest14011-21head08:37:092
10604995328,9cyclictest14011-21head08:37:092
1060299537,38cyclictest0-21swapper/110:01:421
1060299533,37cyclictest0-21swapper/106:47:121
10602995323,10cyclictest4775-21taskset06:31:401
248599520,8rtkit-daemon2484-21rtkit-daemon06:46:291
248599520,7rtkit-daemon2484-21rtkit-daemon05:49:471
248599520,7rtkit-daemon2484-21rtkit-daemon05:49:471
1060599525,29cyclictest0-21swapper/305:44:253
1060599525,27cyclictest0-21swapper/307:14:223
1060599525,27cyclictest0-21swapper/307:14:223
1060599524,41cyclictest765-21hwlatdetect06:22:003
1060599524,29cyclictest0-21swapper/307:27:043
1060599524,28cyclictest0-21swapper/305:57:063
1060599523,44cyclictest20928-21taskset08:47:393
10605995210,11cyclictest16759-21aten_r1power_cu06:56:493
1060499525,41cyclictest24064-21unixbench_singl08:52:072
1060499523,43cyclictest0-21swapper/207:49:172
1060499523,42cyclictest0-21swapper/210:06:552
10604995227,11cyclictest0-21swapper/210:34:272
10602995235,11cyclictest19993-21gltestperf07:01:591
10602995221,13cyclictest0-21swapper/106:36:501
10602995210,36cyclictest29928-21aten_r1power_cu06:16:511
10602995210,35cyclictest20950-21diskstats05:56:571
10602995210,34cyclictest15275-21runrttasks05:45:411
1060099523,43cyclictest0-21swapper/007:32:110
55852512,9sleep20-21swapper/210:50:282
248599510,6rtkit-daemon2484-21rtkit-daemon07:32:501
248599510,6rtkit-daemon2484-21rtkit-daemon06:36:221
248599510,6rtkit-daemon2484-21rtkit-daemon06:36:221
248599510,6rtkit-daemon2484-21rtkit-daemon06:09:011
248599510,5rtkit-daemon2484-21rtkit-daemon06:01:541
1060499517,37cyclictest0-21swapper/209:42:192
1060499514,42cyclictest0-21swapper/209:56:582
1060499514,41cyclictest0-21swapper/207:53:122
1060499514,40cyclictest0-21swapper/208:27:032
1060299518,36cyclictest0-21swapper/107:12:061
1060299518,36cyclictest0-21swapper/107:12:061
1060299514,28cyclictest0-21swapper/110:21:541
1060099515,28cyclictest0-21swapper/006:41:400
1060099514,40cyclictest0-21swapper/005:46:580
1060099514,40cyclictest0-21swapper/005:46:580
1060099514,29cyclictest0-21swapper/007:31:370
1060099514,28cyclictest0-21swapper/006:07:140
1060099514,28cyclictest0-21swapper/005:51:540
1060099513,41cyclictest0-21swapper/007:22:090
10600995119,13cyclictest0-21swapper/006:52:040
10600995117,14cyclictest0-21swapper/009:31:460
63482502,9sleep20-21swapper/207:40:282
248599500,6rtkit-daemon2484-21rtkit-daemon07:09:061
138242502,41sleep20-21swapper/206:47:522
1060599505,28cyclictest0-21swapper/306:11:403
1060599504,37cyclictest0-21swapper/306:06:413
1060599504,28cyclictest0-21swapper/306:27:083
1060599504,25cyclictest17807-21latency_hist05:51:413
1060599504,25cyclictest17807-21latency_hist05:51:413
1060599502,43cyclictest0-21swapper/306:51:503
1060499505,39cyclictest0-21swapper/210:41:452
1060499505,39cyclictest0-21swapper/210:41:452
1060499505,26cyclictest0-21swapper/210:41:302
1060499504,40cyclictest0-21swapper/208:42:052
10604995033,10cyclictest30251-21cut06:16:542
1060499503,40cyclictest0-21swapper/209:31:442
1060499503,39cyclictest0-21swapper/206:51:512
10604995022,13cyclictest0-21swapper/207:42:032
1060499502,43cyclictest0-21swapper/208:34:472
10604995011,12cyclictest0-21swapper/207:58:492
10604995011,12cyclictest0-21swapper/207:58:492
1060299503,39cyclictest0-21swapper/105:36:541
1060099504,28cyclictest0-21swapper/007:12:000
1060099504,28cyclictest0-21swapper/007:12:000
1060099504,28cyclictest0-21swapper/006:27:020
1060099504,28cyclictest0-21swapper/006:11:550
1060099504,27cyclictest0-21swapper/006:22:160
10600995016,29cyclictest41ktimersoftd/006:02:110
285542493,38sleep20-21swapper/208:11:562
189302493,40sleep20-21swapper/205:52:052
1060599494,38cyclictest0-21swapper/305:51:543
1060499495,38cyclictest0-21swapper/210:57:022
1060499495,38cyclictest0-21swapper/209:46:432
1060499495,27cyclictest0-21swapper/208:01:582
1060499493,40cyclictest0-21swapper/209:22:302
1060499493,40cyclictest0-21swapper/209:22:302
10604994920,13cyclictest0-21swapper/209:51:502
1060099494,28cyclictest0-21swapper/006:16:530
1060099494,27cyclictest0-21swapper/006:47:130
305482482,40sleep20-21swapper/207:22:592
1060599484,34cyclictest0-21swapper/306:41:403
1060499485,37cyclictest0-21swapper/209:02:052
1060499485,36cyclictest0-21swapper/209:16:532
10604994827,8cyclictest2269-21cat08:21:472
10604994826,8cyclictest21897-21ssh10:26:442
10604994826,14cyclictest0-21swapper/208:06:582
1060499482,41cyclictest0-21swapper/210:01:512
1060099484,27cyclictest0-21swapper/005:56:510
1060099483,39cyclictest0-21swapper/005:36:540
5192472,9sleep20-21swapper/207:28:232
213132472,38sleep20-21swapper/208:49:052
1060499475,27cyclictest0-21swapper/206:26:402
1060499473,38cyclictest0-21swapper/209:39:242
10604994721,7cyclictest22526-21latency_hist06:01:422
10604994710,23cyclictest0-21swapper/209:00:192
1060099475,37cyclictest0-21swapper/007:06:490
105202474,35sleep00-21swapper/005:36:070
67492462,9sleep20-21swapper/206:34:052
67492462,9sleep20-21swapper/206:34:052
245752462,9sleep20-21swapper/206:02:252
1060599463,22cyclictest0-21swapper/306:31:523
1060599463,22cyclictest0-21swapper/306:31:523
1060499465,34cyclictest0-21swapper/209:26:452
1060499463,38cyclictest0-21swapper/207:02:022
10604994629,10cyclictest17494-21grep06:56:562
10604994619,12cyclictest0-21swapper/205:47:022
10604994619,12cyclictest0-21swapper/205:47:022
257302452,9sleep20-21swapper/207:12:272
257302452,9sleep20-21swapper/207:12:272
127682452,9sleep20-21swapper/205:39:072
113852452,36sleep20-21swapper/206:42:162
10604994531,9cyclictest27163-21grep07:16:582
10604994531,9cyclictest27163-21grep07:16:582
1060299455,32cyclictest0-21swapper/105:36:421
1060499444,32cyclictest0-21swapper/205:41:552
10604994428,10cyclictest4168-21unixbench_singl06:27:132
1060499435,32cyclictest0-21swapper/207:06:542
10605993822,8cyclictest10692-21wc05:36:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional