You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 18:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed May 06, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3263721020,3sleep041ktimersoftd/005:54:470
2188521010,5sleep2281ktimersoftd/206:39:472
268199974,77cyclictest0-21swapper/009:00:520
268199974,77cyclictest0-21swapper/009:00:520
268199964,24cyclictest0-21swapper/007:39:540
268199954,22cyclictest2507-21gdm-simple-gree08:32:170
268199934,26cyclictest0-21swapper/007:14:070
2681999331,10cyclictest3255-21strings10:14:390
268199933,24cyclictest31804-21grep07:44:530
268199926,24cyclictest0-21swapper/010:01:370
268199925,24cyclictest0-21swapper/007:28:360
268199924,25cyclictest0-21swapper/010:11:170
2681999222,11cyclictest0-21swapper/008:03:510
268199914,28cyclictest0-21swapper/010:19:320
157292910,12sleep1268299cyclictest07:22:191
268199904,35cyclictest0-21swapper/008:14:510
268199904,35cyclictest0-21swapper/008:14:510
268199904,35cyclictest0-21swapper/007:30:370
268199904,28cyclictest0-21swapper/008:09:540
268199904,27cyclictest0-21swapper/006:24:530
268199904,26cyclictest0-21swapper/008:54:070
268199904,26cyclictest0-21swapper/008:39:300
268199904,25cyclictest0-21swapper/009:04:290
268199903,24cyclictest0-21swapper/007:38:370
268199903,24cyclictest0-21swapper/007:38:370
268199894,28cyclictest0-21swapper/005:29:480
268199894,27cyclictest0-21swapper/006:59:490
268199894,27cyclictest0-21swapper/004:54:570
268199894,25cyclictest0-21swapper/009:54:480
2681998919,12cyclictest0-21swapper/008:04:530
268199884,38cyclictest0-21swapper/009:34:290
268199884,35cyclictest0-21swapper/009:29:410
268199884,28cyclictest0-21swapper/006:04:430
268199884,26cyclictest0-21swapper/009:24:350
268199884,12cyclictest0-21swapper/008:58:360
268199883,30cyclictest0-21swapper/007:23:130
268199883,27cyclictest0-21swapper/009:39:300
268199874,26cyclictest0-21swapper/007:54:560
268199874,25cyclictest0-21swapper/007:14:540
268199873,25cyclictest0-21swapper/008:44:450
2681998729,10cyclictest7039-21head05:00:020
268199864,26cyclictest0-21swapper/009:17:320
268199864,26cyclictest0-21swapper/006:54:380
2681998533,8cyclictest7147-21grep06:09:420
2681998533,8cyclictest7147-21grep06:09:420
268199853,26cyclictest0-21swapper/008:39:190
268199845,34cyclictest0-21swapper/009:20:210
268199844,26cyclictest0-21swapper/010:04:490
268199844,26cyclictest0-21swapper/009:49:520
268199844,26cyclictest0-21swapper/008:26:290
268199834,25cyclictest0-21swapper/009:44:500
268199824,24cyclictest0-21swapper/007:07:260
2681998235,9cyclictest22918-21wc05:34:470
2681998231,10cyclictest9190-21cpuspeed_turbos06:14:380
268199823,27cyclictest0-21swapper/005:49:570
2681998116,12cyclictest0-21swapper/005:43:100
268199803,27cyclictest0-21swapper/008:20:470
2681997920,12cyclictest0-21swapper/009:13:080
268199773,25cyclictest0-21swapper/007:51:300
23522670,4sleep12471-21df_abs10:14:291
44672644,13sleep20-21swapper/208:40:012
268299646,35cyclictest0-21swapper/109:14:181
248599640,6rtkit-daemon26032-21yum-updatesd-he05:40:071
248599640,6rtkit-daemon0-21swapper/005:00:391
268299635,36cyclictest0-21swapper/109:29:461
2682996227,13cyclictest0-21swapper/107:32:501
248599600,5rtkit-daemon2671-21cyclictest05:10:531
248599600,4rtkit-daemon23658-21ssh08:21:231
268499595,35cyclictest0-21swapper/310:23:383
268399593,50cyclictest0-21swapper/209:08:332
2682995929,11cyclictest7790-21vmstat08:44:521
248599590,7rtkit-daemon0-21swapper/008:24:531
248599590,7rtkit-daemon0-21swapper/005:17:231
2683995838,14cyclictest0-21swapper/208:09:412
268499575,45cyclictest1876-21munin-node10:14:253
268399575,44cyclictest0-21swapper/207:54:312
2683995720,29cyclictest7074-21crond09:39:112
268299574,28cyclictest0-21swapper/106:54:501
260472573,10sleep10-21swapper/107:38:001
260472573,10sleep10-21swapper/107:38:001
248599570,6rtkit-daemon0-21swapper/005:25:001
248599570,6rtkit-daemon0-21swapper/005:25:001
232372573,12sleep30-21swapper/308:19:553
14512573,12sleep10-21swapper/110:13:451
268499564,45cyclictest0-21swapper/310:09:453
268399564,43cyclictest11906-21ssh07:15:562
268399563,45cyclictest0-21swapper/209:39:362
268299569,38cyclictest0-21swapper/107:40:021
2682995617,23cyclictest0-21swapper/107:10:521
248599560,6rtkit-daemon2484-21rtkit-daemon08:54:372
248599560,6rtkit-daemon2484-21rtkit-daemon06:34:422
248599560,6rtkit-daemon0-21swapper/005:29:301
102852563,13sleep10-21swapper/108:01:471
58782554,44sleep20-21swapper/207:09:232
271192553,12sleep20-21swapper/208:26:472
268399555,44cyclictest0-21swapper/209:27:382
268299555,35cyclictest0-21swapper/104:58:251
268299555,13cyclictest1419-21runrttasks08:35:371
2682995526,13cyclictest0-21swapper/108:14:191
268199554,28cyclictest0-21swapper/006:34:510
248599550,5rtkit-daemon2484-21rtkit-daemon08:44:452
248599550,5rtkit-daemon2484-21rtkit-daemon08:08:243
268499548,40cyclictest0-21swapper/309:34:303
268499545,43cyclictest30253-21cpu07:44:323
268499544,43cyclictest0-21swapper/309:29:333
268399545,42cyclictest0-21swapper/207:49:492
268399545,42cyclictest0-21swapper/207:44:342
268399545,12cyclictest0-21swapper/209:09:322
268399544,41cyclictest1287-21snmpd10:09:192
268399544,13cyclictest0-21swapper/210:04:402
268399543,45cyclictest0-21swapper/207:32:582
2683995413,35cyclictest0-21swapper/206:24:342
268299546,31cyclictest0-21swapper/108:32:591
268299544,33cyclictest0-21swapper/107:24:381
2682995422,11cyclictest0-21swapper/107:54:341
193482543,10sleep10-21swapper/109:49:541
168192543,43sleep00-21swapper/006:29:430
15752543,45sleep20-21swapper/207:02:102
268499535,42cyclictest1419-21runrttasks09:59:273
2684995320,27cyclictest361ktimersoftd/309:40:443
268399535,42cyclictest18221-21fschecks_time09:49:342
268399534,41cyclictest19067-21kworker/2:207:13:402
2683995336,9cyclictest7139-21grep06:09:422
2683995336,9cyclictest7139-21grep06:09:422
268299536,30cyclictest0-21swapper/109:14:501
268299535,27cyclictest0-21swapper/108:14:351
268299535,27cyclictest0-21swapper/108:14:351
268299535,15cyclictest0-21swapper/109:39:201
268299534,26cyclictest0-21swapper/108:07:161
2682995323,13cyclictest0-21swapper/106:14:571
2682995322,13cyclictest0-21swapper/106:49:561
2682995322,13cyclictest0-21swapper/106:49:561
250442533,9sleep20-21swapper/206:45:572
248599530,5rtkit-daemon2484-21rtkit-daemon08:59:372
248599530,5rtkit-daemon2484-21rtkit-daemon08:59:372
248599530,5rtkit-daemon2484-21rtkit-daemon08:37:532
245832534,41sleep20-21swapper/209:59:312
9122522,9sleep30-21swapper/308:34:583
302072523,43sleep20-21swapper/208:30:462
268499524,41cyclictest7390-21rt-features08:44:473
268499524,41cyclictest27489-21ssh08:28:073
268499524,40cyclictest29437-21ssh06:54:533
268499523,45cyclictest0-21swapper/307:04:563
268499523,41cyclictest32143-21rm09:22:333
268499523,41cyclictest27546-21ssh10:04:223
268499523,28cyclictest0-21swapper/307:29:413
2684995219,27cyclictest0-21swapper/309:54:393
268399524,41cyclictest19067-21kworker/2:208:51:232
268399524,41cyclictest19067-21kworker/2:207:27:352
2683995232,14cyclictest0-21swapper/209:29:292
268399523,41cyclictest4333-21ssh10:16:252
268399523,41cyclictest19067-21kworker/2:207:41:272
268399523,41cyclictest18080-21aten2.4-expect08:14:312
268399523,41cyclictest18080-21aten2.4-expect08:14:312
268299525,28cyclictest0-21swapper/110:05:181
268299525,28cyclictest0-21swapper/109:09:171
268299525,13cyclictest0-21swapper/109:19:501
268299524,29cyclictest0-21swapper/105:34:571
268299524,24cyclictest0-21swapper/108:59:291
268299524,24cyclictest0-21swapper/108:59:291
2682995225,13cyclictest0-21swapper/107:49:551
2682995222,14cyclictest0-21swapper/106:09:411
2682995222,14cyclictest0-21swapper/106:09:411
2682995221,13cyclictest0-21swapper/105:54:401
2682995221,13cyclictest0-21swapper/105:04:531
262092522,9sleep30-21swapper/305:40:203
250352523,9sleep30-21swapper/306:45:503
214772522,43sleep00-21swapper/006:39:420
95752513,42sleep19709-21cstates08:49:321
72332512,9sleep30-21swapper/305:01:553
58922512,9sleep20-21swapper/206:05:262
268499514,42cyclictest0-21swapper/309:06:353
268499514,40cyclictest0-21swapper/308:09:323
268499514,39cyclictest23399-21entropy09:09:333
268499514,38cyclictest3221-21rm09:27:303
268499513,42cyclictest8334-21ssh07:59:353
268499513,40cyclictest1863-21rm07:03:063
268499513,40cyclictest18343-21ssh09:01:173
268499513,40cyclictest18343-21ssh09:01:173
268399515,39cyclictest0-21swapper/208:04:202
268399515,39cyclictest0-21swapper/206:54:542
268399514,41cyclictest14997-21unixbench_multi07:19:562
268399513,41cyclictest16361-21ssh09:46:162
268399513,40cyclictest7543-21ssh10:20:532
268299516,27cyclictest0-21swapper/108:55:161
268299515,28cyclictest0-21swapper/106:59:531
268299515,28cyclictest0-21swapper/105:59:421
268299515,28cyclictest0-21swapper/105:19:381
268299515,27cyclictest10302-21diskstats07:14:381
268299515,27cyclictest0-21swapper/109:58:041
268299515,27cyclictest0-21swapper/106:34:241
2682995122,13cyclictest0-21swapper/109:24:491
2682995121,13cyclictest0-21swapper/109:59:301
2682995121,13cyclictest0-21swapper/107:05:541
2682995121,13cyclictest0-21swapper/106:04:551
60892502,42sleep30-21swapper/306:08:013
59972503,9sleep30-21swapper/307:09:243
289312503,42sleep328935-21ssh09:18:083
268499505,39cyclictest0-21swapper/307:40:073
268499503,40cyclictest20487-21ssh09:54:013
268499503,40cyclictest14696-21ssh08:55:173
2684995017,8cyclictest361ktimersoftd/307:57:083
2684995014,32cyclictest361ktimersoftd/308:14:463
2684995014,32cyclictest361ktimersoftd/308:14:463
268399504,40cyclictest0-21swapper/207:37:122
268399504,40cyclictest0-21swapper/207:37:122
268399504,38cyclictest13622-21ssh08:06:382
2683995035,10cyclictest11403-21grep05:09:552
2683995032,13cyclictest0-21swapper/209:18:462
268399503,40cyclictest22441-21irqstats08:19:422
268399503,40cyclictest0-21swapper/209:54:262
268299507,26cyclictest0-21swapper/108:42:241
268299507,25cyclictest31124-21iostat_ios07:44:421
268299505,28cyclictest0-21swapper/109:44:391
268299504,29cyclictest0-21swapper/106:29:241
268299504,28cyclictest0-21swapper/106:23:251
2682995021,12cyclictest0-21swapper/110:21:591
2682995019,13cyclictest0-21swapper/109:34:451
268199505,27cyclictest0-21swapper/005:17:110
154742503,9sleep30-21swapper/306:25:553
9532492,9sleep30-21swapper/305:55:363
268499494,39cyclictest24251-21smartctl07:34:403
268499494,39cyclictest24251-21smartctl07:34:403
268499494,39cyclictest0-21swapper/309:45:393
268499494,38cyclictest0-21swapper/305:09:383
268499493,39cyclictest30257-21ssh08:30:553
268499493,38cyclictest26823-21kworker/3:007:49:363
2684994917,26cyclictest2667-21cut08:39:303
268399496,37cyclictest0-21swapper/209:19:422
2683994935,9cyclictest12908-21unixbench_multi06:19:572
2683994921,9cyclictest5051-21latency_hist04:59:282
268299495,36cyclictest0-21swapper/106:44:481
268299495,28cyclictest0-21swapper/106:39:451
268299495,26cyclictest0-21swapper/106:38:421
268199494,28cyclictest0-21swapper/005:04:580
312572482,9sleep30-21swapper/305:53:423
268499484,37cyclictest21994-21munin-node05:34:413
268499484,37cyclictest17395-21ssh07:24:403
268499484,36cyclictest11865-21ssh08:52:183
2684994832,10cyclictest8478-21gltestperf05:04:463
2683994834,8cyclictest1859-21cpuspeed_turbos05:59:382
2683994831,10cyclictest28514-21unixbench_singl05:44:582
2682994819,12cyclictest0-21swapper/105:54:251
268199484,38cyclictest0-21swapper/005:24:400
268199484,38cyclictest0-21swapper/005:24:400
268199484,27cyclictest0-21swapper/005:09:470
268199483,38cyclictest0-21swapper/006:19:360
248599480,5rtkit-daemon2484-21rtkit-daemon06:49:492
248599480,5rtkit-daemon2484-21rtkit-daemon06:49:492
168532482,40sleep00-21swapper/005:22:480
268499474,38cyclictest0-21swapper/305:19:453
2684994732,10cyclictest7307-21gltestperf06:09:433
2684994732,10cyclictest7307-21gltestperf06:09:433
268499473,37cyclictest0-21swapper/307:15:083
268399475,35cyclictest0-21swapper/204:59:452
268299475,27cyclictest0-21swapper/105:48:111
268199474,25cyclictest0-21swapper/005:44:550
106922472,10sleep30-21swapper/306:15:513
48172462,38sleep30-21swapper/304:56:313
268499465,35cyclictest0-21swapper/307:19:343
268499463,36cyclictest11206-21munin-node06:19:533
268399464,27cyclictest0-21swapper/205:54:512
2683994631,9cyclictest15567-21tune2fs05:19:442
268399463,38cyclictest0-21swapper/206:14:362
268399463,37cyclictest17345-21telnet05:24:382
268399463,37cyclictest17345-21telnet05:24:382
268199464,26cyclictest0-21swapper/006:44:510
268199464,26cyclictest0-21swapper/006:04:250
263412463,9sleep20-21swapper/205:42:052
255452462,36sleep30-21swapper/306:49:333
255452462,36sleep30-21swapper/306:49:333
241112462,38sleep20-21swapper/205:39:062
190962462,9sleep30-21swapper/305:25:573
190962462,9sleep30-21swapper/305:25:573
268499455,21cyclictest23082-21cat06:44:243
268399454,26cyclictest0-21swapper/205:29:522
2683994529,10cyclictest12601-21aten2.4-expect05:14:392
203632452,9sleep30-21swapper/306:37:243
268499443,34cyclictest1287-21snmpd05:19:113
2684994429,10cyclictest19949-21tr05:29:393
268399444,22cyclictest16104-21aten2.4-expect06:29:352
2683994429,10cyclictest30912-21unixbench_singl05:49:582
23272444,33sleep00-21swapper/004:50:530
2684994328,10cyclictest26791-21head05:44:363
2684994324,13cyclictest0-21swapper/306:29:403
268399433,35cyclictest0-21swapper/205:04:562
2681994227,9cyclictest26082-21df06:49:380
2681994227,9cyclictest26082-21df06:49:380
268499415,31cyclictest2072-21df_abs05:59:403
268299414,18cyclictest0-21swapper/104:54:281
31123810,18sleep20-21swapper/204:49:392
268499316,16cyclictest0-21swapper/304:54:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional