You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 17:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Aug 02, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14019910751,14cyclictest0-21swapper/011:04:470
2228921010,8chrt22291-21cat10:28:160
140499985,78cyclictest0-21swapper/311:19:213
140499973,67cyclictest0-21swapper/310:22:513
140499925,64cyclictest7767-21timerwakeupswit10:03:503
140499924,68cyclictest0-21swapper/308:48:453
140499924,13cyclictest0-21swapper/310:18:163
1404999218,49cyclictest14727-21sendmail_mailst11:03:433
1404999214,55cyclictest0-21swapper/310:02:533
1404999210,60cyclictest9706-21cpuspeed_turbos10:08:313
140499904,66cyclictest0-21swapper/309:22:183
140499904,62cyclictest0-21swapper/311:02:083
140499904,62cyclictest0-21swapper/308:17:243
1404999018,48cyclictest0-21swapper/310:51:373
140499897,58cyclictest15314-21munin-node09:28:503
140499894,60cyclictest0-21swapper/307:48:553
140499894,58cyclictest26233-21iostat_ios09:43:403
140499894,12cyclictest0-21swapper/308:58:403
140499884,61cyclictest0-21swapper/309:41:343
140499884,61cyclictest0-21swapper/308:34:323
140499884,61cyclictest0-21swapper/308:34:323
140499884,60cyclictest0-21swapper/310:30:123
140499884,60cyclictest0-21swapper/309:07:153
140499884,59cyclictest0-21swapper/309:51:453
140499884,59cyclictest0-21swapper/309:51:453
140499884,12cyclictest0-21swapper/310:33:503
140499884,12cyclictest0-21swapper/310:33:503
140499884,12cyclictest0-21swapper/308:28:383
140499884,10cyclictest0-21swapper/307:21:593
140499883,10cyclictest2429-21sed08:18:473
140499874,60cyclictest0-21swapper/309:55:193
140499874,59cyclictest0-21swapper/308:44:503
140499874,59cyclictest0-21swapper/306:38:343
140499874,11cyclictest0-21swapper/310:53:473
140499873,13cyclictest0-21swapper/309:08:343
140499873,10cyclictest5711-21cat08:23:443
140499864,58cyclictest0-21swapper/306:43:353
140499864,13cyclictest0-21swapper/308:56:573
140499864,12cyclictest0-21swapper/306:18:503
140499864,11cyclictest0-21swapper/311:38:053
140499863,9cyclictest24678-21seq06:53:573
140499863,9cyclictest20130-21http_loadtime10:23:363
140499863,56cyclictest32270-21taskset11:31:213
140499863,12cyclictest0-21swapper/308:08:413
140499854,66cyclictest0-21swapper/310:39:043
140499854,65cyclictest0-21swapper/309:15:053
140499854,58cyclictest0-21swapper/311:14:033
140499853,9cyclictest12555-21sed09:23:343
140499853,58cyclictest20494-21ssh09:33:563
140499853,58cyclictest14827-21munin-node07:43:313
140499853,10cyclictest1544-21cat10:43:473
1404998517,43cyclictest0-21swapper/307:23:573
140499845,64cyclictest0-21swapper/311:25:123
140499844,12cyclictest0-21swapper/308:41:223
140499843,63cyclictest11057-21crond06:28:243
140499843,59cyclictest19077-21ssh11:11:153
140499843,10cyclictest371-21aten_r1power_en07:13:343
140499834,56cyclictest0-21swapper/307:38:343
140499824,60cyclictest0-21swapper/307:28:413
140499824,60cyclictest0-21swapper/306:28:453
140499824,11cyclictest0-21swapper/307:53:553
140499824,11cyclictest0-21swapper/307:53:553
140499814,59cyclictest22661-21fschecks_count07:58:393
140499814,58cyclictest0-21swapper/307:08:393
140499803,9cyclictest107550irq/46-eth006:13:513
140499794,58cyclictest0-21swapper/307:03:403
219499780,5rtkit-daemon2193-21rtkit-daemon11:22:360
219499780,18rtkit-daemon30414-21yum-updatesd-he09:49:102
219499780,18rtkit-daemon30414-21yum-updatesd-he09:49:102
140499774,11cyclictest0-21swapper/307:00:163
140499773,14cyclictest0-21swapper/308:03:463
1404997710,50cyclictest0-21swapper/307:33:553
140499764,14cyclictest0-21swapper/306:52:093
140499763,52cyclictest0-21swapper/306:08:503
140499753,14cyclictest0-21swapper/306:33:543
140299736,51cyclictest0-21swapper/109:58:181
1402997312,52cyclictest0-21swapper/110:03:361
219499710,7rtkit-daemon0-21swapper/210:31:011
219499710,5rtkit-daemon2193-21rtkit-daemon06:53:541
1403997124,25cyclictest0-21swapper/209:47:452
219499690,7rtkit-daemon0-21swapper/208:46:580
1401996847,13cyclictest0-21swapper/010:09:410
140499675,55cyclictest0-21swapper/306:08:263
219499660,5rtkit-daemon14110-21munin-node10:13:472
1401996616,28cyclictest0-21swapper/011:33:470
140399644,45cyclictest0-21swapper/210:08:582
140399634,14cyclictest0-21swapper/211:03:322
140399634,11cyclictest23366-21grep10:28:352
1403996311,7cyclictest11068-21awk06:28:252
1401996343,13cyclictest0-21swapper/009:53:520
258612623,51sleep00-21swapper/010:33:290
258612623,51sleep00-21swapper/010:33:290
219499620,13rtkit-daemon2193-21rtkit-daemon06:28:552
1401996247,10cyclictest0-21swapper/010:58:470
1401996234,13cyclictest0-21swapper/010:02:100
222612614,11sleep20-21swapper/206:48:562
219499610,13rtkit-daemon2193-21rtkit-daemon06:13:492
140399614,28cyclictest0-21swapper/209:13:372
140399614,12cyclictest0-21swapper/208:23:442
118942616,46sleep00-21swapper/006:28:430
140399604,13cyclictest0-21swapper/211:08:372
140299609,11cyclictest0-21swapper/110:23:151
1402996012,38cyclictest0-21swapper/109:33:501
1401996040,13cyclictest0-21swapper/010:17:320
1401996027,13cyclictest0-21swapper/009:23:190
1403995910,28cyclictest0-21swapper/208:39:302
140299596,46cyclictest0-21swapper/111:13:481
140299596,38cyclictest0-21swapper/108:37:471
140299596,38cyclictest0-21swapper/108:37:471
140299594,37cyclictest0-21swapper/109:18:431
1402995915,36cyclictest11593-21runrttasks10:10:201
140299591,50cyclictest0-21swapper/107:23:231
1401995939,13cyclictest0-21swapper/011:28:260
1401995939,13cyclictest0-21swapper/008:23:480
1401995930,24cyclictest0-21swapper/008:57:040
140399584,13cyclictest0-21swapper/209:33:422
140399584,11cyclictest0-21swapper/210:23:472
1403995839,11cyclictest12796-21grep07:38:362
1401995838,13cyclictest0-21swapper/010:38:470
308422573,9sleep226557-21diskmemload09:03:122
219499570,7rtkit-daemon0-21swapper/007:13:091
140399574,32cyclictest0-21swapper/208:53:542
140399574,16cyclictest0-21swapper/210:41:132
140399574,13cyclictest0-21swapper/210:01:242
140399574,12cyclictest0-21swapper/210:55:082
140399574,12cyclictest0-21swapper/208:44:542
1403995716,23cyclictest0-21swapper/211:19:312
1403995714,22cyclictest0-21swapper/209:08:302
140299579,41cyclictest32144-21munin-node09:03:391
140299578,42cyclictest23923-21fschecks_time11:18:321
1401995739,12cyclictest0-21swapper/010:18:350
1401995738,13cyclictest0-21swapper/007:43:210
1401995737,14cyclictest0-21swapper/011:13:360
1401995737,13cyclictest0-21swapper/009:43:310
1401995737,13cyclictest0-21swapper/009:08:190
1401995736,14cyclictest0-21swapper/010:53:300
1401995713,26cyclictest0-21swapper/008:28:400
219499560,5rtkit-daemon2193-21rtkit-daemon06:58:090
140399564,12cyclictest0-21swapper/210:48:502
140399564,12cyclictest0-21swapper/209:28:462
140399564,12cyclictest0-21swapper/208:17:442
140399563,13cyclictest0-21swapper/211:30:022
1403995618,21cyclictest0-21swapper/208:21:192
140299568,39cyclictest25779-21munin-node10:33:351
140299568,39cyclictest25779-21munin-node10:33:351
140299567,42cyclictest0-21swapper/108:23:331
140299567,41cyclictest31864-21runrttasks10:42:191
140299567,30cyclictest0-21swapper/109:28:491
140299564,45cyclictest0-21swapper/108:54:101
140299564,35cyclictest0-21swapper/108:38:431
140299563,46cyclictest0-21swapper/108:46:431
1402995622,26cyclictest0-21swapper/109:13:421
1402995612,37cyclictest1124-21snmpd10:58:481
1402995611,37cyclictest0-21swapper/108:49:201
1401995642,10cyclictest0-21swapper/009:23:340
140199562,45cyclictest0-21swapper/007:13:340
279552552,44sleep00-21swapper/008:08:480
219499550,5rtkit-daemon2193-21rtkit-daemon07:21:230
219499550,4rtkit-daemon2193-21rtkit-daemon07:12:540
140399555,28cyclictest1227-21runrttasks08:48:302
140399555,15cyclictest0-21swapper/211:14:522
140399555,15cyclictest0-21swapper/208:38:182
140399555,15cyclictest0-21swapper/208:38:182
140399555,15cyclictest0-21swapper/208:11:432
140399555,14cyclictest0-21swapper/211:26:542
140399554,11cyclictest0-21swapper/209:24:412
1403995522,14cyclictest0-21swapper/209:18:332
1403995519,9cyclictest19471-21interrupts06:43:462
140299559,26cyclictest2972-21taskset10:47:441
140299556,41cyclictest15331-21ssh11:04:361
140299556,41cyclictest0-21swapper/108:13:201
1402995513,35cyclictest14393-21tail10:13:501
1402995512,37cyclictest0-21swapper/109:58:371
140199554,35cyclictest0-21swapper/010:06:370
1401995536,12cyclictest0-21swapper/009:13:530
1401995536,12cyclictest0-21swapper/007:48:330
1401995535,13cyclictest0-21swapper/009:33:520
1401995525,13cyclictest0-21swapper/008:48:420
242492544,11sleep20-21swapper/209:40:462
140399545,28cyclictest0-21swapper/210:03:332
140399544,30cyclictest0-21swapper/207:28:592
140399544,13cyclictest0-21swapper/209:55:282
1403995420,28cyclictest7994-21munin-node08:28:432
1403995411,35cyclictest0-21swapper/210:58:462
140299549,37cyclictest22373-21grep10:28:161
140299547,40cyclictest29792-21aten_r1power_en11:28:251
140299545,40cyclictest8939-21aten_r1power_cu06:23:361
140299544,31cyclictest0-21swapper/110:48:441
1402995435,11cyclictest20471-21sed07:53:431
1402995435,11cyclictest20471-21sed07:53:431
140199545,23cyclictest0-21swapper/010:32:200
140199544,45cyclictest0-21swapper/009:01:210
1401995439,10cyclictest0-21swapper/009:42:140
140199543,45cyclictest0-21swapper/009:29:130
219499530,6rtkit-daemon2193-21rtkit-daemon06:03:412
140399535,28cyclictest0-21swapper/210:33:382
140399535,28cyclictest0-21swapper/210:33:382
140399535,28cyclictest0-21swapper/207:43:402
140399534,31cyclictest0-21swapper/209:03:522
140399534,30cyclictest0-21swapper/207:33:522
140399534,29cyclictest0-21swapper/207:03:452
1403995320,14cyclictest0-21swapper/206:08:382
1403995319,27cyclictest16537-21fschecks_count10:18:332
140299536,40cyclictest0-21swapper/109:11:201
140299534,41cyclictest0-21swapper/111:08:481
1402995336,10cyclictest15197-21tr07:43:341
140199534,42cyclictest0-21swapper/009:08:340
140199534,42cyclictest0-21swapper/008:38:510
140199534,42cyclictest0-21swapper/007:28:390
140199534,15cyclictest0-21swapper/008:33:510
140199534,15cyclictest0-21swapper/008:33:510
140199534,12cyclictest0-21swapper/008:23:210
1401995337,11cyclictest0-21swapper/008:13:230
1401995332,14cyclictest0-21swapper/011:28:140
219499520,5rtkit-daemon2193-21rtkit-daemon06:58:541
140399525,29cyclictest0-21swapper/210:43:322
140399525,29cyclictest0-21swapper/206:53:392
140399524,29cyclictest0-21swapper/207:48:522
140399524,29cyclictest0-21swapper/206:58:492
140399524,28cyclictest0-21swapper/207:58:512
1403995232,12cyclictest1188-21grep07:13:422
140299529,27cyclictest19960-21switchtime06:43:561
140299528,25cyclictest8819-21perl08:28:401
140299527,25cyclictest27652-21ssh09:46:111
140299524,39cyclictest0-21swapper/109:38:291
1402995213,31cyclictest0-21swapper/107:33:461
1402995212,33cyclictest0-21swapper/108:19:511
1402995210,36cyclictest21821-21if_eth006:48:471
140199524,40cyclictest19637-21head07:53:350
140199524,40cyclictest19637-21head07:53:350
1401995237,10cyclictest0-21swapper/009:50:490
1401995237,10cyclictest0-21swapper/009:50:490
1401995233,13cyclictest0-21swapper/006:38:250
1401995232,14cyclictest0-21swapper/011:08:450
65652512,42sleep00-21swapper/006:18:390
219499510,6rtkit-daemon0-21swapper/007:21:382
140399515,26cyclictest0-21swapper/206:18:382
140399514,29cyclictest0-21swapper/207:08:382
140399514,28cyclictest0-21swapper/211:35:432
140399514,11cyclictest0-21swapper/207:23:372
1403995120,13cyclictest0-21swapper/206:33:412
140299516,29cyclictest0-21swapper/110:53:341
140299515,39cyclictest0-21swapper/111:25:001
140299514,40cyclictest0-21swapper/108:13:531
1402995123,9cyclictest30767-21rm09:02:531
1402995111,34cyclictest0-21swapper/109:27:371
1402995110,35cyclictest1432-21gltestperf11:33:311
140199514,30cyclictest0-21swapper/010:43:310
1401995136,10cyclictest0-21swapper/010:52:530
1401995129,15cyclictest0-21swapper/007:03:580
1401995128,15cyclictest0-21swapper/006:58:380
219499500,5rtkit-daemon2193-21rtkit-daemon07:13:541
219499500,4rtkit-daemon2193-21rtkit-daemon07:04:021
140399507,27cyclictest0-21swapper/208:03:352
140299508,35cyclictest0-21swapper/106:13:391
140299506,37cyclictest24033-21runrttasks08:01:451
1402995031,13cyclictest15412-21grep06:33:581
1402995010,34cyclictest0-21swapper/109:50:191
1402995010,34cyclictest0-21swapper/109:50:191
1401995034,10cyclictest6035-21fschecks_time07:23:430
1401995033,11cyclictest22328-21tr07:58:360
140399494,13cyclictest0-21swapper/207:53:572
140399494,13cyclictest0-21swapper/207:53:572
1401994932,10cyclictest4674-21df06:13:420
1401994918,13cyclictest0-21swapper/006:48:560
170942483,39sleep00-21swapper/006:38:460
145692482,9sleep10-21swapper/107:43:051
140399484,27cyclictest0-21swapper/206:38:412
140299486,36cyclictest0-21swapper/106:28:381
140299486,24cyclictest4027-21sed06:13:261
1401994828,14cyclictest0-21swapper/007:33:420
1401994828,13cyclictest0-21swapper/006:08:270
140299476,12cyclictest25964-21timerandwakeup08:03:551
140299472,39cyclictest0-21swapper/106:38:531
1402994710,29cyclictest7737-21needreboot06:18:521
1401994728,12cyclictest0-21swapper/006:08:450
140299467,32cyclictest0-21swapper/107:23:441
1402994629,10cyclictest8017-21cpuspeed_turbos07:28:381
201142454,35sleep018457-21munin-node06:43:580
1402994527,12cyclictest17278-21aten_r1power_en07:48:331
140199444,33cyclictest0-21swapper/007:43:320
140199443,23cyclictest10170-21ntpdc06:23:510
140199424,32cyclictest0-21swapper/008:03:510
1402994115,11cyclictest0-21swapper/106:08:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional