You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 19:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Dec 26, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
394921330,10sleep21540599cyclictest08:47:382
2485991090,10rtkit-daemon0-21swapper/009:32:560
15402991086,28cyclictest23854-21yum-updatesd-he10:37:380
2485991070,9rtkit-daemon0-21swapper/009:52:410
2485991060,10rtkit-daemon0-21swapper/009:02:500
2485991050,8rtkit-daemon0-21swapper/008:57:500
2485991040,9rtkit-daemon0-21swapper/011:57:360
2485991040,7rtkit-daemon0-21swapper/010:43:010
2485991020,7rtkit-daemon0-21swapper/010:15:100
2485991020,6rtkit-daemon27478-21yum-updatesd-he09:37:490
2485991020,6rtkit-daemon27478-21yum-updatesd-he09:37:490
2485991020,5rtkit-daemon14814-21grep11:22:520
2485991010,8rtkit-daemon0-21swapper/010:22:540
2485991010,8rtkit-daemon0-21swapper/010:22:540
248599990,6rtkit-daemon20233-21yum-updatesd-he11:37:370
248599990,5rtkit-daemon19801-21tune2fs10:27:390
248599970,6rtkit-daemon0-21swapper/007:28:090
248599970,6rtkit-daemon0-21swapper/007:28:090
1540299955,26cyclictest0-21swapper/011:54:060
1540299954,27cyclictest0-21swapper/010:07:220
248599940,7rtkit-daemon0-21swapper/011:07:450
248599940,7rtkit-daemon0-21swapper/011:07:450
248599940,7rtkit-daemon0-21swapper/007:39:010
248599940,6rtkit-daemon0-21swapper/011:19:070
248599930,7rtkit-daemon0-21swapper/009:57:330
248599930,7rtkit-daemon0-21swapper/009:27:420
248599930,6rtkit-daemon0-21swapper/011:16:220
248599920,6rtkit-daemon0-21swapper/010:21:100
1540299924,27cyclictest0-21swapper/009:47:560
1540299923,36cyclictest0-21swapper/011:27:250
248599910,6rtkit-daemon0-21swapper/011:51:360
248599910,6rtkit-daemon0-21swapper/011:51:360
248599910,6rtkit-daemon0-21swapper/010:37:010
15402999029,53cyclictest8137-21sadc08:57:240
15402999029,53cyclictest8137-21sadc08:57:240
1540299895,76cyclictest0-21swapper/008:36:170
1540299894,27cyclictest0-21swapper/007:10:570
1540299875,28cyclictest0-21swapper/008:47:370
1540299875,27cyclictest0-21swapper/007:37:280
1540299874,74cyclictest0-21swapper/008:37:580
1540299874,29cyclictest0-21swapper/008:27:430
15402998733,47cyclictest2824-21grep10:57:510
1540299863,35cyclictest0-21swapper/008:17:430
15402998622,10cyclictest15744-21head06:57:400
1540299854,12cyclictest0-21swapper/008:22:450
15402998512,12cyclictest12013-21telnet07:57:370
1540299844,32cyclictest0-21swapper/007:27:270
1540299844,14cyclictest0-21swapper/012:02:300
1540299844,13cyclictest0-21swapper/010:07:350
1540299843,9cyclictest121850irq/46-eth010:57:200
15402998414,12cyclictest0-21swapper/010:47:440
1540299837,12cyclictest0-21swapper/008:42:410
1540299834,22cyclictest0-21swapper/007:42:400
15402998333,41cyclictest18642-21tune2fs07:02:450
1540299833,22cyclictest0-21swapper/007:47:380
15402998325,9cyclictest17511-21grep08:07:450
15402998323,14cyclictest1419-21runrttasks12:17:290
15402998320,12cyclictest0-21swapper/007:56:490
15404998233,17cyclictest27199-21runrttasks09:36:531
1540299825,15cyclictest0-21swapper/011:02:530
1540299823,26cyclictest0-21swapper/009:12:450
1540299823,25cyclictest0-21swapper/009:07:350
15402998222,12cyclictest1419-21runrttasks09:22:590
15402998221,12cyclictest0-21swapper/012:22:400
15402998210,10cyclictest121850irq/46-eth009:42:350
15402998210,10cyclictest0-21swapper/008:02:400
1540299814,24cyclictest19803-21fschecks_count08:12:450
1540299814,24cyclictest19803-21fschecks_count08:12:450
1540299813,22cyclictest23425-21grep11:42:370
1540299803,21cyclictest0-21swapper/007:21:440
15404997934,26cyclictest24241-21chrt07:12:591
1540299794,25cyclictest0-21swapper/011:32:280
1540299794,14cyclictest0-21swapper/007:12:570
1540299794,12cyclictest0-21swapper/012:07:310
15402997918,8cyclictest0-21swapper/009:17:420
1540299784,14cyclictest0-21swapper/012:12:450
15404997728,41cyclictest32641-21ls09:47:371
15404997728,30cyclictest0-21swapper/110:37:331
248599760,8rtkit-daemon0-21swapper/008:57:351
15404997630,29cyclictest31591-21taskset11:57:501
15404997623,26cyclictest18890-21cat10:27:211
15404997623,26cyclictest18890-21cat10:27:211
15404997531,25cyclictest24512-21vmstat09:27:581
15404997525,31cyclictest0-21swapper/110:47:331
15404997522,46cyclictest0-21swapper/111:37:441
15404997516,18cyclictest30493-1kworker/1:0H11:23:381
248599740,7rtkit-daemon0-21swapper/012:19:201
15404997434,33cyclictest14064-21sh10:17:201
15404997430,24cyclictest25277-21cut07:17:381
15404997427,40cyclictest0-21swapper/112:22:341
15404997421,39cyclictest0-21swapper/112:07:171
15404997417,49cyclictest0-21swapper/108:37:451
248599730,8rtkit-daemon0-21swapper/007:28:461
248599730,8rtkit-daemon0-21swapper/007:28:461
15404997328,26cyclictest16241-21fschecks_time09:12:411
15404997232,33cyclictest1419-21runrttasks11:55:521
15404997231,27cyclictest1287-21snmpd09:39:511
15404997231,27cyclictest1287-21snmpd09:39:511
15404997230,35cyclictest4169-21chrt08:47:411
15404997226,28cyclictest0-21swapper/108:32:251
15404997225,31cyclictest0-21swapper/112:12:451
15404997225,31cyclictest0-21swapper/107:52:431
15404997225,29cyclictest0-21swapper/109:22:391
248599710,7rtkit-daemon0-21swapper/011:49:141
248599710,7rtkit-daemon0-21swapper/011:49:141
15404997131,25cyclictest18459-21unixbench-2d08:07:591
15404997128,25cyclictest1287-21snmpd07:46:481
15404997124,39cyclictest0-21swapper/107:37:401
15404997123,41cyclictest0-21swapper/107:22:411
248599700,6rtkit-daemon0-21swapper/010:47:091
248599700,6rtkit-daemon0-21swapper/009:45:111
15404997028,27cyclictest4116-21unixbench_singl09:52:551
15404997025,28cyclictest0-21swapper/111:12:221
15404997023,40cyclictest0-21swapper/108:22:261
248599690,6rtkit-daemon0-21swapper/008:56:351
248599690,6rtkit-daemon0-21swapper/008:56:351
15404996930,34cyclictest8362-21missed_timers07:47:511
15404996927,35cyclictest1486-21df08:42:401
15404996926,36cyclictest993-21memory07:32:501
15404996925,37cyclictest5973-21netstat09:57:481
15404996924,15cyclictest0-21swapper/110:52:451
15404996827,35cyclictest0-21swapper/110:02:391
15404996827,34cyclictest16908-21sensors11:27:511
15404996827,34cyclictest0-21swapper/108:06:111
15404996730,31cyclictest95281munin-node10:07:561
15404996730,30cyclictest0-21swapper/110:36:431
15404996728,32cyclictest12833-21munin-run11:22:181
15404996728,30cyclictest19737-21diskstats08:12:441
15404996728,30cyclictest19737-21diskstats08:12:441
15404996727,24cyclictest17840-21munin-node11:32:441
15404996725,35cyclictest0-21swapper/111:45:411
15404996722,12cyclictest3523-21aten_r1power_cu11:02:321
15404996626,32cyclictest5927-21aten_r1power_cu11:07:301
15404996626,32cyclictest5927-21aten_r1power_cu11:07:301
15404996626,24cyclictest19077-21sshd10:27:281
15404996617,29cyclictest0-21swapper/107:57:381
15404996536,23cyclictest11081-21tr09:02:381
15404996533,25cyclictest1419-21runrttasks12:08:261
15404996531,27cyclictest1419-21runrttasks07:05:021
15404996527,11cyclictest1287-21snmpd08:22:581
15404996523,35cyclictest0-21swapper/109:07:521
15404996523,27cyclictest0-21swapper/110:57:301
15404996519,39cyclictest0-21swapper/110:17:371
15404996426,31cyclictest20972-21diskstats07:07:441
15404996425,31cyclictest18119-21cpu09:17:371
15404996423,26cyclictest17980-21sed07:02:291
15404996323,23cyclictest286981munin-node08:32:561
15405996025,12cyclictest0-21swapper/211:37:172
317312594,47sleep20-21swapper/208:37:442
1540599559,39cyclictest15034-21fschecks_time10:17:392
62602544,43sleep20-21swapper/207:42:592
289092543,8sleep328929-21python09:37:533
289092543,8sleep328929-21python09:37:533
15404995425,22cyclictest0-21swapper/106:57:301
84412534,40sleep20-21swapper/210:02:512
1540699533,42cyclictest13187-21ntp_states10:12:473
15406995321,9cyclictest0-21swapper/308:57:253
248599520,5rtkit-daemon2484-21rtkit-daemon06:52:483
218362523,42sleep321971-21munin-node11:37:543
167752522,10sleep20-21swapper/208:07:372
1540599523,42cyclictest4756-21munin-node09:57:582
246632512,10sleep30-21swapper/309:29:553
182122513,8sleep318354-21cpuspeed_turbos07:02:423
1540699513,42cyclictest19721-21users09:17:573
1540699512,24cyclictest0-21swapper/310:32:503
15405995134,11cyclictest6832-21sed08:52:442
15405995134,11cyclictest6832-21sed08:52:442
1540599513,43cyclictest0-21swapper/211:37:322
15405995123,7cyclictest14139-21latency_hist08:02:262
15405995120,24cyclictest3295-21idleruntime09:52:422
72382502,10sleep30-21swapper/310:02:353
265752503,39sleep326724-21cstates08:27:413
24112504,38sleep20-21swapper/208:42:522
162592502,10sleep20-21swapper/208:03:542
155452502,10sleep30-21swapper/309:12:353
15406995021,12cyclictest0-21swapper/309:47:173
15405995017,27cyclictest4580-21latency_hist07:42:272
6882493,38sleep2769-21if_eth009:47:442
1540699493,39cyclictest25191-21telnet07:17:373
1540599495,38cyclictest0-21swapper/210:37:372
1540599495,37cyclictest0-21swapper/210:32:372
1540599495,37cyclictest0-21swapper/210:22:392
1540599495,37cyclictest0-21swapper/210:22:392
15405994935,9cyclictest394-21grep12:02:342
15405994934,9cyclictest10314-21grep12:22:322
15405994922,7cyclictest9366-21latency_hist07:52:272
149612492,10sleep20-21swapper/211:24:072
15406994835,8cyclictest16341-21tail11:27:413
15406994833,9cyclictest649-21gltestperf09:47:423
15406994822,9cyclictest32047-21cat12:02:173
15406994817,13cyclictest0-21swapper/311:52:123
15406994817,13cyclictest0-21swapper/311:52:123
15405994834,9cyclictest22106-21unixbench_multi07:08:012
15405994833,10cyclictest26935-21cut08:27:442
15405994816,25cyclictest0-21swapper/210:42:322
318892472,38sleep20-21swapper/209:45:502
308462472,10sleep20-21swapper/208:37:232
294602472,10sleep20-21swapper/207:24:252
235222472,10sleep20-21swapper/208:20:152
224372473,9sleep20-21swapper/209:27:042
198812472,10sleep20-21swapper/207:03:582
15406994732,9cyclictest23677-21cut11:42:413
1540599477,33cyclictest0-21swapper/209:12:562
1540599475,22cyclictest319522latency_hist12:02:172
15405994733,9cyclictest24318-21tail11:42:502
15405994732,10cyclictest20919-21head08:13:002
15405994732,10cyclictest20919-21head08:13:002
15405994731,11cyclictest3955-21df11:02:362
1540599473,37cyclictest9528-21munin-node10:07:362
1540599472,39cyclictest0-21swapper/208:57:332
152442474,6sleep00-21swapper/006:55:580
150472472,10sleep20-21swapper/209:09:112
126392472,39sleep30-21swapper/309:03:563
257052462,9sleep30-21swapper/310:38:263
211552462,38sleep20-21swapper/210:31:242
200262463,10sleep20-21swapper/209:21:442
185612462,9sleep30-21swapper/310:23:433
185612462,9sleep30-21swapper/310:23:433
1540699464,35cyclictest0-21swapper/307:37:273
15406994632,9cyclictest22145-21cut08:17:423
15406994631,9cyclictest13740-21sed07:57:593
15406994616,10cyclictest7250irq/45-ahci09:37:223
15405994631,10cyclictest2157-21cat10:57:422
1540599462,38cyclictest0-21swapper/211:17:382
1540599462,38cyclictest0-21swapper/210:47:552
15405994618,13cyclictest0-21swapper/209:32:552
45122452,10sleep30-21swapper/307:41:433
41872452,38sleep30-21swapper/309:53:093
308172453,9sleep30-21swapper/310:52:203
282292452,10sleep30-21swapper/310:45:153
247842452,10sleep30-21swapper/307:15:403
199102452,9sleep30-21swapper/311:36:173
176402452,10sleep20-21swapper/207:00:522
1540699455,33cyclictest0-21swapper/310:29:483
15406994531,9cyclictest13661-21cut11:22:373
1540699453,26cyclictest0-21swapper/308:42:493
1540599455,25cyclictest0-21swapper/211:52:442
15405994529,10cyclictest8265-21needreboot12:17:422
127982452,10sleep30-21swapper/311:22:023
114912452,9sleep30-21swapper/307:54:083
91062442,10sleep30-21swapper/307:49:083
67182443,10sleep30-21swapper/312:16:023
318432442,10sleep30-21swapper/307:29:223
318432442,10sleep30-21swapper/307:29:223
317602442,36sleep20-21swapper/207:28:162
317602442,36sleep20-21swapper/207:28:162
296052442,10sleep30-21swapper/307:26:193
20342442,9sleep20-21swapper/212:07:182
191582442,35sleep30-21swapper/308:12:383
191582442,35sleep30-21swapper/308:12:383
15406994431,9cyclictest2826-21tail10:57:513
15406994430,9cyclictest7702-21uniq12:17:343
15406994429,9cyclictest32457-21tr12:02:293
15406994421,17cyclictest27501-21aten_r1power_fr11:52:283
15406994414,24cyclictest22457-21kworker/3:010:47:323
1540599445,33cyclictest0-21swapper/212:12:392
1540599445,25cyclictest0-21swapper/208:22:382
15405994430,9cyclictest8650-21cpuspeed_turbos11:12:342
15405994430,9cyclictest24055-21grep09:27:522
1540599443,37cyclictest0-21swapper/207:55:212
1540599443,12cyclictest0-21swapper/209:37:532
1540599443,12cyclictest0-21swapper/209:37:532
15405994429,9cyclictest6217-21cpuspeed_turbos11:07:332
15405994429,9cyclictest6217-21cpuspeed_turbos11:07:332
15405994429,10cyclictest23396-21tune2fs07:12:452
15405994429,10cyclictest17216-21unixbench_singl11:27:542
15405994427,9cyclictest25513-21grep07:17:392
15405994427,12cyclictest12737-21gltestperf10:12:392
1540599442,36cyclictest0-21swapper/211:47:442
1540599442,36cyclictest0-21swapper/211:47:442
103582442,10sleep30-21swapper/311:16:223
78792432,9sleep30-21swapper/311:10:053
78792432,9sleep30-21swapper/311:10:053
55962432,10sleep30-21swapper/308:50:343
54542432,10sleep30-21swapper/311:04:373
1540699433,35cyclictest0-21swapper/310:17:343
1540699433,33cyclictest15746-21telnet06:57:403
15406994329,9cyclictest4023-21unixbench_singl12:07:493
15406994323,15cyclictest0-21swapper/307:10:363
1540699432,9cyclictest0-21swapper/307:43:273
1540599432,36cyclictest0-21swapper/207:33:022
67502423,33sleep30-21swapper/310:00:263
5992422,9sleep20-21swapper/210:55:502
306752423,33sleep30-21swapper/308:35:153
163022422,34sleep30-21swapper/308:04:283
1540699423,34cyclictest0-21swapper/308:37:443
1540699423,33cyclictest20320-21munin-node09:22:503
15406994229,9cyclictest9879-21tr10:07:363
15406994215,8cyclictest8225-21cat08:57:243
15406994215,8cyclictest8225-21cat08:57:243
1540599424,31cyclictest0-21swapper/206:57:302
15405994221,15cyclictest0-21swapper/209:07:192
15406994116,9cyclictest10451-21iostat12:22:353
151702412,32sleep30-21swapper/309:10:493
258582402,32sleep30-21swapper/308:24:393
15406994012,9cyclictest17346-21df_inode08:07:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional