You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 01:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 01, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16922991054,46cyclictest0-21swapper/011:43:450
16922999736,8cyclictest3713-21ssh10:53:380
98322830,8sleep10-21swapper/111:03:331
1692299723,31cyclictest0-21swapper/009:19:530
315302670,12sleep01692299cyclictest09:58:490
288642653,55sleep20-21swapper/211:30:272
16926996519,12cyclictest0-21swapper/311:02:413
233492640,5sleep226-21rcuc/207:58:422
219499640,9rtkit-daemon2193-21rtkit-daemon12:03:282
16924996435,22cyclictest0-21swapper/110:47:041
16925996318,27cyclictest12601-21sshd07:34:022
1692499634,51cyclictest28350-21munin-node09:53:531
166622637,49sleep00-21swapper/011:59:520
219499620,5rtkit-daemon2193-21rtkit-daemon07:01:402
219112624,48sleep20-21swapper/206:48:412
16925996118,23cyclictest19429-21ssh11:18:012
1692599604,37cyclictest0-21swapper/211:48:202
1692599604,36cyclictest0-21swapper/209:13:512
1692599595,12cyclictest1227-21runrttasks11:09:122
1692599594,35cyclictest9656-21diskmemload11:33:412
1692599594,14cyclictest0-21swapper/209:29:242
1692599594,14cyclictest0-21swapper/209:29:242
16925995927,15cyclictest0-21swapper/211:20:322
16925995913,25cyclictest0-21swapper/210:28:232
16925995912,27cyclictest0-21swapper/210:43:402
16925995912,27cyclictest0-21swapper/209:43:462
16924995939,14cyclictest0-21swapper/108:55:071
16924995938,15cyclictest0-21swapper/111:36:321
219499580,9rtkit-daemon2193-21rtkit-daemon09:08:122
16926995841,10cyclictest13935-21gltestperf11:08:393
1692699584,48cyclictest21545-21ssh08:53:543
1692599584,37cyclictest0-21swapper/209:39:132
1692599584,29cyclictest0-21swapper/209:10:202
16925995813,39cyclictest0-21swapper/208:43:592
1692499584,49cyclictest23354-21kworker/1:111:32:351
1692699573,39cyclictest0-21swapper/311:49:053
1692599576,31cyclictest1227-21runrttasks11:49:302
1692599576,26cyclictest0-21swapper/210:22:162
1692599575,31cyclictest0-21swapper/211:01:092
16925995723,25cyclictest844-21munin-node11:38:522
16925995718,24cyclictest0-21swapper/209:37:402
16925995716,10cyclictest5209-21cat10:08:352
1692499575,45cyclictest0-21swapper/111:43:341
16924995724,11cyclictest0-21swapper/108:48:551
16924995724,11cyclictest0-21swapper/108:48:551
16924995716,34cyclictest1399-21aten_r1power_fr10:03:351
1692299573,48cyclictest0-21swapper/011:30:460
16922995724,27cyclictest31483-21switchtime11:33:500
6062564,12sleep30-21swapper/310:01:593
271332562,9sleep20-21swapper/210:39:362
1692699563,12cyclictest0-21swapper/309:18:093
1692599565,32cyclictest0-21swapper/208:51:552
1692599565,32cyclictest0-21swapper/208:51:552
1692599565,30cyclictest0-21swapper/207:23:582
1692599564,25cyclictest0-21swapper/208:53:542
16924995638,12cyclictest0-21swapper/109:58:441
16924995636,14cyclictest0-21swapper/109:03:541
1692499563,9cyclictest0-21swapper/110:08:531
16924995627,12cyclictest0-21swapper/111:13:441
6512553,10sleep10-21swapper/107:09:041
219499550,5rtkit-daemon2193-21rtkit-daemon10:58:153
219499550,5rtkit-daemon2193-21rtkit-daemon10:28:392
219499550,5rtkit-daemon2193-21rtkit-daemon07:18:542
219499550,5rtkit-daemon2193-21rtkit-daemon07:18:542
1692699553,45cyclictest0-21swapper/312:03:463
1692699553,11cyclictest0-21swapper/311:18:393
16926995520,12cyclictest0-21swapper/311:07:323
1692599556,27cyclictest0-21swapper/209:02:582
1692599554,28cyclictest0-21swapper/208:38:472
16925995525,10cyclictest23511-21cpuspeed_turbos11:23:342
16925995514,9cyclictest107550irq/46-eth011:53:342
16924995536,14cyclictest0-21swapper/111:58:441
16924995518,30cyclictest7645-21open_inodes10:58:481
16924995518,30cyclictest1142-21cpuspeed11:38:321
16924995514,35cyclictest13992-21df_abs09:33:391
82942542,9sleep00-21swapper/007:26:040
33282543,45sleep20-21swapper/210:04:002
221192543,9sleep30-21swapper/307:54:003
219499540,5rtkit-daemon2193-21rtkit-daemon08:23:442
1692699547,41cyclictest29539-21munin-node10:18:223
1692699545,25cyclictest0-21swapper/310:38:323
1692699543,44cyclictest0-21swapper/310:45:293
1692699543,11cyclictest10217-21cpuspeed_turbos08:38:403
1692599548,26cyclictest0-21swapper/210:13:272
1692599545,30cyclictest0-21swapper/209:18:342
1692599545,29cyclictest0-21swapper/211:06:102
1692599545,28cyclictest0-21swapper/209:53:372
1692599545,28cyclictest0-21swapper/207:38:552
1692599545,28cyclictest0-21swapper/206:38:502
1692599545,28cyclictest0-21swapper/206:38:502
1692599544,33cyclictest0-21swapper/207:03:432
1692599544,29cyclictest0-21swapper/211:58:332
1692599544,29cyclictest0-21swapper/208:33:382
1692599544,28cyclictest0-21swapper/209:23:472
1692599544,28cyclictest0-21swapper/208:03:492
1692599544,28cyclictest0-21swapper/208:03:492
1692599544,13cyclictest0-21swapper/210:53:332
16925995439,9cyclictest601-21tail10:48:452
16925995423,13cyclictest0-21swapper/209:48:412
16925995422,13cyclictest0-21swapper/206:43:482
16925995421,13cyclictest0-21swapper/207:43:562
1692499545,29cyclictest0-21swapper/109:18:051
16924995435,14cyclictest0-21swapper/109:40:551
16924995422,11cyclictest26265-21ssh11:28:191
16922995430,10cyclictest0-21swapper/009:24:470
1692299543,12cyclictest0-21swapper/008:43:450
16922995428,12cyclictest0-21swapper/010:21:260
1692299542,46cyclictest0-21swapper/006:50:460
219499530,5rtkit-daemon2193-21rtkit-daemon07:58:453
219499530,5rtkit-daemon2193-21rtkit-daemon07:29:012
182822532,43sleep00-21swapper/010:28:250
1692699536,34cyclictest0-21swapper/309:57:143
1692699533,11cyclictest0-21swapper/309:23:243
16926995323,13cyclictest0-21swapper/310:08:433
1692599535,29cyclictest0-21swapper/207:08:552
1692599535,28cyclictest0-21swapper/208:13:462
1692599535,28cyclictest0-21swapper/208:08:582
1692599534,30cyclictest0-21swapper/207:48:472
16925995321,11cyclictest31152-21ssh09:58:422
16925995318,14cyclictest0-21swapper/207:53:412
1692499534,43cyclictest0-21swapper/109:43:391
16924995335,12cyclictest0-21swapper/109:08:361
16924995326,12cyclictest0-21swapper/110:26:211
16924995324,13cyclictest0-21swapper/109:26:051
16922995333,8cyclictest9656-21diskmemload09:55:570
16922995333,14cyclictest0-21swapper/009:08:490
1692299533,44cyclictest0-21swapper/010:15:280
153272533,43sleep10-21swapper/108:44:571
36892523,42sleep00-21swapper/007:18:180
36292523,42sleep01124-21snmpd11:41:340
314032522,43sleep00-21swapper/008:13:520
219499520,5rtkit-daemon2193-21rtkit-daemon08:45:583
219499520,5rtkit-daemon2193-21rtkit-daemon08:08:443
219499520,5rtkit-daemon2193-21rtkit-daemon06:53:472
16926995238,8cyclictest14838-21cut11:58:313
1692699523,44cyclictest0-21swapper/311:43:343
1692699523,28cyclictest0-21swapper/309:33:253
1692699523,28cyclictest0-21swapper/309:33:253
1692699523,11cyclictest0-21swapper/311:40:473
1692699522,8cyclictest17626-21gltestperf08:48:463
1692699522,8cyclictest17626-21gltestperf08:48:463
1692699522,35cyclictest0-21swapper/311:27:423
1692599526,27cyclictest0-21swapper/207:17:352
1692599525,28cyclictest0-21swapper/208:29:002
1692599524,30cyclictest0-21swapper/210:33:572
1692599523,27cyclictest0-21swapper/206:38:322
1692599523,27cyclictest0-21swapper/206:38:322
1692499526,30cyclictest0-21swapper/110:49:141
16924995226,11cyclictest0-21swapper/110:28:321
16924995224,9cyclictest10877-21awk11:53:181
16924995223,12cyclictest0-21swapper/111:18:421
16924995211,25cyclictest12195-21fschecks_count10:18:401
16922995233,8cyclictest18418-21kworker/0:210:26:240
16922995226,12cyclictest0-21swapper/011:53:370
16922995225,12cyclictest0-21swapper/008:48:400
16922995225,12cyclictest0-21swapper/008:48:400
16922995222,18cyclictest0-21swapper/011:06:460
120212523,10sleep10-21swapper/109:29:081
120212523,10sleep10-21swapper/109:29:081
104372522,42sleep00-21swapper/011:51:460
274522512,42sleep00-21swapper/009:04:190
16926995136,9cyclictest27256-21unixbench_multi09:03:583
16926995134,11cyclictest20150-21unixbench_singl10:28:563
1692699513,14cyclictest0-21swapper/309:23:363
16926995125,8cyclictest21912-21munin-node06:49:033
1692599515,25cyclictest0-21swapper/208:22:472
1692499515,28cyclictest0-21swapper/111:53:251
1692499515,27cyclictest0-21swapper/108:38:441
1692499514,29cyclictest0-21swapper/107:04:071
1692499514,27cyclictest0-21swapper/107:48:271
1692499514,26cyclictest0-21swapper/109:18:581
16924995134,9cyclictest6098-21crond07:23:291
16924995134,9cyclictest6098-21crond07:23:291
16924995134,12cyclictest0-21swapper/110:13:531
16924995126,8cyclictest22877-21munin-node10:33:471
16924995126,12cyclictest0-21swapper/108:59:151
16924995125,12cyclictest0-21swapper/109:51:081
16924995122,11cyclictest0-21swapper/110:55:331
16922995131,14cyclictest0-21swapper/008:38:460
1692299513,40cyclictest0-21swapper/010:48:400
16922995129,10cyclictest0-21swapper/009:43:060
16922995126,11cyclictest0-21swapper/009:13:440
16922995124,12cyclictest0-21swapper/009:48:100
16922995124,12cyclictest0-21swapper/007:43:380
59132502,9sleep30-21swapper/307:21:073
59132502,9sleep30-21swapper/307:21:073
52242503,41sleep05317-21cpuspeed08:28:400
305152503,41sleep00-21swapper/010:44:370
246952503,40sleep324699-21ssh10:37:593
219499500,4rtkit-daemon2193-21rtkit-daemon08:03:453
219499500,4rtkit-daemon2193-21rtkit-daemon08:03:453
1692699504,40cyclictest25093-21ssh09:03:033
1692699503,9cyclictest0-21swapper/306:55:043
1692699503,27cyclictest0-21swapper/311:33:503
16926995018,13cyclictest0-21swapper/310:23:583
16926995018,13cyclictest0-21swapper/310:03:463
1692499506,26cyclictest0-21swapper/106:53:531
1692499505,28cyclictest0-21swapper/108:13:401
1692499505,27cyclictest0-21swapper/107:52:421
1692499505,27cyclictest0-21swapper/107:34:051
16924995020,13cyclictest0-21swapper/110:41:341
1692299506,38cyclictest0-21swapper/010:34:110
1692299505,39cyclictest0-21swapper/010:38:570
1692299505,38cyclictest0-21swapper/009:33:540
1692299504,28cyclictest0-21swapper/009:48:500
1692299503,42cyclictest0-21swapper/007:53:200
249362493,41sleep10-21swapper/107:59:591
229522492,9sleep00-21swapper/008:56:450
227032492,41sleep00-21swapper/007:57:000
1692699494,27cyclictest0-21swapper/308:13:433
16926994932,11cyclictest20402-21gltestperf06:43:503
16926994926,8cyclictest27309-21fschecks_time11:28:363
16926994922,9cyclictest9656-21diskmemload11:53:373
16926994921,11cyclictest31965-21crond09:13:243
16926994920,12cyclictest0-21swapper/308:33:373
16926994919,12cyclictest0-21swapper/309:38:513
1692499495,26cyclictest0-21swapper/106:38:431
1692499495,26cyclictest0-21swapper/106:38:431
1692499494,39cyclictest0-21swapper/111:08:441
1692499494,28cyclictest0-21swapper/108:37:481
16924994922,8cyclictest18034-21sh12:03:301
1692299495,38cyclictest0-21swapper/011:23:320
1692299494,40cyclictest0-21swapper/011:13:400
1692299493,40cyclictest0-21swapper/009:28:470
1692299493,40cyclictest0-21swapper/009:28:470
1692299493,40cyclictest0-21swapper/008:12:170
1692299493,38cyclictest0-21swapper/010:03:390
106722493,41sleep10-21swapper/107:30:441
286392482,9sleep00-21swapper/007:01:040
260372482,9sleep30-21swapper/309:50:593
249152482,41sleep00-21swapper/007:59:420
233192483,39sleep123357-21python06:49:001
1692699485,38cyclictest1227-21runrttasks07:27:193
1692699483,27cyclictest0-21swapper/307:18:133
1692699483,26cyclictest0-21swapper/308:28:273
1692699482,23cyclictest0-21swapper/307:35:023
16926994816,9cyclictest20951-21fschecks_time09:43:413
16926994816,12cyclictest0-21swapper/310:48:323
1692499485,26cyclictest0-21swapper/107:54:021
1692499484,27cyclictest0-21swapper/106:58:401
1692299484,40cyclictest0-21swapper/006:56:440
1692299484,38cyclictest0-21swapper/008:28:260
16922994822,12cyclictest0-21swapper/011:08:500
155052483,10sleep10-21swapper/107:41:331
71482472,9sleep30-21swapper/308:32:013
216182472,40sleep00-21swapper/006:47:500
21532472,9sleep30-21swapper/308:20:003
211802473,8sleep121275-21unixbench_singl06:44:041
208402472,39sleep00-21swapper/012:07:420
1692699474,35cyclictest19395-21yum-updatesd-he11:18:093
16926994731,10cyclictest17560-21unixbench-2d07:44:003
1692699473,10cyclictest0-21swapper/309:33:453
16926994722,8cyclictest11738-21ssh10:18:353
16926994721,9cyclictest31454-21munin-node07:08:403
16926994717,13cyclictest0-21swapper/307:03:433
16924994731,12cyclictest0-21swapper/108:32:201
16924994718,11cyclictest29501-21sshd08:09:011
1692299474,38cyclictest0-21swapper/009:01:410
1692299474,37cyclictest0-21swapper/006:38:540
1692299474,37cyclictest0-21swapper/006:38:540
16922994729,7cyclictest21257-21ssh11:18:480
16922994726,9cyclictest0-21swapper/008:18:550
310132462,37sleep00-21swapper/007:05:560
23932463,37sleep10-21swapper/108:22:321
1692699463,36cyclictest27453-21grep06:58:473
16926994615,11cyclictest0-21swapper/306:39:043
16926994615,11cyclictest0-21swapper/306:39:043
1692499463,26cyclictest0-21swapper/107:27:371
16922994613,27cyclictest6145-21sh10:58:220
153252462,9sleep00-21swapper/007:39:100
139422462,9sleep30-21swapper/307:38:443
20862453,36sleep12223-21munin-node07:13:471
16926994528,10cyclictest9933-21head07:28:563
16924994515,12cyclictest0-21swapper/108:23:591
1692299454,36cyclictest0-21swapper/007:18:440
1692299454,36cyclictest0-21swapper/007:18:440
16922994531,10cyclictest0-21swapper/007:08:500
1692299453,38cyclictest6139-21ntp_offset10:08:480
16926994419,9cyclictest18317-21telnet07:48:403
1692299444,12cyclictest0-21swapper/008:38:250
1692499424,22cyclictest0-21swapper/108:03:401
1692499424,22cyclictest0-21swapper/108:03:401
16924994213,13cyclictest0-21swapper/106:38:311
16924994213,13cyclictest0-21swapper/106:38:311
168732424,32sleep00-21swapper/006:38:190
168732424,32sleep00-21swapper/006:38:190
165762424,32sleep30-21swapper/306:34:283
165762424,32sleep30-21swapper/306:34:283
131342422,35sleep00-21swapper/007:36:440
1692299413,26cyclictest0-21swapper/007:28:430
16922994026,10cyclictest25608-21cpu08:03:410
16922994026,10cyclictest25608-21cpu08:03:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional