You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 18:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 24, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21512999724,22cyclictest30460-21ssh08:45:010
257762880,4sleep02151299cyclictest08:38:340
2151599723,60cyclictest0-21swapper/210:35:022
2151699696,28cyclictest0-21swapper/309:54:503
248599680,5rtkit-daemon2484-21rtkit-daemon08:02:253
2151599673,55cyclictest0-21swapper/208:44:272
1970526721,39sleep10-21swapper/110:53:171
248599650,6rtkit-daemon2484-21rtkit-daemon10:28:273
2151599653,55cyclictest0-21swapper/208:54:412
2151599653,55cyclictest0-21swapper/208:54:412
2151599653,54cyclictest0-21swapper/210:00:122
2151599653,54cyclictest0-21swapper/209:40:022
21514996519,10cyclictest25481-21forks07:50:021
21512996510,26cyclictest0-21swapper/008:09:550
21512996510,26cyclictest0-21swapper/008:09:550
2151599644,53cyclictest0-21swapper/210:54:582
2151599644,53cyclictest0-21swapper/210:54:582
2151599644,52cyclictest0-21swapper/210:52:492
2151599633,53cyclictest0-21swapper/209:19:562
2151599633,53cyclictest0-21swapper/207:54:532
97062623,12sleep20-21swapper/209:50:002
2151699624,29cyclictest0-21swapper/310:59:363
2151699624,29cyclictest0-21swapper/310:59:363
2151599623,51cyclictest0-21swapper/210:49:062
2151699614,30cyclictest0-21swapper/310:24:373
2151599613,52cyclictest15970-21grep09:10:172
2151599613,52cyclictest0-21swapper/210:19:552
2151599613,52cyclictest0-21swapper/208:22:492
2151599613,52cyclictest0-21swapper/207:44:442
2151599613,51cyclictest0-21swapper/210:25:012
21512996119,27cyclictest0-21swapper/008:55:000
21512996119,27cyclictest0-21swapper/008:55:000
167042613,49sleep00-21swapper/010:49:370
85512604,12sleep20-21swapper/208:12:212
85512604,12sleep20-21swapper/208:12:212
248599600,8rtkit-daemon2484-21rtkit-daemon08:50:163
248599600,8rtkit-daemon2484-21rtkit-daemon08:50:163
2151699605,32cyclictest0-21swapper/306:44:463
21516996041,12cyclictest7788-21cpuspeed_turbos08:59:563
2151699604,36cyclictest0-21swapper/311:03:213
21516996016,24cyclictest24470-21seq07:49:163
2151599603,51cyclictest0-21swapper/210:29:512
2151599603,49cyclictest0-21swapper/208:00:072
2151499605,48cyclictest0-21swapper/109:32:001
2151699595,30cyclictest0-21swapper/310:15:093
2151699595,30cyclictest0-21swapper/310:15:093
2151699593,38cyclictest0-21swapper/308:16:113
2151599593,50cyclictest0-21swapper/208:25:232
2151599593,49cyclictest0-21swapper/207:38:082
2151499593,28cyclictest0-21swapper/110:11:361
2151299593,10cyclictest0-21swapper/010:54:280
65882584,47sleep30-21swapper/309:45:023
248599580,4rtkit-daemon2484-21rtkit-daemon08:57:383
248599580,4rtkit-daemon2484-21rtkit-daemon08:57:383
2151599583,49cyclictest0-21swapper/210:06:472
2151599583,49cyclictest0-21swapper/209:45:112
21515995819,31cyclictest12298-21aten2.4-expect09:54:502
2151499584,14cyclictest0-21swapper/109:49:401
2151499583,50cyclictest0-21swapper/108:52:511
2151499583,50cyclictest0-21swapper/108:52:511
2151499583,49cyclictest0-21swapper/108:18:111
2151499583,25cyclictest0-21swapper/108:41:291
21514995827,11cyclictest0-21swapper/110:18:431
21514995827,11cyclictest0-21swapper/110:18:431
21512995814,8cyclictest25717-21basename10:14:470
21512995814,8cyclictest25717-21basename10:14:470
26942573,48sleep00-21swapper/010:27:360
2151699574,29cyclictest0-21swapper/310:49:363
21516995715,24cyclictest0-21swapper/310:04:393
2151599574,45cyclictest14237-21diskmemload08:44:562
2151599573,48cyclictest0-21swapper/208:35:052
2151599573,48cyclictest0-21swapper/207:25:162
2151599573,47cyclictest0-21swapper/210:59:472
2151599573,46cyclictest4487-21cpuspeed_turbos08:54:552
2151599573,46cyclictest4487-21cpuspeed_turbos08:54:552
2151499574,46cyclictest0-21swapper/108:31:261
21514995733,9cyclictest121850irq/46-eth010:48:571
2151499573,48cyclictest0-21swapper/109:17:171
2151499573,48cyclictest0-21swapper/107:40:441
2151299574,45cyclictest0-21swapper/010:30:080
2151699567,27cyclictest27808-21aten_r1power_fr09:29:523
2151699565,31cyclictest0-21swapper/309:24:543
2151699565,28cyclictest0-21swapper/308:49:423
21516995621,15cyclictest10943-21fschecks_time10:39:553
2151599564,47cyclictest20526-21rm08:30:022
2151599563,45cyclictest12083-21munin-node07:29:562
2151599563,30cyclictest0-21swapper/205:40:102
2151599563,12cyclictest0-21swapper/210:18:402
2151599563,12cyclictest0-21swapper/210:18:402
2151499563,46cyclictest0-21swapper/111:04:241
21514995615,25cyclictest0-21swapper/109:29:231
106382564,45sleep30-21swapper/306:19:153
2151699556,30cyclictest6467-21cpuspeed_turbos08:09:563
2151699556,30cyclictest6467-21cpuspeed_turbos08:09:563
2151699555,29cyclictest0-21swapper/308:21:223
2151699555,26cyclictest0-21swapper/307:34:553
2151699554,34cyclictest0-21swapper/309:20:383
2151699554,31cyclictest0-21swapper/306:59:453
2151699554,31cyclictest0-21swapper/306:59:453
2151699554,28cyclictest0-21swapper/310:04:543
21516995522,10cyclictest18388-21ps10:50:073
21516995521,14cyclictest0-21swapper/309:16:273
21516995514,23cyclictest0-21swapper/310:31:463
2151599553,46cyclictest0-21swapper/210:13:362
2151599553,46cyclictest0-21swapper/209:35:142
2151599553,46cyclictest0-21swapper/209:35:142
2151499553,47cyclictest0-21swapper/107:48:261
21514995528,11cyclictest0-21swapper/107:54:561
29542543,43sleep20-21swapper/207:10:002
248599540,6rtkit-daemon2484-21rtkit-daemon09:05:013
248599540,5rtkit-daemon2484-21rtkit-daemon09:30:072
235752542,45sleep20-21swapper/205:35:542
2151699545,28cyclictest0-21swapper/307:00:153
2151699544,26cyclictest0-21swapper/307:50:423
21516995422,14cyclictest0-21swapper/307:20:183
21516995422,13cyclictest0-21swapper/308:05:163
21516995422,13cyclictest0-21swapper/305:40:113
21516995421,14cyclictest0-21swapper/309:39:593
21516995421,13cyclictest0-21swapper/307:05:053
21516995421,13cyclictest0-21swapper/306:50:203
21516995421,13cyclictest0-21swapper/306:50:203
21516995421,11cyclictest24115-21sort08:35:053
21516995420,13cyclictest0-21swapper/306:00:033
21516995420,10cyclictest7538-21cut10:34:553
21516995417,13cyclictest0-21swapper/310:09:483
21516995417,13cyclictest0-21swapper/306:30:063
21516995416,14cyclictest0-21swapper/308:26:553
21516995412,25cyclictest14780-21df_abs09:09:583
21515995438,9cyclictest16917-21grep06:30:122
2151599543,46cyclictest12229-21yum-updatesd-he08:18:352
2151599543,45cyclictest13217-21rm09:07:032
2151499545,43cyclictest0-21swapper/108:04:431
2151499543,45cyclictest0-21swapper/110:05:451
2151499543,45cyclictest0-21swapper/108:57:331
2151499543,45cyclictest0-21swapper/108:57:331
21512995431,9cyclictest19906-21kworker/0:008:32:060
2151299543,12cyclictest0-21swapper/009:29:550
21512995412,36cyclictest10411-21mailstats09:50:110
248599530,5rtkit-daemon2484-21rtkit-daemon06:44:593
2151699536,27cyclictest18936-21iostat_ios07:40:063
2151699535,27cyclictest1287-21snmpd06:35:173
2151699535,27cyclictest0-21swapper/307:29:273
2151699534,29cyclictest0-21swapper/308:39:573
2151699534,29cyclictest0-21swapper/305:45:103
2151699534,28cyclictest0-21swapper/309:52:013
2151699534,24cyclictest22597-21gltestperf05:35:083
21516995319,14cyclictest0-21swapper/307:10:023
21516995319,12cyclictest0-21swapper/306:09:143
21516995317,12cyclictest0-21swapper/307:57:233
21516995316,14cyclictest0-21swapper/306:20:203
21516995315,12cyclictest0-21swapper/308:30:093
2151599534,43cyclictest14248-21kworker/2:209:15:102
2151599533,42cyclictest0-21swapper/210:39:542
2151599533,13cyclictest0-21swapper/209:00:012
2151499534,30cyclictest0-21swapper/109:09:551
2151499534,25cyclictest0-21swapper/110:25:151
2151499533,45cyclictest0-21swapper/110:01:291
2151499533,45cyclictest0-21swapper/108:38:551
2151499533,44cyclictest0-21swapper/108:07:121
2151499533,24cyclictest0-21swapper/107:35:131
21514995323,11cyclictest25867-21kworker/1:110:20:081
21514995315,11cyclictest7919-21df_abs08:59:571
21512995325,22cyclictest0-21swapper/009:35:130
21512995325,22cyclictest0-21swapper/009:35:130
118992532,10sleep00-21swapper/009:05:040
81582523,43sleep00-21swapper/006:13:080
296332522,43sleep00-21swapper/006:57:370
296332522,43sleep00-21swapper/006:57:370
248599520,5rtkit-daemon2484-21rtkit-daemon08:05:402
2151699525,28cyclictest0-21swapper/307:15:053
2151699524,28cyclictest0-21swapper/306:25:003
2151699524,28cyclictest0-21swapper/305:50:033
2151699524,27cyclictest0-21swapper/305:59:483
21516995219,13cyclictest0-21swapper/309:35:173
21516995219,13cyclictest0-21swapper/309:35:173
21516995215,13cyclictest0-21swapper/306:10:063
2151499524,15cyclictest0-21swapper/110:36:281
2151499524,14cyclictest0-21swapper/110:33:291
2151499523,43cyclictest0-21swapper/109:21:331
2151499523,24cyclictest0-21swapper/109:39:501
2151499523,24cyclictest0-21swapper/106:59:461
2151499523,24cyclictest0-21swapper/106:59:461
21514995221,13cyclictest0-21swapper/106:19:481
21514995220,14cyclictest0-21swapper/110:54:551
21514995220,14cyclictest0-21swapper/110:54:551
21514995216,12cyclictest0-21swapper/105:40:201
2151299524,43cyclictest0-21swapper/007:19:030
2151299523,12cyclictest0-21swapper/009:00:000
157142522,42sleep00-21swapper/009:59:540
81442513,41sleep10-21swapper/106:12:561
2151699514,26cyclictest12240-21aten2.4-expect07:29:573
21515995134,9cyclictest11014-21head06:20:002
2151599513,28cyclictest0-21swapper/209:24:562
2151599513,28cyclictest0-21swapper/205:50:102
2151499515,29cyclictest0-21swapper/107:05:041
2151499515,28cyclictest0-21swapper/108:10:531
2151499515,28cyclictest0-21swapper/108:10:531
2151499514,31cyclictest0-21swapper/108:29:051
2151499514,27cyclictest0-21swapper/107:04:231
21514995121,13cyclictest0-21swapper/107:14:451
21514995121,12cyclictest0-21swapper/108:20:421
2151499512,41cyclictest0-21swapper/107:20:081
21514995118,15cyclictest0-21swapper/109:04:421
2151299515,40cyclictest0-21swapper/008:09:050
2151299514,40cyclictest0-21swapper/007:55:000
2151299513,42cyclictest0-21swapper/007:52:140
2151299513,42cyclictest0-21swapper/005:45:040
2151299513,16cyclictest0-21swapper/010:40:060
2151299513,12cyclictest0-21swapper/009:10:110
150032512,43sleep00-21swapper/009:58:210
128092513,41sleep10-21swapper/106:21:271
127232513,40sleep112859-21sh09:54:551
57932503,42sleep10-21swapper/106:08:211
237892502,9sleep00-21swapper/005:38:420
2151499507,26cyclictest0-21swapper/109:36:051
2151499507,26cyclictest0-21swapper/109:36:051
2151499504,29cyclictest0-21swapper/106:50:211
2151499504,29cyclictest0-21swapper/106:50:211
2151499503,41cyclictest0-21swapper/109:54:361
21514995022,12cyclictest0-21swapper/105:35:191
21514995020,15cyclictest0-21swapper/106:00:091
21514995020,14cyclictest0-21swapper/108:48:161
21514995019,13cyclictest0-21swapper/106:40:001
21512995036,8cyclictest8764-21ssh10:35:140
21512995032,12cyclictest0-21swapper/010:08:580
2151299503,41cyclictest0-21swapper/009:40:140
2151299503,41cyclictest0-21swapper/006:30:500
2151299503,26cyclictest0-21swapper/008:03:410
195792502,9sleep00-21swapper/007:40:180
121262503,41sleep10-21swapper/110:40:141
92752492,41sleep00-21swapper/007:22:360
248599490,4rtkit-daemon2484-21rtkit-daemon05:45:012
2151599493,40cyclictest973-21latency_hist05:59:482
2151599493,28cyclictest0-21swapper/206:09:582
2151599493,25cyclictest0-21swapper/207:45:122
2151499495,27cyclictest0-21swapper/105:54:111
2151499494,38cyclictest0-21swapper/107:30:051
2151499494,27cyclictest0-21swapper/105:45:021
21514994918,14cyclictest31300-21aten2.4-expect05:54:591
2151299495,12cyclictest0-21swapper/010:55:090
2151299495,12cyclictest0-21swapper/010:55:090
2151299494,39cyclictest0-21swapper/008:15:040
21512994932,11cyclictest27418-21munin-node08:40:030
2151299493,40cyclictest0-21swapper/009:44:540
2151299493,40cyclictest0-21swapper/008:50:270
2151299493,40cyclictest0-21swapper/008:50:270
2151299493,39cyclictest0-21swapper/009:24:590
21512994927,10cyclictest0-21swapper/011:01:560
21512994924,11cyclictest0-21swapper/009:17:260
21512994923,8cyclictest13077-21latency_hist06:24:480
21512994922,12cyclictest0-21swapper/008:21:520
48842482,9sleep20-21swapper/206:05:122
248599480,5rtkit-daemon2484-21rtkit-daemon06:37:292
2151699483,26cyclictest0-21swapper/305:34:503
21515994832,10cyclictest2568-21tail06:00:122
21515994821,9cyclictest25458-21ssh07:50:012
2151299485,38cyclictest0-21swapper/007:35:040
2151299485,12cyclictest0-21swapper/009:20:060
2151299483,39cyclictest0-21swapper/008:24:580
21512994821,21cyclictest26940-21kworker/u8:006:05:180
2151299482,15cyclictest0-21swapper/010:19:490
133002482,40sleep00-21swapper/006:24:520
226162472,40sleep00-21swapper/006:44:270
21514994729,13cyclictest0-21swapper/107:25:271
21514994722,8cyclictest15483-21latency_hist06:29:471
21512994720,12cyclictest0-21swapper/010:09:520
213692472,9sleep00-21swapper/007:44:530
96792462,37sleep00-21swapper/007:24:540
85262462,37sleep00-21swapper/006:14:530
322742462,38sleep00-21swapper/005:55:100
296772462,9sleep20-21swapper/206:58:112
296772462,9sleep20-21swapper/206:58:112
21515994633,8cyclictest21998-21cat06:40:202
2151599463,27cyclictest0-21swapper/207:00:022
2151599463,25cyclictest0-21swapper/207:05:162
21515994626,14cyclictest0-21swapper/206:15:062
21515994619,12cyclictest0-21swapper/207:19:572
2151499464,36cyclictest0-21swapper/106:30:051
21514994629,9cyclictest18764-21fschecks_count06:35:051
2151299464,36cyclictest0-21swapper/005:50:110
21512994632,8cyclictest41ktimersoftd/007:10:020
21512994627,8cyclictest18104-21munin-node06:35:220
20562462,38sleep00-21swapper/007:08:170
248902453,37sleep10-21swapper/106:47:591
247822452,37sleep00-21swapper/006:46:330
2151599453,34cyclictest0-21swapper/206:45:022
21515994521,10cyclictest25395-21telnet06:49:592
21515994521,10cyclictest25395-21telnet06:49:592
2151599452,39cyclictest0-21swapper/207:15:202
21514994527,11cyclictest5266-21cpuspeed_turbos07:14:591
21512994530,10cyclictest2000-21tune2fs06:00:050
21512994519,12cyclictest0-21swapper/005:40:210
2151299444,33cyclictest0-21swapper/006:54:470
2151299444,33cyclictest0-21swapper/006:54:470
2151299443,36cyclictest0-21swapper/007:34:170
21512994323,9cyclictest0-21swapper/007:00:180
21515994119,8cyclictest13434-21telnet06:25:002
2151499414,30cyclictest0-21swapper/105:34:491
2151599383,7cyclictest21489-21latency_hist05:34:502
2151299363,27cyclictest0-21swapper/005:34:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional