You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 07:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Jul 07, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
156222970,5sleep1201ktimersoftd/118:43:391
1172999944,72cyclictest0-21swapper/121:03:381
1172999935,69cyclictest0-21swapper/123:08:111
1172999924,70cyclictest0-21swapper/120:53:401
311702910,3sleep3361ktimersoftd/323:38:093
1172999915,68cyclictest0-21swapper/123:49:371
1172999915,66cyclictest0-21swapper/121:22:211
1172999914,80cyclictest0-21swapper/120:44:171
1172999914,78cyclictest24365-21ntp_kernel_pll_22:38:381
1172999904,79cyclictest0-21swapper/122:48:261
1172999904,78cyclictest0-21swapper/120:48:271
1172999904,55cyclictest13358-21df22:23:261
11729998912,71cyclictest0-21swapper/123:58:441
1172999884,67cyclictest2932-21munin-node20:33:441
1172999884,67cyclictest0-21swapper/122:32:451
1172999883,61cyclictest5728-21munin-node22:58:391
1172999876,60cyclictest0-21swapper/121:30:001
1172999875,75cyclictest0-21swapper/123:08:221
1172999875,66cyclictest0-21swapper/123:28:101
1172999875,65cyclictest0-21swapper/122:09:071
1172999875,65cyclictest0-21swapper/119:03:531
1172999874,66cyclictest0-21swapper/122:00:211
1172999874,65cyclictest32343-21irqstats23:38:321
1172999874,65cyclictest32343-21irqstats23:38:321
1172999874,62cyclictest0-21swapper/119:33:181
1172999874,62cyclictest0-21swapper/119:33:181
1172999873,11cyclictest20027-21cpuspeed_turbos22:33:251
1172999865,73cyclictest1227-21runrttasks21:24:171
1172999865,65cyclictest0-21swapper/122:44:001
1172999865,65cyclictest0-21swapper/121:49:341
1172999864,66cyclictest0-21swapper/121:53:311
1172999864,60cyclictest0-21swapper/121:33:231
1172999864,13cyclictest31707-21telnet22:03:231
1172999863,50cyclictest0-21swapper/122:19:311
11729998618,48cyclictest16191-21unixbench_multi23:13:431
11729998614,52cyclictest180571ssh23:18:241
11729998610,61cyclictest3462-21cut23:43:301
1172999854,74cyclictest0-21swapper/123:33:341
1172999854,68cyclictest0-21swapper/120:42:261
1172999854,54cyclictest0-21swapper/122:16:561
1172999853,75cyclictest0-21swapper/121:45:441
1172999853,64cyclictest0-21swapper/119:27:521
1172999844,66cyclictest0-21swapper/121:14:461
1172999843,9cyclictest15717-21ssh21:38:331
1172999843,9cyclictest15717-21ssh21:38:331
1172999843,74cyclictest0-21swapper/123:23:171
1172999843,52cyclictest0-21swapper/123:55:321
1172999843,10cyclictest21427-21ntp_kernel_pll_20:58:441
1172999834,64cyclictest0-21swapper/120:14:441
1172999834,64cyclictest0-21swapper/120:14:441
1172999834,62cyclictest0-21swapper/121:12:591
1172999834,60cyclictest24124-21gltestperf20:08:381
1172999834,60cyclictest24124-21gltestperf20:08:381
1172999823,9cyclictest22248-21aten_r1power_vo18:58:321
1172999814,59cyclictest0-21swapper/120:18:471
1172999814,58cyclictest0-21swapper/119:43:391
1172999814,57cyclictest0-21swapper/118:53:341
1172999814,54cyclictest0-21swapper/119:13:191
1172999813,10cyclictest721-21munin-node22:53:431
1172999804,69cyclictest0-21swapper/120:33:171
1172999804,48cyclictest0-21swapper/119:58:431
1172999803,8cyclictest6572-21munin-node19:33:281
1172999803,8cyclictest6572-21munin-node19:33:281
1172999803,8cyclictest10995-21chrt19:42:191
1172999794,48cyclictest19487-21munin-run18:53:201
1172999794,48cyclictest19487-21munin-run18:53:201
1172999784,66cyclictest16433-21cpuspeed_turbos19:53:311
1172999784,55cyclictest0-21swapper/119:20:231
1172999783,8cyclictest30279-21iostat_ios19:13:411
1172999783,8cyclictest14326-21fschecks_count19:48:371
1172999783,11cyclictest20865-21aten_r1power_cu20:03:281
1172999773,56cyclictest0-21swapper/118:35:101
1172999763,7cyclictest14798-21cat18:43:201
1172999754,53cyclictest0-21swapper/118:33:211
1172999744,55cyclictest0-21swapper/120:23:351
64882730,7sleep00-21swapper/021:23:470
1084827211,49sleep30-21swapper/318:28:403
78822643,55sleep00-21swapper/023:49:400
219499640,5rtkit-daemon2193-21rtkit-daemon23:04:423
115592630,6sleep20-21swapper/222:19:162
108522634,52sleep00-21swapper/020:43:420
11731996022,33cyclictest0-21swapper/321:19:413
98312593,48sleep00-21swapper/022:18:300
300852582,49sleep00-21swapper/023:34:490
282532583,9sleep028300-21mailstats19:08:460
308892572,12sleep00-21swapper/022:01:210
121642573,13sleep00-21swapper/018:36:220
11728995740,10cyclictest15296-21tr18:43:350
299722562,47sleep00-21swapper/020:20:440
219499560,4rtkit-daemon2193-21rtkit-daemon20:58:243
123692562,12sleep00-21swapper/021:33:320
120112563,8sleep012014-21ssh23:57:260
11731995619,30cyclictest7092-21http_loadtime22:13:313
1172899566,30cyclictest0-21swapper/021:43:330
1172899563,28cyclictest0-21swapper/022:14:310
23882552,12sleep00-21swapper/022:07:500
219499550,5rtkit-daemon2193-21rtkit-daemon23:39:033
219499550,5rtkit-daemon2193-21rtkit-daemon23:39:033
219499550,5rtkit-daemon2193-21rtkit-daemon21:58:223
1173099553,43cyclictest1124-21snmpd19:14:342
1172899556,27cyclictest0-21swapper/022:53:240
11728995521,13cyclictest0-21swapper/021:13:470
285682543,45sleep00-21swapper/022:44:420
276422542,11sleep00-21swapper/020:16:290
276422542,11sleep00-21swapper/020:16:290
259502543,44sleep00-21swapper/022:42:280
219499540,6rtkit-daemon2193-21rtkit-daemon22:43:353
219499540,5rtkit-daemon2193-21rtkit-daemon20:48:253
219499540,3rtkit-daemon2193-21rtkit-daemon21:50:453
212492542,10sleep20-21swapper/221:48:012
160602543,44sleep30-21swapper/318:43:463
1173099544,44cyclictest0-21swapper/219:53:422
11730995436,12cyclictest0-21swapper/220:48:162
1172899544,29cyclictest0-21swapper/022:28:110
65252532,12sleep00-21swapper/019:33:210
65252532,12sleep00-21swapper/019:33:210
57482532,11sleep00-21swapper/020:37:450
315732533,45sleep00-21swapper/023:38:230
315732533,45sleep00-21swapper/023:38:230
219499530,7rtkit-daemon2193-21rtkit-daemon18:29:082
219499530,5rtkit-daemon2193-21rtkit-daemon23:43:403
219499530,5rtkit-daemon2193-21rtkit-daemon22:18:293
219499530,5rtkit-daemon2193-21rtkit-daemon20:38:473
145122532,10sleep20-21swapper/218:40:552
1173199533,43cyclictest2680-21diskmemload00:01:283
1173199533,42cyclictest0-21swapper/321:07:133
1173099536,26cyclictest14073-21yum-updatesd-he23:13:102
1173099534,44cyclictest0-21swapper/223:03:432
1173099534,42cyclictest0-21swapper/223:13:282
1173099534,34cyclictest0-21swapper/221:37:072
1173099533,43cyclictest0-21swapper/222:48:242
1172899535,28cyclictest0-21swapper/020:54:510
1172899535,13cyclictest0-21swapper/021:21:450
1172899534,27cyclictest0-21swapper/020:23:420
11728995334,11cyclictest21603-21tune2fs20:03:350
11728995323,12cyclictest0-21swapper/020:48:370
11728995321,13cyclictest0-21swapper/019:23:360
11728995311,25cyclictest0-21swapper/022:58:350
102002533,12sleep00-21swapper/021:29:410
48392522,10sleep20-21swapper/223:45:512
252912522,11sleep00-21swapper/020:11:580
252912522,11sleep00-21swapper/020:11:580
239952522,10sleep20-21swapper/220:08:372
239952522,10sleep20-21swapper/220:08:372
236102523,43sleep00-21swapper/023:25:460
219499520,5rtkit-daemon2193-21rtkit-daemon23:21:343
219499520,5rtkit-daemon2193-21rtkit-daemon21:53:303
219499520,5rtkit-daemon2193-21rtkit-daemon21:38:303
219499520,5rtkit-daemon2193-21rtkit-daemon21:38:303
187332522,11sleep00-21swapper/019:58:320
131562522,11sleep00-21swapper/000:00:490
1173199522,45cyclictest0-21swapper/323:48:543
1173099529,36cyclictest7938-21unixbench_multi20:38:482
1173099523,41cyclictest5250-21ssh20:35:552
1173099523,41cyclictest0-21swapper/221:53:282
1172899525,29cyclictest0-21swapper/019:53:480
1172899525,13cyclictest0-21swapper/022:48:490
1172899525,13cyclictest0-21swapper/020:40:550
1172899524,29cyclictest1227-21runrttasks23:09:050
1172899524,26cyclictest0-21swapper/019:38:230
11728995223,9cyclictest21162-21ssh20:58:400
11728995220,13cyclictest0-21swapper/021:03:380
76922512,10sleep30-21swapper/321:27:503
47892513,42sleep00-21swapper/022:09:150
219499510,5rtkit-daemon2193-21rtkit-daemon23:02:123
219499510,5rtkit-daemon2193-21rtkit-daemon20:54:023
219499510,5rtkit-daemon2193-21rtkit-daemon20:43:473
184762513,42sleep00-21swapper/022:29:470
157982512,10sleep20-21swapper/219:52:412
1173199512,41cyclictest1124-21snmpd19:59:413
1173099514,41cyclictest0-21swapper/222:38:292
1173099514,41cyclictest0-21swapper/221:11:042
1173099514,40cyclictest0-21swapper/221:23:272
1173099513,41cyclictest0-21swapper/221:48:552
1173099513,11cyclictest7526-21open_inodes22:13:392
11730995123,7cyclictest20881-21latency_hist23:23:092
1172899514,28cyclictest0-21swapper/018:58:550
1172899514,27cyclictest0-21swapper/023:03:460
1172899514,27cyclictest0-21swapper/021:48:360
1172899514,27cyclictest0-21swapper/019:48:360
1172899514,27cyclictest0-21swapper/018:42:140
11728995135,10cyclictest21416-21grep18:53:520
11728995134,11cyclictest15184-21cpuspeed_turbos21:38:270
11728995134,11cyclictest15184-21cpuspeed_turbos21:38:270
1172899513,30cyclictest0-21swapper/021:53:330
11728995121,12cyclictest0-21swapper/023:18:270
11728995121,10cyclictest27630-21idleruntime-cro23:33:080
11728995120,13cyclictest0-21swapper/018:48:380
11728995120,13cyclictest0-21swapper/018:48:380
11728995120,12cyclictest0-21swapper/023:43:240
59912503,39sleep00-21swapper/019:29:220
59912503,39sleep00-21swapper/019:29:220
219499500,6rtkit-daemon2193-21rtkit-daemon21:33:303
219499500,5rtkit-daemon2193-21rtkit-daemon22:38:353
215882502,10sleep20-21swapper/218:54:502
211062502,10sleep30-21swapper/321:47:293
198772504,39sleep30-21swapper/322:33:253
1173199503,40cyclictest29949-21kworker/3:223:26:533
1173199503,39cyclictest0-21swapper/323:28:423
1173099505,36cyclictest0-21swapper/220:53:392
1173099504,40cyclictest0-21swapper/223:56:352
1173099504,39cyclictest0-21swapper/222:53:212
11730995032,12cyclictest0-21swapper/221:03:322
1173099503,41cyclictest0-21swapper/223:51:302
11730995023,7cyclictest24247-21latency_hist19:03:202
11730995011,32cyclictest26536-21http_loadtime20:13:372
11730995011,32cyclictest26536-21http_loadtime20:13:372
1172899504,28cyclictest0-21swapper/022:33:250
1172899504,28cyclictest0-21swapper/021:08:280
1172899504,27cyclictest0-21swapper/020:28:470
1172899504,27cyclictest0-21swapper/019:13:350
11728995019,12cyclictest0-21swapper/023:13:220
219499490,5rtkit-daemon2193-21rtkit-daemon23:53:403
11731994934,9cyclictest1429-21fschecks_count22:53:283
11731994933,10cyclictest22442-21cpuspeed_turbos18:58:333
1173199493,38cyclictest0-21swapper/322:08:183
1173099494,38cyclictest19805-21aten2.4-expect22:33:232
1173099494,12cyclictest0-21swapper/222:26:062
11730994934,9cyclictest1372-21crond19:23:182
1173099493,40cyclictest0-21swapper/221:38:422
1173099493,40cyclictest0-21swapper/221:38:422
1173099493,39cyclictest30537-21ssh23:36:262
11730994910,32cyclictest0-21swapper/221:28:242
1172899494,27cyclictest0-21swapper/019:03:500
1172899494,27cyclictest0-21swapper/018:33:210
1172899493,27cyclictest1124-21snmpd19:44:250
290822482,10sleep20-21swapper/222:46:342
1173199483,38cyclictest0-21swapper/322:03:143
1173099485,37cyclictest0-21swapper/223:23:362
1173099484,38cyclictest0-21swapper/223:02:002
1173099484,38cyclictest0-21swapper/221:13:262
1173099484,29cyclictest0-21swapper/220:03:312
1173099484,11cyclictest0-21swapper/221:18:282
11730994831,12cyclictest0-21swapper/223:28:582
1173099483,40cyclictest0-21swapper/221:58:422
1173099483,40cyclictest0-21swapper/200:02:012
1173099483,38cyclictest2042-21ssh22:06:432
11730994820,13cyclictest0-21swapper/220:23:492
11572482,40sleep20-21swapper/223:40:152
11572482,40sleep20-21swapper/223:40:152
219499470,5rtkit-daemon2193-21rtkit-daemon18:38:153
11731994733,9cyclictest17409-21kernelversion22:28:343
11731994720,8cyclictest3998-21cat19:28:193
1173199472,37cyclictest12899-21ssh22:23:193
1173099474,28cyclictest0-21swapper/219:34:372
1173099474,28cyclictest0-21swapper/219:34:372
1173099474,27cyclictest0-21swapper/219:03:412
1173099474,12cyclictest0-21swapper/219:28:322
1173099474,12cyclictest0-21swapper/219:28:322
1173099473,38cyclictest0-21swapper/220:59:522
11730994719,11cyclictest0-21swapper/220:51:522
1172899473,25cyclictest723-21cat19:18:530
37242463,37sleep20-21swapper/219:25:572
23272462,10sleep20-21swapper/220:28:522
203642462,10sleep20-21swapper/219:59:592
186272463,37sleep20-21swapper/218:48:492
186272463,37sleep20-21swapper/218:48:492
1173199463,37cyclictest0-21swapper/321:32:213
1173199463,37cyclictest0-21swapper/321:13:123
1173199463,37cyclictest0-21swapper/319:13:193
11731994629,12cyclictest0-21swapper/323:09:263
11731994620,8cyclictest17727-21cat23:18:103
1173199462,39cyclictest0-21swapper/319:52:183
1173099464,37cyclictest0-21swapper/222:28:382
1173099463,12cyclictest0-21swapper/222:08:422
11730994618,9cyclictest12322-21latency_hist18:38:212
25362453,36sleep30-21swapper/320:31:353
252392452,10sleep30-21swapper/320:11:203
252392452,10sleep30-21swapper/320:11:203
217872453,36sleep30-21swapper/318:57:253
1173199457,32cyclictest0-21swapper/320:13:293
1173199457,32cyclictest0-21swapper/320:13:293
11731994531,9cyclictest12924-21sort19:43:513
1173199453,37cyclictest0-21swapper/320:33:413
1173199453,35cyclictest31669-21tail19:18:313
11731994520,8cyclictest26761-21cat19:08:203
11731994519,9cyclictest32629-21cat20:28:173
1173099455,34cyclictest0-21swapper/218:43:412
228712443,9sleep30-21swapper/320:06:333
1173199443,11cyclictest0-21swapper/322:48:313
11731994426,12cyclictest0-21swapper/319:58:173
11731994424,16cyclictest0-21swapper/319:36:103
11731994424,16cyclictest0-21swapper/319:36:103
11731994415,24cyclictest2680-21diskmemload21:13:443
11731994413,12cyclictest0-21swapper/318:53:203
11731994413,12cyclictest0-21swapper/318:53:203
1173099444,11cyclictest0-21swapper/220:18:412
1173099443,36cyclictest0-21swapper/219:10:012
110282442,10sleep20-21swapper/219:42:462
1173199433,33cyclictest0-21swapper/320:18:413
1173199433,11cyclictest0-21swapper/319:43:183
11730994328,10cyclictest0-21swapper/219:43:312
1173199424,31cyclictest0-21swapper/318:43:213
1173199423,9cyclictest4468-21cpuspeed_turbos19:28:323
1173199423,9cyclictest4468-21cpuspeed_turbos19:28:323
1173199423,32cyclictest0-21swapper/319:13:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional