You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 01:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Dec 14, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991090,8rtkit-daemon0-21swapper/222:59:252
2485991080,8rtkit-daemon0-21swapper/221:19:292
2485991070,8rtkit-daemon0-21swapper/221:44:282
2485991070,7rtkit-daemon0-21swapper/223:49:302
2485991050,6rtkit-daemon0-21swapper/221:39:352
2485991050,3rtkit-daemon0-21swapper/200:24:142
2485991040,7rtkit-daemon0-21swapper/220:14:392
2485991040,7rtkit-daemon0-21swapper/220:14:392
2485991010,6rtkit-daemon22500-21timerandwakeup20:24:382
2485991010,5rtkit-daemon0-21swapper/219:38:182
2485991000,6rtkit-daemon0-21swapper/221:34:282
2485991000,5rtkit-daemon0-21swapper/221:09:292
248599980,5rtkit-daemon18676-21awk19:09:342
248599980,5rtkit-daemon12-21rcu_preempt00:34:212
248599980,5rtkit-daemon0-21swapper/219:49:022
248599970,6rtkit-daemon0-21swapper/220:44:372
248599970,5rtkit-daemon0-21swapper/223:57:222
248599970,5rtkit-daemon0-21swapper/222:54:322
248599970,5rtkit-daemon0-21swapper/220:34:302
248599970,5rtkit-daemon0-21swapper/200:14:222
248599960,6rtkit-daemon0-21swapper/200:29:292
248599960,6rtkit-daemon0-21swapper/200:29:292
1719799954,71cyclictest0-21swapper/022:24:250
248599930,4rtkit-daemon0-21swapper/219:19:262
1719799934,70cyclictest0-21swapper/021:14:370
1719799934,65cyclictest0-21swapper/000:19:120
17205999240,45cyclictest28687-21cut22:54:203
1720599923,44cyclictest2453-21tail00:14:193
248599910,8rtkit-daemon0-21swapper/223:44:232
248599910,8rtkit-daemon0-21swapper/223:44:232
1719799914,70cyclictest0-21swapper/021:59:320
1720599904,15cyclictest0-21swapper/319:29:213
17205999029,10cyclictest5809-21unixbench_singl00:19:323
1719799905,13cyclictest0-21swapper/019:35:390
17205998935,47cyclictest9744-21cut19:59:273
1720599893,26cyclictest25212-21head23:54:203
17205998926,55cyclictest15842-21munin-plugin-st22:29:063
17205998825,11cyclictest9713-21gltestperf22:14:233
17197998820,45cyclictest0-21swapper/022:49:180
1720599874,34cyclictest0-21swapper/319:39:213
1720599864,11cyclictest0-21swapper/300:04:263
17205998629,10cyclictest16139-21needreboot21:19:313
248599850,27rtkit-daemon29639-21timerandwakeup20:39:382
1720599854,28cyclictest0-21swapper/323:24:303
1720599853,11cyclictest0-21swapper/320:54:243
17205998528,9cyclictest5080-21gltestperf19:49:303
1719799853,65cyclictest0-21swapper/000:24:110
17205998427,10cyclictest28962-21gltestperf20:39:263
1719799844,74cyclictest0-21swapper/000:34:180
1720599834,27cyclictest0-21swapper/321:09:193
1720599834,25cyclictest0-21swapper/322:29:163
17205998327,11cyclictest26823-21needreboot22:49:263
1719799834,64cyclictest0-21swapper/020:59:310
1719799834,60cyclictest0-21swapper/020:49:400
1719799833,24cyclictest23101-21latency_hist20:29:120
17197998329,48cyclictest0-21swapper/022:36:500
17197998319,43cyclictest0-21swapper/023:50:430
1720599824,28cyclictest0-21swapper/323:34:143
17205998230,9cyclictest7231-21fschecks_time22:09:213
1720599823,30cyclictest0-21swapper/323:29:123
1719799824,71cyclictest0-21swapper/022:39:220
1719799824,70cyclictest0-21swapper/022:49:050
17197998220,55cyclictest29033-21idleruntime-cro21:49:080
1720599813,29cyclictest0-21swapper/323:39:323
1719799815,11cyclictest1419-21runrttasks23:04:240
1719799815,11cyclictest1419-21runrttasks23:04:240
1719799814,70cyclictest0-21swapper/023:34:220
1719799814,70cyclictest0-21swapper/021:56:510
1719799814,70cyclictest0-21swapper/019:49:410
1719799814,69cyclictest1419-21runrttasks20:23:030
1719799814,21cyclictest0-21swapper/021:40:180
1719799813,70cyclictest12502-21grep22:19:290
1719799813,70cyclictest12502-21grep22:19:290
1719799813,70cyclictest0-21swapper/022:09:350
17197998124,49cyclictest9756-21gltestperf22:14:240
17197998121,54cyclictest0-21swapper/023:20:020
1720599803,28cyclictest0-21swapper/321:59:283
1720599803,12cyclictest0-21swapper/320:29:443
1719799803,70cyclictest0-21swapper/019:29:300
1719799803,25cyclictest1419-21runrttasks19:11:250
17197998024,49cyclictest0-21swapper/020:04:320
17197998013,61cyclictest25152-21entropy19:24:270
1719799794,67cyclictest0-21swapper/021:24:300
1719799794,12cyclictest0-21swapper/019:19:390
1719799793,13cyclictest0-21swapper/019:43:280
17197997929,43cyclictest0-21swapper/023:54:340
17197997923,38cyclictest12209-21latency_hist23:29:040
17205997831,10cyclictest4963-21gltestperf22:04:253
17205997827,9cyclictest22252-21sort23:49:123
1719799784,68cyclictest0-21swapper/020:39:400
1719799784,67cyclictest0-21swapper/023:59:150
1719799784,66cyclictest0-21swapper/022:29:300
1719799784,66cyclictest0-21swapper/019:59:220
1719799784,12cyclictest0-21swapper/021:29:230
1719799783,22cyclictest20126-21tr19:14:320
1719799783,21cyclictest1419-21runrttasks23:00:010
17197997821,51cyclictest0-21swapper/021:49:310
1720599774,27cyclictest0-21swapper/319:34:573
1719799774,66cyclictest0-21swapper/020:29:440
1719799774,66cyclictest0-21swapper/000:04:270
1719799774,15cyclictest0-21swapper/019:46:430
17197997734,36cyclictest4597-21grep23:09:360
1719799773,68cyclictest0-21swapper/020:14:260
1719799773,68cyclictest0-21swapper/020:14:260
1719799773,67cyclictest0-21swapper/021:34:380
1719799773,12cyclictest0-21swapper/021:09:230
248599760,24rtkit-daemon15252-21ls20:09:392
1720599763,26cyclictest0-21swapper/320:37:263
17205997629,10cyclictest14290-21unixbench_singl21:14:403
1719799763,66cyclictest0-21swapper/000:14:140
17197997623,46cyclictest9136-21tr00:29:140
17197997623,46cyclictest9136-21tr00:29:140
17197997621,49cyclictest1419-21runrttasks22:06:490
17197997620,9cyclictest1419-21runrttasks23:33:130
17197997620,49cyclictest1-21systemd21:09:100
1719799754,64cyclictest0-21swapper/020:44:260
1719799754,63cyclictest0-21swapper/019:09:150
17197997525,44cyclictest0-21swapper/019:56:320
17197997520,9cyclictest20487-21sshd23:44:200
17197997520,9cyclictest20487-21sshd23:44:200
1720599745,34cyclictest0-21swapper/320:04:323
1719799744,14cyclictest0-21swapper/000:09:330
1719799744,13cyclictest0-21swapper/020:54:380
17197997421,46cyclictest0-21swapper/020:09:300
17197997412,14cyclictest0-21swapper/023:39:210
248599730,17rtkit-daemon0-21swapper/223:39:532
248599730,17rtkit-daemon0-21swapper/222:45:102
1719799733,9cyclictest28000-21munin-node22:54:150
17197997321,45cyclictest0-21swapper/020:34:290
1720599723,34cyclictest0-21swapper/300:09:273
248599710,6rtkit-daemon0-21swapper/219:28:402
1719799714,13cyclictest0-21swapper/023:18:210
1719799714,13cyclictest0-21swapper/021:20:210
248599660,7rtkit-daemon0-21swapper/219:29:402
248599650,6rtkit-daemon0-21swapper/200:09:592
248599650,5rtkit-daemon0-21swapper/222:53:102
1720499653,56cyclictest0-21swapper/223:09:362
1720499634,51cyclictest0-21swapper/222:39:322
248599620,7rtkit-daemon0-21swapper/122:20:111
248599620,7rtkit-daemon0-21swapper/122:20:111
248599620,12rtkit-daemon0-21swapper/122:28:261
248599620,11rtkit-daemon0-21swapper/123:34:531
248599620,11rtkit-daemon0-21swapper/122:16:041
1720499624,52cyclictest0-21swapper/222:29:332
1720499623,53cyclictest0-21swapper/219:39:222
17203996242,13cyclictest0-21swapper/122:39:181
1720499614,51cyclictest0-21swapper/222:04:262
1720499614,49cyclictest0-21swapper/222:39:072
1720499604,48cyclictest0-21swapper/200:09:022
248599590,2rtkit-daemon0-21swapper/122:29:111
1720499594,49cyclictest0-21swapper/223:19:062
1720499594,49cyclictest0-21swapper/220:31:072
1720499594,48cyclictest0-21swapper/222:14:072
1720499594,47cyclictest0-21swapper/220:21:032
17203995940,12cyclictest0-21swapper/122:09:361
1720499584,49cyclictest0-21swapper/223:19:182
1720399583,48cyclictest0-21swapper/123:09:151
1720499573,47cyclictest0-21swapper/221:08:252
1720499573,30cyclictest0-21swapper/221:54:212
17203995714,36cyclictest10640-21forks23:24:201
155892579,38sleep30-21swapper/319:04:243
1720499564,33cyclictest0-21swapper/219:49:222
1720499562,39cyclictest0-21swapper/221:14:522
1720399563,47cyclictest0-21swapper/123:50:431
1720399555,41cyclictest0-21swapper/100:19:101
131402554,11sleep10-21swapper/121:14:261
17203995436,11cyclictest19381-21gltestperf20:19:271
112032544,11sleep10-21swapper/100:34:071
89862533,11sleep10-21swapper/119:59:171
1720499535,40cyclictest0-21swapper/223:34:292
1720399535,41cyclictest0-21swapper/121:24:251
1720399534,41cyclictest0-21swapper/120:54:221
17203995336,9cyclictest29345-21munin-node19:34:371
17203995321,13cyclictest0-21swapper/120:39:381
17203995321,13cyclictest0-21swapper/119:19:321
59572523,11sleep10-21swapper/122:04:471
24872523,43sleep10-21swapper/123:07:141
24872523,43sleep10-21swapper/123:07:141
216152524,11sleep10-21swapper/123:47:201
216152524,11sleep10-21swapper/123:47:201
1720499524,40cyclictest0-21swapper/223:29:172
1720499524,39cyclictest0-21swapper/223:04:232
1720499524,39cyclictest0-21swapper/223:04:232
1720499524,28cyclictest0-21swapper/222:24:322
17204995233,12cyclictest27594-21gltestperf23:59:182
17204995222,14cyclictest0-21swapper/220:49:362
1720499522,42cyclictest0-21swapper/219:14:282
1720399525,29cyclictest0-21swapper/121:19:201
1720399524,27cyclictest0-21swapper/119:54:331
17203995236,9cyclictest27537-21diskstats19:29:271
17203995236,10cyclictest0-21swapper/100:24:191
17203995235,9cyclictest20937-21munin-node20:24:391
17203995234,12cyclictest8626-21gltestperf21:04:281
17203995232,12cyclictest25034-21unixbench_multi20:29:431
17203995220,13cyclictest0-21swapper/122:56:221
17203995210,14cyclictest0-21swapper/119:24:431
54682513,11sleep20-21swapper/200:19:292
265932513,10sleep10-21swapper/121:43:431
240572513,10sleep10-21swapper/121:36:461
1720599517,27cyclictest0-21swapper/320:14:273
1720599517,27cyclictest0-21swapper/320:14:273
1720599514,30cyclictest0-21swapper/321:39:093
1720599514,29cyclictest0-21swapper/320:59:333
1720499514,39cyclictest0-21swapper/221:29:212
1720499514,28cyclictest0-21swapper/219:59:302
1720499514,27cyclictest0-21swapper/223:24:142
17204995135,10cyclictest4684-21grep20:54:402
1720499513,28cyclictest0-21swapper/222:14:362
1720399515,28cyclictest0-21swapper/120:49:271
1720399515,27cyclictest0-21swapper/100:04:031
1720399514,29cyclictest0-21swapper/121:54:161
1720399514,29cyclictest0-21swapper/119:49:411
17203995132,12cyclictest1939-21cpuspeed_turbos21:59:181
1720399513,42cyclictest0-21swapper/123:54:131
274682503,11sleep10-21swapper/122:50:131
17205995034,10cyclictest14647-21cut20:09:273
1720599503,28cyclictest0-21swapper/323:49:043
1720599503,28cyclictest0-21swapper/323:49:043
1720499504,26cyclictest0-21swapper/221:49:352
17204995018,13cyclictest0-21swapper/222:20:242
17204995018,13cyclictest0-21swapper/222:20:242
1720399505,35cyclictest0-21swapper/121:44:251
1720399505,27cyclictest0-21swapper/120:15:051
1720399505,27cyclictest0-21swapper/120:15:051
1720399504,39cyclictest0-21swapper/122:34:271
1720399504,39cyclictest0-21swapper/120:59:221
17203995035,9cyclictest29827-21diskstats21:49:221
1720399503,39cyclictest0-21swapper/123:14:201
17203995019,13cyclictest0-21swapper/119:39:371
17203995015,27cyclictest27974-21wc20:39:101
97122493,11sleep10-21swapper/123:22:411
190992493,40sleep10-21swapper/123:40:351
1720599494,28cyclictest0-21swapper/321:54:313
1720599494,27cyclictest0-21swapper/319:24:563
1720599492,22cyclictest0-21swapper/321:46:273
17205994912,18cyclictest0-21swapper/323:04:143
17205994912,18cyclictest0-21swapper/323:04:143
1720499494,28cyclictest0-21swapper/220:59:402
1720499493,29cyclictest0-21swapper/221:24:242
17204994920,13cyclictest0-21swapper/221:59:182
1720399494,39cyclictest0-21swapper/121:09:241
1720399494,38cyclictest0-21swapper/100:14:331
17203994935,8cyclictest18877-21munin-node19:09:381
17203994917,13cyclictest0-21swapper/100:04:231
102742493,39sleep10-21swapper/100:29:321
102742493,39sleep10-21swapper/100:29:321
251602483,11sleep10-21swapper/122:46:181
1720599484,28cyclictest0-21swapper/323:14:233
1720599484,27cyclictest0-21swapper/322:44:423
1720599484,27cyclictest0-21swapper/300:30:503
1720599484,27cyclictest0-21swapper/300:30:503
1720599484,27cyclictest0-21swapper/300:27:193
1720599484,27cyclictest0-21swapper/300:02:183
1720599484,26cyclictest0-21swapper/323:10:353
17205994831,11cyclictest18524-21needreboot21:24:313
1720599483,29cyclictest0-21swapper/322:39:363
1720599483,28cyclictest0-21swapper/321:04:363
1720599483,27cyclictest0-21swapper/319:14:383
1720499484,28cyclictest0-21swapper/219:54:242
1720399485,36cyclictest0-21swapper/120:04:431
1720399485,15cyclictest0-21swapper/100:09:241
1720399483,27cyclictest0-21swapper/119:14:371
1720399483,26cyclictest0-21swapper/120:13:101
1720599474,26cyclictest0-21swapper/320:22:213
1720599474,26cyclictest0-21swapper/319:54:323
1720599473,27cyclictest0-21swapper/322:34:293
1720599473,27cyclictest0-21swapper/321:39:293
17205994716,25cyclictest19006-21timerwakeupswit19:09:393
1720399473,39cyclictest0-21swapper/122:59:241
325812462,38sleep30-21swapper/320:48:323
17205994630,10cyclictest31022-21unixbench_singl21:49:383
1720599463,26cyclictest0-21swapper/323:19:243
1720599462,39cyclictest0-21swapper/319:49:133
1720499464,36cyclictest0-21swapper/220:04:432
1720399464,35cyclictest30579-21head20:44:221
17203994610,29cyclictest0-21swapper/119:44:221
144812462,38sleep10-21swapper/123:32:411
1720599453,28cyclictest0-21swapper/300:36:333
17205994524,14cyclictest0-21swapper/320:24:223
1720399453,38cyclictest0-21swapper/121:29:231
1720599444,33cyclictest30688-21grep22:59:163
1720599444,25cyclictest0-21swapper/322:20:243
1720599444,25cyclictest0-21swapper/322:20:243
1720599443,23cyclictest0-21swapper/320:54:103
171242424,32sleep10-21swapper/119:08:391
1720599413,9cyclictest23316-21memory19:19:343
17205994124,10cyclictest21415-21unixbench_multi21:29:383
171302414,6sleep20-21swapper/219:08:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional