You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 09:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Sep 11, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21485991024,73cyclictest14810-21unixbench_multi21:06:441
311542990,2sleep20-21swapper/219:56:032
2148599996,12cyclictest27621-21runrttasks19:50:361
2148599995,13cyclictest0-21swapper/117:36:181
2148599985,74cyclictest18461-21python22:01:381
2148599985,70cyclictest0-21swapper/119:45:321
2148599954,70cyclictest0-21swapper/121:33:091
2148599954,68cyclictest24084-21unixbench_singl20:31:441
2148599946,64cyclictest0-21swapper/121:46:211
2148599934,69cyclictest0-21swapper/117:36:491
2148599925,68cyclictest0-21swapper/119:40:261
21485999216,8cyclictest4242-21latency_hist22:31:071
2148599915,71cyclictest0-21swapper/120:08:401
2148599915,65cyclictest0-21swapper/121:26:221
2148599915,24cyclictest7247-21fschecks_time20:56:301
2148599914,63cyclictest0-21swapper/122:11:191
2148599913,20cyclictest14220-21diskmemload19:53:521
21485999119,47cyclictest0-21swapper/117:53:421
21485999119,10cyclictest3866-21cut21:41:191
21485999114,13cyclictest0-21swapper/122:46:231
21485999113,11cyclictest28409-21sh20:40:291
2148599905,14cyclictest0-21swapper/121:01:231
2148599904,64cyclictest0-21swapper/120:46:261
2148599904,24cyclictest10558-21runrttasks22:40:161
2148599903,25cyclictest4686-21cpu22:31:221
2148599903,20cyclictest14220-21diskmemload21:24:321
21485999020,11cyclictest20932-21rm21:16:381
2148599895,65cyclictest0-21swapper/122:55:291
2148599894,64cyclictest0-21swapper/121:40:121
2148599894,64cyclictest0-21swapper/121:40:121
2148599893,24cyclictest14070-21timerwakeupswit20:16:431
21485998915,8cyclictest107550irq/46-eth020:11:261
21485998911,13cyclictest0-21swapper/118:01:351
2148599886,15cyclictest0-21swapper/121:59:401
2148599885,13cyclictest0-21swapper/120:31:111
2148599884,68cyclictest0-21swapper/118:56:391
2148599884,23cyclictest0-21swapper/119:06:271
2148599884,22cyclictest0-21swapper/120:05:421
2148599884,20cyclictest11209-21munin-node22:41:191
2148599884,20cyclictest0-21swapper/122:58:321
2148599884,12cyclictest21411-21load22:06:301
2148599875,60cyclictest0-21swapper/119:56:281
2148599874,68cyclictest0-21swapper/118:52:391
2148599874,68cyclictest0-21swapper/118:52:391
2148599874,67cyclictest0-21swapper/119:11:491
2148599874,62cyclictest0-21swapper/120:21:281
2148599874,21cyclictest0-21swapper/121:51:441
21485998723,49cyclictest0-21swapper/119:32:531
21485998715,9cyclictest107550irq/46-eth022:16:281
21485998715,9cyclictest107550irq/46-eth022:16:281
2148599865,14cyclictest0-21swapper/121:14:471
2148599864,13cyclictest0-21swapper/120:51:421
21485998626,52cyclictest26039-21gltestperf18:46:341
21485998622,54cyclictest1178-21needreboot19:01:391
21485998619,10cyclictest0-21swapper/120:41:241
2148599854,65cyclictest0-21swapper/119:23:101
2148599854,65cyclictest0-21swapper/118:33:021
2148599854,64cyclictest0-21swapper/118:41:331
2148599854,22cyclictest0-21swapper/122:21:191
21485998518,49cyclictest0-21swapper/118:38:031
21485998413,9cyclictest13047-21crond18:21:161
2148599834,64cyclictest0-21swapper/118:23:011
2148599834,64cyclictest0-21swapper/118:16:181
2148599834,62cyclictest0-21swapper/117:56:281
21485998314,12cyclictest0-21swapper/119:16:261
2148599815,22cyclictest14322-21date19:31:141
2148599793,21cyclictest0-21swapper/117:41:281
21485997817,9cyclictest1227-21runrttasks18:28:211
2148599774,20cyclictest0-21swapper/117:46:291
2148599754,17cyclictest0-21swapper/118:07:471
2148599754,17cyclictest0-21swapper/118:07:471
2148599685,13cyclictest0-21swapper/117:31:191
219499640,5rtkit-daemon2193-21rtkit-daemon20:19:123
2148399643,33cyclictest0-21swapper/022:26:010
21487996334,11cyclictest0-21swapper/322:21:243
21483996225,31cyclictest22891-21munin-node21:21:390
2148699613,52cyclictest0-21swapper/221:01:232
2148699612,54cyclictest0-21swapper/220:01:282
219499600,4rtkit-daemon2193-21rtkit-daemon22:27:523
2148699603,51cyclictest26722-21load20:36:332
2148399607,39cyclictest25320-21ssh20:36:100
2148399604,49cyclictest0-21swapper/020:01:290
2148399603,39cyclictest0-21swapper/020:50:560
2148399602,51cyclictest0-21swapper/021:46:300
200212603,14sleep20-21swapper/219:38:032
134752593,49sleep20-21swapper/222:43:522
270412583,47sleep30-21swapper/317:41:333
219499580,6rtkit-daemon2193-21rtkit-daemon20:13:503
21487995832,12cyclictest0-21swapper/321:50:153
21487995831,12cyclictest0-21swapper/319:58:033
21487995828,17cyclictest32084-21runrttasks21:34:283
21486995818,33cyclictest1227-21runrttasks21:12:152
2148399589,33cyclictest0-21swapper/020:17:240
2148399588,32cyclictest0-21swapper/021:27:120
2148399583,47cyclictest0-21swapper/021:33:500
2148399582,48cyclictest0-21swapper/021:36:430
2148399582,48cyclictest0-21swapper/021:36:430
2148399582,39cyclictest0-21swapper/022:51:330
21487995731,12cyclictest0-21swapper/320:55:403
2148799573,47cyclictest0-21swapper/320:41:413
21487995718,32cyclictest9866-21aten_r1power_vo21:01:223
2148699574,47cyclictest0-21swapper/219:56:462
2148399574,45cyclictest0-21swapper/021:51:310
2148399572,37cyclictest0-21swapper/021:41:220
21483995710,31cyclictest0-21swapper/020:51:310
2148399571,49cyclictest0-21swapper/020:06:310
2148799569,38cyclictest0-21swapper/322:41:223
21487995631,12cyclictest0-21swapper/322:35:343
2148699564,45cyclictest0-21swapper/220:06:352
21486995633,8cyclictest107550irq/46-eth022:31:282
2148699563,46cyclictest30677-21grep20:41:442
2148399564,45cyclictest0-21swapper/020:56:230
2148399562,35cyclictest0-21swapper/022:56:230
2148399561,37cyclictest0-21swapper/021:05:430
211112563,45sleep221161-21switchtime21:16:422
94362553,45sleep20-21swapper/221:01:062
2148699554,45cyclictest1227-21runrttasks21:44:282
2148699554,12cyclictest0-21swapper/222:55:522
2148699552,48cyclictest0-21swapper/222:06:222
2148699552,11cyclictest0-21swapper/221:31:372
2148399555,36cyclictest0-21swapper/019:45:110
2148399554,44cyclictest0-21swapper/022:03:480
21483995534,15cyclictest0-21swapper/018:01:340
2148399553,44cyclictest0-21swapper/018:11:330
2148399553,28cyclictest0-21swapper/021:06:350
2148399551,47cyclictest0-21swapper/017:41:360
2148399551,15cyclictest107550irq/46-eth022:14:080
295952543,18sleep30-21swapper/318:53:593
295952543,18sleep30-21swapper/318:53:593
219499540,5rtkit-daemon2193-21rtkit-daemon22:16:233
219499540,5rtkit-daemon2193-21rtkit-daemon22:16:233
219499540,5rtkit-daemon2193-21rtkit-daemon22:06:233
219499540,5rtkit-daemon2193-21rtkit-daemon21:56:393
21487995434,14cyclictest0-21swapper/322:01:183
21487995417,31cyclictest22869-21sh20:31:273
2148699544,9cyclictest107550irq/46-eth021:06:452
2148699544,12cyclictest0-21swapper/222:19:562
2148699544,12cyclictest0-21swapper/222:19:562
21486995438,10cyclictest22058-21grep17:31:332
2148699543,45cyclictest2628-21ssh22:26:362
2148699543,44cyclictest0-21swapper/221:26:372
2148399548,30cyclictest0-21swapper/021:12:440
2148399546,29cyclictest0-21swapper/022:31:230
2148399545,32cyclictest0-21swapper/022:29:390
21483995437,10cyclictest14996-21unixbench_multi18:21:490
2148399543,44cyclictest0-21swapper/022:16:420
2148399543,44cyclictest0-21swapper/022:16:420
2148399543,44cyclictest0-21swapper/019:16:140
2148399543,39cyclictest0-21swapper/022:09:540
21483995419,22cyclictest25560-21munin-node20:36:430
21483995411,26cyclictest0-21swapper/019:56:300
129372543,9sleep20-21swapper/221:54:222
219499530,5rtkit-daemon2193-21rtkit-daemon20:36:273
2148799533,43cyclictest0-21swapper/319:36:143
2148699535,12cyclictest0-21swapper/221:56:372
2148699534,44cyclictest0-21swapper/221:36:252
2148699534,44cyclictest0-21swapper/221:36:252
2148699534,12cyclictest22356-21ssh22:56:362
2148399534,42cyclictest0-21swapper/020:44:390
21483995336,11cyclictest25540-21grep19:46:320
2148399533,44cyclictest0-21swapper/022:47:300
2148399533,44cyclictest0-21swapper/022:43:580
2148399533,33cyclictest0-21swapper/021:56:530
2148399533,33cyclictest0-21swapper/020:31:030
21483995323,11cyclictest14466-21munin-node19:31:360
2148399532,45cyclictest0-21swapper/020:15:250
21483995313,22cyclictest29659-21timerandwakeup19:51:440
2148399531,36cyclictest0-21swapper/018:06:340
2148399531,36cyclictest0-21swapper/018:06:340
2148399531,35cyclictest0-21swapper/021:16:240
171242533,13sleep30-21swapper/318:26:473
219499520,5rtkit-daemon2193-21rtkit-daemon20:29:423
219499520,5rtkit-daemon2193-21rtkit-daemon20:04:363
21487995237,9cyclictest22557-21gltestperf17:31:383
2148799522,42cyclictest1124-21snmpd19:08:083
21487995214,31cyclictest0-21swapper/318:01:323
2148699524,41cyclictest0-21swapper/222:36:232
2148699524,40cyclictest0-21swapper/220:31:342
21486995237,10cyclictest24818-21needreboot22:11:332
2148699523,42cyclictest0-21swapper/220:21:442
2148699520,9cyclictest7438-21kworker/0:119:16:272
2148399528,28cyclictest0-21swapper/019:39:400
2148399523,29cyclictest0-21swapper/019:16:290
2148399522,43cyclictest0-21swapper/022:36:170
2148399522,43cyclictest0-21swapper/017:46:330
21483995213,21cyclictest0-21swapper/017:56:360
201072523,10sleep20-21swapper/218:34:482
306932512,41sleep30-21swapper/317:47:183
299382512,42sleep30-21swapper/319:51:503
219499510,5rtkit-daemon2193-21rtkit-daemon21:51:163
21487995136,10cyclictest24689-21munin-node19:46:333
2148799513,42cyclictest7498-21taskset20:56:333
21487995129,11cyclictest0-21swapper/321:18:053
2148799512,44cyclictest0-21swapper/321:11:253
2148799512,41cyclictest14220-21diskmemload22:37:323
21487995118,27cyclictest14926-21cat18:21:483
2148699514,43cyclictest0-21swapper/220:50:592
21486995119,25cyclictest19362-21cstates20:26:262
21486995114,31cyclictest30686-21df_abs22:21:232
21486995113,33cyclictest0-21swapper/221:46:272
21483995132,12cyclictest768-21grep19:01:330
2148399513,30cyclictest21915-21python18:36:470
2148399513,30cyclictest0-21swapper/020:21:300
2148399512,40cyclictest25285-21basename18:46:260
2148399512,32cyclictest0-21swapper/017:51:290
2148399511,43cyclictest0-21swapper/018:56:480
209212513,7sleep321019-21sh22:56:193
312412502,9sleep20-21swapper/217:51:282
21487995035,9cyclictest18761-21sort18:31:333
2148799503,41cyclictest0-21swapper/321:43:203
2148799502,40cyclictest14326-21munin-node22:46:393
21487995018,27cyclictest23149-21cat21:21:233
2148699503,42cyclictest0-21swapper/222:46:202
21486995020,11cyclictest0-21swapper/219:12:542
21486995011,33cyclictest19987-21latency_hist22:06:072
2148399503,40cyclictest0-21swapper/018:41:310
2148399502,32cyclictest0-21swapper/018:53:050
2148399502,32cyclictest0-21swapper/018:53:050
21483995019,12cyclictest0-21swapper/018:31:470
197492502,10sleep30-21swapper/319:37:033
115732502,9sleep30-21swapper/319:22:563
82382493,10sleep30-21swapper/318:10:513
82382493,10sleep30-21swapper/318:10:513
56282492,10sleep20-21swapper/218:02:562
224002492,10sleep20-21swapper/218:38:312
2148799493,40cyclictest0-21swapper/321:39:213
2148799493,40cyclictest0-21swapper/321:39:213
2148799493,39cyclictest0-21swapper/321:26:383
2148699494,39cyclictest0-21swapper/221:24:532
2148699494,38cyclictest0-21swapper/219:31:252
123732492,39sleep20-21swapper/220:16:202
272762482,10sleep30-21swapper/318:49:523
248762482,40sleep30-21swapper/318:44:403
21487994834,9cyclictest12589-21unixbench_multi18:16:473
21487994833,9cyclictest19360-21tail22:51:383
21487994833,9cyclictest13895-21cut21:06:303
21487994828,9cyclictest0-21swapper/319:04:333
2148699483,39cyclictest0-21swapper/220:51:132
21486994829,11cyclictest28260-21grep18:51:322
21486994829,11cyclictest28260-21grep18:51:322
21486994820,12cyclictest0-21swapper/220:15:202
21486994820,12cyclictest0-21swapper/219:46:462
21486994820,12cyclictest0-21swapper/219:44:542
2148699482,39cyclictest14159-21gltestperf18:21:362
21483994820,12cyclictest0-21swapper/018:16:260
2148399482,32cyclictest0-21swapper/019:08:080
2148399481,41cyclictest0-21swapper/017:36:020
2148399481,32cyclictest0-21swapper/019:26:310
2148399481,32cyclictest0-21swapper/018:26:400
115892483,38sleep20-21swapper/219:23:082
285722472,38sleep20-21swapper/217:45:432
21487994733,9cyclictest7447-21ssh20:06:443
21487994733,9cyclictest12375-21cpuspeed_turbos19:26:283
2148799473,38cyclictest0-21swapper/322:13:393
2148799472,40cyclictest14220-21diskmemload20:49:343
21487994714,26cyclictest21896-21fschecks_count19:41:323
21486994732,9cyclictest3373-21gltestperf19:06:332
2148399473,38cyclictest0-21swapper/017:36:200
128032472,9sleep20-21swapper/218:18:072
103752472,38sleep30-21swapper/318:12:363
84582462,10sleep20-21swapper/218:11:182
81892463,10sleep20-21swapper/218:10:142
81892463,10sleep20-21swapper/218:10:142
321492462,38sleep30-21swapper/319:01:123
21487994631,9cyclictest32092-21gltestperf17:51:363
2148799463,37cyclictest0-21swapper/320:21:323
2148699465,26cyclictest0-21swapper/218:46:392
2148699464,26cyclictest0-21swapper/219:05:412
21486994618,12cyclictest0-21swapper/217:46:282
2148399463,37cyclictest0-21swapper/019:22:170
67462452,37sleep30-21swapper/319:12:293
2148699454,12cyclictest0-21swapper/218:26:322
21486994532,9cyclictest30307-21grep18:56:282
21486994529,10cyclictest1589-21tr17:56:312
2148699452,38cyclictest0-21swapper/219:26:262
21486994518,12cyclictest0-21swapper/217:36:302
21487994431,8cyclictest20786-21tr18:36:313
2148799443,12cyclictest9438-21awk19:21:133
2148699443,25cyclictest0-21swapper/218:43:042
2148799413,32cyclictest0-21swapper/317:36:283
2148799413,31cyclictest0-21swapper/318:01:183
213882385,26sleep00-21swapper/017:30:300
21487993718,13cyclictest0-21swapper/317:31:193
209272379,15sleep20-21swapper/217:26:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional