You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 08:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Aug 28, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194199994,12cyclictest0-21swapper/119:34:401
1941999925,26cyclictest6788-21cpuspeed21:39:331
194199954,29cyclictest0-21swapper/119:19:421
1941999423,13cyclictest0-21swapper/120:44:211
194199934,24cyclictest1124-21snmpd21:16:431
193999934,70cyclictest0-21swapper/019:49:400
194199925,29cyclictest0-21swapper/118:29:521
194199925,28cyclictest0-21swapper/120:00:081
194199925,27cyclictest0-21swapper/122:40:211
194199924,28cyclictest0-21swapper/122:53:251
194199924,28cyclictest0-21swapper/119:07:321
194199924,28cyclictest0-21swapper/117:44:491
194199924,26cyclictest0-21swapper/120:53:001
194199924,26cyclictest0-21swapper/120:53:001
193999923,67cyclictest0-21swapper/022:42:260
194199915,26cyclictest0-21swapper/121:24:321
194199914,29cyclictest0-21swapper/123:09:481
194199914,28cyclictest0-21swapper/122:34:421
194199914,28cyclictest0-21swapper/122:24:491
194199914,21cyclictest0-21swapper/122:54:351
1939999115,7cyclictest1675-21ssh23:09:330
194199905,32cyclictest0-21swapper/120:37:461
194199904,48cyclictest1124-21snmpd19:51:291
194199904,29cyclictest0-21swapper/121:44:491
193999904,68cyclictest0-21swapper/020:44:210
193999903,7cyclictest107550irq/46-eth020:54:100
193999903,7cyclictest107550irq/46-eth020:54:100
194199896,24cyclictest0-21swapper/122:14:301
194199894,29cyclictest0-21swapper/122:04:511
194199894,29cyclictest0-21swapper/121:09:341
194199894,28cyclictest0-21swapper/121:04:471
194199894,28cyclictest0-21swapper/120:46:131
194199894,27cyclictest0-21swapper/118:04:271
1939998923,46cyclictest162161ssh20:14:460
1939998919,7cyclictest16166-21munin-run21:54:180
194199887,27cyclictest0-21swapper/118:59:431
194199885,25cyclictest2111-21diskstats19:54:401
194199884,27cyclictest0-21swapper/121:31:491
193999883,23cyclictest0-21swapper/020:56:220
193999883,23cyclictest0-21swapper/020:56:220
1939998821,46cyclictest4294-21ssh21:34:420
194199874,25cyclictest27079-21diskmemload20:28:131
194199874,24cyclictest9811-21diskstats20:54:381
194199874,24cyclictest9811-21diskstats20:54:381
193999873,7cyclictest107550irq/46-eth021:12:210
193999873,67cyclictest0-21swapper/021:59:490
193999873,22cyclictest0-21swapper/021:56:110
193999873,21cyclictest27079-21diskmemload22:35:450
1939998717,9cyclictest2341-21fschecks_time19:54:420
1939998717,10cyclictest0-21swapper/020:28:310
194199866,26cyclictest0-21swapper/123:07:501
193999864,64cyclictest0-21swapper/019:09:420
193999863,21cyclictest0-21swapper/023:07:310
1939998614,8cyclictest27079-21diskmemload22:06:490
194199856,28cyclictest0-21swapper/122:29:361
194199854,28cyclictest0-21swapper/118:44:461
194199854,28cyclictest0-21swapper/118:44:461
194199854,27cyclictest0-21swapper/118:24:441
193999854,74cyclictest0-21swapper/020:29:370
193999854,22cyclictest0-21swapper/020:44:450
193999853,20cyclictest7898-21rm22:29:360
1939998521,7cyclictest27079-21diskmemload21:27:000
1939998520,40cyclictest15455-21kworker/0:122:46:180
193999852,22cyclictest0-21swapper/021:41:100
1939998514,8cyclictest3575-21ssh22:24:160
1939998513,7cyclictest24781-21ssh22:54:410
1939998513,12cyclictest0-21swapper/021:00:540
1939998512,10cyclictest0-21swapper/020:01:270
1939998510,17cyclictest20466-21ssh20:20:310
193999843,73cyclictest0-21swapper/021:44:390
193999843,65cyclictest0-21swapper/021:04:440
193999843,64cyclictest0-21swapper/020:04:460
193999843,26cyclictest0-21swapper/020:34:460
193999843,22cyclictest0-21swapper/022:16:070
1939998419,8cyclictest27452-21ssh22:59:310
1939998418,45cyclictest0-21swapper/022:49:440
1939998417,50cyclictest0-21swapper/022:24:500
1939998414,13cyclictest0-21swapper/022:09:350
1939998410,11cyclictest0-21swapper/021:19:450
193999834,58cyclictest0-21swapper/018:26:350
193999833,72cyclictest1124-21snmpd19:44:360
1939998317,10cyclictest0-21swapper/021:30:170
194199826,27cyclictest0-21swapper/122:21:221
193999824,71cyclictest0-21swapper/019:19:230
193999824,61cyclictest0-21swapper/017:49:520
193999823,8cyclictest12678-21tune2fs20:09:410
193999823,8cyclictest12678-21tune2fs20:09:410
193999823,24cyclictest1124-21snmpd18:03:340
193999823,19cyclictest23221-21grep21:14:380
1939998223,45cyclictest0-21swapper/019:29:510
1939998223,45cyclictest0-21swapper/019:29:510
1939998221,44cyclictest0-21swapper/018:34:260
194199815,29cyclictest0-21swapper/121:36:041
193999813,24cyclictest0-21swapper/018:19:380
1939998119,8cyclictest7052-21munin-node17:54:440
1939998112,8cyclictest107550irq/46-eth018:40:000
194199805,27cyclictest0-21swapper/121:52:011
1939997925,47cyclictest2892-21tune2fs17:44:450
1939997915,44cyclictest0-21swapper/018:34:480
193999784,15cyclictest0-21swapper/019:26:280
193999773,67cyclictest14557-21cut18:09:400
193999773,36cyclictest0-21swapper/019:38:070
1939997720,51cyclictest0-21swapper/019:44:240
1939997622,48cyclictest31611-21fschecks_time18:44:430
1939997622,48cyclictest31611-21fschecks_time18:44:430
1939997619,8cyclictest1227-21runrttasks18:07:170
1939997619,8cyclictest1227-21runrttasks18:07:170
1939997619,50cyclictest7577-21grep18:59:570
1939997514,8cyclictest0-21swapper/018:56:200
1939997510,11cyclictest0-21swapper/018:18:320
193999743,13cyclictest0-21swapper/019:04:330
1939997411,11cyclictest0-21swapper/018:49:540
1939997117,8cyclictest16299-21idleruntime19:19:450
1942996730,12cyclictest0-21swapper/221:11:302
1939996615,7cyclictest1914-21latency_hist17:44:270
1943996423,23cyclictest15471-21cpuspeed_turbos20:14:353
194399642,10cyclictest0-21swapper/320:37:353
313302620,6sleep331331-21munin-node19:49:433
194399625,51cyclictest0-21swapper/322:04:303
1942996131,12cyclictest0-21swapper/221:50:412
194399604,47cyclictest0-21swapper/322:39:363
194299605,37cyclictest0-21swapper/222:34:372
1942996032,12cyclictest0-21swapper/222:19:462
1942996032,12cyclictest0-21swapper/220:34:462
1942996030,13cyclictest0-21swapper/220:26:282
194399594,27cyclictest0-21swapper/322:31:093
1942995931,13cyclictest0-21swapper/222:05:032
194399585,46cyclictest0-21swapper/321:59:403
194399585,45cyclictest0-21swapper/320:59:513
194399584,49cyclictest0-21swapper/323:09:053
194399584,46cyclictest0-21swapper/319:19:553
194299585,36cyclictest0-21swapper/223:09:482
194299583,47cyclictest0-21swapper/221:34:362
1941995826,11cyclictest28804-21ssh19:44:531
194399574,46cyclictest1227-21runrttasks22:22:543
194399574,46cyclictest0-21swapper/321:54:383
194399574,46cyclictest0-21swapper/321:19:373
194399574,46cyclictest0-21swapper/319:39:553
194399574,45cyclictest0-21swapper/320:19:443
1942995730,12cyclictest0-21swapper/221:59:492
284222564,7sleep128427-21rm21:23:221
224702563,47sleep10-21swapper/122:03:251
194399565,44cyclictest0-21swapper/317:49:573
194399565,43cyclictest0-21swapper/321:14:313
194399564,46cyclictest0-21swapper/322:15:123
194399564,45cyclictest0-21swapper/321:29:333
194399564,45cyclictest0-21swapper/318:39:373
194399564,44cyclictest5140-21head19:59:343
194399564,44cyclictest0-21swapper/322:24:483
1943995633,17cyclictest11843-21ps22:34:473
194399563,46cyclictest0-21swapper/322:49:323
194399563,46cyclictest0-21swapper/320:09:363
194399563,46cyclictest0-21swapper/320:09:363
1943995616,24cyclictest26784-21fschecks_count18:34:433
194299565,35cyclictest0-21swapper/222:30:162
194299564,34cyclictest0-21swapper/220:58:562
194299564,34cyclictest0-21swapper/220:58:562
194299564,19cyclictest0-21swapper/219:34:272
1942995639,10cyclictest14568-21cpuspeed_turbos18:09:402
1942995630,12cyclictest0-21swapper/221:00:522
171612560,8sleep30-21swapper/321:04:493
194399555,43cyclictest0-21swapper/321:25:283
194399555,42cyclictest27922-21irqstats22:59:383
194399554,45cyclictest0-21swapper/320:44:093
194399554,44cyclictest0-21swapper/321:44:053
194399554,44cyclictest0-21swapper/320:49:313
194399554,44cyclictest0-21swapper/320:49:313
194399554,44cyclictest0-21swapper/319:44:473
1942995528,12cyclictest0-21swapper/220:41:002
1942995528,12cyclictest0-21swapper/219:14:462
194199555,44cyclictest0-21swapper/120:18:281
1941995523,14cyclictest0-21swapper/121:54:501
58602543,13sleep20-21swapper/222:25:232
219499540,5rtkit-daemon2193-21rtkit-daemon20:09:431
219499540,5rtkit-daemon2193-21rtkit-daemon20:09:431
194399545,43cyclictest0-21swapper/320:24:323
194399544,44cyclictest0-21swapper/322:57:523
194399544,44cyclictest0-21swapper/320:57:063
194399544,44cyclictest0-21swapper/320:57:063
194399544,44cyclictest0-21swapper/320:33:583
194399544,43cyclictest2930-21grep23:09:493
194399544,43cyclictest0-21swapper/321:49:443
194399543,44cyclictest0-21swapper/319:34:523
194399543,36cyclictest29196-21ssh22:13:593
1942995432,9cyclictest1156-21munin-run19:54:222
1942995428,13cyclictest0-21swapper/221:04:522
1942995428,12cyclictest0-21swapper/222:59:522
1942995428,12cyclictest0-21swapper/222:52:312
1942995425,23cyclictest0-21swapper/221:26:132
194199544,9cyclictest0-21swapper/119:09:541
195482530,6sleep334-21rcuc/319:24:573
194399534,43cyclictest0-21swapper/321:45:313
1943995336,11cyclictest13296-21tr19:14:383
194399533,44cyclictest0-21swapper/321:13:383
194399533,44cyclictest0-21swapper/320:06:403
1942995336,10cyclictest2773-21grep18:49:582
1942995328,12cyclictest0-21swapper/220:12:102
1942995328,12cyclictest0-21swapper/220:12:102
1942995318,13cyclictest0-21swapper/219:04:432
1941995333,13cyclictest0-21swapper/120:19:381
1941995323,12cyclictest0-21swapper/119:24:371
219499520,5rtkit-daemon2193-21rtkit-daemon18:34:391
219499520,5rtkit-daemon2193-21rtkit-daemon17:54:561
194399523,44cyclictest0-21swapper/322:47:363
194399523,44cyclictest0-21swapper/319:55:013
1943995211,34cyclictest0-21swapper/321:34:293
194299524,42cyclictest0-21swapper/220:05:042
1942995237,9cyclictest281ktimersoftd/219:09:582
194299523,41cyclictest0-21swapper/222:14:262
194299523,34cyclictest0-21swapper/218:24:352
1942995229,10cyclictest0-21swapper/219:54:302
194199526,28cyclictest0-21swapper/122:49:111
194199525,28cyclictest0-21swapper/120:29:451
1941995222,12cyclictest0-21swapper/122:14:181
1941995222,12cyclictest0-21swapper/118:49:371
219499510,5rtkit-daemon2193-21rtkit-daemon19:14:451
219499510,5rtkit-daemon2193-21rtkit-daemon18:40:021
213512512,41sleep20-21swapper/220:23:572
211262513,9sleep20-21swapper/218:24:232
194399514,27cyclictest0-21swapper/320:44:413
1942995135,9cyclictest7884-21grep17:54:452
1942995135,10cyclictest615-21crond18:49:252
1942995135,10cyclictest615-21crond18:49:252
194299513,42cyclictest0-21swapper/221:46:272
1942995121,23cyclictest0-21swapper/220:48:362
1942995116,29cyclictest19973-21ssh22:49:032
194199514,29cyclictest0-21swapper/118:54:591
194199514,29cyclictest0-21swapper/118:19:501
194199514,29cyclictest0-21swapper/118:15:021
194199514,27cyclictest0-21swapper/123:01:011
194199514,27cyclictest0-21swapper/119:34:241
194199514,27cyclictest0-21swapper/119:34:241
1941995121,14cyclictest0-21swapper/120:06:011
1941995119,14cyclictest0-21swapper/121:00:231
6012503,11sleep20-21swapper/223:08:522
1943995023,11cyclictest13136-21open_inodes18:05:003
1943995023,11cyclictest13136-21open_inodes18:05:003
194299508,34cyclictest27069-21crond19:44:232
194299504,40cyclictest0-21swapper/220:29:572
1942995037,8cyclictest281ktimersoftd/218:40:032
194299503,41cyclictest0-21swapper/220:51:442
194299503,41cyclictest0-21swapper/220:51:442
1942995023,22cyclictest0-21swapper/222:41:412
194199504,27cyclictest0-21swapper/117:49:511
1941995022,13cyclictest0-21swapper/118:10:021
194399496,36cyclictest0-21swapper/318:29:363
194399494,39cyclictest0-21swapper/319:04:413
194399494,29cyclictest0-21swapper/318:01:113
1943994927,17cyclictest0-21swapper/318:19:363
194299496,37cyclictest29-21ksoftirqd/222:58:092
194299495,37cyclictest0-21swapper/221:14:432
194299493,40cyclictest0-21swapper/219:01:332
194299493,39cyclictest0-21swapper/219:44:512
1942994922,21cyclictest0-21swapper/220:04:092
194199494,27cyclictest0-21swapper/119:39:371
88232482,9sleep20-21swapper/221:41:252
28702483,10sleep30-21swapper/318:50:233
220462482,10sleep20-21swapper/219:31:212
220462482,10sleep20-21swapper/219:31:212
194399486,25cyclictest0-21swapper/318:24:363
194399485,28cyclictest0-21swapper/317:46:093
194299485,26cyclictest0-21swapper/220:14:462
194299484,13cyclictest0-21swapper/221:21:382
194299483,39cyclictest0-21swapper/222:10:472
194299483,39cyclictest0-21swapper/218:14:542
52732472,38sleep20-21swapper/218:55:302
194399475,35cyclictest0-21swapper/319:29:343
194399475,35cyclictest0-21swapper/319:29:343
194399473,9cyclictest11450-21gltestperf19:09:443
194299478,32cyclictest281ktimersoftd/221:54:482
194299474,27cyclictest0-21swapper/221:29:392
194299473,37cyclictest0-21swapper/217:49:352
194199476,25cyclictest0-21swapper/118:06:121
194199476,25cyclictest0-21swapper/118:06:121
194399464,27cyclictest0-21swapper/318:11:543
185132463,10sleep30-21swapper/318:16:303
194399454,35cyclictest0-21swapper/318:59:443
194299454,35cyclictest0-21swapper/218:04:272
1942994530,9cyclictest17806-21aten2.4-expect19:24:342
1942994529,10cyclictest12716-21cut18:04:522
1942994529,10cyclictest12716-21cut18:04:522
194399443,26cyclictest0-21swapper/318:54:323
194299444,24cyclictest0-21swapper/218:29:452
194299443,34cyclictest0-21swapper/218:34:442
194199444,20cyclictest1914-21latency_hist17:44:281
1943994315,12cyclictest0-21swapper/317:54:353
194299434,34cyclictest0-21swapper/217:44:552
194399425,14cyclictest0-21swapper/318:44:363
194399425,14cyclictest0-21swapper/318:44:363
194299422,24cyclictest15358-21munin-node19:19:412
194399352,10cyclictest0-21swapper/317:44:273
1942993420,10cyclictest0-21swapper/217:44:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional