You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 05:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Sep 13, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2945721110,5chrt29453-21tr20:04:343
126469910242,11cyclictest1287-21telnet21:49:261
126469910041,14cyclictest0-21swapper/121:57:211
1264699975,29cyclictest1227-21runrttasks19:33:361
12646999743,13cyclictest0-21swapper/122:44:331
12646999737,8cyclictest32126-21munin-run20:09:191
12646999638,13cyclictest0-21swapper/121:14:501
12646999638,10cyclictest5384-21diskmemload19:49:481
14952950,8sleep31500-21cpuspeed_turbos21:49:283
12646999437,11cyclictest9675-21yum-updatesd-he21:11:581
12646999435,14cyclictest0-21swapper/119:45:261
1264699925,30cyclictest1227-21runrttasks21:22:291
12648999141,43cyclictest0-21swapper/319:44:493
12643999119,55cyclictest0-21swapper/021:24:120
133582900,6sleep013361-21tail20:29:300
1264399893,65cyclictest21022-21munin-node22:19:270
1264399893,65cyclictest21022-21munin-node22:19:270
12646998838,13cyclictest0-21swapper/119:34:551
1264399885,74cyclictest0-21swapper/020:04:540
1264399883,78cyclictest5081munin-node20:59:440
1264399883,78cyclictest5081munin-node20:59:440
1264399883,78cyclictest27629-21munin-node22:29:380
1264399883,69cyclictest5384-21diskmemload21:26:070
1264399883,65cyclictest0-21swapper/019:49:390
1264899874,12cyclictest0-21swapper/319:54:333
1264899873,76cyclictest0-21swapper/321:28:513
1264399874,66cyclictest0-21swapper/021:12:090
1264399873,76cyclictest0-21swapper/020:55:140
1264399873,76cyclictest0-21swapper/020:24:330
1264399873,64cyclictest0-21swapper/022:38:440
1264399872,69cyclictest32398-21ssh20:09:310
1264899864,12cyclictest0-21swapper/318:29:233
12648998634,45cyclictest0-21swapper/320:54:423
12648998627,9cyclictest26635-21gltestperf19:59:373
12648998618,10cyclictest32041-21aten_r1power_fr18:09:363
1264399867,66cyclictest0-21swapper/022:01:200
1264399864,75cyclictest0-21swapper/021:49:410
1264399864,75cyclictest0-21swapper/021:43:490
1264399864,75cyclictest0-21swapper/021:43:490
1264399864,74cyclictest0-21swapper/021:44:520
1264399864,74cyclictest0-21swapper/019:59:430
1264399864,74cyclictest0-21swapper/019:09:550
1264399863,74cyclictest6498-21ntp_offset22:44:410
1264399863,66cyclictest0-21swapper/022:14:430
1264399863,66cyclictest0-21swapper/022:14:430
1264399863,64cyclictest0-21swapper/019:39:580
1264399863,64cyclictest0-21swapper/019:39:580
1264399862,75cyclictest0-21swapper/022:40:520
1264899854,35cyclictest0-21swapper/320:49:503
12648998526,9cyclictest23603-21ssh22:22:293
12648998526,9cyclictest23603-21ssh22:22:293
12648998525,14cyclictest0-21swapper/320:11:203
1264399855,46cyclictest0-21swapper/020:19:260
1264399855,46cyclictest0-21swapper/020:19:260
1264399854,73cyclictest0-21swapper/019:34:500
1264399853,74cyclictest0-21swapper/021:06:270
1264399853,68cyclictest26814-21cstates20:49:320
1264399853,64cyclictest11174-21head22:04:260
1264899844,38cyclictest0-21swapper/320:48:033
1264899844,12cyclictest0-21swapper/320:24:183
1264899844,12cyclictest0-21swapper/320:24:183
12648998438,38cyclictest0-21swapper/320:14:393
12646998437,13cyclictest0-21swapper/119:43:131
12646998437,13cyclictest0-21swapper/119:43:131
1264399844,73cyclictest0-21swapper/019:59:030
1264399844,72cyclictest0-21swapper/020:39:350
1264399844,72cyclictest0-21swapper/020:19:190
1264399844,72cyclictest0-21swapper/019:44:460
1264399843,74cyclictest0-21swapper/022:49:550
1264399843,73cyclictest967-21chrt18:09:550
1264399843,63cyclictest1124-21snmpd21:54:400
1264899834,34cyclictest0-21swapper/322:29:303
1264899834,13cyclictest0-21swapper/320:24:303
1264899833,34cyclictest0-21swapper/321:34:423
1264399836,70cyclictest0-21swapper/022:54:230
1264399835,70cyclictest0-21swapper/020:36:090
1264399833,65cyclictest0-21swapper/017:31:190
1264399833,65cyclictest0-21swapper/017:31:190
1264399833,64cyclictest0-21swapper/022:27:590
1264399833,63cyclictest0-21swapper/020:49:160
1264899824,29cyclictest20177-21cpuspeed_turbos20:39:313
12648998231,11cyclictest22020-21gltestperf18:54:423
1264899823,70cyclictest0-21swapper/319:34:463
1264899823,34cyclictest0-21swapper/322:47:263
1264899823,33cyclictest11778-21missed_timers21:14:453
1264899823,30cyclictest19539-21fschecks_time18:49:413
12648998225,12cyclictest0-21swapper/322:14:273
12648998225,12cyclictest0-21swapper/322:14:273
12648998225,10cyclictest5782-21proc_pri18:19:503
1264399824,71cyclictest0-21swapper/018:39:550
1264399824,71cyclictest0-21swapper/018:14:440
1264399824,71cyclictest0-21swapper/018:14:440
1264399824,61cyclictest0-21swapper/019:33:220
1264399824,48cyclictest0-21swapper/022:12:230
1264399823,72cyclictest19576-21tune2fs18:49:410
1264899815,34cyclictest0-21swapper/321:59:293
1264899814,31cyclictest0-21swapper/318:04:373
12648998131,8cyclictest14516-21cut20:29:443
1264899813,25cyclictest0-21swapper/321:13:083
12648998126,11cyclictest0-21swapper/322:56:073
1264399814,70cyclictest0-21swapper/021:14:320
1264399814,58cyclictest0-21swapper/021:29:420
1264399813,60cyclictest0-21swapper/021:34:470
1264899805,31cyclictest24882-21head17:54:353
1264899803,34cyclictest0-21swapper/321:03:003
1264899803,34cyclictest0-21swapper/321:03:003
1264899803,33cyclictest0-21swapper/318:44:423
12648998029,8cyclictest20765-21cpuspeed_turbos21:29:323
1264399804,69cyclictest0-21swapper/017:59:430
1264399803,61cyclictest0-21swapper/018:29:350
1264899794,30cyclictest13747-21open_files19:39:493
1264899794,30cyclictest13747-21open_files19:39:493
1264899793,37cyclictest0-21swapper/322:39:343
1264399794,68cyclictest0-21swapper/017:39:580
1264399794,59cyclictest0-21swapper/017:44:490
1264899784,33cyclictest14948-21ssh21:19:403
1264399783,68cyclictest11773-21aten_r1power_vo18:34:370
1264399783,67cyclictest0-21swapper/017:34:450
1264899773,9cyclictest27325-21cpuspeed_turbos21:39:273
1264899773,9cyclictest27325-21cpuspeed_turbos21:39:273
1264899773,26cyclictest20208-21if_eth019:49:453
12648997724,9cyclictest26298-21cpuspeed_turbos19:04:373
12648997722,12cyclictest0-21swapper/321:56:373
12648997721,8cyclictest1486-21crond22:39:133
12646997747,14cyclictest0-21swapper/122:39:281
1264399773,68cyclictest0-21swapper/018:23:460
1264399773,59cyclictest0-21swapper/017:54:340
1264399773,57cyclictest0-21swapper/018:59:400
1264399773,57cyclictest0-21swapper/018:59:400
1264899763,32cyclictest11383-21crond18:34:233
12648997625,13cyclictest0-21swapper/320:36:293
12648997624,12cyclictest0-21swapper/317:49:523
1264399763,66cyclictest21436-21cpuspeed_turbos18:54:370
1264399763,59cyclictest0-21swapper/019:26:450
1264899755,32cyclictest0-21swapper/321:06:373
12648997544,26cyclictest0-21swapper/322:04:443
1264899754,12cyclictest0-21swapper/317:34:253
1264899754,12cyclictest0-21swapper/317:34:253
12648997517,9cyclictest20047-21telnet17:44:383
12646997547,10cyclictest7017-21cut20:19:331
12646997547,10cyclictest7017-21cut20:19:331
1264399754,64cyclictest7871-21irqstats18:24:460
1264399754,64cyclictest0-21swapper/019:04:460
1264399753,59cyclictest0-21swapper/019:21:440
1264899747,19cyclictest0-21swapper/322:26:553
1264399743,52cyclictest0-21swapper/018:08:490
1264899736,29cyclictest0-21swapper/319:24:453
12648997331,11cyclictest0-21swapper/319:29:553
12648997320,7cyclictest14444-21ssh22:09:233
12646997343,12cyclictest0-21swapper/118:19:341
1264399723,56cyclictest0-21swapper/019:14:510
1264399713,57cyclictest0-21swapper/018:44:350
1264399713,56cyclictest0-21swapper/017:49:370
1264899703,13cyclictest0-21swapper/319:14:213
12648996922,7cyclictest30890-21ssh21:44:313
1264799687,54cyclictest0-21swapper/220:54:292
1264399674,54cyclictest12642-21awk17:29:250
1264799664,55cyclictest0-21swapper/222:24:462
12647996614,45cyclictest22316-21cat18:54:472
12648996527,10cyclictest0-21swapper/317:34:413
1264799655,54cyclictest0-21swapper/220:45:422
1264799655,54cyclictest0-21swapper/218:24:232
12647996521,28cyclictest0-21swapper/220:08:452
76242640,7sleep226-21rcuc/221:59:142
1264799644,13cyclictest0-21swapper/221:24:462
1264799643,11cyclictest13393-21aten_r1power_po20:29:312
219499630,4rtkit-daemon2193-21rtkit-daemon22:54:362
219499630,4rtkit-daemon2193-21rtkit-daemon22:50:442
1264799636,49cyclictest0-21swapper/222:19:462
1264799636,49cyclictest0-21swapper/222:19:462
1264799635,51cyclictest0-21swapper/221:39:502
1264799635,51cyclictest0-21swapper/221:39:502
1264799635,49cyclictest12481-21ntp_states22:04:422
1264799634,52cyclictest0-21swapper/220:09:352
1264799632,20cyclictest0-21swapper/222:40:022
1264799625,50cyclictest0-21swapper/222:34:472
1264799623,39cyclictest5326-21taskset20:15:092
1264799614,51cyclictest0-21swapper/221:44:392
1264799614,51cyclictest0-21swapper/221:33:562
1264799614,51cyclictest0-21swapper/221:15:352
1264799614,51cyclictest0-21swapper/221:03:112
1264799614,51cyclictest0-21swapper/221:03:112
1264799614,51cyclictest0-21swapper/220:39:402
1264799614,50cyclictest0-21swapper/219:44:452
1264799614,13cyclictest0-21swapper/222:19:072
1264799614,13cyclictest0-21swapper/222:19:072
1264799613,50cyclictest27626-21grep19:59:522
12647996117,27cyclictest0-21swapper/221:10:282
12647996114,32cyclictest0-21swapper/221:36:152
1264799605,13cyclictest0-21swapper/221:19:272
1264799604,49cyclictest0-21swapper/218:29:232
1264799604,38cyclictest0-21swapper/220:52:462
1264799604,11cyclictest0-21swapper/220:34:432
310612583,49sleep131191-21cat22:34:301
1264799584,12cyclictest0-21swapper/221:59:312
1264799584,10cyclictest24367-21grep19:54:552
1264799583,49cyclictest0-21swapper/219:31:442
12647995810,41cyclictest0-21swapper/221:54:152
1264699585,28cyclictest0-21swapper/120:49:461
12646995846,7cyclictest201ktimersoftd/121:29:521
1264799578,31cyclictest0-21swapper/219:39:202
1264799574,46cyclictest0-21swapper/218:04:572
1264799573,48cyclictest5720-21unixbench-2d21:04:522
1264699574,45cyclictest0-21swapper/121:03:011
1264699574,45cyclictest0-21swapper/121:03:011
219499560,5rtkit-daemon2193-21rtkit-daemon22:44:372
1264799566,43cyclictest1124-21snmpd19:52:452
1264799564,46cyclictest0-21swapper/222:10:582
1264699565,28cyclictest1227-21runrttasks22:23:321
1264699565,28cyclictest1227-21runrttasks22:23:321
12646995640,9cyclictest18093-21tr22:14:291
12646995640,9cyclictest18093-21tr22:14:291
12646995638,11cyclictest0-21swapper/119:04:531
12646995637,10cyclictest16277-21ssh20:34:181
12646995635,13cyclictest0-21swapper/121:06:411
285512552,11sleep10-21swapper/120:03:161
278742554,12sleep20-21swapper/219:06:372
1264799554,45cyclictest0-21swapper/219:40:522
1264799554,45cyclictest0-21swapper/219:40:522
1264799553,45cyclictest25817-21kernelversion17:54:462
1264799553,13cyclictest0-21swapper/220:29:132
12647995514,35cyclictest29005-21munin-node22:29:472
1264699554,44cyclictest0-21swapper/120:14:301
1264699554,16cyclictest0-21swapper/122:02:191
12646995536,12cyclictest0-21swapper/120:58:091
12646995535,13cyclictest0-21swapper/119:56:511
12646995533,15cyclictest0-21swapper/120:44:051
12646995520,15cyclictest0-21swapper/118:44:391
252342543,43sleep10-21swapper/120:45:451
219499540,5rtkit-daemon2193-21rtkit-daemon18:34:393
12648995435,12cyclictest0-21swapper/322:49:513
1264699544,16cyclictest0-21swapper/120:26:571
1264699544,13cyclictest0-21swapper/121:34:361
12646995437,10cyclictest17487-21taskset21:24:301
12646995435,13cyclictest0-21swapper/122:05:231
12646995434,12cyclictest0-21swapper/121:39:421
12646995434,12cyclictest0-21swapper/121:39:421
12646995431,14cyclictest0-21swapper/117:54:351
12646995423,11cyclictest5384-21diskmemload22:54:121
307192532,44sleep130813-21sh19:14:341
219499530,5rtkit-daemon2193-21rtkit-daemon19:04:232
1264899534,41cyclictest0-21swapper/319:04:213
1264899534,41cyclictest0-21swapper/319:04:213
1264799534,42cyclictest0-21swapper/217:44:482
1264799534,22cyclictest0-21swapper/217:49:432
1264799534,10cyclictest12890-21aten2.4-expect17:29:382
1264799534,10cyclictest12890-21aten2.4-expect17:29:382
1264799533,22cyclictest0-21swapper/219:19:372
1264699535,29cyclictest0-21swapper/122:54:571
1264699535,29cyclictest0-21swapper/118:14:461
1264699535,29cyclictest0-21swapper/118:14:461
1264699535,29cyclictest0-21swapper/117:59:431
1264699534,30cyclictest0-21swapper/118:54:381
1264699534,30cyclictest0-21swapper/117:49:501
1264699534,30cyclictest0-21swapper/117:34:501
12646995337,8cyclictest16839-21yum-updatesd-he22:12:101
12646995335,12cyclictest0-21swapper/122:26:451
12646995334,13cyclictest0-21swapper/122:31:571
12646995333,10cyclictest22164-21crond17:49:251
12646995322,12cyclictest30201-21cut18:04:431
12646995321,14cyclictest0-21swapper/120:10:191
199432520,5sleep226-21rcuc/217:44:262
1264799525,28cyclictest0-21swapper/218:44:362
12647995222,25cyclictest0-21swapper/220:23:122
12647995222,25cyclictest0-21swapper/220:23:122
12647995220,12cyclictest0-21swapper/219:09:342
12647995218,12cyclictest0-21swapper/218:44:232
1264699525,29cyclictest0-21swapper/121:45:291
1264699525,27cyclictest0-21swapper/120:34:201
1264699524,28cyclictest0-21swapper/117:44:251
12646995220,14cyclictest0-21swapper/119:24:441
28672512,10sleep10-21swapper/119:22:521
206912512,10sleep10-21swapper/118:51:161
1264799517,27cyclictest0-21swapper/218:29:562
1264799515,27cyclictest0-21swapper/218:39:222
1264799514,28cyclictest0-21swapper/219:14:362
1264799514,28cyclictest0-21swapper/218:14:492
1264799514,28cyclictest0-21swapper/218:14:492
1264799514,28cyclictest0-21swapper/217:34:582
1264799512,10cyclictest0-21swapper/219:25:462
12647995119,14cyclictest0-21swapper/218:59:442
1264699514,28cyclictest0-21swapper/118:39:381
219499500,5rtkit-daemon2193-21rtkit-daemon18:00:033
1264799503,33cyclictest0-21swapper/218:49:392
12647995022,13cyclictest0-21swapper/218:09:372
1264699504,28cyclictest0-21swapper/119:11:431
12646995030,12cyclictest327-21gltestperf18:09:441
12646995029,13cyclictest0-21swapper/118:34:461
12648994934,10cyclictest0-21swapper/318:14:383
12648994934,10cyclictest0-21swapper/318:14:383
12648994931,13cyclictest0-21swapper/317:39:403
1264799494,26cyclictest0-21swapper/217:59:362
1264699495,24cyclictest0-21swapper/118:59:321
1264699495,24cyclictest0-21swapper/118:59:321
1264699494,27cyclictest0-21swapper/118:31:351
1264699494,26cyclictest0-21swapper/118:24:391
12646994915,15cyclictest0-21swapper/117:29:551
12646994915,15cyclictest0-21swapper/117:29:551
12648994830,13cyclictest0-21swapper/319:14:503
1264899444,33cyclictest0-21swapper/318:39:383
12647994316,7cyclictest12620-21latency_hist17:29:262
1264899413,32cyclictest0-21swapper/319:19:343
124082414,30sleep10-21swapper/117:26:491
1264899394,31cyclictest0-21swapper/317:29:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional