You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 01:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 29, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23573991054,94cyclictest19847-21fschecks_time21:28:411
23571991013,90cyclictest0-21swapper/019:53:410
2357199974,85cyclictest0-21swapper/022:48:350
2357399964,85cyclictest1656-21munin-node21:48:561
2357199964,85cyclictest0-21swapper/020:18:490
2357199964,85cyclictest0-21swapper/020:18:490
2357399954,84cyclictest0-21swapper/122:08:201
2357199955,84cyclictest0-21swapper/020:58:400
2357199955,84cyclictest0-21swapper/020:58:400
2357199955,83cyclictest6545-21grep18:14:020
2357199955,83cyclictest6545-21grep18:14:020
2357199955,83cyclictest0-21swapper/022:43:350
2357199954,85cyclictest0-21swapper/022:11:360
2357199954,84cyclictest0-21swapper/021:20:420
2357399944,82cyclictest7042-21df_abs21:58:371
2357499934,69cyclictest0-21swapper/219:54:532
2357399934,83cyclictest0-21swapper/122:09:131
2357399934,82cyclictest0-21swapper/121:19:211
2357199934,82cyclictest0-21swapper/019:52:300
2357199933,83cyclictest5931-21ssh21:08:330
2357199933,83cyclictest0-21swapper/022:18:310
2357199932,84cyclictest0-21swapper/020:55:220
23571999313,73cyclictest0-21swapper/022:23:380
23571999313,73cyclictest0-21swapper/022:23:380
2357499925,65cyclictest0-21swapper/221:07:082
2357499925,65cyclictest0-21swapper/221:07:082
2357499924,73cyclictest0-21swapper/220:15:382
2357499924,72cyclictest0-21swapper/221:11:402
2357499924,68cyclictest0-21swapper/220:53:392
23574999210,60cyclictest0-21swapper/222:28:342
23574999210,60cyclictest0-21swapper/222:28:342
2357399925,80cyclictest18827-21runrttasks22:16:141
2357399925,80cyclictest0-21swapper/120:38:451
2357399923,83cyclictest0-21swapper/120:01:131
2357399923,82cyclictest0-21swapper/121:58:111
2357399923,82cyclictest0-21swapper/120:25:271
2357199925,80cyclictest0-21swapper/023:08:470
2357199924,82cyclictest0-21swapper/021:53:480
2357199924,81cyclictest0-21swapper/022:58:390
2357199924,81cyclictest0-21swapper/021:38:500
2357199924,81cyclictest0-21swapper/021:07:370
2357199924,81cyclictest0-21swapper/021:07:370
2357499914,71cyclictest0-21swapper/218:23:582
2357499914,69cyclictest1227-21runrttasks22:37:332
2357499914,62cyclictest0-21swapper/221:27:242
2357399914,81cyclictest628-21runrttasks20:09:421
2357399914,80cyclictest31937-21crond21:48:211
2357399914,80cyclictest31937-21crond21:48:211
2357199914,81cyclictest18113-21grep22:13:540
2357199913,81cyclictest25010-21taskset21:36:580
2357199912,82cyclictest0-21swapper/020:13:490
2357499904,71cyclictest0-21swapper/220:45:272
2357499904,70cyclictest0-21swapper/222:14:262
2357399903,80cyclictest0-21swapper/120:17:031
2357399903,78cyclictest0-21swapper/120:20:411
2357399903,78cyclictest0-21swapper/120:20:411
2357199904,80cyclictest0-21swapper/021:43:490
2357199904,80cyclictest0-21swapper/021:43:490
2357199904,80cyclictest0-21swapper/018:48:430
2357199904,79cyclictest26047-21gltestperf17:48:500
2357199903,79cyclictest1227-21runrttasks17:43:440
2357199902,82cyclictest0-21swapper/020:38:520
2357499897,66cyclictest0-21swapper/221:30:322
2357499896,62cyclictest6766-21chrt22:47:592
2357499894,64cyclictest0-21swapper/222:04:422
2357399894,78cyclictest21138-21taskset22:18:491
2357399893,80cyclictest0-21swapper/119:52:021
2357399893,79cyclictest29428-21fschecks_time19:03:451
2357399893,79cyclictest0-21swapper/119:58:061
2357199895,77cyclictest0-21swapper/023:03:340
2357199894,79cyclictest27547-21cat20:03:260
2357199894,78cyclictest3569-21idleruntime-cro22:43:200
2357199894,78cyclictest0-21swapper/022:33:550
2357199894,77cyclictest622-21gltestperf21:48:410
2357199894,77cyclictest0-21swapper/020:23:390
2357199892,81cyclictest0-21swapper/022:53:410
2357199892,81cyclictest0-21swapper/021:27:310
2357499885,63cyclictest0-21swapper/221:51:012
2357499884,68cyclictest0-21swapper/221:55:092
2357499884,65cyclictest0-21swapper/219:28:412
2357499884,60cyclictest0-21swapper/222:58:322
2357399884,78cyclictest8960-21sed22:48:531
2357399884,78cyclictest0-21swapper/120:36:411
2357399884,77cyclictest0-21swapper/119:43:581
2357399883,79cyclictest0-21swapper/122:40:211
2357399883,79cyclictest0-21swapper/120:55:351
2357399883,78cyclictest1458-21munin-node19:13:421
2357399883,45cyclictest0-21swapper/122:33:201
2357399883,45cyclictest0-21swapper/122:33:201
2357199885,77cyclictest0-21swapper/020:35:050
2357199885,75cyclictest0-21swapper/018:03:300
2357199884,78cyclictest0-21swapper/020:03:580
2357199884,78cyclictest0-21swapper/019:44:330
2357199884,77cyclictest19375-21cpuspeed_turbos21:28:360
2357199884,47cyclictest8275-21grep21:58:550
2357199883,78cyclictest11245-21sshd21:14:400
2357499876,62cyclictest7121-21munin-node22:48:422
2357499874,75cyclictest0-21swapper/222:25:332
2357499874,75cyclictest0-21swapper/222:25:332
2357499874,66cyclictest0-21swapper/220:25:272
2357499874,65cyclictest0-21swapper/222:12:152
2357499873,67cyclictest18513-21switchtime23:03:502
2357399874,77cyclictest0-21swapper/122:24:411
2357399874,77cyclictest0-21swapper/122:24:411
2357399874,76cyclictest0-21swapper/120:48:391
2357399873,78cyclictest612-21gzip20:58:541
2357399873,78cyclictest612-21gzip20:58:541
2357399873,78cyclictest0-21swapper/122:45:201
2357199875,75cyclictest0-21swapper/022:03:340
2357199874,77cyclictest0-21swapper/018:55:450
2357199874,77cyclictest0-21swapper/018:55:450
2357199874,55cyclictest29931-21head19:03:520
2357199873,78cyclictest23223-21munin-node20:43:520
2357199873,77cyclictest14120-21diskmemload20:28:400
2357199872,78cyclictest0-21swapper/020:08:350
2357499865,61cyclictest0-21swapper/222:53:532
2357499864,72cyclictest18472-21sh19:48:462
2357499864,65cyclictest0-21swapper/220:33:332
2357499864,58cyclictest0-21swapper/220:20:082
2357499864,58cyclictest0-21swapper/220:20:082
2357399864,76cyclictest3258-21fschecks_count21:03:411
2357399864,76cyclictest3258-21fschecks_count21:03:411
2357399863,77cyclictest0-21swapper/121:42:431
2357399863,77cyclictest0-21swapper/120:43:431
2357399863,76cyclictest25453-21switchtime18:54:001
2357399863,76cyclictest25453-21switchtime18:54:001
2357399863,76cyclictest21293-21interrupts23:08:401
2357399863,76cyclictest0-21swapper/121:35:131
2357199864,71cyclictest0-21swapper/019:09:230
2357199863,77cyclictest0-21swapper/022:30:200
2357199863,77cyclictest0-21swapper/022:30:200
2357499858,64cyclictest24759-21sh19:58:412
2357499854,72cyclictest19686-21missed_timers20:38:502
2357499854,72cyclictest0-21swapper/221:41:522
2357499854,71cyclictest21547-21netstat23:08:442
2357499853,67cyclictest0-21swapper/221:13:452
2357499853,60cyclictest0-21swapper/220:08:432
2357499852,66cyclictest0-21swapper/220:30:052
2357399853,76cyclictest0-21swapper/117:58:531
2357399853,75cyclictest1227-21runrttasks21:25:511
23573998519,59cyclictest436-21vmstat19:09:011
2357199854,75cyclictest0-21swapper/018:23:580
2357199854,45cyclictest0-21swapper/018:03:420
2357499844,74cyclictest0-21swapper/220:06:362
2357499844,66cyclictest0-21swapper/221:48:052
2357499844,66cyclictest0-21swapper/221:48:052
2357499844,49cyclictest0-21swapper/218:08:522
2357499844,49cyclictest0-21swapper/218:08:522
2357499843,67cyclictest0-21swapper/219:44:022
2357399844,73cyclictest15184-21munin-node22:58:491
2357399843,75cyclictest0-21swapper/121:13:351
2357199844,74cyclictest0-21swapper/020:51:290
2357199843,74cyclictest0-21swapper/019:03:290
2357199843,51cyclictest4166-21grep18:09:030
2357199843,51cyclictest4166-21grep18:09:030
252642830,9sleep32357599cyclictest21:37:583
2357499834,59cyclictest0-21swapper/220:59:002
2357499834,59cyclictest0-21swapper/220:59:002
2357499834,55cyclictest0-21swapper/220:50:132
2357499834,48cyclictest0-21swapper/222:39:292
2357499833,59cyclictest0-21swapper/222:19:532
2357399834,72cyclictest0-21swapper/122:58:061
2357399834,71cyclictest23882-21aten_r1power_fr17:43:421
2357399833,74cyclictest0-21swapper/123:05:381
2357399833,74cyclictest0-21swapper/121:10:141
2357399833,74cyclictest0-21swapper/120:05:181
2357399833,74cyclictest0-21swapper/118:18:411
2357399833,44cyclictest0-21swapper/119:38:431
2357199834,73cyclictest0-21swapper/018:43:530
2357499824,70cyclictest0-21swapper/217:58:552
2357499824,69cyclictest0-21swapper/218:58:412
2357499824,67cyclictest0-21swapper/221:33:402
2357499824,63cyclictest0-21swapper/221:19:352
2357399824,72cyclictest0-21swapper/120:32:571
2357399824,71cyclictest0-21swapper/119:18:431
2357399823,73cyclictest0-21swapper/122:37:141
2357199824,72cyclictest0-21swapper/018:18:460
2357499814,44cyclictest0-21swapper/218:48:452
2357399814,70cyclictest20168-21munin-node18:43:501
2357399814,70cyclictest0-21swapper/118:39:171
2357399813,72cyclictest0-21swapper/119:29:051
2357399813,71cyclictest32405-21runrttasks18:03:421
2357199815,69cyclictest0-21swapper/019:33:520
2357199813,70cyclictest0-21swapper/018:29:150
2357199813,51cyclictest0-21swapper/018:39:180
2357499804,70cyclictest0-21swapper/221:59:032
2357499804,64cyclictest0-21swapper/217:43:492
2357399805,68cyclictest11364-21yum19:34:021
2357399804,69cyclictest0-21swapper/118:35:501
2357399803,71cyclictest0-21swapper/118:13:301
2357399803,71cyclictest0-21swapper/118:13:301
2357399803,63cyclictest4994-21runrttasks18:13:421
2357399803,63cyclictest4994-21runrttasks18:13:421
2357199803,71cyclictest0-21swapper/019:19:010
2357199803,70cyclictest0-21swapper/019:13:440
2357499794,66cyclictest24704-21fschecks_time18:53:472
2357499794,66cyclictest24704-21fschecks_time18:53:472
23574997912,49cyclictest107550irq/46-eth017:53:312
2357399794,68cyclictest26492-21head18:58:411
2357399793,70cyclictest0-21swapper/118:28:521
2357399793,70cyclictest0-21swapper/118:23:461
2357399793,69cyclictest0-21swapper/118:48:571
2357199794,69cyclictest14118-21latency_hist19:43:270
2357199792,71cyclictest0-21swapper/019:28:400
2357499784,67cyclictest0-21swapper/218:04:012
2357499784,66cyclictest0-21swapper/219:08:282
2357499783,51cyclictest2412-21telnet19:18:372
23574997813,49cyclictest0-21swapper/219:13:432
23574997810,49cyclictest0-21swapper/218:14:222
23574997810,49cyclictest0-21swapper/218:14:222
2357399784,68cyclictest0-21swapper/117:53:011
2357199783,64cyclictest23565-21cyclictest17:43:310
2357499774,58cyclictest0-21swapper/219:38:372
2357499773,8cyclictest6699-21yum-updatesd-he19:25:302
2357499773,54cyclictest0-21swapper/218:28:542
23574997723,37cyclictest0-21swapper/217:53:452
2357199773,69cyclictest0-21swapper/017:54:030
2357399764,66cyclictest0-21swapper/119:28:271
2357499754,64cyclictest0-21swapper/219:33:462
2357499754,64cyclictest0-21swapper/218:33:442
2357499753,65cyclictest0-21swapper/219:08:522
2357399754,64cyclictest0-21swapper/117:54:331
23571997522,47cyclictest5867-21latency19:23:500
2357199743,39cyclictest0-21swapper/018:33:520
2357399734,63cyclictest0-21swapper/117:43:321
2357499724,61cyclictest0-21swapper/218:43:452
23574997215,40cyclictest0-21swapper/218:20:182
2357499714,49cyclictest0-21swapper/218:38:462
2357499694,59cyclictest0-21swapper/217:43:322
219499630,6rtkit-daemon0-21swapper/220:33:573
23575995923,22cyclictest28603-21cpuspeed_turbos20:53:373
298372573,44sleep30-21swapper/319:03:523
23575995724,26cyclictest1227-21runrttasks20:50:213
310032562,47sleep30-21swapper/321:44:443
310032562,47sleep30-21swapper/321:44:443
2357599564,31cyclictest0-21swapper/319:33:443
2357599555,33cyclictest0-21swapper/319:21:443
2357599555,30cyclictest0-21swapper/319:48:263
2357599554,44cyclictest0-21swapper/320:04:383
2357599554,28cyclictest0-21swapper/321:20:313
23575995538,10cyclictest2326-21cpuspeed_turbos20:13:383
23575995521,12cyclictest11525-21yum-updatesd-he18:25:473
246852543,45sleep324690-21sh20:48:043
2357599549,12cyclictest0-21swapper/319:38:373
2357599544,25cyclictest0-21swapper/321:10:173
52662533,43sleep35355-21diskstats19:23:433
2357599534,30cyclictest0-21swapper/320:38:593
2357599534,22cyclictest0-21swapper/319:54:173
2357599534,12cyclictest10695-21python21:13:533
2357599534,11cyclictest0-21swapper/321:28:413
23575995336,10cyclictest30557-21cut17:58:483
23575995318,26cyclictest14641-21hwlatdetect22:58:403
191172533,43sleep319242-21timerwakeupswit19:48:583
2357599524,30cyclictest0-21swapper/322:08:343
2357599524,29cyclictest0-21swapper/317:53:313
2357599524,27cyclictest0-21swapper/321:23:423
23575995237,8cyclictest31867-21grep20:08:453
23575995235,10cyclictest2743-21cpuspeed_turbos18:08:433
23575995235,10cyclictest2743-21cpuspeed_turbos18:08:433
23575995234,11cyclictest3979-21perl21:53:403
2357599514,27cyclictest0-21swapper/320:58:433
2357599514,27cyclictest0-21swapper/320:58:433
23575995135,9cyclictest28389-21grep17:53:503
23575995133,11cyclictest764-21tail18:03:513
23575995123,10cyclictest26933-21netstat21:38:493
23575995121,12cyclictest0-21swapper/319:08:523
23575995121,11cyclictest10840-21yum-updatesd-he20:25:283
23575995119,14cyclictest0-21swapper/322:43:313
14392512,42sleep31565-21unixbench_multi21:48:553
92912503,40sleep30-21swapper/322:50:033
281892502,12sleep30-21swapper/318:59:413
2357599504,30cyclictest0-21swapper/320:18:393
2357599504,30cyclictest0-21swapper/320:18:393
2357599504,29cyclictest0-21swapper/318:53:473
2357599504,29cyclictest0-21swapper/318:53:473
2357599504,28cyclictest0-21swapper/320:33:253
2357599504,28cyclictest0-21swapper/319:59:013
2357599504,28cyclictest0-21swapper/319:28:533
2357599504,28cyclictest0-21swapper/318:19:023
2357599504,27cyclictest0-21swapper/322:58:203
23575995032,11cyclictest5663-21gltestperf18:13:483
23575995032,11cyclictest5663-21gltestperf18:13:483
2357599503,28cyclictest0-21swapper/322:33:473
23575995021,12cyclictest0-21swapper/322:23:483
23575995021,12cyclictest0-21swapper/322:23:483
23575995021,12cyclictest0-21swapper/321:58:323
225912502,12sleep30-21swapper/323:10:433
2357599495,26cyclictest0-21swapper/321:03:263
2357599495,26cyclictest0-21swapper/321:03:263
2357599494,28cyclictest0-21swapper/323:03:453
2357599494,28cyclictest0-21swapper/318:33:483
2357599494,27cyclictest0-21swapper/318:38:433
2357599494,26cyclictest0-21swapper/322:13:463
2357599493,28cyclictest27557-21ntp_offset22:28:473
2357599493,28cyclictest27557-21ntp_offset22:28:473
23575994919,12cyclictest0-21swapper/322:05:003
23575994919,12cyclictest0-21swapper/318:48:473
2357599484,26cyclictest0-21swapper/322:43:173
2357599484,24cyclictest19730-21sh22:18:313
23575994818,14cyclictest0-21swapper/317:45:133
2357599474,26cyclictest0-21swapper/319:15:283
139452472,38sleep30-21swapper/318:30:553
2357599464,24cyclictest0-21swapper/318:45:233
232112414,30sleep30-21swapper/317:39:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional