You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 23:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Sep 07, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
848221050,12sleep21869699cyclictest09:05:012
1869199985,40cyclictest0-21swapper/010:49:230
1869199984,27cyclictest0-21swapper/009:14:510
1869199964,22cyclictest11438-21diskmemload09:05:090
1869199954,25cyclictest0-21swapper/009:49:400
1869199954,24cyclictest0-21swapper/010:02:220
1869699943,85cyclictest0-21swapper/209:54:202
1869699934,80cyclictest1124-21snmpd09:18:012
1869699933,83cyclictest0-21swapper/209:57:312
1869599934,7cyclictest107550irq/46-eth009:24:571
1869199934,27cyclictest0-21swapper/009:44:500
1869199934,23cyclictest22518-21ssh07:49:490
18691999317,13cyclictest0-21swapper/010:09:380
1869199928,25cyclictest0-21swapper/008:54:430
1869199925,14cyclictest0-21swapper/010:54:370
1869199924,24cyclictest0-21swapper/008:36:210
1869199923,24cyclictest0-21swapper/010:50:200
18696999112,60cyclictest0-21swapper/209:34:582
1869199917,77cyclictest11438-21diskmemload09:13:000
1869199917,19cyclictest23462-1kworker/0:1H06:04:340
1869199916,15cyclictest0-21swapper/010:19:480
1869199914,26cyclictest0-21swapper/009:19:520
1869199914,24cyclictest0-21swapper/008:29:520
1869199914,23cyclictest0-21swapper/008:06:450
1869199914,23cyclictest0-21swapper/008:06:450
1869199914,22cyclictest27623-21sshd10:24:410
1869199914,11cyclictest0-21swapper/007:04:590
18691999124,12cyclictest0-21swapper/006:19:580
18691999116,9cyclictest11438-21diskmemload08:14:510
18691999116,12cyclictest0-21swapper/006:15:000
18691999116,11cyclictest0-21swapper/008:11:190
1869699904,79cyclictest6987-21chrt10:41:512
1869699904,78cyclictest0-21swapper/208:10:032
1869599904,67cyclictest0-21swapper/108:44:391
1869599904,67cyclictest0-21swapper/108:44:391
1869599903,21cyclictest0-21swapper/110:08:201
18695999025,48cyclictest3365-21munin-node08:59:591
18695999022,49cyclictest1227-21runrttasks09:37:531
18695999021,51cyclictest0-21swapper/108:08:041
18695999021,51cyclictest0-21swapper/108:08:041
1869199904,26cyclictest0-21swapper/008:59:390
1869199904,26cyclictest0-21swapper/008:40:530
1869199903,25cyclictest0-21swapper/009:37:210
1869199903,24cyclictest1124-21snmpd07:14:510
18691999028,13cyclictest0-21swapper/010:29:550
18691999024,11cyclictest15514-21sshd07:39:470
18691999014,9cyclictest0-21swapper/007:44:470
1869699895,65cyclictest9055-21latency_hist08:19:302
1869599896,65cyclictest0-21swapper/109:17:001
1869599893,23cyclictest0-21swapper/108:55:001
1869199899,9cyclictest20707-21grep09:24:460
1869199895,26cyclictest0-21swapper/008:22:140
1869199895,12cyclictest11438-21diskmemload08:49:460
1869199895,10cyclictest1227-21runrttasks10:43:060
1869199894,16cyclictest0-21swapper/008:24:470
1869199893,26cyclictest0-21swapper/008:47:440
1869199893,26cyclictest0-21swapper/008:47:440
1869199893,20cyclictest25513-21ssh09:32:010
1869199893,20cyclictest25513-21ssh09:32:010
18691998921,9cyclictest28444-21ssh07:59:400
18691998921,9cyclictest28444-21ssh07:59:400
18691998917,64cyclictest0-21swapper/010:14:520
18691998917,64cyclictest0-21swapper/010:14:520
1869699886,75cyclictest0-21swapper/208:30:042
1869699884,78cyclictest0-21swapper/209:40:102
1869699884,78cyclictest0-21swapper/207:38:012
1869699884,77cyclictest15659-21crond08:29:282
1869699884,70cyclictest0-21swapper/210:54:412
1869699884,68cyclictest0-21swapper/210:17:442
1869699884,68cyclictest0-21swapper/210:17:442
1869699883,66cyclictest0-21swapper/210:01:102
1869599883,21cyclictest0-21swapper/110:49:441
18695998821,50cyclictest1124-21snmpd08:17:531
1869199885,27cyclictest0-21swapper/011:02:200
1869199884,25cyclictest0-21swapper/007:54:470
1869199884,24cyclictest0-21swapper/010:38:420
1869199884,24cyclictest0-21swapper/009:57:520
1869199884,11cyclictest0-21swapper/007:24:320
1869199884,11cyclictest0-21swapper/007:24:320
18691998812,13cyclictest11438-21diskmemload09:39:480
1869699875,67cyclictest0-21swapper/209:45:462
1869699875,65cyclictest0-21swapper/208:54:582
1869699875,63cyclictest0-21swapper/208:44:502
1869699875,63cyclictest0-21swapper/208:44:502
1869699875,61cyclictest0-21swapper/210:44:562
1869699875,49cyclictest0-21swapper/208:39:172
1869699874,77cyclictest0-21swapper/210:54:072
1869699874,53cyclictest0-21swapper/209:30:122
1869699874,53cyclictest0-21swapper/209:30:122
18696998722,44cyclictest876-21ssh10:34:202
1869599874,65cyclictest0-21swapper/106:00:001
1869599873,22cyclictest0-21swapper/108:02:131
1869599873,22cyclictest0-21swapper/108:02:131
1869599873,19cyclictest0-21swapper/110:55:001
18695998721,48cyclictest23236-21fschecks_time08:39:451
18695998720,49cyclictest0-21swapper/108:26:181
1869199873,22cyclictest0-21swapper/007:34:360
18691998727,18cyclictest16160-21gltestperf06:34:520
18691998727,18cyclictest16160-21gltestperf06:34:520
18691998726,11cyclictest1227-21runrttasks10:04:500
1869699866,62cyclictest0-21swapper/205:42:292
1869699865,75cyclictest0-21swapper/208:03:402
1869699865,75cyclictest0-21swapper/208:03:402
1869699863,73cyclictest0-21swapper/208:23:282
18695998631,38cyclictest1124-21snmpd08:20:491
1869599863,61cyclictest0-21swapper/107:44:501
1869599863,22cyclictest0-21swapper/108:09:561
1869599863,20cyclictest0-21swapper/108:53:421
1869599863,20cyclictest0-21swapper/107:55:421
18695998615,54cyclictest0-21swapper/109:44:441
18695998613,12cyclictest0-21swapper/110:59:511
18695998610,8cyclictest0-21swapper/109:59:431
1869699855,74cyclictest0-21swapper/209:00:242
1869699854,75cyclictest0-21swapper/210:24:552
1869699854,74cyclictest20161-21grep09:24:402
1869699854,63cyclictest26048-21cut07:54:502
1869699854,63cyclictest0-21swapper/207:27:442
1869699853,8cyclictest107550irq/46-eth009:14:272
1869699853,77cyclictest0-21swapper/207:50:522
1869699853,63cyclictest0-21swapper/206:09:292
1869599853,22cyclictest0-21swapper/108:38:481
1869599853,21cyclictest0-21swapper/110:23:401
18695998522,47cyclictest0-21swapper/106:14:341
18695998522,41cyclictest17192-21ssh07:41:321
18695998521,48cyclictest19495-21diskstats05:34:531
18695998516,51cyclictest0-21swapper/109:09:311
18695998512,11cyclictest0-21swapper/109:52:071
18695998511,13cyclictest0-21swapper/109:54:461
18695998511,12cyclictest0-21swapper/110:28:011
1869199855,26cyclictest0-21swapper/005:37:280
1869199854,27cyclictest0-21swapper/005:54:500
18691998513,13cyclictest0-21swapper/007:25:040
1869699846,61cyclictest0-21swapper/207:29:432
1869699844,74cyclictest0-21swapper/210:04:452
1869699844,74cyclictest0-21swapper/209:19:472
1869699844,72cyclictest18523-21rm07:44:442
1869699844,72cyclictest0-21swapper/208:04:582
1869699844,72cyclictest0-21swapper/208:04:582
1869699844,62cyclictest0-21swapper/210:09:332
1869699843,60cyclictest18152-21cstates10:59:372
1869599843,66cyclictest0-21swapper/107:37:461
1869599843,22cyclictest0-21swapper/109:21:171
18695998429,41cyclictest8007-21memory07:24:541
18695998423,47cyclictest0-21swapper/105:59:351
18695998421,46cyclictest0-21swapper/105:44:351
18695998419,44cyclictest0-21swapper/110:34:501
18695998415,50cyclictest0-21swapper/110:29:281
18695998415,49cyclictest0-21swapper/110:42:121
18695998412,11cyclictest0-21swapper/110:14:441
18695998412,11cyclictest0-21swapper/110:14:441
1869199844,25cyclictest0-21swapper/006:54:570
1869199844,23cyclictest1227-21runrttasks07:03:580
1869199844,10cyclictest23846-21tail05:44:490
18691998414,13cyclictest0-21swapper/005:49:480
18691998414,13cyclictest0-21swapper/005:49:480
1869699835,64cyclictest0-21swapper/208:51:532
1869699835,57cyclictest0-21swapper/210:22:012
1869699834,63cyclictest0-21swapper/210:36:552
1869599833,74cyclictest0-21swapper/108:29:491
1869599833,25cyclictest0-21swapper/107:54:281
1869599833,22cyclictest9635-21cat10:44:561
1869599833,21cyclictest11438-21diskmemload09:41:061
18695998323,45cyclictest0-21swapper/107:08:101
1869199838,21cyclictest107550irq/46-eth006:39:570
18691998331,9cyclictest11330-21gltestperf06:24:500
219499820,5rtkit-daemon2193-21rtkit-daemon09:16:143
1869699824,71cyclictest4250-21latency_hist07:19:322
1869699823,72cyclictest3666-21cpuspeed_turbos06:09:482
1869699823,72cyclictest0-21swapper/206:29:442
18696998215,48cyclictest0-21swapper/208:39:492
18696998210,55cyclictest0-21swapper/207:41:372
1869599823,71cyclictest17437-21latency_hist06:39:341
1869599823,71cyclictest17437-21latency_hist06:39:341
1869599823,21cyclictest0-21swapper/109:06:231
18695998228,48cyclictest32264-21cpuspeed_turbos07:09:451
1869199822,26cyclictest0-21swapper/007:14:320
18691998216,12cyclictest0-21swapper/006:09:470
1869699815,59cyclictest0-21swapper/205:45:552
1869699814,71cyclictest0-21swapper/205:50:032
1869699814,71cyclictest0-21swapper/205:50:032
1869699814,70cyclictest0-21swapper/206:19:332
1869699813,72cyclictest0-21swapper/207:09:482
1869699813,71cyclictest18422-21fschecks_time06:39:512
18695998127,38cyclictest25419-21ssh09:31:391
18695998127,38cyclictest25419-21ssh09:31:391
18695998122,40cyclictest20106-21ssh10:14:091
18691998114,12cyclictest0-21swapper/006:49:450
1869699805,69cyclictest0-21swapper/206:45:002
1869699804,59cyclictest9298-21missed_timers06:19:582
1869699803,71cyclictest10519-21aten_r1power_cu06:24:432
1869599803,70cyclictest9280-21munin-node07:29:591
18695998020,45cyclictest0-21swapper/105:44:541
18697997926,46cyclictest0-21swapper/307:56:153
1869699795,67cyclictest0-21swapper/207:05:002
1869699795,47cyclictest0-21swapper/205:54:522
18695997920,44cyclictest0-21swapper/106:54:371
1869199794,24cyclictest0-21swapper/006:04:460
1869199794,15cyclictest0-21swapper/006:29:460
18697997829,41cyclictest6654-21idleruntime-cro07:24:313
18697997829,41cyclictest6654-21idleruntime-cro07:24:313
1869699784,69cyclictest0-21swapper/207:20:002
1869699784,69cyclictest0-21swapper/207:20:002
1869699784,57cyclictest0-21swapper/206:04:352
1869699784,56cyclictest0-21swapper/206:52:392
18691997816,13cyclictest0-21swapper/006:44:550
18697997727,42cyclictest2734-21munin-node08:09:493
1869699774,64cyclictest19581-21cut05:34:542
18695997728,43cyclictest9312-21needreboot06:19:581
18695997721,48cyclictest6319-21forks06:14:511
18691997720,12cyclictest0-21swapper/007:29:480
18697997631,38cyclictest29949-21python08:00:003
18697997631,38cyclictest29949-21python08:00:003
18697997631,12cyclictest15606-21fschecks_time07:39:483
18697997630,39cyclictest11340-21runrttasks09:09:553
18697997626,44cyclictest0-21swapper/308:58:033
1869599763,9cyclictest26649-21diskstats05:49:511
1869599763,9cyclictest26649-21diskstats05:49:511
1869599763,66cyclictest5512-21iostat_ios07:19:521
1869599763,66cyclictest5512-21iostat_ios07:19:521
18695997620,48cyclictest20397-21cut06:44:461
1869599762,67cyclictest11841-21ps06:24:591
18695997619,51cyclictest14118-21netstat06:29:581
18697997532,36cyclictest31856-21rm09:41:063
18697997530,38cyclictest1227-21runrttasks09:04:063
18697997530,30cyclictest13592-21ssh07:35:283
18697997520,48cyclictest60281munin-node08:14:593
18697997520,47cyclictest0-21swapper/310:35:263
1869699754,45cyclictest16007-21perl06:34:512
1869699754,45cyclictest16007-21perl06:34:512
1869699753,65cyclictest24938-21aten_r1power_po06:54:442
18695997512,11cyclictest0-21swapper/106:04:461
18697997432,35cyclictest13367-21runrttasks10:51:073
18697997425,41cyclictest19836-21munin-run06:44:333
1869599743,65cyclictest1124-21snmpd06:42:391
1869599743,22cyclictest24657-21cat06:54:331
18695997423,45cyclictest27316-21aten_r1power_po06:59:441
18697997334,12cyclictest491-21runrttasks06:04:083
18697997327,39cyclictest30720-21ls10:29:393
18697997322,44cyclictest0-21swapper/308:50:093
18697997321,46cyclictest0-21swapper/308:25:503
1869699734,48cyclictest0-21swapper/207:00:212
18695997321,45cyclictest2114-21telnet07:14:441
18697997232,34cyclictest18811-21taskset09:21:363
18697997231,34cyclictest6926-21munin-node09:04:423
18697997231,34cyclictest1227-21runrttasks09:55:373
18697997231,34cyclictest1227-21runrttasks09:50:463
18697997230,36cyclictest15369-21sed10:54:413
18697997227,39cyclictest0-21swapper/309:34:493
18697997220,45cyclictest23252-21aten_r1power_po09:29:393
18697997220,45cyclictest23252-21aten_r1power_po09:29:393
18697997132,32cyclictest1227-21runrttasks07:19:003
18697997129,35cyclictest20299-21iostat_ios08:34:523
18697997127,36cyclictest14088-21munin-node10:04:383
18697997121,15cyclictest0-21swapper/308:33:113
18695997113,7cyclictest0-21swapper/105:34:361
18697997030,33cyclictest5343-21ssh10:39:423
18697997030,32cyclictest20256-21df09:24:413
18697997029,12cyclictest10791-21sort09:59:373
18697997023,38cyclictest4238-21awk06:09:543
18697997023,17cyclictest0-21swapper/310:19:073
18697997023,17cyclictest0-21swapper/310:19:073
18697996929,33cyclictest18464-21nfs_client10:09:523
18697996928,33cyclictest26760-21latency_hist10:24:253
18697996927,36cyclictest18074-21ssh10:59:363
18697996910,53cyclictest0-21swapper/306:38:523
18697996910,53cyclictest0-21swapper/306:38:523
18697996850,12cyclictest8954-21grep06:19:533
18697996828,16cyclictest0-21swapper/307:52:473
18697996823,38cyclictest0-21swapper/308:46:303
18697996823,38cyclictest0-21swapper/308:46:303
18697996810,51cyclictest0-21swapper/310:27:283
1869699684,56cyclictest0-21swapper/205:34:352
18697996732,20cyclictest22972-21ssh08:39:433
18697996723,37cyclictest0-21swapper/309:45:303
18697996632,14cyclictest29369-21crond07:04:313
18697996629,11cyclictest19198-21gltestperf07:44:513
18697996627,31cyclictest10495-21munin-node06:24:523
18697996626,33cyclictest8037-21munin-node07:24:543
18697996624,35cyclictest31733-21munin-node08:04:523
18697996624,35cyclictest31733-21munin-node08:04:523
18697996623,37cyclictest25117-21which05:45:053
18697996622,37cyclictest886-21munin-node07:09:593
18697996617,42cyclictest10450-21ssh10:47:323
18697996545,15cyclictest0-21swapper/306:54:323
18697996524,15cyclictest11631-21ssh08:21:433
18697996519,15cyclictest0-21swapper/306:44:463
18697996428,22cyclictest26068-21munin-node05:49:583
18697996428,22cyclictest26068-21munin-node05:49:583
18697996422,35cyclictest9999-21grep07:29:483
18697996421,37cyclictest28562-21aten_r1power_po05:54:473
18697996421,35cyclictest21298-21munin-node05:40:043
18697996238,18cyclictest1227-21runrttasks07:05:163
18697996223,33cyclictest14118-21netstat06:29:583
18697996112,43cyclictest0-21swapper/306:54:553
18697995940,13cyclictest7139-21grep06:15:033
18697995917,36cyclictest19590-21fschecks_count05:34:543
18697995835,17cyclictest1227-21runrttasks06:07:173
18697995332,16cyclictest0-21swapper/305:34:363
1869199515,26cyclictest0-21swapper/005:39:570
185712484,6sleep00-21swapper/005:33:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional