You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 17:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Dec 11, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99621320,8sleep2281ktimersoftd/208:26:172
1450499995,86cyclictest25738-21timerwakeupswit11:31:203
1450399979,72cyclictest0-21swapper/206:41:282
1449899975,67cyclictest0-21swapper/009:20:520
1449899924,73cyclictest0-21swapper/008:01:240
81832910,4sleep38184-21tune2fs10:56:073
81832910,4sleep38184-21tune2fs10:56:073
1449899916,64cyclictest0-21swapper/010:01:020
14503999015,13cyclictest0-21swapper/208:36:202
14498999017,8cyclictest460-21jbd2/sda2-806:51:200
14504998923,12cyclictest0-21swapper/308:36:063
1449899895,69cyclictest0-21swapper/012:04:450
1449899895,62cyclictest0-21swapper/012:06:060
1449899893,24cyclictest32582-21munin-node08:26:170
1450499884,76cyclictest0-21swapper/308:35:543
1450499883,77cyclictest23019-21open_inodes11:26:163
1449899884,13cyclictest0-21swapper/007:01:190
1449899883,67cyclictest0-21swapper/007:38:240
214802870,3sleep2281ktimersoftd/208:01:142
1450499874,76cyclictest22953-21munin-node10:21:223
1450499874,75cyclictest11757-21fschecks_time09:56:103
1450399873,77cyclictest0-21swapper/211:26:122
1449899874,67cyclictest0-21swapper/011:09:370
1449899873,67cyclictest0-21swapper/011:31:150
1449899873,64cyclictest0-21swapper/007:06:280
1449899873,24cyclictest0-21swapper/011:49:430
1450499865,74cyclictest0-21swapper/311:25:473
14504998630,50cyclictest32168-21gltestperf09:31:103
14504998630,49cyclictest1733-21cpuspeed_turbos07:21:113
14504998620,59cyclictest1369-21runrttasks07:50:233
1449899864,65cyclictest0-21swapper/008:36:060
1449899864,63cyclictest0-21swapper/011:51:110
14504998530,47cyclictest17792-21cut11:16:093
14503998527,51cyclictest25828-21cat09:16:262
1450499845,23cyclictest0-21swapper/310:46:023
1450499844,14cyclictest0-21swapper/310:11:023
1450499844,10cyclictest1369-21runrttasks10:34:313
1449899845,15cyclictest0-21swapper/007:51:220
1449899844,71cyclictest0-21swapper/009:06:200
1449899843,26cyclictest0-21swapper/007:31:070
14498998424,52cyclictest1369-21runrttasks11:41:040
14498998419,50cyclictest0-21swapper/008:35:530
14498998416,13cyclictest0-21swapper/010:06:270
55822830,3sleep226-21rcuc/211:56:232
1450499834,23cyclictest0-21swapper/306:41:093
1450399833,74cyclictest0-21swapper/209:31:122
1450399833,72cyclictest20995-21grep11:21:212
1450399832,74cyclictest0-21swapper/208:21:212
1449899834,72cyclictest0-21swapper/010:41:160
1449899834,62cyclictest0-21swapper/009:31:020
1449899834,23cyclictest0-21swapper/009:01:040
1449899833,22cyclictest0-21swapper/011:59:440
1450499824,71cyclictest0-21swapper/307:41:163
14504998225,51cyclictest0-21swapper/311:56:003
14503998233,43cyclictest17582-21unixbench_multi07:51:282
1449899824,71cyclictest0-21swapper/010:11:080
1449899824,71cyclictest0-21swapper/008:51:070
1449899824,71cyclictest0-21swapper/006:42:590
1449899824,62cyclictest0-21swapper/006:46:130
1449899824,62cyclictest0-21swapper/006:46:130
14498998232,43cyclictest3943-21head07:26:090
14498998219,9cyclictest5966-21sshd09:45:180
14498998216,11cyclictest25342-21munin-node10:26:050
1450499815,69cyclictest12230-21head11:06:043
1450499814,70cyclictest0-21swapper/311:36:163
1450499814,69cyclictest0-21swapper/310:01:173
14504998130,44cyclictest21135-21unixbench_multi09:06:253
1450499813,71cyclictest5009-21munin-node10:51:183
14504998124,9cyclictest7224-21if_eth009:46:123
1450399815,69cyclictest0-21swapper/207:11:332
1450399814,70cyclictest9929-21telnet08:46:052
1450399814,70cyclictest3916-21munin-node07:26:172
1450399813,14cyclictest0-21swapper/209:21:272
14503998126,48cyclictest14793-21aten_r1power_vo08:56:062
1450499805,69cyclictest0-21swapper/309:36:263
1450499805,69cyclictest0-21swapper/309:36:263
1450499803,70cyclictest32526-21munin-node10:41:023
1450499803,69cyclictest27806-21munin-node08:16:163
14504998027,10cyclictest4743-21gltestperf07:26:173
14504998022,8cyclictest1369-21runrttasks08:14:133
14504998022,8cyclictest1369-21runrttasks08:14:133
1450399803,69cyclictest0-21swapper/210:30:502
1450399803,68cyclictest0-21swapper/208:54:272
1450399803,12cyclictest0-21swapper/209:01:172
14503998029,44cyclictest29295-21tr09:26:062
1449899806,25cyclictest0-21swapper/007:46:190
1449899804,68cyclictest21035-21grep11:21:210
1449899804,61cyclictest0-21swapper/011:36:180
1449899803,71cyclictest0-21swapper/011:19:390
1449899803,70cyclictest0-21swapper/011:02:170
1449899803,70cyclictest0-21swapper/011:02:170
14504997910,12cyclictest12256-21munin-node08:51:143
1450399794,69cyclictest0-21swapper/208:16:112
1450399793,69cyclictest8829-21telnet07:36:062
14503997924,49cyclictest1912-21fschecks_count11:51:032
1449899794,68cyclictest0-21swapper/009:49:240
14498997924,48cyclictest6172-21wc10:51:120
14498997922,50cyclictest29323-21grep09:26:060
14498997913,9cyclictest114550irq/46-eth010:21:180
1450499785,66cyclictest0-21swapper/308:30:543
1450499784,67cyclictest0-21swapper/308:21:183
14504997825,9cyclictest1369-21runrttasks11:53:023
14504997825,9cyclictest1369-21runrttasks09:42:323
1450399784,29cyclictest0-21swapper/211:30:592
1450399783,69cyclictest5132-21head10:51:002
1450399783,31cyclictest0-21swapper/209:51:232
14503997816,15cyclictest0-21swapper/210:46:102
1449899787,19cyclictest0-21swapper/008:20:330
14498997831,41cyclictest8957-21tr09:51:050
1449899783,69cyclictest0-21swapper/007:11:430
1449899783,23cyclictest2625-21munin-node10:46:110
1449899783,22cyclictest0-21swapper/008:41:210
1449899783,12cyclictest0-21swapper/007:21:140
14498997826,45cyclictest0-21swapper/011:11:180
14498997825,48cyclictest1369-21runrttasks09:22:190
14498997824,47cyclictest0-21swapper/011:26:040
1450499774,13cyclictest0-21swapper/312:03:093
14504997737,34cyclictest17508-21tail10:06:243
14504997725,10cyclictest1369-21runrttasks09:14:063
14504997724,9cyclictest29853-21gltestperf07:11:163
14504997724,8cyclictest1369-21runrttasks07:10:203
1450399774,14cyclictest0-21swapper/207:45:572
1450399773,14cyclictest0-21swapper/208:41:212
14503997725,46cyclictest1369-21runrttasks10:36:002
1449899774,66cyclictest0-21swapper/007:56:110
1449899773,22cyclictest0-21swapper/008:09:070
1449899772,22cyclictest23375-21switchtime06:56:290
14498997717,52cyclictest0-21swapper/008:46:080
14498997713,14cyclictest0-21swapper/010:31:010
1450499768,62cyclictest8479-21awk07:35:563
1450499764,12cyclictest0-21swapper/308:50:533
1450499763,33cyclictest0-21swapper/311:41:153
1450499763,28cyclictest22720-21latency_hist10:20:503
1450499763,28cyclictest22720-21latency_hist10:20:503
14504997627,9cyclictest17768-21fschecks_time09:01:123
14504997625,10cyclictest21954-21aten_r1power_fr06:56:093
14504997623,8cyclictest17407-21cpuspeed_turbos06:46:133
14504997623,8cyclictest17407-21cpuspeed_turbos06:46:133
14504997622,9cyclictest1369-21runrttasks11:46:373
14504997620,9cyclictest9236-21sort09:51:093
1450399763,65cyclictest0-21swapper/211:11:182
1450399763,11cyclictest19254-21crond06:50:572
1450399763,11cyclictest19254-21crond06:50:572
1450399762,66cyclictest0-21swapper/207:31:082
1450399762,12cyclictest30683-1kworker/2:2H10:16:182
1450399762,12cyclictest30683-1kworker/2:2H10:16:182
14503997619,14cyclictest0-21swapper/206:51:212
14503997616,16cyclictest32150-21grep11:46:062
14503997616,12cyclictest0-21swapper/209:50:382
1449899765,13cyclictest14489-21cyclictest06:40:580
1449899763,23cyclictest0-21swapper/010:36:240
1449899763,22cyclictest25423-21munin-node08:11:180
1449899763,22cyclictest25423-21munin-node08:11:180
14498997626,42cyclictest2285-21gltestperf09:36:120
14498997626,42cyclictest2285-21gltestperf09:36:120
14498997611,57cyclictest0-21swapper/009:11:050
1450499755,13cyclictest0-21swapper/309:00:203
1450499754,23cyclictest25192-21munin-run08:10:553
14504997526,10cyclictest8452-21if_err_eth008:41:153
14504997523,9cyclictest1369-21runrttasks08:01:203
14504997523,8cyclictest1369-21runrttasks07:01:373
14504997523,10cyclictest27385-21gltestperf09:21:103
1450399755,62cyclictest0-21swapper/209:35:572
1450399755,62cyclictest0-21swapper/209:35:572
1450399753,64cyclictest0-21swapper/208:11:212
1450399753,64cyclictest0-21swapper/208:11:212
14503997522,11cyclictest1369-21runrttasks09:43:012
14503997521,9cyclictest1369-21runrttasks11:00:442
14503997521,9cyclictest1369-21runrttasks11:00:442
14503997520,11cyclictest27136-21tune2fs11:36:062
14503997517,10cyclictest1369-21runrttasks11:43:322
14503997514,9cyclictest24271-21munin-node07:01:322
1449899753,21cyclictest0-21swapper/010:16:210
1449899753,21cyclictest0-21swapper/010:16:210
1449899753,10cyclictest7459-21chrt10:56:000
1449899753,10cyclictest7459-21chrt10:56:000
1450499746,14cyclictest0-21swapper/309:29:223
1450499743,32cyclictest18257-21munin-node07:56:203
14504997426,8cyclictest1369-21runrttasks09:20:393
14504997421,9cyclictest1369-21runrttasks10:39:313
1450399743,63cyclictest0-21swapper/211:19:002
14503997424,10cyclictest3383-21tune2fs08:31:112
14503997421,8cyclictest31650-21cpuspeed07:16:112
1450399742,33cyclictest13404-21munin-node10:01:172
1449899744,12cyclictest0-21swapper/009:56:040
1449899743,20cyclictest0-21swapper/008:56:050
14498997417,8cyclictest1369-21runrttasks07:44:370
14498997412,9cyclictest30194-21munin-node08:21:070
1450499734,63cyclictest0-21swapper/311:11:193
1450499733,34cyclictest593-21timerwakeupswit07:16:303
14504997324,9cyclictest1369-21runrttasks07:52:493
1450499732,63cyclictest0-21swapper/306:51:163
1450399733,27cyclictest22511-21tune2fs09:11:102
14503997323,9cyclictest24740-21grep08:06:292
14503997322,9cyclictest9764-21netstat12:06:142
14503997322,9cyclictest1369-21runrttasks09:08:152
1449899733,24cyclictest32560-21cat07:16:210
14504997229,9cyclictest10043-21proc_pri07:36:223
14504997225,10cyclictest8546-21munin-node12:06:023
1450399723,63cyclictest0-21swapper/212:01:072
1450399723,30cyclictest0-21swapper/207:08:492
14503997221,9cyclictest1369-21runrttasks10:08:082
14503997221,10cyclictest1369-21runrttasks07:46:072
14503997221,10cyclictest1369-21runrttasks06:57:152
14503997220,9cyclictest1369-21runrttasks10:10:582
1450399722,62cyclictest1314-21strings10:41:142
14504997120,13cyclictest0-21swapper/310:26:003
1450399715,17cyclictest0-21swapper/210:35:502
14503997123,10cyclictest1015-21crond11:10:472
14503997120,10cyclictest23335-21cstates10:21:032
14503997119,8cyclictest20403-21crond08:00:542
14503997022,9cyclictest10780-21if_eth011:01:102
14503997022,9cyclictest10780-21if_eth011:01:102
1450399694,11cyclictest13175-21munin-run10:00:492
1450499684,58cyclictest0-21swapper/311:01:223
1450499684,58cyclictest0-21swapper/311:01:223
243799670,8rtkit-daemon0-21swapper/211:49:031
14503996618,9cyclictest1699-21cpuspeed_turbos07:21:112
151392613,13sleep10-21swapper/110:01:251
237742583,12sleep10-21swapper/111:29:391
14502995637,11cyclictest27504-21gltestperf07:06:171
14502995633,14cyclictest17455-21cpuspeed_turbos06:46:131
14502995633,14cyclictest17455-21cpuspeed_turbos06:46:131
46032553,11sleep10-21swapper/108:32:461
249002554,44sleep10-21swapper/110:23:091
14502995537,10cyclictest8254-21cut10:56:081
14502995537,10cyclictest8254-21cut10:56:081
14502995520,14cyclictest0-21swapper/108:46:291
8032544,43sleep10-21swapper/107:16:521
1450299545,29cyclictest0-21swapper/108:06:131
1450299544,43cyclictest0-21swapper/107:00:571
1450299544,30cyclictest0-21swapper/107:26:271
47222534,12sleep10-21swapper/110:50:141
165722533,11sleep10-21swapper/111:14:041
1450299534,29cyclictest0-21swapper/109:06:091
1450299534,28cyclictest0-21swapper/110:31:011
14502995335,10cyclictest5564-21tail09:41:231
14502995333,12cyclictest895-21head10:41:081
14502995321,14cyclictest0-21swapper/111:41:051
14502995321,13cyclictest0-21swapper/107:36:171
131622532,11sleep10-21swapper/107:44:581
116872534,43sleep10-21swapper/111:02:391
116872534,43sleep10-21swapper/111:02:391
283712523,11sleep10-21swapper/109:21:271
274922523,43sleep10-21swapper/108:14:561
274922523,43sleep10-21swapper/108:14:561
1450299524,29cyclictest0-21swapper/107:31:131
14502995235,11cyclictest29821-21gltestperf09:26:111
14502995232,12cyclictest19810-21cpuspeed_turbos06:51:111
14502995221,13cyclictest0-21swapper/110:51:111
122442524,11sleep10-21swapper/108:50:561
83642513,12sleep10-21swapper/109:50:291
70452513,12sleep10-21swapper/108:38:261
36042513,12sleep10-21swapper/109:40:371
36042513,12sleep10-21swapper/109:40:371
226682513,12sleep10-21swapper/108:04:201
181692514,40sleep10-21swapper/110:10:521
14502995134,10cyclictest15601-21cut06:41:171
14502995133,11cyclictest13918-21grep11:06:261
14502995131,12cyclictest17504-21unixbench_multi10:06:241
14502995130,13cyclictest17275-21cut11:16:031
14502995120,14cyclictest0-21swapper/108:56:041
14502995119,12cyclictest0-21swapper/110:30:171
322292503,41sleep10-21swapper/108:24:281
1450299505,29cyclictest0-21swapper/107:56:281
1450299505,28cyclictest0-21swapper/111:31:071
1450299505,27cyclictest0-21swapper/108:41:251
1450299505,27cyclictest0-21swapper/107:21:171
1450299504,28cyclictest0-21swapper/109:59:261
1450299504,28cyclictest0-21swapper/109:11:231
14502995033,11cyclictest16225-21cut07:51:091
14502995031,12cyclictest26343-21crond09:20:511
14502995031,11cyclictest9499-21gltestperf09:51:111
14502995019,12cyclictest0-21swapper/108:29:261
326152493,8sleep132639-21open_files09:31:181
296982493,11sleep10-21swapper/108:17:341
193212493,39sleep10-21swapper/111:20:531
152992493,11sleep10-21swapper/107:46:391
1450299495,27cyclictest0-21swapper/111:56:131
1450299495,14cyclictest0-21swapper/107:01:201
1450299494,28cyclictest0-21swapper/106:40:591
1450299494,27cyclictest0-21swapper/111:55:471
1450299494,27cyclictest0-21swapper/110:20:501
1450299494,27cyclictest0-21swapper/110:20:501
1450299484,37cyclictest201ktimersoftd/107:11:141
1450299484,27cyclictest0-21swapper/112:06:171
14502994830,11cyclictest27385-21cut11:36:081
14502994821,14cyclictest0-21swapper/112:01:101
320242473,38sleep10-21swapper/110:37:241
14504994718,8cyclictest14649-21cat06:40:593
1450299475,25cyclictest0-21swapper/109:01:051
134332432,8sleep213523-21strings06:36:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional