You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 12:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 01, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
680121000,5sleep2281ktimersoftd/223:18:492
219499860,4rtkit-daemon2193-21rtkit-daemon19:55:340
2076998521,15cyclictest0-21swapper/021:16:350
2076998121,53cyclictest0-21swapper/022:27:130
2076997829,31cyclictest27450-21processes21:24:220
2076997829,30cyclictest5770-21cpuspeed_turbos20:54:060
2076997827,27cyclictest1227-21runrttasks21:31:140
2076997820,51cyclictest0-21swapper/023:49:030
2076997820,50cyclictest0-21swapper/022:03:040
2076997728,29cyclictest1227-21runrttasks23:01:300
2076997728,29cyclictest1227-21runrttasks23:01:300
2076997725,44cyclictest0-21swapper/021:44:190
2076997723,32cyclictest0-21swapper/023:44:020
2076997629,41cyclictest966-21ssh21:34:090
2076997625,29cyclictest15629-21latency_hist21:08:540
2076997624,35cyclictest0-21swapper/020:44:080
2076997622,46cyclictest0-21swapper/022:14:440
2076997620,49cyclictest0-21swapper/022:38:360
2076997527,40cyclictest23389-21tune2fs21:19:120
2076997526,42cyclictest12112-21sh23:24:200
2076997524,44cyclictest0-21swapper/021:58:530
2076997524,33cyclictest0-21swapper/023:22:240
2076997523,45cyclictest0-21swapper/019:04:150
2076997522,46cyclictest0-21swapper/020:42:000
2076997522,45cyclictest0-21swapper/020:03:560
2076997427,39cyclictest0-21swapper/022:19:210
2076997427,39cyclictest0-21swapper/022:19:210
2076997424,34cyclictest0-21swapper/023:54:010
2076997424,30cyclictest0-21swapper/022:44:380
2076997424,30cyclictest0-21swapper/021:03:530
2076997424,30cyclictest0-21swapper/021:03:530
2076997423,43cyclictest0-21swapper/019:44:150
2076997422,45cyclictest0-21swapper/023:04:010
2076997324,42cyclictest0-21swapper/021:39:090
2076997324,42cyclictest0-21swapper/021:39:090
2076997323,43cyclictest0-21swapper/023:09:220
2076997321,46cyclictest0-21swapper/023:29:000
2076997321,45cyclictest0-21swapper/022:57:420
2076997321,34cyclictest0-21swapper/023:18:490
2076997318,48cyclictest0-21swapper/022:12:440
2076997234,24cyclictest12835-21fschecks_time22:39:070
2076997228,28cyclictest1227-21runrttasks21:08:570
2076997226,30cyclictest0-21swapper/022:32:570
2076997225,39cyclictest19687-21kernelversion23:39:060
2076997225,39cyclictest19687-21kernelversion23:39:060
2076997222,33cyclictest0-21swapper/022:04:070
2076997220,45cyclictest0-21swapper/022:50:360
2076997220,45cyclictest0-21swapper/021:51:020
2076997220,30cyclictest0-21swapper/020:51:150
2076997143,22cyclictest0-21swapper/018:38:580
2076997121,43cyclictest0-21swapper/018:45:180
2076997121,42cyclictest0-21swapper/000:04:150
2076997027,36cyclictest17870-21ssh23:37:050
2076997024,39cyclictest22469-21irqstats19:19:200
2076997022,20cyclictest0-21swapper/000:00:410
2076996922,32cyclictest0-21swapper/020:37:440
2076996825,35cyclictest1227-21runrttasks20:29:140
2076996820,34cyclictest0-21swapper/020:24:240
2076996820,34cyclictest0-21swapper/020:24:240
2076996816,34cyclictest0-21swapper/019:52:240
208599673,56cyclictest10947-21rm22:35:313
160642674,12sleep20-21swapper/221:54:572
2076996627,32cyclictest0-21swapper/019:34:140
2076996621,30cyclictest0-21swapper/018:39:210
2076996619,29cyclictest0-21swapper/020:04:100
2076996532,27cyclictest1227-21runrttasks19:24:530
2076996529,29cyclictest16174-21grep20:14:140
2076996521,29cyclictest26212-21munin-node19:29:160
2076996520,29cyclictest0-21swapper/020:13:370
2076996418,29cyclictest9968-21df_abs18:54:120
2076996418,29cyclictest9968-21df_abs18:54:120
2076996415,42cyclictest0-21swapper/020:19:140
2076996321,35cyclictest0-21swapper/019:18:580
2076996317,39cyclictest0-21swapper/019:03:580
2076996317,39cyclictest0-21swapper/019:03:580
208599623,13cyclictest0-21swapper/321:09:243
2076996227,18cyclictest0-21swapper/018:49:160
2076996212,43cyclictest0-21swapper/019:39:210
2076996212,43cyclictest0-21swapper/019:39:210
151952623,50sleep20-21swapper/219:04:192
3502617,42sleep1455-21fschecks_time18:34:161
2076996118,37cyclictest0-21swapper/019:09:140
2085996021,32cyclictest0-21swapper/321:29:083
208599593,49cyclictest31606-21runrttasks23:06:583
230412583,8sleep323051-21uname23:44:113
208599585,44cyclictest0-21swapper/322:44:023
208499582,49cyclictest0-21swapper/222:50:172
2081995839,12cyclictest31585-21fschecks_count22:19:101
2081995839,12cyclictest31585-21fschecks_count22:19:101
176232583,47sleep20-21swapper/221:59:052
219499570,5rtkit-daemon2193-21rtkit-daemon23:04:112
208499579,30cyclictest107550irq/46-eth023:54:392
2081995730,10cyclictest15566-21swap21:54:231
114272573,8sleep111527-21tail21:49:121
64732563,46sleep30-21swapper/323:18:233
304872562,10sleep30-21swapper/322:18:203
219499560,6rtkit-daemon2193-21rtkit-daemon21:39:152
219499560,6rtkit-daemon2193-21rtkit-daemon21:39:152
219499560,5rtkit-daemon2193-21rtkit-daemon20:48:392
208599564,45cyclictest0-21swapper/321:34:083
208599563,46cyclictest0-21swapper/321:18:423
208599563,45cyclictest1547-21nscd23:38:473
278642553,8sleep110607-21kworker/1:123:00:391
278642553,8sleep110607-21kworker/1:123:00:391
219499550,6rtkit-daemon2193-21rtkit-daemon21:34:152
219499550,6rtkit-daemon2193-21rtkit-daemon21:18:082
219499550,5rtkit-daemon2193-21rtkit-daemon22:59:042
219499550,5rtkit-daemon2193-21rtkit-daemon22:59:042
219499550,5rtkit-daemon2193-21rtkit-daemon22:39:052
219499550,5rtkit-daemon2193-21rtkit-daemon22:38:502
219499550,5rtkit-daemon2193-21rtkit-daemon22:29:282
219499550,5rtkit-daemon2193-21rtkit-daemon22:16:512
219499550,5rtkit-daemon2193-21rtkit-daemon21:29:302
208599554,45cyclictest27150-21diskmemload23:31:523
208599554,45cyclictest0-21swapper/322:39:043
208599554,44cyclictest0-21swapper/320:44:223
208599553,45cyclictest0-21swapper/322:56:233
208599553,44cyclictest8325-21iostat_ios21:44:123
2084995537,11cyclictest23563-21grep21:19:132
2084995516,23cyclictest0-21swapper/222:10:062
208199555,12cyclictest0-21swapper/123:16:161
208199554,34cyclictest0-21swapper/123:23:581
2081995521,28cyclictest18608-21aten_r1power_cu23:38:541
2081995521,28cyclictest18608-21aten_r1power_cu23:38:541
2081995520,9cyclictest3221-21ssh22:24:151
321212544,42sleep30-21swapper/323:58:593
219499540,5rtkit-daemon2193-21rtkit-daemon23:49:243
219499540,5rtkit-daemon2193-21rtkit-daemon22:19:062
219499540,5rtkit-daemon2193-21rtkit-daemon22:19:062
208599549,38cyclictest0-21swapper/323:23:573
208599543,45cyclictest27150-21diskmemload22:51:303
208599543,44cyclictest0-21swapper/320:59:393
208599543,44cyclictest0-21swapper/320:59:393
208599543,43cyclictest19526-21ssh22:00:153
2085995410,36cyclictest0-21swapper/322:29:063
208199545,28cyclictest829-21ssh23:59:131
208199544,15cyclictest0-21swapper/122:33:291
2081995431,16cyclictest0-21swapper/123:19:041
2081995423,10cyclictest17650-21cpuspeed21:59:041
2081995421,14cyclictest0-21swapper/123:11:091
2081995410,21cyclictest23925-21sort22:54:221
219499530,5rtkit-daemon2193-21rtkit-daemon21:44:142
208599534,43cyclictest0-21swapper/323:53:533
208599534,42cyclictest27150-21diskmemload21:49:533
208599534,42cyclictest13357-21kworker/3:223:00:533
208599534,42cyclictest13357-21kworker/3:223:00:533
208599533,42cyclictest27983-21ssh21:24:453
208599532,45cyclictest0-21swapper/321:54:133
2085995314,34cyclictest0-21swapper/321:04:543
208499534,42cyclictest0-21swapper/222:24:172
208499533,43cyclictest0-21swapper/221:13:542
208499532,43cyclictest1124-21snmpd23:21:172
208199536,24cyclictest28432-21gltestperf22:14:111
208199536,17cyclictest0-21swapper/121:18:281
208199535,14cyclictest0-21swapper/122:12:321
208199535,14cyclictest0-21swapper/121:00:081
208199535,14cyclictest0-21swapper/121:00:081
208199535,14cyclictest0-21swapper/120:47:501
208199534,29cyclictest0-21swapper/122:39:021
208199534,29cyclictest0-21swapper/121:19:311
2081995321,13cyclictest0-21swapper/121:09:101
2081995316,21cyclictest6274-21gltestperf20:54:111
143422534,42sleep214431-21ssh23:29:062
219499520,5rtkit-daemon2193-21rtkit-daemon22:46:192
219499520,5rtkit-daemon2193-21rtkit-daemon21:28:522
208599524,41cyclictest6693-21ssh21:42:423
208599524,41cyclictest6693-21ssh21:42:423
208599524,41cyclictest4960-21ssh20:53:203
208599524,41cyclictest0-21swapper/322:09:033
208599524,39cyclictest523-21ssh23:09:053
2085995236,10cyclictest28276-21gltestperf20:39:143
208599523,43cyclictest0-21swapper/320:54:403
208599523,41cyclictest1288-21ssh22:22:473
208599523,41cyclictest1288-21ssh22:22:473
208499524,41cyclictest0-21swapper/223:25:192
208499522,43cyclictest1124-21snmpd19:00:282
208499522,43cyclictest1124-21snmpd19:00:282
208199525,40cyclictest0-21swapper/120:51:021
208199524,30cyclictest0-21swapper/123:36:201
208199524,29cyclictest0-21swapper/119:09:171
208199524,28cyclictest1124-21snmpd23:29:211
2081995223,11cyclictest4439-21needreboot00:04:141
2081995222,13cyclictest0-21swapper/122:49:131
2081995222,13cyclictest0-21swapper/119:59:291
2081995221,14cyclictest0-21swapper/123:54:161
179172522,9sleep20-21swapper/223:37:172
54892512,9sleep30-21swapper/319:51:523
27752513,7sleep32889-21munin-node19:44:303
219499510,5rtkit-daemon2193-21rtkit-daemon22:55:572
208599514,40cyclictest9595-21proc_pri19:59:243
208599514,39cyclictest5115-21munin-run22:28:503
2085995130,13cyclictest3221-21gltestperf18:39:193
208599513,42cyclictest0-21swapper/300:04:143
208599513,40cyclictest8376-21ssh23:19:193
208499514,40cyclictest0-21swapper/219:49:082
2084995136,9cyclictest22786-21grep19:19:262
208499513,40cyclictest28886-21ssh20:39:262
208499512,41cyclictest21952-21ssh23:43:512
208499512,41cyclictest10901-21ssh21:49:062
208199516,27cyclictest0-21swapper/122:04:251
208199515,28cyclictest0-21swapper/119:24:221
208199514,28cyclictest0-21swapper/121:04:151
208199514,28cyclictest0-21swapper/119:19:141
2081995126,7cyclictest27150-21diskmemload21:25:361
174882512,9sleep10-21swapper/122:44:471
116262512,42sleep10-21swapper/118:58:371
116262512,42sleep10-21swapper/118:58:371
114412512,43sleep20-21swapper/218:56:122
114412512,43sleep20-21swapper/218:56:122
66752502,42sleep10-21swapper/118:46:161
208599505,39cyclictest21955-21memory22:04:163
208599503,39cyclictest361ktimersoftd/319:39:143
208599503,39cyclictest361ktimersoftd/319:39:143
208599503,29cyclictest0-21swapper/319:24:193
208599502,42cyclictest0-21swapper/319:09:313
2084995034,10cyclictest4095-21grep18:39:332
2084995032,11cyclictest16640-21needreboot20:14:212
208499503,42cyclictest0-21swapper/222:06:302
208499502,42cyclictest1124-21snmpd23:11:152
208499502,41cyclictest21022-21ssh23:41:172
208499502,41cyclictest21022-21ssh23:41:172
208499502,39cyclictest1763-21ssh00:00:032
2084995014,31cyclictest7559-21runrttasks20:55:142
208199505,27cyclictest0-21swapper/123:44:061
208199505,27cyclictest0-21swapper/121:43:531
208199505,27cyclictest0-21swapper/121:39:081
208199505,27cyclictest0-21swapper/121:39:081
208199505,27cyclictest0-21swapper/120:19:171
208199504,28cyclictest0-21swapper/123:04:031
208199504,27cyclictest0-21swapper/122:34:041
208199504,27cyclictest0-21swapper/120:34:261
208199504,26cyclictest0-21swapper/120:24:061
208199504,26cyclictest0-21swapper/120:24:061
2081995012,22cyclictest339-21cut21:34:031
90002492,39sleep10-21swapper/118:50:271
2085994934,10cyclictest25786-21grep20:34:153
2085994931,11cyclictest11521-21gltestperf20:04:153
208599493,39cyclictest20625-21ssh23:39:503
208599493,39cyclictest20625-21ssh23:39:503
2085994922,8cyclictest24770-21munin-run20:33:553
2085994919,23cyclictest0-21swapper/320:28:553
2085994919,23cyclictest0-21swapper/320:28:553
2084994934,9cyclictest5944-21aten2.4-expect19:54:072
208499493,11cyclictest0-21swapper/220:59:202
208499493,11cyclictest0-21swapper/220:59:202
2084994921,9cyclictest25978-21latency_hist19:28:572
208199495,27cyclictest0-21swapper/119:54:131
208199495,27cyclictest0-21swapper/119:49:201
208199495,26cyclictest0-21swapper/120:42:431
208199494,28cyclictest0-21swapper/120:14:171
208199494,28cyclictest0-21swapper/119:44:251
208199494,28cyclictest0-21swapper/119:04:141
208199494,28cyclictest0-21swapper/118:39:351
208199494,27cyclictest0-21swapper/121:29:481
2081994922,12cyclictest0-21swapper/123:49:091
172382492,9sleep20-21swapper/219:09:142
150182492,9sleep30-21swapper/320:11:393
211152482,40sleep10-21swapper/119:17:521
208599485,13cyclictest0-21swapper/319:04:193
208599482,41cyclictest0-21swapper/318:44:223
2085994811,31cyclictest16734-21open_inodes20:14:243
208499484,38cyclictest0-21swapper/200:07:442
2084994833,9cyclictest13410-21grep20:09:102
2084994831,11cyclictest8627-21cpuspeed_turbos19:59:092
2084994830,10cyclictest18743-21wc20:19:152
208499482,37cyclictest27150-21diskmemload23:48:562
208199485,26cyclictest0-21swapper/119:33:571
208199484,27cyclictest0-21swapper/120:29:051
208199484,27cyclictest0-21swapper/118:59:201
208199484,27cyclictest0-21swapper/118:59:201
2081994820,12cyclictest0-21swapper/119:37:161
208599474,33cyclictest0-21swapper/319:14:083
208599474,28cyclictest0-21swapper/319:19:093
2085994728,14cyclictest0-21swapper/321:23:363
208599472,39cyclictest0-21swapper/319:29:013
208499473,38cyclictest0-21swapper/221:04:222
208499473,37cyclictest21363-21missed_timers20:24:212
208499473,37cyclictest21363-21missed_timers20:24:212
208499472,39cyclictest0-21swapper/219:34:102
95012462,37sleep30-21swapper/318:54:043
95012462,37sleep30-21swapper/318:54:043
208599465,35cyclictest0-21swapper/319:34:303
2085994629,11cyclictest7442-21tr18:49:133
208199464,36cyclictest0-21swapper/119:39:141
208199464,36cyclictest0-21swapper/119:39:141
208199464,27cyclictest0-21swapper/120:09:261
208199464,25cyclictest0-21swapper/120:04:251
2084994530,11cyclictest0-21swapper/220:34:242
2084994530,10cyclictest22894-21tr20:29:072
208499453,24cyclictest1227-21runrttasks20:07:242
208499452,38cyclictest0-21swapper/220:49:112
208499452,36cyclictest31001-21munin-node19:39:302
208499452,36cyclictest31001-21munin-node19:39:302
208499452,31cyclictest0-21swapper/219:16:182
76972442,9sleep30-21swapper/319:54:343
137802442,9sleep30-21swapper/319:00:333
137802442,9sleep30-21swapper/319:00:333
2084994314,12cyclictest0-21swapper/219:44:492
208599425,31cyclictest0-21swapper/320:19:073
60942412,32sleep20-21swapper/218:44:272
2084994126,9cyclictest7926-21chrt18:49:182
2084994125,10cyclictest27430-21netstat19:29:222
6082338,14sleep30-21swapper/318:34:183
208499316,16cyclictest0-21swapper/218:38:582
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional