You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-12 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Nov 12, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2119221210,3sleep041ktimersoftd/022:25:110
990399955,11cyclictest0-21swapper/122:25:221
9903998914,28cyclictest0-21swapper/123:00:221
9903998127,8cyclictest11253-21munin-node20:20:101
172152740,3sleep1201ktimersoftd/123:55:211
246399700,5rtkit-daemon2462-21rtkit-daemon00:30:293
990599683,57cyclictest0-21swapper/323:54:353
9904996822,39cyclictest12574-21needreboot23:00:132
990199683,47cyclictest0-21swapper/022:45:170
990499664,14cyclictest0-21swapper/222:40:212
9901996638,14cyclictest0-21swapper/022:40:220
990199654,24cyclictest0-21swapper/021:57:280
990599643,52cyclictest0-21swapper/321:00:293
9905996334,13cyclictest0-21swapper/322:35:113
990499635,16cyclictest0-21swapper/200:02:082
990499634,12cyclictest0-21swapper/222:05:122
9901996336,12cyclictest0-21swapper/022:30:220
9901996334,13cyclictest0-21swapper/022:05:250
9905996231,14cyclictest0-21swapper/321:21:233
9905996231,14cyclictest0-21swapper/321:21:233
990499626,14cyclictest0-21swapper/223:52:242
144512624,50sleep20-21swapper/222:15:072
9905996133,13cyclictest0-21swapper/321:58:423
9905996132,14cyclictest0-21swapper/322:58:343
990599613,51cyclictest0-21swapper/300:00:453
9905996113,41cyclictest22353-21awk22:25:273
990499616,11cyclictest1403-21runrttasks22:35:012
9901996135,12cyclictest0-21swapper/022:50:220
9901996134,11cyclictest0-21swapper/023:20:030
232482610,12sleep0990199cyclictest21:40:080
109652613,50sleep20-21swapper/222:59:272
9905996031,13cyclictest0-21swapper/322:16:163
9905996013,42cyclictest20394-21ssh23:12:323
9904996037,10cyclictest0-21swapper/223:32:322
9901996034,11cyclictest0-21swapper/023:10:060
9901996033,12cyclictest0-21swapper/000:20:130
9901996033,11cyclictest0-21swapper/023:00:100
9901996031,12cyclictest0-21swapper/021:15:290
176772603,12sleep20-21swapper/220:30:292
990599599,7cyclictest0-21swapper/321:25:243
9905995933,12cyclictest0-21swapper/322:44:493
9905995931,12cyclictest0-21swapper/323:30:153
9905995930,13cyclictest0-21swapper/323:42:343
990599593,12cyclictest0-21swapper/323:48:363
9901995936,8cyclictest22875-21grep00:05:080
9901995934,11cyclictest0-21swapper/023:25:120
9901995934,11cyclictest0-21swapper/023:25:120
9901995933,12cyclictest0-21swapper/021:10:160
9901995932,12cyclictest0-21swapper/023:30:110
9901995926,12cyclictest0-21swapper/019:49:590
292272593,48sleep30-21swapper/321:49:263
990599584,48cyclictest32160-21yum-updatesd-he21:53:013
990599584,11cyclictest0-21swapper/323:00:173
9905995831,13cyclictest0-21swapper/323:36:183
9905995829,12cyclictest0-21swapper/300:25:203
990499586,46cyclictest1403-21runrttasks22:54:442
990499584,48cyclictest0-21swapper/200:15:192
9901995833,11cyclictest0-21swapper/023:40:160
9901995833,10cyclictest0-21swapper/023:35:230
9901995830,12cyclictest0-21swapper/000:31:000
9901995830,10cyclictest16955-21ssh22:19:530
9901995816,27cyclictest0-21swapper/022:00:320
9901995816,27cyclictest0-21swapper/022:00:320
990599573,11cyclictest0-21swapper/319:29:593
9905995718,32cyclictest1-21systemd21:44:543
990499574,12cyclictest0-21swapper/200:20:092
990499574,10cyclictest6024-21latency_hist00:29:492
990199574,36cyclictest0-21swapper/000:15:130
990199574,25cyclictest0-21swapper/021:28:450
9901995733,10cyclictest0-21swapper/023:57:250
9901995730,12cyclictest0-21swapper/019:35:330
9901995730,11cyclictest0-21swapper/000:10:160
9901995730,11cyclictest0-21swapper/000:10:160
9901995724,13cyclictest0-21swapper/000:35:080
98182573,10sleep29970-21grep21:20:082
98182573,10sleep29970-21grep21:20:082
990599564,12cyclictest0-21swapper/321:15:113
9905995630,12cyclictest0-21swapper/300:10:213
9905995630,12cyclictest0-21swapper/300:10:213
990599563,12cyclictest0-21swapper/323:09:513
990599563,11cyclictest0-21swapper/319:53:203
990599563,11cyclictest0-21swapper/319:53:203
9905995620,30cyclictest28978-21cstates00:15:053
990499564,46cyclictest0-21swapper/221:25:092
990499564,45cyclictest0-21swapper/222:10:152
990499564,45cyclictest0-21swapper/221:40:162
9901995636,13cyclictest0-21swapper/022:58:270
9901995633,7cyclictest2613-21diskmemload00:24:590
9901995631,11cyclictest0-21swapper/020:10:330
9901995629,12cyclictest0-21swapper/021:09:560
9901995629,12cyclictest0-21swapper/020:50:210
9901995628,14cyclictest0-21swapper/021:50:120
9901995628,12cyclictest0-21swapper/023:49:180
9901995628,12cyclictest0-21swapper/020:55:120
9901995627,12cyclictest0-21swapper/019:40:220
9901995627,12cyclictest0-21swapper/019:30:160
9901995620,11cyclictest0-21swapper/019:53:150
9901995620,11cyclictest0-21swapper/019:53:150
125892563,13sleep20-21swapper/219:15:132
990599558,9cyclictest4085-21sh22:48:253
990599553,11cyclictest0-21swapper/321:11:283
990499555,42cyclictest6511-21cpuspeed21:15:102
990499554,45cyclictest0-21swapper/223:45:072
990499554,45cyclictest0-21swapper/222:20:052
990499554,45cyclictest0-21swapper/222:00:102
990499554,45cyclictest0-21swapper/222:00:102
990499554,45cyclictest0-21swapper/221:53:062
990499554,30cyclictest0-21swapper/200:14:492
990499554,30cyclictest0-21swapper/200:14:492
990499554,13cyclictest0-21swapper/223:15:532
990499554,11cyclictest0-21swapper/222:26:072
990499553,46cyclictest0-21swapper/222:30:122
990499553,36cyclictest0-21swapper/223:40:392
9904995513,27cyclictest0-21swapper/223:20:022
9903995531,10cyclictest24579-21munin-node23:20:241
9901995530,11cyclictest0-21swapper/023:53:070
9901995530,11cyclictest0-21swapper/022:20:160
990199553,13cyclictest0-21swapper/021:47:190
9901995528,11cyclictest0-21swapper/021:30:060
9901995526,13cyclictest0-21swapper/022:36:070
9901995525,14cyclictest0-21swapper/021:35:130
9901995521,19cyclictest0-21swapper/022:10:220
25382552,9sleep20-21swapper/221:55:332
990599543,9cyclictest23458-21ssh00:05:183
990499545,43cyclictest0-21swapper/221:31:562
990499544,9cyclictest27727-21munin-run20:54:562
990499544,43cyclictest0-21swapper/219:55:122
990499543,45cyclictest0-21swapper/221:10:082
990499543,44cyclictest32739-21munin-node21:05:192
990499543,44cyclictest2613-21diskmemload23:35:012
990499543,44cyclictest0-21swapper/200:04:582
9901995429,12cyclictest0-21swapper/021:02:060
9901995429,11cyclictest0-21swapper/020:35:210
9901995429,11cyclictest0-21swapper/020:35:210
9901995429,11cyclictest0-21swapper/020:30:170
9901995429,11cyclictest0-21swapper/019:55:140
9901995427,12cyclictest0-21swapper/023:05:210
9901995427,11cyclictest0-21swapper/019:15:200
9901995426,14cyclictest0-21swapper/000:00:150
9901995424,13cyclictest0-21swapper/023:15:200
9901995424,13cyclictest0-21swapper/021:20:160
9901995424,13cyclictest0-21swapper/021:20:160
49592544,42sleep10-21swapper/121:11:241
246399540,5rtkit-daemon2462-21rtkit-daemon00:34:593
9905995338,9cyclictest32750-21gltestperf00:20:083
990499534,43cyclictest0-21swapper/221:45:362
990499534,42cyclictest209092sleep221:35:172
990499534,12cyclictest0-21swapper/219:25:192
990499533,44cyclictest0-21swapper/223:11:012
990399539,37cyclictest0-21swapper/122:20:141
9901995329,9cyclictest11025-21munin-run20:19:570
9901995326,12cyclictest0-21swapper/020:40:070
39712530,4sleep14039-21munin-node22:00:071
39712530,4sleep14039-21munin-node22:00:071
246399530,5rtkit-daemon2462-21rtkit-daemon23:25:243
246399530,5rtkit-daemon2462-21rtkit-daemon23:25:243
238822532,9sleep30-21swapper/319:36:043
187172532,45sleep31257-21snmpd21:32:013
990599523,34cyclictest0-21swapper/323:55:073
990599523,11cyclictest0-21swapper/322:12:103
9905995227,10cyclictest0-21swapper/319:58:343
9905995214,24cyclictest0-21swapper/322:31:553
990499526,13cyclictest28780-21grep23:25:102
990499526,13cyclictest28780-21grep23:25:102
990499525,29cyclictest0-21swapper/200:29:572
990499524,41cyclictest0-21swapper/219:50:092
990499524,41cyclictest0-21swapper/219:50:092
990499524,13cyclictest0-21swapper/220:25:212
990399523,43cyclictest0-21swapper/123:17:321
9903995216,25cyclictest0-21swapper/122:42:201
246399520,5rtkit-daemon2462-21rtkit-daemon23:15:103
19602522,44sleep10-21swapper/100:22:461
122652522,43sleep20-21swapper/219:15:012
990499514,42cyclictest0-21swapper/200:35:022
990499514,41cyclictest0-21swapper/223:09:082
990499514,31cyclictest0-21swapper/219:40:182
990499514,13cyclictest0-21swapper/220:05:102
9904995133,12cyclictest15810-21hwlatdetect19:20:222
9903995131,13cyclictest0-21swapper/123:40:071
990399513,43cyclictest0-21swapper/100:30:391
9903995124,12cyclictest0-21swapper/119:50:291
9903995124,12cyclictest0-21swapper/119:50:291
9901995125,11cyclictest0-21swapper/019:20:270
9901995124,11cyclictest0-21swapper/020:05:100
9901995123,11cyclictest0-21swapper/019:25:160
9901995121,13cyclictest0-21swapper/020:20:080
9901995121,12cyclictest0-21swapper/019:11:470
9901995119,13cyclictest0-21swapper/020:25:220
31342513,42sleep03152-21switchtime20:00:300
25322513,9sleep30-21swapper/321:09:053
246399510,5rtkit-daemon2462-21rtkit-daemon23:22:023
990599503,10cyclictest8434-21memory22:05:173
9905995028,10cyclictest0-21swapper/319:20:163
990499505,29cyclictest0-21swapper/223:55:052
990499505,27cyclictest0-21swapper/221:00:182
990499504,40cyclictest0-21swapper/222:45:112
990499504,39cyclictest26963-21aten2.4-expect19:45:112
990499504,30cyclictest0-21swapper/220:35:112
990499504,30cyclictest0-21swapper/220:35:112
990499504,30cyclictest0-21swapper/220:10:112
9904995035,9cyclictest21160-21grep20:40:102
9904995021,12cyclictest0-21swapper/220:20:112
9904995020,12cyclictest0-21swapper/219:35:182
990399504,40cyclictest0-21swapper/122:07:411
990399503,43cyclictest0-21swapper/122:56:421
9903995029,9cyclictest16903-21sed20:30:151
9903995027,11cyclictest0-21swapper/123:54:411
9903995023,12cyclictest0-21swapper/123:10:131
9903995020,24cyclictest1529-21if_eth021:55:141
9901995022,11cyclictest0-21swapper/020:45:050
25842502,9sleep20-21swapper/220:00:202
990599495,11cyclictest0-21swapper/320:20:263
990599494,39cyclictest0-21swapper/320:54:563
990599493,10cyclictest0-21swapper/320:41:053
9905994928,10cyclictest0-21swapper/320:14:173
990599492,40cyclictest20794-21ssh21:35:163
9905994914,7cyclictest0-21swapper/322:00:143
9905994914,7cyclictest0-21swapper/322:00:143
990499493,40cyclictest1403-21runrttasks20:55:072
990399496,37cyclictest0-21swapper/123:39:481
990399495,38cyclictest0-21swapper/121:33:421
990399493,40cyclictest14162-21runrttasks22:15:041
990399493,40cyclictest0-21swapper/100:10:061
990399493,40cyclictest0-21swapper/100:10:061
9903994919,9cyclictest21014-21netstat21:35:191
288332494,9sleep10-21swapper/119:48:271
181302493,40sleep31257-21snmpd20:34:293
115902494,9sleep10-21swapper/100:36:201
990599484,10cyclictest5789-21munin-node22:50:153
990599483,38cyclictest0-21swapper/319:10:013
990599483,38cyclictest0-21swapper/319:10:013
990599483,37cyclictest0-21swapper/319:15:013
990599483,10cyclictest0-21swapper/319:17:323
990499484,27cyclictest0-21swapper/220:45:062
990399485,36cyclictest0-21swapper/121:27:121
990399484,38cyclictest0-21swapper/121:40:251
9903994829,7cyclictest31889-21rm21:51:581
9903994829,13cyclictest0-21swapper/122:37:561
9903994814,29cyclictest30312-21unixbench-2d00:15:241
33222483,38sleep13463-21df_inode00:25:041
274332482,39sleep10-21swapper/120:51:221
264932482,39sleep10-21swapper/119:44:001
264022482,40sleep10-21swapper/122:33:191
22532482,40sleep10-21swapper/121:05:571
204062482,9sleep30-21swapper/320:38:033
204062482,9sleep30-21swapper/320:38:033
990599474,28cyclictest0-21swapper/320:25:093
990599473,36cyclictest20684-21irqstats19:30:253
990499474,28cyclictest0-21swapper/219:30:142
9904994719,11cyclictest0-21swapper/220:15:232
990399475,35cyclictest0-21swapper/122:10:181
990399474,37cyclictest0-21swapper/122:47:531
990399473,37cyclictest0-21swapper/123:28:151
990399473,37cyclictest0-21swapper/123:28:151
9903994729,7cyclictest17186-21ssh23:07:541
9903994723,10cyclictest5802-21iostat_ios22:50:161
9903994722,8cyclictest14817-21cat19:20:011
9903994721,12cyclictest0-21swapper/121:49:341
85522474,37sleep10-21swapper/120:14:041
318752472,39sleep10-21swapper/121:00:291
244572472,6sleep124460-21ssh00:07:391
990599466,13cyclictest0-21swapper/320:05:243
990599464,37cyclictest0-21swapper/322:22:173
990399469,12cyclictest0-21swapper/121:23:051
990399469,12cyclictest0-21swapper/121:23:051
9903994628,7cyclictest53-21kworker/1:100:02:551
9903994628,7cyclictest10694-21ssh23:45:341
9903994626,9cyclictest14950-21telnet19:20:131
9903994613,11cyclictest0-21swapper/120:28:411
246399460,4rtkit-daemon2462-21rtkit-daemon19:09:492
246399460,4rtkit-daemon2462-21rtkit-daemon19:09:492
122252462,37sleep10-21swapper/119:14:311
9905994531,9cyclictest28386-21df20:55:113
9905994529,10cyclictest25057-21fschecks_count19:40:153
990399453,36cyclictest28545-21munin-node20:55:131
9903994527,7cyclictest6206-21ssh21:14:581
9903994526,8cyclictest8920-21telnet20:15:091
9903994519,12cyclictest0-21swapper/119:35:171
96132454,34sleep10-21swapper/119:06:471
96132454,34sleep10-21swapper/119:06:471
217062452,37sleep10-21swapper/119:33:451
107322452,9sleep30-21swapper/320:16:203
9903994426,7cyclictest1146-21ssh23:32:251
35502442,36sleep10-21swapper/120:01:031
227122442,36sleep10-21swapper/120:42:001
9905994330,8cyclictest23861-21uniq20:45:123
990599433,35cyclictest0-21swapper/319:45:223
9905994312,9cyclictest2537-21sed20:00:193
990399434,33cyclictest0-21swapper/120:39:571
990399434,33cyclictest0-21swapper/120:39:571
12712432,35sleep10-21swapper/119:59:261
96962424,31sleep00-21swapper/019:07:500
96962424,31sleep00-21swapper/019:07:500
9903994126,10cyclictest0-21swapper/119:25:111
9903994119,9cyclictest23202-21telnet20:45:051
9903994025,10cyclictest0-21swapper/120:05:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional