You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 01:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 08, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2870621390,13sleep2255099cyclictest20:03:302
2546991043,14cyclictest0-21swapper/022:28:270
25469910231,9cyclictest8083-21ssh21:08:420
25469910023,12cyclictest0-21swapper/021:36:310
25469910023,12cyclictest0-21swapper/021:36:310
2551999733,56cyclictest0-21swapper/322:28:193
2546999632,9cyclictest32697-21kworker/0:021:53:220
255099944,83cyclictest0-21swapper/220:53:252
244562930,10sleep2255099cyclictest19:53:422
2551999139,45cyclictest0-21swapper/320:48:083
2551999123,13cyclictest0-21swapper/322:49:473
2550999125,46cyclictest0-21swapper/220:38:302
2551999024,12cyclictest0-21swapper/322:07:043
2551998938,45cyclictest0-21swapper/320:53:313
2551998930,9cyclictest14545-21cpuspeed_turbos22:58:173
2551998930,9cyclictest14545-21cpuspeed_turbos22:58:173
255099893,35cyclictest0-21swapper/222:53:582
2551998838,42cyclictest5048-21fschecks_time22:43:223
255099883,33cyclictest0-21swapper/220:38:052
255199875,33cyclictest0-21swapper/321:26:023
255199875,30cyclictest0-21swapper/321:28:143
255199874,31cyclictest0-21swapper/321:53:203
2551998736,45cyclictest0-21swapper/322:41:443
2551998726,14cyclictest0-21swapper/321:44:403
255199865,74cyclictest0-21swapper/323:23:373
2551998633,46cyclictest0-21swapper/320:09:473
2551998631,48cyclictest0-21swapper/323:19:123
2551998619,12cyclictest0-21swapper/321:13:423
255099864,30cyclictest0-21swapper/222:33:052
2550998630,48cyclictest0-21swapper/221:33:222
2550998630,48cyclictest0-21swapper/221:33:222
255099863,76cyclictest3036-21ssh21:03:122
2550998622,12cyclictest0-21swapper/222:08:282
255199855,35cyclictest0-21swapper/321:58:223
255199855,14cyclictest0-21swapper/320:31:493
255199854,26cyclictest0-21swapper/320:24:463
255199853,33cyclictest0-21swapper/320:17:363
2551998529,8cyclictest24548-21cpuspeed_turbos18:48:273
2551998529,8cyclictest24548-21cpuspeed_turbos18:48:273
2551998529,11cyclictest0-21swapper/320:23:103
2551998529,11cyclictest0-21swapper/320:23:103
2551998519,8cyclictest13313-21cpuspeed_turbos21:18:203
255099854,33cyclictest0-21swapper/223:28:312
255099853,14cyclictest0-21swapper/223:18:312
255099853,10cyclictest15366-21crond20:33:102
255199844,73cyclictest0-21swapper/319:43:233
255199844,32cyclictest0-21swapper/319:33:123
255199844,30cyclictest20246-21aten_r1power_fr22:18:163
255199844,30cyclictest20246-21aten_r1power_fr22:18:163
255199844,29cyclictest1227-21runrttasks23:08:493
255199844,14cyclictest0-21swapper/320:52:193
2551998433,44cyclictest0-21swapper/322:23:173
255099844,33cyclictest0-21swapper/220:58:362
255099844,31cyclictest0-21swapper/222:42:142
255099844,31cyclictest0-21swapper/218:43:312
255099843,33cyclictest0-21swapper/220:13:302
255099842,31cyclictest30879-21ssh21:43:372
2550998419,13cyclictest0-21swapper/220:44:522
2550998416,61cyclictest24238-21fschecks_time22:23:232
232322840,2sleep10-21swapper/119:53:251
255199836,31cyclictest0-21swapper/322:08:073
255199834,32cyclictest0-21swapper/323:18:033
255199834,32cyclictest0-21swapper/322:15:173
255199834,31cyclictest0-21swapper/320:40:223
255199834,13cyclictest0-21swapper/320:33:403
2551998314,13cyclictest0-21swapper/321:08:213
255099834,30cyclictest0-21swapper/222:43:172
255099833,32cyclictest12535-21runrttasks21:17:372
255099833,16cyclictest0-21swapper/221:28:182
255099833,12cyclictest0-21swapper/220:49:342
255199823,15cyclictest0-21swapper/322:34:133
255099824,29cyclictest0-21swapper/223:02:122
255099824,29cyclictest0-21swapper/223:02:122
2550998230,47cyclictest0-21swapper/222:33:282
255099823,32cyclictest0-21swapper/221:58:292
255099823,30cyclictest0-21swapper/221:18:182
255099823,12cyclictest0-21swapper/223:14:522
2550998229,47cyclictest0-21swapper/221:08:212
2550998211,13cyclictest0-21swapper/221:38:202
255199815,13cyclictest12126-21ssh22:53:303
255199814,31cyclictest0-21swapper/320:06:043
255199814,31cyclictest0-21swapper/318:33:143
2551998131,11cyclictest28847-21rm21:42:083
2551998127,9cyclictest24108-21grep21:33:333
2551998127,9cyclictest24108-21grep21:33:333
2550998130,45cyclictest0-21swapper/223:12:282
255099813,38cyclictest0-21swapper/220:24:062
255099813,33cyclictest0-21swapper/222:22:112
255099813,33cyclictest0-21swapper/222:22:112
255099813,33cyclictest0-21swapper/220:18:422
255099813,33cyclictest0-21swapper/220:18:422
255099813,31cyclictest0-21swapper/220:09:412
255099813,24cyclictest0-21swapper/221:23:192
255099813,12cyclictest0-21swapper/221:48:222
255099812,73cyclictest27561-21diskmemload22:50:322
255099812,33cyclictest0-21swapper/222:13:402
255199804,31cyclictest0-21swapper/318:58:153
255199803,33cyclictest0-21swapper/321:52:483
2551998028,9cyclictest12847-21df_abs18:23:293
255099804,32cyclictest0-21swapper/223:24:572
255099804,30cyclictest0-21swapper/218:08:282
255099803,30cyclictest0-21swapper/222:08:012
2550998018,14cyclictest0-21swapper/221:53:412
2550998017,15cyclictest0-21swapper/219:18:272
255199794,13cyclictest0-21swapper/323:28:173
2551997928,8cyclictest1227-21runrttasks19:43:123
255099794,30cyclictest0-21swapper/219:33:122
255099794,28cyclictest27561-21diskmemload23:07:352
255099793,34cyclictest1124-21snmpd19:37:552
255099793,34cyclictest1124-21snmpd19:37:552
255199783,39cyclictest0-21swapper/321:03:333
2551997825,11cyclictest21863-21munin-node18:43:313
255199775,24cyclictest0-21swapper/321:01:203
255199775,11cyclictest0-21swapper/319:08:133
255199774,27cyclictest0-21swapper/319:18:443
2551997727,9cyclictest1227-21runrttasks19:59:073
255099773,35cyclictest25411-21munin-node19:58:432
2550997729,40cyclictest0-21swapper/218:05:212
255199765,30cyclictest0-21swapper/323:04:013
255099763,24cyclictest0-21swapper/218:53:422
2550997623,8cyclictest17100-21aten_r1power_cu18:33:232
255199753,22cyclictest23691-21cut19:53:303
255099753,30cyclictest0-21swapper/218:28:412
2550997510,8cyclictest107550irq/46-eth019:25:232
255099744,13cyclictest0-21swapper/218:23:332
255099743,30cyclictest0-21swapper/219:48:312
255099743,29cyclictest0-21swapper/219:03:272
2550997317,9cyclictest18004-21latency_hist19:43:132
255199728,27cyclictest4038-21ntpq18:03:413
2551997219,8cyclictest30731-21sed18:58:473
255099723,33cyclictest0-21swapper/219:13:132
255099715,13cyclictest0-21swapper/219:13:262
2550997125,9cyclictest0-21swapper/218:18:282
255099703,14cyclictest0-21swapper/218:48:252
255099703,14cyclictest0-21swapper/218:48:252
255099702,32cyclictest18271-21sshd19:43:222
2550996823,8cyclictest29326-21cpuspeed_turbos18:58:282
255099673,13cyclictest0-21swapper/218:13:262
254699654,13cyclictest0-21swapper/022:23:370
2551996427,10cyclictest0-21swapper/319:48:463
219499640,6rtkit-daemon0-21swapper/018:13:381
5342635,51sleep00-21swapper/022:38:000
2546996335,10cyclictest16248-21telnet21:23:180
2548996226,26cyclictest30613-21uptime20:53:431
254699624,17cyclictest0-21swapper/023:18:260
254699623,40cyclictest0-21swapper/022:16:480
66382614,11sleep10-21swapper/121:57:421
254899609,12cyclictest0-21swapper/123:06:081
2546996018,20cyclictest3239-21ssh22:40:000
2546995932,8cyclictest21124-21rm22:18:250
2546995932,8cyclictest21124-21rm22:18:250
2546995833,9cyclictest1124-21snmpd20:03:530
2546995831,8cyclictest11564-21ssh21:13:510
2546995815,26cyclictest0-21swapper/020:19:530
2546995815,26cyclictest0-21swapper/020:19:530
77842573,46sleep07882-21sed21:58:250
254899575,46cyclictest0-21swapper/120:30:181
2548995716,35cyclictest6483-21head20:18:291
2548995716,35cyclictest6483-21head20:18:291
2546995732,9cyclictest16479-21ssh22:12:370
2546995731,9cyclictest8987-21munin-node20:23:330
254699573,9cyclictest5821-21python22:43:340
45032563,9sleep00-21swapper/019:13:310
261972562,48sleep00-21swapper/018:50:410
261972562,48sleep00-21swapper/018:50:410
2548995611,39cyclictest1080-21lldpd22:33:351
2546995632,9cyclictest7547-21munin-node18:13:250
2546995632,9cyclictest19776-21ssh20:38:290
2546995629,9cyclictest29811-21ssh21:43:210
2546995623,13cyclictest0-21swapper/023:08:050
254699554,11cyclictest0-21swapper/021:38:240
254699554,11cyclictest0-21swapper/020:28:220
2546995531,10cyclictest28769-21munin-node20:53:450
2546995531,10cyclictest10697-21sshd19:26:230
2546995530,9cyclictest14797-21telnet18:28:260
126372554,44sleep00-21swapper/018:23:290
2551995440,8cyclictest5204-21munin-node18:08:283
254899545,31cyclictest0-21swapper/123:33:021
2548995440,9cyclictest29905-21gltestperf18:58:331
2548995418,11cyclictest0-21swapper/118:18:411
2546995431,8cyclictest4452-21ssh23:32:230
2546995431,10cyclictest1124-21snmpd19:40:240
254699543,11cyclictest0-21swapper/023:27:140
2546995429,10cyclictest1124-21snmpd21:02:520
2546995411,25cyclictest0-21swapper/021:28:310
201162543,44sleep10-21swapper/119:44:431
41382536,10sleep10-21swapper/120:13:541
254899535,42cyclictest0-21swapper/122:44:161
254699539,26cyclictest32345-21cut20:08:360
254699534,29cyclictest0-21swapper/018:08:380
2546995333,7cyclictest27561-21diskmemload23:00:090
2546995333,7cyclictest27561-21diskmemload23:00:090
2546995332,9cyclictest26633-21munin-node18:53:380
2546995331,7cyclictest5390-21ssh21:05:260
2546995330,8cyclictest8475-21kworker/0:120:16:520
254699533,12cyclictest0-21swapper/020:48:260
2546995323,13cyclictest0-21swapper/020:43:220
191332534,10sleep00-21swapper/018:36:550
36652523,10sleep10-21swapper/119:13:071
33882523,10sleep10-21swapper/121:52:581
280042523,43sleep10-21swapper/120:51:141
2551995227,7cyclictest6112-21cat19:18:123
254899524,21cyclictest0-21swapper/121:43:341
2548995214,31cyclictest107550irq/46-eth023:03:041
2548995214,31cyclictest107550irq/46-eth023:03:041
2548995210,37cyclictest201ktimersoftd/122:18:221
2548995210,37cyclictest201ktimersoftd/122:18:221
2546995231,8cyclictest27561-21diskmemload22:03:410
2546995231,8cyclictest1124-21snmpd19:18:550
254699523,11cyclictest0-21swapper/023:12:000
254699523,11cyclictest0-21swapper/019:04:560
2546995224,12cyclictest0-21swapper/022:48:140
2546995222,13cyclictest0-21swapper/022:53:280
215442525,10sleep00-21swapper/018:42:150
285872513,42sleep10-21swapper/121:41:091
254899513,8cyclictest12-21rcu_preempt21:08:391
254899513,44cyclictest0-21swapper/123:13:151
254699514,29cyclictest0-21swapper/021:53:070
2546995123,12cyclictest0-21swapper/019:13:120
2546995121,13cyclictest0-21swapper/023:13:260
127792515,40sleep10-21swapper/122:06:041
255199505,39cyclictest0-21swapper/318:38:493
254899508,36cyclictest0-21swapper/122:23:181
254899505,14cyclictest0-21swapper/120:03:261
254899505,13cyclictest0-21swapper/123:23:211
254899504,41cyclictest0-21swapper/120:58:251
254899504,27cyclictest0-21swapper/122:53:371
254699504,28cyclictest0-21swapper/018:18:400
2546995022,12cyclictest0-21swapper/019:28:290
213942503,40sleep10-21swapper/120:41:071
188282503,10sleep10-21swapper/121:26:341
156752506,11sleep00-21swapper/021:22:050
103272503,40sleep10-21swapper/122:51:591
255199494,38cyclictest8754-21telnet19:23:243
255099495,25cyclictest2538-21cyclictest18:03:152
254899496,38cyclictest0-21swapper/123:18:321
254899496,26cyclictest0-21swapper/118:53:231
254899494,26cyclictest0-21swapper/119:23:341
254899493,28cyclictest0-21swapper/121:18:011
254899493,26cyclictest0-21swapper/122:38:311
254899493,24cyclictest0-21swapper/120:08:171
254899493,20cyclictest22954-21sh21:33:191
254899493,20cyclictest22954-21sh21:33:191
254899493,11cyclictest0-21swapper/122:13:371
2548994915,29cyclictest201ktimersoftd/120:33:381
2546994924,9cyclictest15961-21grep20:33:230
2546994921,13cyclictest0-21swapper/018:03:280
23102494,37sleep00-21swapper/018:00:360
154032493,40sleep10-21swapper/121:21:011
254899485,13cyclictest0-21swapper/121:28:311
254899485,12cyclictest0-21swapper/119:05:191
254899484,8cyclictest3507-21df21:03:221
254899484,26cyclictest0-21swapper/119:33:351
254899484,26cyclictest0-21swapper/119:33:351
254899484,25cyclictest0-21swapper/123:10:561
254899483,27cyclictest0-21swapper/121:58:101
254899483,27cyclictest0-21swapper/119:58:381
254899483,26cyclictest0-21swapper/122:28:261
254899483,25cyclictest0-21swapper/118:33:141
254899483,24cyclictest0-21swapper/120:43:581
254899483,11cyclictest0-21swapper/122:11:061
254699484,27cyclictest0-21swapper/019:48:290
254699483,29cyclictest0-21swapper/018:58:360
254699483,28cyclictest0-21swapper/019:44:330
2546994818,13cyclictest0-21swapper/018:43:420
219499480,6rtkit-daemon2193-21rtkit-daemon17:58:311
130122483,40sleep10-21swapper/119:30:291
254899475,13cyclictest0-21swapper/118:48:261
254899475,13cyclictest0-21swapper/118:48:261
254899474,26cyclictest0-21swapper/118:45:161
254899473,25cyclictest0-21swapper/119:38:221
2548994720,9cyclictest7319-21iostat19:18:351
2548994718,12cyclictest0-21swapper/120:23:331
2548994715,11cyclictest5001-21latency19:13:361
2546994725,10cyclictest25438-21telnet19:58:220
255199463,36cyclictest0-21swapper/318:33:273
2551994620,12cyclictest0-21swapper/319:33:243
2551994620,12cyclictest0-21swapper/319:33:243
2548994632,9cyclictest20398-21sed18:38:351
254899463,27cyclictest0-21swapper/118:33:321
254899463,25cyclictest0-21swapper/118:05:581
254899463,23cyclictest5158-21munin-node18:08:321
2548994618,11cyclictest0-21swapper/119:48:231
2548994618,11cyclictest0-21swapper/118:23:311
2546994634,8cyclictest23354-21tr19:53:260
2546994619,12cyclictest0-21swapper/019:33:240
2546994619,12cyclictest0-21swapper/019:33:240
255199445,33cyclictest0-21swapper/318:18:353
21232444,6sleep30-21swapper/317:58:463
255199434,33cyclictest0-21swapper/319:08:263
2551994223,14cyclictest0-21swapper/318:13:393
2550994125,11cyclictest0-21swapper/218:42:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional