You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 06:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jun 03, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1908621370,4sleep219081-21cpuspeed_turbos22:55:232
20738998839,31cyclictest23764-21ssh21:25:523
20738998440,27cyclictest18969-21wc22:05:443
20738998437,29cyclictest27268-21ntp_states21:30:393
20738998437,29cyclictest161731ssh23:38:503
20738998332,31cyclictest0-21swapper/323:50:333
20738998332,31cyclictest0-21swapper/323:50:333
20738998330,30cyclictest0-21swapper/322:40:283
20738998237,38cyclictest16221-21ntp_states00:25:343
20738998138,35cyclictest3427-21runrttasks21:44:463
20738998136,37cyclictest27305-21tr23:55:213
20738998037,26cyclictest22682-21kworker/3:121:54:423
20738998035,28cyclictest15954-21rm21:15:293
20738998035,28cyclictest15954-21rm21:15:293
20738998033,28cyclictest1124-21snmpd22:38:373
20738997935,36cyclictest21988-21ntpq22:10:383
20738997932,40cyclictest0-21swapper/321:35:343
20738997930,42cyclictest0-21swapper/322:27:303
20738997930,41cyclictest4795-21sendmail_mailqu23:20:383
20738997928,43cyclictest0-21swapper/321:14:283
20738997928,43cyclictest0-21swapper/321:14:283
20738997927,44cyclictest0-21swapper/323:15:203
20738997926,44cyclictest0-21swapper/323:12:463
20738997926,44cyclictest0-21swapper/323:12:463
20738997836,35cyclictest23980-21unixbench_singl23:00:443
20738997831,39cyclictest0-21swapper/323:43:013
20738997831,29cyclictest3871-21ssh00:07:473
20738997831,26cyclictest0-21swapper/322:02:103
20738997828,42cyclictest0-21swapper/322:15:273
20738997827,44cyclictest0-21swapper/323:27:293
20738997824,45cyclictest0-21swapper/320:18:543
20738997823,47cyclictest12708-21ssh21:56:423
20738997823,47cyclictest12708-21ssh21:56:423
219499770,6rtkit-daemon9581-21memory21:05:393
219499770,29rtkit-daemon2193-21rtkit-daemon23:08:560
20738997735,34cyclictest14789-21cat00:25:063
20738997734,26cyclictest11529-21munin-node23:30:363
20738997730,27cyclictest32099-21munin-run19:40:163
20738997729,29cyclictest0-21swapper/300:02:303
20738997725,44cyclictest5756-21munin-run21:00:133
20738997723,37cyclictest0-21swapper/300:32:233
20738997723,37cyclictest0-21swapper/300:32:233
20738997635,25cyclictest1124-21snmpd19:46:463
20738997635,25cyclictest1124-21snmpd19:46:463
20738997633,26cyclictest28918-21grep22:20:413
20738997630,26cyclictest19780-21iostat_ios22:55:313
20738997629,40cyclictest13548-21switchtime22:45:423
20738997629,28cyclictest0-21swapper/321:45:383
20738997627,42cyclictest0-21swapper/322:53:253
20738997623,45cyclictest0-21swapper/321:21:273
20738997537,31cyclictest19888-21fschecks_time20:20:333
20738997531,30cyclictest0-21swapper/322:30:293
20738997531,30cyclictest0-21swapper/322:30:293
20738997531,29cyclictest0-21swapper/323:09:493
20738997530,11cyclictest107550irq/46-eth020:13:433
20738997527,40cyclictest0-21swapper/300:15:163
20738997526,30cyclictest0-21swapper/323:48:013
20738997428,39cyclictest0-21swapper/319:40:493
20738997326,40cyclictest0-21swapper/320:35:323
20738997233,32cyclictest1227-21runrttasks21:01:523
20738997227,29cyclictest0-21swapper/319:21:423
20738997226,39cyclictest0-21swapper/300:10:113
20738997123,41cyclictest0-21swapper/319:10:453
20738997039,24cyclictest27305-21cpuspeed_turbos19:25:273
20738997029,35cyclictest0-21swapper/320:45:153
20738997026,37cyclictest6074-21seq19:50:433
20738997022,40cyclictest0-21swapper/320:30:263
20738997022,40cyclictest0-21swapper/320:30:263
20738996922,39cyclictest0-21swapper/320:00:163
20738996838,14cyclictest31407-21cpuspeed_turbos20:45:283
20738996826,35cyclictest0-21swapper/320:04:193
20738996824,24cyclictest0-21swapper/320:05:283
20738996749,12cyclictest22349-21gltestperf20:25:353
20738996716,34cyclictest0-21swapper/319:05:293
20738996716,34cyclictest0-21swapper/319:05:293
20738996621,37cyclictest2425-21netstat20:50:383
20738996619,32cyclictest0-21swapper/319:31:433
219499650,6rtkit-daemon0-21swapper/020:57:312
20738996538,20cyclictest25146-21tail19:15:383
219499620,4rtkit-daemon2193-21rtkit-daemon00:11:240
2073699627,46cyclictest31790-21processes00:00:401
2073599623,51cyclictest0-21swapper/000:20:330
2073799614,39cyclictest0-21swapper/221:28:282
20736996121,33cyclictest23058-21df_abs21:25:421
2073599613,11cyclictest0-21swapper/023:26:210
153872613,51sleep00-21swapper/022:50:220
68092603,12sleep10-21swapper/121:00:341
52692603,48sleep10-21swapper/123:20:581
219499600,4rtkit-daemon2193-21rtkit-daemon21:39:300
219499600,22rtkit-daemon2193-21rtkit-daemon21:40:300
2073799603,38cyclictest0-21swapper/222:20:332
20736996012,41cyclictest8951-21df_abs21:05:301
20735996029,23cyclictest20343-21grep20:20:390
219499590,6rtkit-daemon2193-21rtkit-daemon23:40:320
2073799593,38cyclictest30554-21ssh00:00:242
20737995919,23cyclictest26-21rcuc/219:20:172
2073599594,47cyclictest0-21swapper/022:10:370
20735995920,29cyclictest0-21swapper/023:10:410
20735995920,29cyclictest0-21swapper/023:10:410
203732597,12sleep00-21swapper/022:10:110
20737995840,10cyclictest5124-21grep00:10:222
2073699584,11cyclictest0-21swapper/100:33:481
2073699584,11cyclictest0-21swapper/100:33:481
2073799577,30cyclictest0-21swapper/200:15:322
2073799574,35cyclictest0-21swapper/220:15:372
2073799573,36cyclictest0-21swapper/221:40:292
20737995719,22cyclictest0-21swapper/200:27:452
2073599573,48cyclictest0-21swapper/000:30:580
2073599573,48cyclictest0-21swapper/000:30:580
56942562,9sleep00-21swapper/020:59:370
20738995631,19cyclictest0-21swapper/319:05:183
2073799565,23cyclictest0-21swapper/223:00:322
20737995624,13cyclictest0-21swapper/200:30:322
20737995624,13cyclictest0-21swapper/200:30:322
20737995620,12cyclictest0-21swapper/219:43:442
20737995617,22cyclictest0-21swapper/222:50:272
219499550,6rtkit-daemon2193-21rtkit-daemon22:41:420
219499550,6rtkit-daemon2193-21rtkit-daemon22:25:350
219499550,5rtkit-daemon2193-21rtkit-daemon00:05:310
2073799554,34cyclictest0-21swapper/222:20:002
20737995533,7cyclictest18100-21ssh21:18:102
20737995533,7cyclictest18100-21ssh21:18:102
20737995518,22cyclictest0-21swapper/221:13:162
20737995518,22cyclictest0-21swapper/221:13:162
20736995537,13cyclictest0-21swapper/122:40:241
20736995536,14cyclictest0-21swapper/100:05:301
20736995536,13cyclictest0-21swapper/123:50:191
20736995536,13cyclictest0-21swapper/123:50:191
20736995527,12cyclictest0-21swapper/123:43:341
2073599554,14cyclictest0-21swapper/021:30:350
192642553,10sleep10-21swapper/122:06:051
283352543,11sleep20-21swapper/220:38:382
233722543,10sleep00-21swapper/020:26:110
219499540,5rtkit-daemon2193-21rtkit-daemon22:45:350
219499540,5rtkit-daemon2193-21rtkit-daemon21:50:440
2073799547,29cyclictest0-21swapper/221:20:192
2073799543,32cyclictest14944-21ssh22:49:412
20737995416,22cyclictest25927-21munin-node21:30:422
20737995413,23cyclictest1084-21lldpd19:35:252
20736995412,25cyclictest0-21swapper/123:16:441
219499530,5rtkit-daemon2193-21rtkit-daemon23:57:320
219499530,5rtkit-daemon2193-21rtkit-daemon23:40:020
219499530,5rtkit-daemon2193-21rtkit-daemon23:17:410
219499530,5rtkit-daemon2193-21rtkit-daemon22:20:360
219499530,5rtkit-daemon2193-21rtkit-daemon22:16:210
219499530,5rtkit-daemon2193-21rtkit-daemon00:15:310
219499530,5rtkit-daemon2193-21rtkit-daemon00:00:240
2073799535,23cyclictest0-21swapper/223:41:582
2073799534,31cyclictest0-21swapper/221:45:302
2073799534,30cyclictest0-21swapper/222:30:322
2073799534,30cyclictest0-21swapper/222:30:322
2073799534,29cyclictest0-21swapper/220:45:352
2073799533,34cyclictest0-21swapper/222:35:342
20737995322,13cyclictest0-21swapper/223:20:232
20737995321,13cyclictest0-21swapper/219:45:372
20737995321,13cyclictest0-21swapper/219:45:372
20737995313,23cyclictest11557-21aten_r1power_en00:20:172
20736995326,11cyclictest0-21swapper/121:54:061
2073599534,13cyclictest0-21swapper/023:50:180
2073599534,13cyclictest0-21swapper/023:50:180
2073599533,44cyclictest0-21swapper/022:55:370
2073599533,43cyclictest0-21swapper/021:45:390
17342533,42sleep10-21swapper/119:40:581
136042532,44sleep00-21swapper/021:59:590
136042532,44sleep00-21swapper/021:59:590
64972523,42sleep10-21swapper/121:48:391
31372524,12sleep10-21swapper/121:43:441
219499520,5rtkit-daemon2193-21rtkit-daemon23:20:260
219499520,5rtkit-daemon2193-21rtkit-daemon23:00:340
219499520,5rtkit-daemon2193-21rtkit-daemon22:32:200
219499520,5rtkit-daemon2193-21rtkit-daemon22:32:200
212382523,42sleep10-21swapper/120:24:311
2073799525,40cyclictest0-21swapper/222:00:342
2073799524,27cyclictest0-21swapper/223:50:222
2073799524,27cyclictest0-21swapper/223:50:222
20737995236,10cyclictest29727-21cpuspeed_turbos21:35:262
20737995233,11cyclictest32167-21ps22:25:392
20737995221,13cyclictest0-21swapper/222:05:262
20737995221,13cyclictest0-21swapper/221:05:472
20737995219,25cyclictest14168-21cut23:35:252
20736995233,13cyclictest0-21swapper/121:20:291
20736995225,11cyclictest0-21swapper/123:25:171
2073599525,41cyclictest0-21swapper/021:09:010
20735995236,10cyclictest22691-21grep19:05:500
20735995236,10cyclictest22691-21grep19:05:500
2073599523,43cyclictest0-21swapper/023:31:050
2073599523,39cyclictest0-21swapper/019:30:470
172132523,7sleep017218-21ssh00:27:210
219499510,5rtkit-daemon2193-21rtkit-daemon22:39:050
2073799517,27cyclictest0-21swapper/221:55:242
2073799517,27cyclictest0-21swapper/221:55:242
2073799515,28cyclictest0-21swapper/223:25:262
2073799514,28cyclictest0-21swapper/221:50:392
2073799514,28cyclictest0-21swapper/220:40:372
2073799514,27cyclictest0-21swapper/222:12:432
2073799514,25cyclictest0-21swapper/223:10:192
2073799514,25cyclictest0-21swapper/223:10:192
2073799513,33cyclictest0-21swapper/200:06:092
2073699516,28cyclictest0-21swapper/122:20:181
2073699514,30cyclictest0-21swapper/121:10:311
2073699514,30cyclictest0-21swapper/121:10:311
20736995133,13cyclictest0-21swapper/121:55:431
20736995133,13cyclictest0-21swapper/121:55:431
20736995126,9cyclictest30860-21python21:35:421
20736995124,12cyclictest0-21swapper/122:16:231
20736995123,12cyclictest0-21swapper/121:30:321
20736995113,12cyclictest0-21swapper/122:45:361
184692513,10sleep10-21swapper/121:19:331
184692513,10sleep10-21swapper/121:19:331
167742512,40sleep00-21swapper/020:15:270
109172513,42sleep10-21swapper/100:18:551
305172503,41sleep10-21swapper/120:40:591
281202502,41sleep00-21swapper/020:35:500
2073799509,23cyclictest0-21swapper/220:15:152
2073799505,27cyclictest0-21swapper/220:00:362
2073799504,33cyclictest0-21swapper/223:49:142
2073799504,28cyclictest0-21swapper/222:40:372
2073799504,27cyclictest0-21swapper/223:05:252
2073799504,26cyclictest0-21swapper/219:05:192
20737995020,12cyclictest0-21swapper/223:55:322
20737995018,14cyclictest0-21swapper/223:15:212
2073699507,25cyclictest0-21swapper/100:14:311
2073699506,26cyclictest0-21swapper/122:35:251
2073699504,41cyclictest0-21swapper/123:01:461
20736995034,12cyclictest0-21swapper/100:28:341
20736995034,11cyclictest0-21swapper/123:13:091
20736995034,11cyclictest0-21swapper/123:13:091
20736995021,12cyclictest0-21swapper/123:55:191
20736995012,20cyclictest13813-21cstates23:35:211
20735995029,14cyclictest12911-21wc20:05:350
140522503,9sleep10-21swapper/120:09:111
138252502,9sleep20-21swapper/220:06:142
125312503,9sleep10-21swapper/123:32:521
69262493,9sleep10-21swapper/119:54:481
31452493,9sleep10-21swapper/120:52:441
289972492,41sleep00-21swapper/019:29:030
259962493,9sleep10-21swapper/120:34:181
259962493,9sleep10-21swapper/120:34:181
2073799494,29cyclictest0-21swapper/220:30:412
2073799494,29cyclictest0-21swapper/220:30:412
2073799494,27cyclictest0-21swapper/223:31:012
2073799493,27cyclictest0-21swapper/219:50:402
20737994918,15cyclictest0-21swapper/219:11:402
2073699496,23cyclictest25931-21df23:05:231
2073699494,28cyclictest0-21swapper/122:12:111
20736994936,8cyclictest22060-21munin-node23:45:431
20736994932,13cyclictest0-21swapper/122:51:551
20736994932,11cyclictest0-21swapper/100:20:561
20736994931,13cyclictest0-21swapper/122:55:571
2073699493,38cyclictest0-21swapper/122:25:381
20736994919,15cyclictest0-21swapper/122:02:191
2073599494,39cyclictest0-21swapper/021:25:130
2073599494,39cyclictest0-21swapper/021:12:290
2073599494,39cyclictest0-21swapper/021:12:290
2073599494,38cyclictest0-21swapper/020:10:320
20735994933,10cyclictest7687-21grep21:00:470
2073599493,39cyclictest0-21swapper/021:25:510
5492483,39sleep10-21swapper/120:47:201
235292483,38sleep10-21swapper/120:28:141
2073799484,27cyclictest0-21swapper/220:25:432
2073799484,26cyclictest0-21swapper/219:35:172
20737994831,10cyclictest2897-21grep20:50:452
2073799483,28cyclictest0-21swapper/219:55:272
2073699485,26cyclictest0-21swapper/122:31:341
2073699485,26cyclictest0-21swapper/122:31:341
2073699485,25cyclictest0-21swapper/119:31:431
2073699483,11cyclictest0-21swapper/120:55:391
20735994831,10cyclictest5690-21grep19:50:360
2073599483,40cyclictest10930-21proc_pri20:00:470
2073599483,39cyclictest0-21swapper/022:04:160
186262483,9sleep10-21swapper/120:16:371
248592473,10sleep10-21swapper/119:15:341
233702472,9sleep00-21swapper/019:10:540
230422473,9sleep10-21swapper/119:09:341
230422473,9sleep10-21swapper/119:09:341
2073799474,26cyclictest0-21swapper/219:25:342
2073799472,32cyclictest0-21swapper/220:22:062
2073699475,26cyclictest0-21swapper/120:10:361
2073699474,27cyclictest0-21swapper/119:35:311
2073699474,26cyclictest0-21swapper/119:58:431
2073699472,38cyclictest0-21swapper/120:36:421
20736994717,12cyclictest0-21swapper/120:00:311
2073599473,38cyclictest0-21swapper/021:15:480
2073599473,38cyclictest0-21swapper/021:15:480
2073599473,38cyclictest0-21swapper/020:43:540
263632462,37sleep00-21swapper/019:20:490
257672462,37sleep00-21swapper/020:31:190
257672462,37sleep00-21swapper/020:31:190
20737994630,10cyclictest22161-21head19:05:422
20737994630,10cyclictest22161-21head19:05:422
20736994623,16cyclictest0-21swapper/119:25:261
20736994615,13cyclictest0-21swapper/119:15:191
20735994632,9cyclictest32298-21strings20:45:390
2073599463,38cyclictest0-21swapper/019:47:420
2073599463,38cyclictest0-21swapper/019:47:420
20735994625,10cyclictest0-21swapper/023:45:090
2073799453,24cyclictest0-21swapper/221:00:352
2073599453,20cyclictest1043-21munin-node20:50:380
20735994518,12cyclictest0-21swapper/019:15:270
205612454,34sleep00-21swapper/019:03:290
263422443,35sleep10-21swapper/119:20:341
2073599443,37cyclictest0-21swapper/019:41:520
20735994419,20cyclictest30375-21df_abs19:35:280
20735994330,8cyclictest8062-21gltestperf19:55:360
20736994225,11cyclictest0-21swapper/119:45:271
20736994225,11cyclictest0-21swapper/119:45:271
2073799413,24cyclictest0-21swapper/219:21:422
2073699404,12cyclictest0-21swapper/119:05:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional