You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 17:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Sep 02, 2026 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2707621800,4sleep11988899cyclictest10:56:161
355421730,5sleep31990199cyclictest11:16:013
1068911600,4ptp4l401ktimersoftd/309:31:213
19888997514,8cyclictest25-21ksoftirqd/114:07:181
90982670,2sleep30-21swapper/310:16:233
194862655,10sleep00-21swapper/009:32:110
103402630,2sleep00-21swapper/012:36:320
19888996119,5cyclictest25-21ksoftirqd/114:56:231
50922600,1sleep30-21swapper/311:16:213
195602604,10sleep20-21swapper/209:33:102
19892995910,11cyclictest26482-21chrt12:53:362
19892995811,12cyclictest2601-21grep11:56:312
19888995822,7cyclictest25-21ksoftirqd/114:56:061
68092570,2sleep10-21swapper/114:45:291
1989299579,14cyclictest20446-21fschecks_time14:26:212
198812570,2sleep00-21swapper/011:41:230
1989299568,21cyclictest17576-21munin-run13:51:052
1989299563,31cyclictest0-21swapper/214:13:122
19888995616,18cyclictest25-21ksoftirqd/112:01:261
19901995523,8cyclictest41-21ksoftirqd/312:21:153
1989299559,12cyclictest31727-21ssh12:59:112
1989299559,12cyclictest28380-21ssh12:22:082
29382540,1sleep30-21swapper/313:02:003
1989299547,14cyclictest18185-21munin-run11:41:022
19888995425,5cyclictest25-21ksoftirqd/114:05:111
19888995420,8cyclictest25-21ksoftirqd/113:21:241
19888995416,7cyclictest25-21ksoftirqd/111:56:211
19901995322,8cyclictest41-21ksoftirqd/312:41:243
19901995322,8cyclictest41-21ksoftirqd/310:01:293
19901995321,7cyclictest41-21ksoftirqd/312:36:203
1989299538,16cyclictest20379-21ssh13:52:312
1989299538,12cyclictest669-21ssh13:01:082
19883995326,4cyclictest9-21ksoftirqd/012:46:030
19883995318,4cyclictest9-21ksoftirqd/012:21:170
1990199526,11cyclictest2033-21apt-get14:41:103
19901995236,3cyclictest41-21ksoftirqd/313:06:153
19901995224,4cyclictest41-21ksoftirqd/314:01:053
19901995223,7cyclictest41-21ksoftirqd/314:26:193
19901995222,8cyclictest41-21ksoftirqd/313:36:243
19901995222,7cyclictest41-21ksoftirqd/311:49:053
19901995220,8cyclictest41-21ksoftirqd/312:14:503
1989299528,11cyclictest5630-21ssh13:06:092
1989299527,12cyclictest11489-21chrt10:21:242
1989299527,11cyclictest31748-21ssh14:05:042
1989299525,13cyclictest29611-21sed14:36:052
1989299525,12cyclictest17382-21awk13:16:342
1989299525,12cyclictest17382-21awk13:16:342
1989299524,13cyclictest18299-21irqrtprio14:56:262
1989299524,13cyclictest10914-21latency_hist11:31:022
1989299524,13cyclictest10914-21latency_hist11:31:022
19883995241,6cyclictest9-21ksoftirqd/011:56:150
19901995124,4cyclictest41-21ksoftirqd/313:16:183
19901995124,4cyclictest41-21ksoftirqd/313:16:183
19901995123,4cyclictest41-21ksoftirqd/314:21:253
19901995122,8cyclictest41-21ksoftirqd/315:05:113
19901995122,8cyclictest41-21ksoftirqd/315:05:113
19901995121,8cyclictest41-21ksoftirqd/314:06:193
19901995120,7cyclictest41-21ksoftirqd/313:30:463
19901995120,7cyclictest41-21ksoftirqd/313:14:443
1989299518,12cyclictest22499-21ssh12:50:132
1989299515,18cyclictest12585-21ssh14:17:252
1989299515,13cyclictest0-21swapper/213:22:362
1989299514,19cyclictest8330-21cstates13:41:202
1989299514,13cyclictest28032-21seq13:27:432
1989299514,12cyclictest31375-21latency_hist11:06:012
1989299514,11cyclictest12675-21cstates14:51:192
1988899511,8cyclictest27627-21sensors_temp12:21:281
19888995116,4cyclictest25-21ksoftirqd/114:21:231
19883995124,4cyclictest9-21ksoftirqd/013:21:040
19883995124,4cyclictest9-21ksoftirqd/013:21:040
19901995022,7cyclictest41-21ksoftirqd/309:46:133
19901995022,6cyclictest41-21ksoftirqd/310:51:213
19901995022,5cyclictest41-21ksoftirqd/313:51:233
19901995021,8cyclictest41-21ksoftirqd/312:26:263
19901995021,8cyclictest41-21ksoftirqd/309:41:013
19901995021,7cyclictest41-21ksoftirqd/312:33:303
19901995021,7cyclictest41-21ksoftirqd/309:56:003
19901995020,7cyclictest41-21ksoftirqd/311:51:583
19901995019,8cyclictest41-21ksoftirqd/310:36:143
1989299509,12cyclictest28008-21ssh11:50:542
1989299509,12cyclictest2318-21ssh14:06:452
1989299508,12cyclictest8158-21ssh12:36:002
1989299508,11cyclictest17345-21ssh12:44:522
1989299507,13cyclictest25938-21ssh15:04:402
1989299507,13cyclictest25938-21ssh15:04:402
1989299506,10cyclictest22951-21munin-node09:41:032
1989299505,17cyclictest1749-21ssh13:34:252
1989299505,12cyclictest9955-21/usr/sbin/munin12:36:252
1989299505,12cyclictest4171-21snmp_o5powerctl14:41:342
1989299505,11cyclictest31290-21cut09:56:192
1989299504,13cyclictest22814-21/usr/sbin/munin13:56:232
1989299504,13cyclictest12470-21mailstats11:31:242
1989299504,12cyclictest6473-21needreboot10:11:222
1989299503,14cyclictest15759-21irqrtprio10:31:192
19888995022,6cyclictest25-21ksoftirqd/111:36:021
19888995021,7cyclictest25-21ksoftirqd/114:31:241
19888995019,7cyclictest25-21ksoftirqd/111:11:181
19888995014,9cyclictest25-21ksoftirqd/109:41:281
19883995023,3cyclictest9-21ksoftirqd/012:16:320
317242490,3sleep231729-21unixbench_multi14:36:352
1990199494,7cyclictest41-21ksoftirqd/313:41:183
19901994923,4cyclictest41-21ksoftirqd/310:41:283
19901994922,4cyclictest41-21ksoftirqd/314:16:193
19901994921,5cyclictest41-21ksoftirqd/310:16:003
19901994921,4cyclictest41-21ksoftirqd/312:56:273
19901994920,8cyclictest41-21ksoftirqd/310:26:133
19901994920,7cyclictest41-21ksoftirqd/312:02:423
19901994919,7cyclictest41-21ksoftirqd/312:46:523
1990199491,8cyclictest30505-21apt-get13:31:093
19901994918,9cyclictest41-21ksoftirqd/311:31:253
19901994918,7cyclictest41-21ksoftirqd/313:24:043
1989299499,19cyclictest10773-21ssh14:48:522
1989299499,16cyclictest13231-21diskmemload12:07:542
1989299497,10cyclictest17468-21ssh14:22:242
1989299495,16cyclictest12077-21mailstats13:11:272
1989299495,14cyclictest18447-21taskset12:12:252
1989299495,12cyclictest22023-21irqrtprio12:16:222
1989299495,10cyclictest4393-21python10:06:242
1989299494,16cyclictest32306-21awk12:26:232
1989299494,12cyclictest3737-21cat13:36:232
1989299493,13cyclictest7862-21cpuspeed_turbos10:16:132
19888994920,7cyclictest25-21ksoftirqd/112:51:281
19888994920,5cyclictest25-21ksoftirqd/112:46:221
19888994915,8cyclictest25-21ksoftirqd/112:56:281
19883994923,4cyclictest9-21ksoftirqd/013:36:330
19883994922,3cyclictest9-21ksoftirqd/014:01:050
19883994921,4cyclictest9-21ksoftirqd/014:41:060
19901994820,8cyclictest41-21ksoftirqd/314:04:103
19901994820,5cyclictest41-21ksoftirqd/314:56:243
19901994820,4cyclictest41-21ksoftirqd/311:06:243
19901994819,8cyclictest41-21ksoftirqd/314:36:213
19901994818,9cyclictest41-21ksoftirqd/310:21:143
19901994818,9cyclictest41-21ksoftirqd/309:56:283
19901994818,7cyclictest41-21ksoftirqd/314:14:243
19901994818,7cyclictest41-21ksoftirqd/311:59:263
19901994817,7cyclictest41-21ksoftirqd/314:50:503
1989299487,13cyclictest21682-21chrt10:45:452
1989299485,9cyclictest26774-21apt-get10:56:122
1989299484,17cyclictest25390-21missed_timers10:51:222
1989299484,12cyclictest23365-21latency_hist11:46:022
1989299484,11cyclictest849-21cstates10:01:132
1989299484,11cyclictest0-21swapper/211:51:462
19888994821,5cyclictest25-21ksoftirqd/113:58:471
19888994819,7cyclictest25-21ksoftirqd/113:36:211
19888994819,7cyclictest25-21ksoftirqd/111:46:211
19888994814,4cyclictest25-21ksoftirqd/113:42:541
19888994814,4cyclictest25-21ksoftirqd/113:18:531
19888994814,4cyclictest25-21ksoftirqd/113:18:531
19888994810,7cyclictest25-21ksoftirqd/112:32:151
19901994725,9cyclictest41-21ksoftirqd/313:46:193
19901994720,8cyclictest41-21ksoftirqd/312:10:593
19901994720,5cyclictest41-21ksoftirqd/311:01:013
19901994720,5cyclictest41-21ksoftirqd/309:36:103
19901994718,7cyclictest41-21ksoftirqd/311:41:513
19901994717,7cyclictest41-21ksoftirqd/311:40:453
19901994716,7cyclictest41-21ksoftirqd/314:32:583
1989299477,21cyclictest13231-21diskmemload12:02:082
1989299474,13cyclictest4333-21fschecks_count11:16:162
1989299474,10cyclictest29129-21memory09:51:192
1988899477,9cyclictest13231-21diskmemload14:31:061
1988899474,7cyclictest25-21ksoftirqd/111:36:201
19888994718,7cyclictest25-21ksoftirqd/114:11:291
19888994717,9cyclictest25-21ksoftirqd/112:41:151
19883994737,4cyclictest9-21ksoftirqd/013:51:170
19883994722,3cyclictest9-21ksoftirqd/013:51:050
19901994619,9cyclictest41-21ksoftirqd/311:21:183
19901994618,8cyclictest41-21ksoftirqd/314:55:013
1990199461,7cyclictest41-21ksoftirqd/312:16:163
1988899466,3cyclictest121rcu_preempt12:11:031
1988899464,8cyclictest25-21ksoftirqd/111:01:191
19888994625,3cyclictest25-21ksoftirqd/112:17:071
19888994617,4cyclictest25-21ksoftirqd/113:11:251
19888994616,8cyclictest25-21ksoftirqd/113:01:311
19883994622,3cyclictest9-21ksoftirqd/014:31:350
19883994622,3cyclictest9-21ksoftirqd/012:46:330
19883994621,3cyclictest9-21ksoftirqd/012:26:310
169622460,2sleep00-21swapper/014:56:040
1990199456,9cyclictest41-21ksoftirqd/311:06:013
1990199456,4cyclictest41-21ksoftirqd/312:56:033
19901994518,5cyclictest41-21ksoftirqd/310:46:263
19901994517,9cyclictest41-21ksoftirqd/310:06:223
1989299454,10cyclictest22037-21apt-get10:46:122
1988899453,8cyclictest25-21ksoftirqd/113:31:051
19888994520,5cyclictest25-21ksoftirqd/109:56:131
19888994518,9cyclictest25-21ksoftirqd/110:36:181
19883994522,3cyclictest9-21ksoftirqd/010:26:290
19883994521,3cyclictest9-21ksoftirqd/014:06:330
1989299446,10cyclictest233-21systemd-journal09:37:352
1989299444,10cyclictest17841-21if_enp1s0.110:36:182
1988899443,7cyclictest25-21ksoftirqd/113:51:351
19888994420,3cyclictest25-21ksoftirqd/114:19:231
19888994414,7cyclictest25-21ksoftirqd/112:13:361
19888994410,3cyclictest25-21ksoftirqd/110:11:171
19883994433,4cyclictest9-21ksoftirqd/012:56:160
19883994432,7cyclictest9-21ksoftirqd/009:46:110
19883994421,4cyclictest9-21ksoftirqd/011:51:200
19883994420,3cyclictest9-21ksoftirqd/014:26:240
19883994419,4cyclictest9-21ksoftirqd/010:41:140
19883994417,4cyclictest9-21ksoftirqd/012:01:170
1990199437,7cyclictest41-21ksoftirqd/311:26:213
1990199437,7cyclictest41-21ksoftirqd/311:26:213
1990199430,9cyclictest41-21ksoftirqd/310:31:193
1988899436,9cyclictest25-21ksoftirqd/110:46:141
1988899436,9cyclictest25-21ksoftirqd/110:21:001
1988899435,8cyclictest25-21ksoftirqd/113:46:281
1988899435,8cyclictest25-21ksoftirqd/111:16:291
1988899435,7cyclictest25-21ksoftirqd/112:26:321
1988899435,10cyclictest25-21ksoftirqd/114:36:351
1988899434,5cyclictest25-21ksoftirqd/110:06:291
1988899434,10cyclictest25-21ksoftirqd/113:06:271
1988899432,7cyclictest25-21ksoftirqd/112:36:211
19888994318,9cyclictest25-21ksoftirqd/111:26:201
19888994318,9cyclictest25-21ksoftirqd/111:26:201
19888994316,9cyclictest25-21ksoftirqd/109:36:121
19883994319,4cyclictest9-21ksoftirqd/013:26:160
19883994319,4cyclictest9-21ksoftirqd/010:36:140
19883994318,3cyclictest9-21ksoftirqd/011:21:240
19883994317,4cyclictest9-21ksoftirqd/013:31:160
1988899425,7cyclictest25-21ksoftirqd/110:01:281
1988899424,7cyclictest25-21ksoftirqd/111:41:191
1988899424,10cyclictest25-21ksoftirqd/115:01:291
1988899424,10cyclictest25-21ksoftirqd/115:01:291
1988899423,8cyclictest25-21ksoftirqd/114:46:221
1988899422,7cyclictest25-21ksoftirqd/110:21:141
1988899421,7cyclictest25-21ksoftirqd/110:41:301
1988899420,2cyclictest121rcu_preempt11:21:231
1988399423,5cyclictest9-21ksoftirqd/011:11:170
19883994219,4cyclictest9-21ksoftirqd/012:06:130
19883994219,3cyclictest9-21ksoftirqd/011:36:300
19883994218,4cyclictest9-21ksoftirqd/013:44:490
19883994218,3cyclictest9-21ksoftirqd/010:26:010
1989299414,12cyclictest2448-21memory11:11:202
1988899416,4cyclictest25-21ksoftirqd/113:33:571
1988899416,3cyclictest121rcu_preempt10:26:191
1988899414,8cyclictest25-21ksoftirqd/109:51:001
1988899414,7cyclictest25-21ksoftirqd/111:51:161
1988899414,4cyclictest25-21ksoftirqd/110:31:301
1988399419,4cyclictest9-21ksoftirqd/013:09:280
19883994133,5cyclictest9-21ksoftirqd/012:51:160
19883994116,4cyclictest9-21ksoftirqd/010:31:160
19883994115,4cyclictest9-21ksoftirqd/014:16:470
19883994112,7cyclictest9-21ksoftirqd/012:11:190
1989299405,12cyclictest648-21rs:main2
1988899404,3cyclictest121rcu_preempt09:50:591
19883994015,4cyclictest9-21ksoftirqd/014:01:230
19883994013,5cyclictest9-21ksoftirqd/014:46:060
1971024018,11sleep125-21ksoftirqd/109:35:071
1988899397,3cyclictest25-21ksoftirqd/111:06:161
1988899394,2cyclictest121rcu_preempt10:51:161
19883993929,3cyclictest9-21ksoftirqd/013:21:210
19883993929,3cyclictest9-21ksoftirqd/010:01:150
19883993928,3cyclictest9-21ksoftirqd/011:46:240
1988399391,4cyclictest28845-21munin-run11:01:000
1988399390,3cyclictest121rcu_preempt14:21:360
1988399383,6cyclictest121rcu_preempt13:01:330
1988399383,3cyclictest9-21ksoftirqd/014:56:230
19883993825,6cyclictest9-21ksoftirqd/011:06:290
19883993825,3cyclictest9-21ksoftirqd/013:11:190
19883993814,3cyclictest9-21ksoftirqd/009:56:160
19883993811,5cyclictest9-21ksoftirqd/015:01:320
19883993811,5cyclictest9-21ksoftirqd/015:01:320
19883993811,5cyclictest9-21ksoftirqd/011:01:180
19883993811,4cyclictest9-21ksoftirqd/009:40:590
1988399380,6cyclictest121rcu_preempt11:36:020
1988399373,6cyclictest9-21ksoftirqd/010:46:160
19883993727,3cyclictest9-21ksoftirqd/009:51:150
19883993726,3cyclictest9-21ksoftirqd/011:26:150
19883993726,3cyclictest9-21ksoftirqd/011:26:150
19883993723,4cyclictest9-21ksoftirqd/010:06:210
1988399371,3cyclictest8317-21ssh12:36:040
19883993710,4cyclictest9-21ksoftirqd/014:46:270
1989299364,17cyclictest26912-21snmp_o5powerctl09:46:252
19883993619,7cyclictest9-21ksoftirqd/010:51:170
19883993612,4cyclictest9-21ksoftirqd/009:41:140
1989299354,19cyclictest0-21swapper/211:06:292
1988399350,3cyclictest121rcu_preempt10:16:220
1988399349,4cyclictest9-21ksoftirqd/014:11:190
19883993423,3cyclictest9-21ksoftirqd/011:21:010
1989299337,10cyclictest8195-21chrt11:22:302
1988399326,3cyclictest9-21ksoftirqd/010:11:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional