You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 04:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Sun Apr 12, 2026 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
56921590,5sleep72456899cyclictest21:55:177
2613821400,0sleep20-21swapper/223:15:332
2253721370,0sleep20-21swapper/221:23:532
763521180,0sleep20-21swapper/222:52:182
223321130,0sleep20-21swapper/222:24:282
1845621090,1sleep2321ktimersoftd/221:27:072
199582890,1sleep4501ktimersoftd/423:06:384
85912840,4sleep62456199cyclictest22:14:316
85912840,4sleep62456199cyclictest22:14:306
326882820,0sleep00-21swapper/021:27:520
143902820,1sleep314393-21sed00:20:183
200242800,0sleep50-21swapper/521:18:355
144842800,1sleep30-21swapper/323:08:053
70102790,0sleep30-21swapper/323:43:563
59342790,1sleep6671rcuc/600:30:166
84032780,0sleep10-21swapper/121:26:331
67962780,1sleep06773-21sshd23:28:230
224692780,1sleep50-21swapper/522:56:305
149902780,1sleep70-21swapper/723:20:127
42922770,0sleep50-21swapper/521:40:085
89192760,0sleep60-21swapper/600:16:366
305652760,1sleep07-21ksoftirqd/021:19:110
179922760,1sleep07-21ksoftirqd/000:11:580
287092750,1sleep328705-21sshd22:43:063
74142740,0sleep10-21swapper/100:38:591
68242740,2sleep62456199cyclictest21:10:596
174092740,1sleep3401rcuc/300:01:353
98972730,0sleep60-21swapper/623:09:376
15382730,1sleep41539-21sshd21:45:034
116502730,0sleep20-21swapper/223:44:112
58932720,0sleep2311rcuc/220:44:592
40732720,1sleep3401rcuc/323:50:383
40732720,1sleep3401rcuc/323:50:373
323082720,1sleep532306-21sshd23:36:375
323082720,1sleep532306-21sshd23:36:365
254642720,0sleep10-21swapper/119:10:131
218892720,0sleep2311rcuc/222:46:082
161462720,1sleep416144-21sshd22:04:364
126472720,1sleep412646-21sshd00:21:554
6262710,0sleep4491rcuc/423:45:174
143192710,0sleep40-21swapper/423:18:244
92692700,0sleep70-21swapper/700:16:377
8732700,0sleep40-21swapper/421:10:414
34602700,4sleep62456199cyclictest23:04:076
319372700,0sleep50-21swapper/522:20:475
75512690,0sleep70-21swapper/721:12:447
304222690,0sleep7761rcuc/723:05:297
292342690,0sleep20-21swapper/221:17:202
24692690,0sleep00-21swapper/000:17:580
201062690,0sleep10-21swapper/121:22:001
278252680,1sleep6681ktimersoftd/621:34:316
19682670,1sleep41967-21sshd22:33:054
320032660,0sleep30-21swapper/323:22:493
24152640,4sleep42455199cyclictest00:00:474
277482630,0sleep20-21swapper/221:56:402
3212620,0sleep10-21swapper/123:40:091
64682600,0sleep50-21swapper/521:10:595
2414425949,6sleep70-21swapper/719:07:407
2416025848,6sleep30-21swapper/319:07:523
2419325747,6sleep00-21swapper/019:08:210
2331725731,11sleep10-21swapper/119:05:171
2406725332,6sleep40-21swapper/419:06:404
2418125039,7sleep60-21swapper/619:08:116
2413924636,6sleep20-21swapper/219:07:352
306462430,0sleep50-21swapper/522:19:025
306462430,0sleep50-21swapper/522:19:025
2409824130,7sleep50-21swapper/519:07:065
266602290,0sleep40-21swapper/423:51:514
266602290,0sleep40-21swapper/423:51:504
2454099281,12cyclictest0-21swapper/200:08:322
97062270,1sleep40-21swapper/423:35:234
97062270,1sleep40-21swapper/423:35:234
266162270,0sleep30-21swapper/321:18:593
203002270,0sleep40-21swapper/423:13:364
54432250,0sleep70-21swapper/723:16:107
316882250,2sleep60-21swapper/600:14:296
257952250,0sleep40-21swapper/423:20:404
2454099240,20cyclictest0-21swapper/222:06:032
206562240,0sleep50-21swapper/521:30:395
284572230,1sleep30-21swapper/321:44:463
267862230,1sleep30-21swapper/322:48:093
2454099230,1cyclictest80750irq/25-eno1-rx-23:33:542
2454099230,1cyclictest80750irq/25-eno1-rx-23:33:532
100892230,1sleep610088-21bash23:50:576
100892230,1sleep610088-21bash23:50:566
248992220,1sleep10-21swapper/123:46:351
62622210,0sleep20-21swapper/200:25:062
49522210,0sleep20-21swapper/223:28:162
2454099210,20cyclictest8614-21sshd23:57:442
2454099210,20cyclictest0-21swapper/200:00:152
2454099210,1cyclictest0-21swapper/200:12:312
155362210,0sleep50-21swapper/522:14:545
155362210,0sleep50-21swapper/522:14:545
78402200,1sleep07836-21sshd22:21:140
58432200,1sleep00-21swapper/022:57:210
38382200,0sleep00-21swapper/022:36:360
267472200,1sleep00-21swapper/021:30:580
2455199200,2cyclictest17747-21sshd00:00:004
2454099200,13cyclictest0-21swapper/219:24:242
2452899200,1cyclictest0-21swapper/023:00:390
203292200,1sleep720275-21sshd22:49:347
2453499190,17cyclictest0-21swapper/123:57:051
2452899190,6cyclictest0-21swapper/020:48:270
229982190,0sleep40-21swapper/421:59:544
94362180,1sleep7761rcuc/722:28:197
55562180,0sleep20-21swapper/223:35:142
55562180,0sleep20-21swapper/223:35:132
49582180,0sleep10-21swapper/123:00:421
4752180,0sleep30-21swapper/323:00:293
269642180,0sleep10-21swapper/122:18:511
269642180,0sleep10-21swapper/122:18:501
2454099183,12cyclictest0-21swapper/219:53:522
2454099183,12cyclictest0-21swapper/219:53:522
2454099182,12cyclictest0-21swapper/220:09:122
2453499180,1cyclictest0-21swapper/123:32:221
2453499180,1cyclictest0-21swapper/123:32:211
2453499180,16cyclictest0-21swapper/100:25:181
2453499180,11cyclictest0-21swapper/121:13:391
2452899189,4cyclictest7-21ksoftirqd/000:25:010
2452899183,5cyclictest7-21ksoftirqd/021:21:400
203422180,1sleep10-21swapper/122:21:551
299782170,1sleep129977-21sshd22:12:101
299782170,1sleep129977-21sshd22:12:091
2455699170,15cyclictest461-21systemd-journal23:03:095
2454099172,13cyclictest0-21swapper/221:04:552
2454099172,12cyclictest0-21swapper/220:03:442
24540991715,1cyclictest1-21systemd23:20:402
2452899177,3cyclictest7-21ksoftirqd/023:59:350
2452899177,3cyclictest7-21ksoftirqd/022:40:320
171342170,1sleep5591ktimersoftd/522:39:065
138142170,0sleep20-21swapper/200:35:492
137442170,13sleep280750irq/25-eno1-rx-23:51:082
137442170,13sleep280750irq/25-eno1-rx-23:51:082
32862160,1sleep40-21swapper/422:52:034
268062160,0sleep5581rcuc/523:31:085
268062160,0sleep5581rcuc/523:31:075
2456899160,14cyclictest2706-21bash21:28:017
2456199166,3cyclictest69-21ksoftirqd/622:04:576
2456199164,3cyclictest69-21ksoftirqd/622:31:576
2456199163,5cyclictest658-21polkitd23:15:166
2456199162,4cyclictest69-21ksoftirqd/622:27:116
24561991613,1cyclictest22060-21sshd21:54:456
24561991612,2cyclictest761-21systemd-logind22:52:026
2456199160,2cyclictest0-21swapper/622:20:146
2455699160,14cyclictest6804-21gdbus23:21:505
2455199160,14cyclictest726-21gdbus23:33:354
2455199160,14cyclictest726-21gdbus23:33:344
2454099163,12cyclictest0-21swapper/221:43:592
2454099162,13cyclictest0-21swapper/219:37:522
2454099161,7cyclictest0-21swapper/221:05:202
2454099161,12cyclictest0-21swapper/220:27:432
2454099160,8cyclictest0-21swapper/220:21:442
2454099160,8cyclictest0-21swapper/220:15:042
2454099160,8cyclictest0-21swapper/200:31:432
2454099160,15cyclictest0-21swapper/221:32:312
2454099160,13cyclictest0-21swapper/222:38:472
2454099160,13cyclictest0-21swapper/220:54:392
2454099160,13cyclictest0-21swapper/220:32:312
2454099160,13cyclictest0-21swapper/219:41:442
2454099160,13cyclictest0-21swapper/219:31:442
2454099160,13cyclictest0-21swapper/219:26:242
2454099160,13cyclictest0-21swapper/219:15:452
2453499165,9cyclictest726-21gdbus21:38:261
2452899165,3cyclictest7-21ksoftirqd/023:32:020
2452899165,3cyclictest7-21ksoftirqd/023:32:010
2452899164,5cyclictest7-21ksoftirqd/021:47:430
2452899164,1cyclictest101rcu_sched22:04:130
2452899163,4cyclictest91rcu_preempt23:40:490
2452899160,1cyclictest0-21swapper/020:44:250
2452899160,15cyclictest0-21swapper/023:35:220
2452899160,15cyclictest0-21swapper/023:35:210
239752160,0sleep40-21swapper/421:51:214
192482160,0sleep00-21swapper/022:52:550
147262160,0sleep7761rcuc/722:11:207
147262160,0sleep7761rcuc/722:11:197
123862160,0sleep7761rcuc/723:32:057
123862160,0sleep7761rcuc/723:32:057
24568991512,1cyclictest0-21swapper/721:54:107
2456899150,13cyclictest0-21swapper/700:30:287
2456899150,13cyclictest0-21swapper/700:20:167
2456199159,1cyclictest69-21ksoftirqd/622:16:156
2456199159,1cyclictest69-21ksoftirqd/622:16:146
2456199158,3cyclictest69-21ksoftirqd/600:01:346
2456199157,1cyclictest69-21ksoftirqd/623:14:476
2456199156,1cyclictest69-21ksoftirqd/623:35:416
2456199156,1cyclictest69-21ksoftirqd/623:35:406
2456199155,3cyclictest69-21ksoftirqd/622:38:056
2456199155,1cyclictest69-21ksoftirqd/621:48:056
2456199154,4cyclictest69-21ksoftirqd/622:45:216
2456199151,3cyclictest0-21swapper/623:25:096
2456199150,1cyclictest91rcu_preempt23:55:286
2456199150,13cyclictest0-21swapper/600:09:036
2455699150,13cyclictest0-21swapper/521:28:005
24551991512,2cyclictest0-21swapper/422:38:364
24551991511,2cyclictest781-21gdbus23:03:374
24551991511,2cyclictest0-21swapper/421:29:314
24545991512,2cyclictest0-21swapper/321:56:023
2454599150,13cyclictest0-21swapper/323:10:233
2454099152,12cyclictest0-21swapper/220:46:322
2454099152,12cyclictest0-21swapper/220:38:322
2454099152,12cyclictest0-21swapper/219:59:362
2454099152,12cyclictest0-21swapper/219:46:562
2454099150,7cyclictest10315-21sshd00:15:042
2454099150,13cyclictest0-21swapper/221:45:492
2454099150,12cyclictest0-21swapper/220:57:042
2454099150,12cyclictest0-21swapper/219:14:402
2453499159,5cyclictest20667-21sshd23:10:101
2453499155,8cyclictest726-21gdbus22:41:181
2453499155,8cyclictest6804-21gdbus22:01:081
2453499155,8cyclictest671-21avahi-daemon23:25:591
2453499154,9cyclictest681-21dbus-daemon00:07:171
2453499150,2cyclictest0-21swapper/123:08:021
2453499150,1cyclictest0-21swapper/121:15:191
2453499150,13cyclictest0-21swapper/123:35:441
2453499150,13cyclictest0-21swapper/123:35:431
2452899158,3cyclictest7-21ksoftirqd/022:19:520
2452899158,3cyclictest7-21ksoftirqd/022:19:520
2452899157,3cyclictest7-21ksoftirqd/022:33:210
2452899156,1cyclictest7-21ksoftirqd/023:07:260
2452899155,7cyclictest7-21ksoftirqd/023:51:180
2452899155,7cyclictest7-21ksoftirqd/023:51:170
2452899155,2cyclictest7-21ksoftirqd/023:45:410
2452899154,3cyclictest726-21gdbus23:15:210
224342150,0sleep4491rcuc/400:08:504
2456899140,2cyclictest0-21swapper/721:47:197
2456899140,13cyclictest0-21swapper/722:57:367
2456199147,4cyclictest69-21ksoftirqd/623:32:386
2456199147,4cyclictest69-21ksoftirqd/623:32:376
2456199147,3cyclictest69-21ksoftirqd/621:37:146
2456199147,3cyclictest69-21ksoftirqd/621:20:216
2456199146,2cyclictest69-21ksoftirqd/622:07:176
2456199145,1cyclictest69-21ksoftirqd/621:27:136
2456199144,4cyclictest69-21ksoftirqd/622:41:546
2456199142,5cyclictest69-21ksoftirqd/622:55:056
2456199142,5cyclictest681-21dbus-daemon23:48:586
2456199140,12cyclictest681ktimersoftd/621:41:126
2456199140,12cyclictest2362-21sshd23:41:546
2456199140,12cyclictest0-21swapper/600:36:206
24556991411,2cyclictest681-21dbus-daemon21:49:305
24556991411,2cyclictest0-21swapper/523:54:315
24556991411,2cyclictest0-21swapper/523:54:305
2455699140,13cyclictest12694-21sshd22:02:415
2455699140,12cyclictest1899-21sshd23:10:495
2455699140,12cyclictest1076-21ntp_kernel_pll_21:55:175
24551991412,1cyclictest16852-21nscd22:15:544
24551991412,1cyclictest16852-21nscd22:15:534
24551991411,2cyclictest0-21swapper/422:45:034
24551991411,2cyclictest0-21swapper/421:32:534
2455199140,2cyclictest7620-21sshd21:35:104
2455199140,12cyclictest0-21swapper/422:40:464
2454599148,4cyclictest681-21dbus-daemon22:15:143
2454599148,4cyclictest681-21dbus-daemon22:15:133
24545991412,1cyclictest0-21swapper/321:13:423
24545991411,2cyclictest671-21avahi-daemon22:50:453
24545991411,1cyclictest24968-21sshd23:25:493
2454599140,1cyclictest0-21swapper/321:33:193
2454599140,1cyclictest0-21swapper/300:33:413
2454599140,13cyclictest671-21avahi-daemon23:37:073
2454599140,13cyclictest671-21avahi-daemon23:37:063
2454099147,2cyclictest0-21swapper/220:10:082
2454099142,8cyclictest0-21swapper/222:02:232
2454099142,12cyclictest0-21swapper/223:12:352
2454099141,12cyclictest0-21swapper/222:26:472
2454099140,2cyclictest5815-21sshd21:53:522
2454099140,13cyclictest0-21swapper/222:55:352
2454099140,13cyclictest0-21swapper/222:30:312
2454099140,13cyclictest0-21swapper/222:19:152
2454099140,13cyclictest0-21swapper/222:19:152
2454099140,13cyclictest0-21swapper/200:20:162
2453499145,8cyclictest726-21gdbus23:23:311
2453499145,8cyclictest726-21gdbus21:31:121
2453499145,8cyclictest6804-21gdbus00:18:351
2453499145,7cyclictest6804-21gdbus21:50:081
2453499144,2cyclictest6804-21gdbus21:42:181
2453499144,2cyclictest671-21avahi-daemon23:19:421
2453499143,9cyclictest726-21gdbus00:10:031
2453499143,9cyclictest658-21polkitd22:47:441
2453499143,2cyclictest781-21gdbus22:37:141
2453499143,2cyclictest726-21gdbus00:02:521
2453499143,2cyclictest681-21dbus-daemon23:51:031
2453499143,2cyclictest681-21dbus-daemon23:51:021
2453499143,2cyclictest681-21dbus-daemon22:31:161
2453499140,2cyclictest1-21systemd22:09:111
2453499140,13cyclictest13369-21sshd21:49:091
2452899147,3cyclictest7-21ksoftirqd/022:45:230
2452899146,4cyclictest7-21ksoftirqd/021:36:220
2452899146,3cyclictest7-21ksoftirqd/021:56:110
2452899145,3cyclictest7-21ksoftirqd/022:28:520
2452899145,3cyclictest7-21ksoftirqd/021:10:300
2452899144,5cyclictest7-21ksoftirqd/023:11:590
2452899143,1cyclictest7-21ksoftirqd/000:37:530
2452899142,2cyclictest461-21systemd-journal22:05:130
2452899141,11cyclictest7108-21kworker/0:021:43:560
2452899140,4cyclictest7-21ksoftirqd/022:11:450
2452899140,4cyclictest7-21ksoftirqd/022:11:450
2452899140,1cyclictest1014-21runrttasks00:00:110
163652140,0sleep40-21swapper/400:30:464
116132140,0sleep30-21swapper/300:11:363
24568991311,1cyclictest1-21systemd21:34:487
24568991311,1cyclictest0-21swapper/722:00:377
24568991311,1cyclictest0-21swapper/700:38:257
2456899130,12cyclictest0-21swapper/722:33:577
2456899130,12cyclictest0-21swapper/700:01:027
2456899130,11cyclictest0-21swapper/721:17:527
2456199138,1cyclictest69-21ksoftirqd/600:22:146
2456199133,3cyclictest69-21ksoftirqd/600:28:386
2456199133,2cyclictest723-21nscd21:55:336
2456199131,4cyclictest69-21ksoftirqd/623:21:166
2456199130,4cyclictest0-21swapper/621:16:076
24556991310,2cyclictest628-21sshd00:02:275
2455699130,1cyclictest0-21swapper/500:16:005
2455699130,12cyclictest0-21swapper/522:54:255
2455699130,12cyclictest0-21swapper/500:26:135
2455199130,1cyclictest762-21ModemManager23:44:534
24545991311,1cyclictest761-21systemd-logind22:34:383
24545991311,1cyclictest0-21swapper/323:16:573
24545991310,2cyclictest671-21avahi-daemon00:26:513
2454599130,1cyclictest9296-21sshd00:16:383
2454599130,1cyclictest0-21swapper/322:29:143
2454599130,12cyclictest854-21systemd-cgroups23:31:293
2454599130,12cyclictest854-21systemd-cgroups23:31:283
2454599130,12cyclictest4946-21bash21:46:543
2454599130,12cyclictest0-21swapper/322:35:413
2454599130,12cyclictest0-21swapper/321:29:583
2454599130,12cyclictest0-21swapper/320:45:203
2454099137,3cyclictest0-21swapper/221:35:202
2454099136,3cyclictest26540-21sshd23:46:392
2454099130,8cyclictest0-21swapper/223:08:552
2454099130,1cyclictest0-21swapper/223:00:402
2454099130,1cyclictest0-21swapper/222:40:062
2454099130,13cyclictest0-21swapper/222:13:352
2454099130,13cyclictest0-21swapper/222:13:352
2454099130,13cyclictest0-21swapper/221:10:472
2453499135,6cyclictest6804-21gdbus00:30:051
2453499135,1cyclictest7019-21/usr/sbin/munin19:40:121
2453499134,2cyclictest726-21gdbus21:55:311
2453499133,2cyclictest761-21systemd-logind22:50:341
2453499133,2cyclictest671-21avahi-daemon00:20:411
2453499133,2cyclictest658-21polkitd22:55:531
2453499132,5cyclictest0-21swapper/120:12:241
2453499132,2cyclictest0-21swapper/122:25:331
2453499130,2cyclictest15465-21processes19:55:191
2452899136,3cyclictest7-21ksoftirqd/000:25:200
2452899135,4cyclictest7-21ksoftirqd/000:30:340
2452899135,4cyclictest7-21ksoftirqd/000:06:040
2452899134,3cyclictest7-21ksoftirqd/021:52:020
2452899132,4cyclictest7-21ksoftirqd/023:20:210
2452899131,3cyclictest0-21swapper/019:45:150
2452899130,6cyclictest0-21swapper/019:30:420
2452899130,4cyclictest0-21swapper/019:59:480
205882130,0sleep4491rcuc/422:13:254
205882130,0sleep4491rcuc/422:13:244
15892130,1sleep71594-21bash23:28:047
26772120,0sleep30-21swapper/322:05:303
2456899128,2cyclictest7449-21sshd23:00:497
2456899128,2cyclictest681-21dbus-daemon22:18:467
2456899128,2cyclictest681-21dbus-daemon22:18:457
24568991210,1cyclictest0-21swapper/721:21:307
2456899120,1cyclictest0-21swapper/723:44:067
2456899120,11cyclictest0-21swapper/700:06:427
2455699129,2cyclictest1-21systemd23:05:185
24556991210,1cyclictest0-21swapper/522:26:205
2455699120,1cyclictest0-21swapper/523:16:215
2455699120,11cyclictest0-21swapper/523:48:525
2455699120,11cyclictest0-21swapper/523:43:135
24551991210,1cyclictest1282-21sshd22:27:514
24551991210,1cyclictest0-21swapper/423:25:394
24551991210,1cyclictest0-21swapper/421:16:534
24551991210,1cyclictest0-21swapper/400:39:194
2455199120,1cyclictest0-21swapper/400:16:454
2455199120,1cyclictest0-21swapper/400:14:184
2455199120,11cyclictest0-21swapper/400:29:064
2454599129,2cyclictest3522-21sshd21:21:053
24545991210,1cyclictest0-21swapper/323:57:253
2453499123,2cyclictest1059-21snmpd20:24:151
2453499122,4cyclictest0-21swapper/121:04:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional