You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 07:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Tue Dec 09, 2025 00:45:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188921220,4sleep42208899cyclictest00:20:224
2845321170,0sleep40-21swapper/422:53:504
25172820,0sleep60-21swapper/621:21:446
90972810,1sleep50-21swapper/522:48:305
76052810,1sleep60-21swapper/623:58:036
247192800,0sleep00-21swapper/023:30:000
235282800,1sleep523533-21grepconf.sh22:33:235
222072800,1sleep422208-21systemd-cgroups21:33:444
40352790,0sleep40-21swapper/400:14:124
254132760,1sleep30-21swapper/323:30:033
240162760,0sleep70-21swapper/700:19:297
323422740,1sleep60-21swapper/623:14:116
174092740,0sleep00-21swapper/022:42:410
21452730,4sleep02206599cyclictest22:17:550
55332720,0sleep20-21swapper/221:15:232
251502720,0sleep30-21swapper/300:25:573
245482720,0sleep60-21swapper/621:47:086
245482720,0sleep60-21swapper/621:47:086
169842720,0sleep4491rcuc/421:43:054
138222720,0sleep40-21swapper/421:19:414
193602710,0sleep60-21swapper/623:42:406
179122710,1sleep3704-21systemd-logind22:36:023
176402710,0sleep30-21swapper/322:12:543
105472710,0sleep10-21swapper/121:12:411
193782700,0sleep30-21swapper/322:03:083
149652700,0sleep70-21swapper/721:52:467
144542700,0sleep10-21swapper/122:25:421
315162690,0sleep20-21swapper/221:31:182
96212680,0sleep50-21swapper/500:27:445
67802680,0sleep30-21swapper/322:44:593
143052650,0sleep40-21swapper/422:35:394
15542610,1sleep10-21swapper/122:31:031
133302600,0sleep30-21swapper/321:59:153
2174125949,6sleep60-21swapper/619:08:376
283012560,0sleep10-21swapper/122:17:161
2184925242,6sleep40-21swapper/419:09:554
2177625230,7sleep50-21swapper/519:09:005
2177124826,7sleep00-21swapper/019:08:550
2183024535,6sleep30-21swapper/319:09:453
2181624434,6sleep70-21swapper/719:09:347
2152524333,6sleep10-21swapper/119:05:521
238612410,0sleep10-21swapper/122:50:021
237872410,0sleep50-21swapper/500:32:255
237872410,0sleep50-21swapper/500:32:245
2155323928,7sleep20-21swapper/219:06:172
221522240,0sleep30-21swapper/322:53:093
2207199230,1cyclictest0-21swapper/122:46:301
2207199230,1cyclictest0-21swapper/122:43:161
322932210,0sleep10-21swapper/122:10:591
22071992116,1cyclictest1-21systemd22:36:221
286772200,1sleep70-21swapper/700:00:127
269812200,1sleep325589-1kworker/3:2H21:27:343
2207199200,1cyclictest22132-21sshd22:56:241
82382190,0sleep20-21swapper/222:45:062
324252190,0sleep00-21swapper/022:07:460
315722190,1sleep331570-21bash21:51:073
22071991914,1cyclictest704-21systemd-logind21:37:481
208872190,0sleep00-21swapper/000:05:580
188982190,0sleep60-21swapper/600:22:076
157222190,4sleep12207199cyclictest23:58:551
136402190,1sleep6671rcuc/600:15:106
40682180,0sleep10-21swapper/100:07:361
314062180,0sleep5591ktimersoftd/522:20:495
26362180,0sleep70-21swapper/720:40:187
22077991816,1cyclictest33-21ksoftirqd/223:45:152
22071991815,1cyclictest660-21dbus-daemon00:20:161
178492180,0sleep00-21swapper/000:28:340
135532180,1sleep40-21swapper/421:29:354
112522180,0sleep60-21swapper/622:45:196
43192170,0sleep40-21swapper/400:00:584
297942170,1sleep529786-21sshd22:04:145
257702170,1sleep50-21swapper/521:57:095
22071991714,1cyclictest1-21systemd21:32:461
192472170,1sleep70-21swapper/722:29:407
61592160,0sleep70-21swapper/722:01:447
323532160,2sleep2311rcuc/223:00:452
323532160,2sleep2311rcuc/223:00:452
266502160,0sleep70-21swapper/722:50:177
251482160,0sleep60-21swapper/621:10:466
242722160,1sleep40-21swapper/422:43:244
22095991614,1cyclictest29270-21kworker/5:219:37:355
22095991614,1cyclictest18787-21kworker/5:020:38:345
22088991613,1cyclictest704-21systemd-logind23:39:584
89842150,0sleep10-21swapper/122:02:031
231572150,0sleep10-21swapper/100:29:081
2209999150,14cyclictest0-21swapper/600:11:366
2209599156,3cyclictest60-21ksoftirqd/522:56:155
22095991513,1cyclictest5981-21kworker/5:120:52:065
22095991513,1cyclictest29270-21kworker/5:219:30:595
2208899150,14cyclictest14573-21sshd23:32:124
22077991513,1cyclictest6567-21grepconf.sh23:11:262
2207799150,14cyclictest0-21swapper/200:33:432
2207799150,14cyclictest0-21swapper/200:33:422
22071991513,1cyclictest3124-21sshd23:40:561
22071991512,2cyclictest31865-21cp23:10:401
2207199150,13cyclictest0-21swapper/100:34:251
2207199150,13cyclictest0-21swapper/100:34:251
2206599150,13cyclictest0-21swapper/023:49:500
18492150,0sleep4491rcuc/422:14:394
12982150,1sleep60-21swapper/621:44:526
250152140,0sleep40-21swapper/400:09:474
247172140,0sleep20-21swapper/222:00:182
246472140,1sleep07-21ksoftirqd/023:03:240
246472140,1sleep07-21ksoftirqd/023:03:230
245662140,1sleep60-21swapper/622:06:576
22105991410,3cyclictest0-21swapper/721:13:227
2210599140,12cyclictest0-21swapper/721:26:007
2209999140,12cyclictest26307-21sshd22:33:416
2209599147,3cyclictest60-21ksoftirqd/522:50:325
22095991412,1cyclictest4226-21kworker/5:019:41:025
22095991412,1cyclictest18787-21kworker/5:020:12:155
2209599140,1cyclictest0-21swapper/500:18:485
2209599140,12cyclictest18349-21sshd23:25:535
2208899145,3cyclictest51-21ksoftirqd/423:25:174
2208899140,12cyclictest4023-21sshd21:21:544
2208899140,12cyclictest0-21swapper/422:21:554
2208299140,13cyclictest0-21swapper/322:32:183
22077991413,0cyclictest537-40kipmi022:20:152
2207799140,1cyclictest0-21swapper/222:57:192
2207799140,12cyclictest24376-21sshd22:30:102
2207799140,12cyclictest0-21swapper/223:07:172
2207799140,12cyclictest0-21swapper/223:07:162
22071991410,2cyclictest0-21swapper/123:47:301
2207199140,12cyclictest0-21swapper/123:38:391
22065991411,2cyclictest0-21swapper/021:55:510
2206599140,2cyclictest0-21swapper/021:22:560
2206599140,12cyclictest13399-21sshd23:42:020
22105991311,1cyclictest0-21swapper/723:31:327
22105991311,1cyclictest0-21swapper/721:19:417
2210599130,1cyclictest14883-21bash23:05:367
2210599130,1cyclictest14883-21bash23:05:367
2210599130,12cyclictest0-21swapper/723:20:397
2210599130,12cyclictest0-21swapper/700:30:347
2210599130,12cyclictest0-21swapper/700:30:337
22099991311,1cyclictest27643-21bash21:50:406
2209999130,2cyclictest0-21swapper/623:32:016
2209999130,1cyclictest0-21swapper/622:43:546
2209999130,1cyclictest0-21swapper/600:03:136
2209999130,11cyclictest0-21swapper/600:38:346
2209999130,11cyclictest0-21swapper/600:38:336
2209599139,2cyclictest0-21swapper/523:16:385
2209599135,4cyclictest60-21ksoftirqd/523:57:165
22095991311,1cyclictest4226-21kworker/5:019:49:335
22095991311,1cyclictest18787-21kworker/5:020:26:165
22095991311,1cyclictest13907-21kworker/5:220:02:015
22095991311,1cyclictest0-21swapper/522:37:225
22095991311,1cyclictest0-21swapper/522:25:325
2209599130,4cyclictest60-21ksoftirqd/522:40:145
2209599130,1cyclictest0-21swapper/521:42:175
2209599130,11cyclictest8063-21sshd23:51:265
2209599130,11cyclictest29199-21bash21:34:285
2208899138,4cyclictest653-21avahi-daemon21:38:284
2208899133,3cyclictest51-21ksoftirqd/421:58:244
2208899131,3cyclictest101rcu_sched21:13:324
2208899130,1cyclictest28561-21crond20:30:004
2208899130,1cyclictest0-21swapper/400:33:344
2208899130,1cyclictest0-21swapper/400:33:334
2208899130,11cyclictest6856-21bash22:25:034
2208899130,11cyclictest0-21swapper/423:56:034
2208899130,11cyclictest0-21swapper/423:10:544
22082991311,1cyclictest12031-21grep21:45:473
22082991311,1cyclictest12031-21grep21:45:473
2208299130,2cyclictest0-21swapper/321:10:343
2208299130,1cyclictest0-21swapper/323:47:013
2208299130,12cyclictest0-21swapper/323:27:013
2208299130,12cyclictest0-21swapper/323:23:543
2208299130,12cyclictest0-21swapper/322:29:123
2208299130,11cyclictest0-21swapper/322:56:223
2207799139,3cyclictest0-21swapper/221:57:392
22077991311,1cyclictest0-21swapper/222:17:162
22077991311,1cyclictest0-21swapper/200:12:442
2207799130,1cyclictest0-21swapper/223:50:252
2207799130,12cyclictest0-21swapper/200:15:502
2207799130,11cyclictest660-21dbus-daemon23:27:582
2207799130,11cyclictest0-21swapper/223:32:402
2207199133,9cyclictest0-21swapper/121:28:441
2207199130,2cyclictest0-21swapper/120:25:231
2207199130,1cyclictest24142-21tty00:39:001
2207199130,1cyclictest24142-21tty00:38:591
2207199130,1cyclictest0-21swapper/122:05:401
2207199130,12cyclictest0-21swapper/123:03:501
2207199130,12cyclictest0-21swapper/123:03:491
22065991311,1cyclictest0-21swapper/000:16:430
22065991310,2cyclictest0-21swapper/022:48:080
2206599130,1cyclictest754-21NetworkManager23:33:430
2206599130,1cyclictest2343-21bash00:00:430
2206599130,1cyclictest1-21systemd21:40:000
2206599130,12cyclictest660-21dbus-daemon21:33:410
49652120,0sleep50-21swapper/521:38:345
250112120,0sleep30-21swapper/300:16:123
2210599129,2cyclictest0-21swapper/723:45:087
22105991210,1cyclictest660-21dbus-daemon22:42:537
22105991210,1cyclictest27104-21sshd23:53:277
22105991210,1cyclictest0-21swapper/723:40:587
22105991210,1cyclictest0-21swapper/722:18:097
22105991210,1cyclictest0-21swapper/721:38:147
22105991210,1cyclictest0-21swapper/700:37:417
22105991210,1cyclictest0-21swapper/700:37:417
22105991210,1cyclictest0-21swapper/700:07:587
2210599120,1cyclictest0-21swapper/723:36:157
2210599120,1cyclictest0-21swapper/723:01:267
2210599120,1cyclictest0-21swapper/723:01:267
2210599120,11cyclictest0-21swapper/722:47:277
2210599120,11cyclictest0-21swapper/722:11:187
2210599120,11cyclictest0-21swapper/721:22:067
2210599120,11cyclictest0-21swapper/700:25:587
2210599120,11cyclictest0-21swapper/700:14:417
2209999129,2cyclictest0-21swapper/622:53:026
22099991210,1cyclictest0-21swapper/622:21:196
2209999120,11cyclictest0-21swapper/623:24:146
2209999120,11cyclictest0-21swapper/623:18:026
2209999120,11cyclictest0-21swapper/600:33:596
2209999120,11cyclictest0-21swapper/600:33:596
2209999120,11cyclictest0-21swapper/600:29:266
2209599129,2cyclictest0-21swapper/523:47:485
2209599129,1cyclictest0-21swapper/522:16:485
2209599121,1cyclictest60-21ksoftirqd/521:15:265
22095991211,0cyclictest13907-21kworker/5:220:05:095
22095991210,1cyclictest5981-21kworker/5:121:00:365
22095991210,1cyclictest5981-21kworker/5:120:57:185
22095991210,1cyclictest19425-21kworker/5:119:20:355
22095991210,1cyclictest18787-21kworker/5:020:48:385
22095991210,1cyclictest1-21systemd23:34:475
22095991210,1cyclictest0-21swapper/523:39:285
22095991210,1cyclictest0-21swapper/523:05:115
22095991210,1cyclictest0-21swapper/523:05:115
2209599120,3cyclictest660-21dbus-daemon22:05:125
2209599120,2cyclictest0-21swapper/521:11:345
2209599120,1cyclictest27483-21sshd21:27:375
2209599120,1cyclictest16959-21sshd00:02:195
2209599120,1cyclictest101rcu_sched23:41:175
2209599120,1cyclictest0-21swapper/522:11:265
2209599120,1cyclictest0-21swapper/521:45:455
2209599120,1cyclictest0-21swapper/521:45:455
2209599120,1cyclictest0-21swapper/500:05:575
2208899127,1cyclictest51-21ksoftirqd/423:05:594
2208899127,1cyclictest51-21ksoftirqd/423:05:594
2208899125,3cyclictest51-21ksoftirqd/422:19:444
2208899125,1cyclictest51-21ksoftirqd/422:47:544
2208899124,5cyclictest51-21ksoftirqd/400:28:094
2208899124,4cyclictest51-21ksoftirqd/421:46:474
2208899124,4cyclictest51-21ksoftirqd/421:46:474
2208899124,3cyclictest51-21ksoftirqd/423:42:004
2208899123,3cyclictest51-21ksoftirqd/422:57:014
2208899122,3cyclictest4711-21bash23:01:164
2208899122,3cyclictest4711-21bash23:01:154
2208899121,4cyclictest30661-21unixbench_singl23:50:244
22088991210,1cyclictest0-21swapper/422:31:144
2208899120,2cyclictest738-21gdbus23:16:574
2208899120,2cyclictest1-21systemd22:10:004
2208899120,1cyclictest0-21swapper/422:03:094
2208899120,1cyclictest0-21swapper/421:54:174
2208899120,1cyclictest0-21swapper/421:00:154
2208899120,1cyclictest0-21swapper/400:38:074
2208899120,1cyclictest0-21swapper/400:38:074
2208899120,11cyclictest0-21swapper/423:48:154
2208299129,2cyclictest0-21swapper/322:22:293
22082991210,1cyclictest9534-21bash21:42:183
22082991210,1cyclictest0-21swapper/323:57:143
22082991210,1cyclictest0-21swapper/321:15:573
22082991210,1cyclictest0-21swapper/320:07:483
2208299120,1cyclictest0-21swapper/321:33:013
2208299120,1cyclictest0-21swapper/300:30:443
2208299120,1cyclictest0-21swapper/300:30:433
2208299120,1cyclictest0-21swapper/300:11:133
2208299120,11cyclictest0-21swapper/323:53:043
2208299120,11cyclictest0-21swapper/323:17:113
2208299120,11cyclictest0-21swapper/300:39:523
2208299120,11cyclictest0-21swapper/300:39:513
2208299120,11cyclictest0-21swapper/300:00:523
2207799129,2cyclictest0-21swapper/221:49:432
2207799129,2cyclictest0-21swapper/221:49:432
2207799124,5cyclictest0-21swapper/223:57:072
22077991210,1cyclictest0-21swapper/223:42:062
22077991210,1cyclictest0-21swapper/200:36:162
22077991210,1cyclictest0-21swapper/200:36:152
2207799120,3cyclictest0-21swapper/219:50:152
2207799120,1cyclictest9250-21sh20:55:172
2207799120,1cyclictest0-21swapper/222:38:222
2207799120,1cyclictest0-21swapper/221:37:212
2207799120,11cyclictest18463-21sshd00:09:062
2207799120,11cyclictest0-21swapper/222:11:552
2207799120,11cyclictest0-21swapper/221:51:122
2207799120,11cyclictest0-21swapper/221:25:072
2207799120,10cyclictest5585-21kworker/2:222:05:152
2207199127,4cyclictest660-21dbus-daemon23:34:041
2207199123,6cyclictest0-21swapper/119:39:071
22071991210,1cyclictest778-21gdbus21:52:201
22071991210,1cyclictest660-21dbus-daemon21:22:421
22071991210,1cyclictest22253-21gdbus23:15:501
22071991210,1cyclictest0-21swapper/121:17:301
2207199120,8cyclictest0-21swapper/119:20:011
2207199120,8cyclictest0-21swapper/100:01:361
2207199120,1cyclictest10350-21sshd23:51:401
2207199120,1cyclictest0-21swapper/100:16:321
2207199120,11cyclictest0-21swapper/123:28:411
2206599129,2cyclictest0-21swapper/021:41:280
2206599125,1cyclictest21320-21sshd23:39:370
22065991210,1cyclictest6562-21sshd22:01:460
22065991210,1cyclictest0-21swapper/021:47:560
22065991210,1cyclictest0-21swapper/021:47:560
22065991210,1cyclictest0-21swapper/000:36:040
22065991210,1cyclictest0-21swapper/000:36:040
2206599120,1cyclictest0-21swapper/021:15:400
2206599120,11cyclictest0-21swapper/023:16:390
2206599120,11cyclictest0-21swapper/021:29:470
2206599120,11cyclictest0-21swapper/000:22:220
2210599119,1cyclictest0-21swapper/722:56:447
2210599119,1cyclictest0-21swapper/721:57:037
2210599119,1cyclictest0-21swapper/721:42:087
2210599119,1cyclictest0-21swapper/721:34:207
2210599110,1cyclictest0-21swapper/723:57:057
2210599110,1cyclictest0-21swapper/722:37:467
2209999119,1cyclictest0-21swapper/622:28:036
2209999119,1cyclictest0-21swapper/621:39:476
2209999110,1cyclictest0-21swapper/623:27:196
2209999110,1cyclictest0-21swapper/620:37:496
2209999110,10cyclictest0-21swapper/620:05:346
2209599119,1cyclictest19425-21kworker/5:119:13:195
2209599119,1cyclictest18787-21kworker/5:020:43:165
2209599119,1cyclictest18787-21kworker/5:020:34:465
2209599119,1cyclictest18787-21kworker/5:020:19:105
2209599119,1cyclictest0-21swapper/500:22:295
2209599118,2cyclictest60-21ksoftirqd/500:35:215
2209599118,2cyclictest60-21ksoftirqd/500:35:215
2209599113,4cyclictest60-21ksoftirqd/521:20:225
2209599111,3cyclictest101rcu_sched23:12:465
2209599111,1cyclictest60-21ksoftirqd/523:24:555
2208899115,3cyclictest51-21ksoftirqd/400:15:144
2208899113,7cyclictest0-21swapper/419:21:544
2208899113,5cyclictest0-21swapper/420:43:444
2208899110,1cyclictest0-21swapper/423:20:554
2208899110,1cyclictest0-21swapper/420:48:494
2208299119,1cyclictest0-21swapper/323:01:363
2208299119,1cyclictest0-21swapper/323:01:363
2208299119,1cyclictest0-21swapper/320:42:053
2208299119,1cyclictest0-21swapper/300:21:343
2208299118,2cyclictest0-21swapper/322:45:363
2208299110,1cyclictest0-21swapper/322:18:203
2207799119,1cyclictest0-21swapper/223:15:042
2207799119,1cyclictest0-21swapper/222:43:292
2207799119,1cyclictest0-21swapper/220:15:152
2207799118,1cyclictest33-21ksoftirqd/220:30:132
2207199119,1cyclictest9776-21systemd-cgroups23:08:311
2207199119,1cyclictest9776-21systemd-cgroups23:08:311
2207199119,1cyclictest1117-21nfsd21:43:001
2207199113,5cyclictest0-21swapper/121:04:581
2207199110,10cyclictest0-21swapper/121:59:281
2207199110,10cyclictest0-21swapper/100:13:001
2206599119,1cyclictest0-21swapper/023:57:390
2206599119,1cyclictest0-21swapper/022:21:330
2206599119,1cyclictest0-21swapper/022:14:000
2206599110,1cyclictest0-21swapper/023:11:370
2206599110,10cyclictest0-21swapper/022:56:530
2206599110,10cyclictest0-21swapper/022:30:480
2206599110,10cyclictest0-21swapper/000:34:460
2206599110,10cyclictest0-21swapper/000:34:450
193572110,0sleep00-21swapper/023:09:330
193572110,0sleep00-21swapper/023:09:330
2210599108,1cyclictest0-21swapper/723:17:347
2210599108,1cyclictest0-21swapper/723:10:187
2210599108,1cyclictest0-21swapper/722:22:197
2210599108,1cyclictest0-21swapper/722:05:557
2210599108,1cyclictest0-21swapper/700:21:247
2209999108,1cyclictest21473-21sshd23:52:516
2209999108,1cyclictest0-21swapper/622:58:496
2209999107,2cyclictest654-21polkitd22:36:216
2209999107,2cyclictest0-21swapper/621:18:496
2209599108,1cyclictest9091-21kworker/5:119:58:135
2209599108,1cyclictest9091-21kworker/5:119:51:375
2209599108,1cyclictest29270-21kworker/5:219:25:475
2209599101,1cyclictest60-21ksoftirqd/521:51:595
2209599100,9cyclictest0-21swapper/519:19:475
2209599100,0cyclictest0-21swapper/523:00:305
2209599100,0cyclictest0-21swapper/523:00:295
2208899100,1cyclictest0-21swapper/420:20:194
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional