You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 11:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon May 25, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
54262990,0sleep60-21swapper/600:26:466
220192770,1sleep0721-21dbus-daemon00:20:150
220192770,1sleep0721-21dbus-daemon00:20:150
271732630,0sleep70-21swapper/721:47:087
858324925,8sleep00-21swapper/019:07:350
117532480,1sleep411754-21grepconf.sh00:27:084
206422470,0sleep10-21swapper/123:22:411
317252460,2sleep5884399cyclictest00:17:085
113312460,2sleep5884399cyclictest22:59:555
83922450,0sleep50-21swapper/521:18:235
305632450,0sleep50-21swapper/522:55:305
296662450,0sleep50-21swapper/523:37:595
206562450,0sleep00-21swapper/023:31:530
189602450,0sleep70-21swapper/700:29:197
9372440,0sleep40-21swapper/423:21:324
293722440,0sleep10-21swapper/123:24:581
210182440,0sleep30-21swapper/322:32:543
210182440,0sleep30-21swapper/322:32:543
163432440,0sleep00-21swapper/022:51:010
156792440,0sleep4471rcuc/400:08:504
298242430,2sleep6885199cyclictest22:40:426
292772430,0sleep70-21swapper/721:39:477
195792430,0sleep40-21swapper/421:59:314
160532430,0sleep40-21swapper/423:05:464
120562430,0sleep40-21swapper/423:48:074
110482430,0sleep10-21swapper/121:40:381
206962420,0sleep30-21swapper/321:22:453
197012420,0sleep10-21swapper/100:14:311
108762420,2sleep5884399cyclictest00:01:065
100122420,1sleep410007-21bash23:12:514
847124130,8sleep20-21swapper/219:06:012
835724129,9sleep10-21swapper/119:04:311
284462410,0sleep40-21swapper/421:09:414
269312410,0sleep10-21swapper/119:38:581
199242410,0sleep10-21swapper/122:47:331
165842410,0sleep40-21swapper/422:54:414
128492410,0sleep20-21swapper/223:16:422
849624027,9sleep70-21swapper/719:06:227
840024028,9sleep40-21swapper/419:05:074
839124027,9sleep60-21swapper/619:05:016
835024029,8sleep30-21swapper/319:04:253
317982400,0sleep10-21swapper/123:34:191
167082400,0sleep70-21swapper/722:17:527
833423926,9sleep50-21swapper/519:04:115
187792390,0sleep50-21swapper/520:19:055
165212370,1sleep116503-21sshd21:28:041
165212370,1sleep116503-21sshd21:28:041
87652300,1sleep48747-21sshd21:25:434
87652300,1sleep48747-21sshd21:25:434
201272280,0sleep40-21swapper/421:35:364
8800992115,4cyclictest9-21ksoftirqd/022:29:090
8800992115,4cyclictest9-21ksoftirqd/022:29:090
8800992017,1cyclictest9-21ksoftirqd/023:59:500
8800992014,4cyclictest9-21ksoftirqd/000:35:440
8800992012,5cyclictest9-21ksoftirqd/023:54:190
57682209,1sleep449-21ksoftirqd/400:17:324
274162200,1sleep627417-21grepconf.sh23:19:186
8800991916,3cyclictest9-21ksoftirqd/022:34:360
8800991915,1cyclictest9-21ksoftirqd/000:14:050
8843991816,2cyclictest57-21ksoftirqd/523:12:305
8816991812,5cyclictest11351-21bash23:35:012
8800991815,2cyclictest9-21ksoftirqd/023:04:010
8800991813,3cyclictest9-21ksoftirqd/022:14:440
4052180,0sleep10-21swapper/122:04:001
8851991713,1cyclictest65-21ksoftirqd/600:28:596
8843991714,2cyclictest25254-21sshd00:31:365
8835991711,5cyclictest49-21ksoftirqd/422:27:264
8800991715,1cyclictest9-21ksoftirqd/021:19:100
8800991715,1cyclictest9-21ksoftirqd/000:08:450
8800991714,2cyclictest9-21ksoftirqd/023:15:550
8800991714,2cyclictest9-21ksoftirqd/022:26:480
8800991713,3cyclictest9-21ksoftirqd/022:06:440
8800991713,1cyclictest9-21ksoftirqd/021:27:420
8800991713,1cyclictest9-21ksoftirqd/021:27:420
8800991710,4cyclictest9-21ksoftirqd/023:18:590
104762170,0sleep00-21swapper/022:56:130
8859991613,2cyclictest73-21ksoftirqd/723:18:587
8843991615,1cyclictest57-21ksoftirqd/521:54:565
8843991613,2cyclictest26126-21sshd22:23:565
8808991614,1cyclictest25-21ksoftirqd/123:46:071
8800991615,1cyclictest9-21ksoftirqd/021:55:430
8800991615,1cyclictest9-21ksoftirqd/000:12:520
8800991614,1cyclictest9-21ksoftirqd/023:46:560
8800991614,1cyclictest9-21ksoftirqd/023:37:430
8800991614,1cyclictest9-21ksoftirqd/022:45:270
8800991613,2cyclictest9-21ksoftirqd/023:01:160
8800991613,1cyclictest9-21ksoftirqd/022:40:200
8800991613,1cyclictest9-21ksoftirqd/021:30:320
8800991613,1cyclictest9-21ksoftirqd/021:30:320
8800991612,3cyclictest9-21ksoftirqd/000:30:190
8800991612,1cyclictest9-21ksoftirqd/021:42:500
268552160,0sleep40-21swapper/421:17:344
119042160,0sleep611903-21sshd22:58:126
8843991513,2cyclictest57-21ksoftirqd/523:16:455
8843991513,2cyclictest3211-21sshd00:22:585
8843991513,2cyclictest3211-21sshd00:22:585
8843991510,1cyclictest2909-21sshd00:34:025
8824991513,1cyclictest41-21ksoftirqd/300:01:453
8816991514,1cyclictest33-21ksoftirqd/222:01:392
8816991514,1cyclictest33-21ksoftirqd/221:27:422
8816991514,1cyclictest33-21ksoftirqd/221:27:422
8816991512,2cyclictest33-21ksoftirqd/222:55:512
8808991513,1cyclictest25-21ksoftirqd/122:14:261
8808991513,1cyclictest25-21ksoftirqd/100:30:201
8800991514,1cyclictest9-21ksoftirqd/023:28:000
8800991514,1cyclictest9-21ksoftirqd/021:58:580
8800991514,1cyclictest9-21ksoftirqd/021:14:310
8800991513,1cyclictest9-21ksoftirqd/023:42:130
8800991513,1cyclictest9-21ksoftirqd/022:21:030
8800991513,1cyclictest9-21ksoftirqd/021:49:010
8800991513,1cyclictest9-21ksoftirqd/021:34:250
8800991513,1cyclictest9-21ksoftirqd/000:25:180
8800991512,1cyclictest9-21ksoftirqd/023:50:260
308312150,1sleep530834-21grep22:13:095
25552150,1sleep02550-21bash22:09:360
231652150,0sleep40-21swapper/422:58:504
149792150,1sleep214899-21sshd00:29:062
8843991412,1cyclictest57-21ksoftirqd/523:21:545
8843991412,1cyclictest57-21ksoftirqd/522:46:495
8843991412,1cyclictest57-21ksoftirqd/521:49:095
8835991410,3cyclictest21344-21systemd22:07:034
8816991412,2cyclictest33-21ksoftirqd/223:47:012
8816991412,1cyclictest33-21ksoftirqd/222:50:262
8816991412,1cyclictest33-21ksoftirqd/200:04:442
8816991411,2cyclictest33-21ksoftirqd/222:44:272
8816991411,1cyclictest33-21ksoftirqd/223:04:052
881699140,13cyclictest26030-21kworker/2:523:48:492
8808991412,1cyclictest25-21ksoftirqd/123:00:151
8800991413,1cyclictest9-21ksoftirqd/021:10:550
8800991412,1cyclictest9-21ksoftirqd/023:09:360
8800991412,1cyclictest9-21ksoftirqd/021:45:490
58612140,0sleep70-21swapper/721:31:067
58612140,0sleep70-21swapper/721:31:067
232242140,0sleep6641ktimersoftd/622:07:106
227092140,0sleep50-21swapper/522:40:165
226602140,0sleep40-21swapper/423:17:164
134442140,1sleep413443-21bash22:37:594
885999132,5cyclictest25437-21sshd21:21:087
8859991313,0cyclictest0-21swapper/722:47:357
8851991311,1cyclictest65-21ksoftirqd/623:38:446
885199130,1cyclictest859-21gdbus00:22:526
885199130,1cyclictest859-21gdbus00:22:526
884399134,5cyclictest21789-21sshd21:33:545
8843991312,1cyclictest57-21ksoftirqd/522:18:415
8843991312,1cyclictest57-21ksoftirqd/521:29:305
8843991312,1cyclictest57-21ksoftirqd/521:29:305
8843991312,1cyclictest57-21ksoftirqd/521:08:595
8843991312,1cyclictest57-21ksoftirqd/500:28:275
8843991311,2cyclictest57-21ksoftirqd/523:24:095
8843991311,1cyclictest57-21ksoftirqd/523:57:085
8843991311,1cyclictest57-21ksoftirqd/522:23:155
8843991311,1cyclictest57-21ksoftirqd/521:48:285
883599139,1cyclictest49-21ksoftirqd/421:32:224
883599139,1cyclictest49-21ksoftirqd/421:32:224
883599134,6cyclictest30063-21sshd22:11:144
882499136,6cyclictest41-21ksoftirqd/321:17:253
882499133,4cyclictest0-21swapper/300:21:323
882499133,4cyclictest0-21swapper/300:21:323
8824991312,1cyclictest41-21ksoftirqd/300:17:023
8824991310,2cyclictest857-21polkitd21:47:233
881699139,3cyclictest33-21ksoftirqd/223:31:342
8816991312,1cyclictest33-21ksoftirqd/222:31:472
8816991312,1cyclictest33-21ksoftirqd/222:31:472
8816991312,1cyclictest33-21ksoftirqd/222:20:122
8816991312,1cyclictest33-21ksoftirqd/221:32:232
8816991312,1cyclictest33-21ksoftirqd/221:32:232
8816991312,1cyclictest33-21ksoftirqd/221:14:332
8816991311,2cyclictest33-21ksoftirqd/222:11:432
8816991311,1cyclictest33-21ksoftirqd/223:57:172
8816991311,1cyclictest33-21ksoftirqd/223:42:562
8816991311,1cyclictest33-21ksoftirqd/200:09:122
8816991311,1cyclictest20602-21sshd22:36:312
8816991310,2cyclictest33-21ksoftirqd/200:15:322
8816991310,1cyclictest33-21ksoftirqd/221:48:332
8808991312,1cyclictest25-21ksoftirqd/121:45:211
880099131,0cyclictest0-21swapper/019:31:190
72392130,0sleep10-21swapper/122:52:221
43792130,0sleep60-21swapper/621:56:526
27522130,0sleep70-21swapper/723:27:127
243132130,0sleep40-21swapper/400:31:324
21462130,0sleep60-21swapper/600:00:356
169042130,0sleep70-21swapper/723:50:117
885999122,4cyclictest859-21gdbus23:18:127
8859991211,1cyclictest73-21ksoftirqd/721:15:167
8859991210,1cyclictest73-21ksoftirqd/721:59:107
8859991210,1cyclictest0-21swapper/721:49:587
885999120,11cyclictest25191-21systemd00:00:027
885199125,1cyclictest709-21systemd-logind23:16:296
885199122,4cyclictest9062-21systemd-cgroups22:28:316
885199122,4cyclictest12030-21sshd22:13:566
885199120,11cyclictest26689-21bash21:28:396
885199120,11cyclictest26689-21bash21:28:396
885199120,11cyclictest0-21swapper/622:34:246
884399129,2cyclictest5035-21systemd21:58:475
884399129,1cyclictest57-21ksoftirqd/522:29:175
884399129,1cyclictest57-21ksoftirqd/522:29:175
884399128,3cyclictest57-21ksoftirqd/521:21:305
884399124,5cyclictest28810-21sshd22:03:495
8843991211,1cyclictest57-21ksoftirqd/523:42:245
8843991210,1cyclictest57-21ksoftirqd/523:46:145
8843991210,1cyclictest57-21ksoftirqd/523:33:145
8843991210,1cyclictest57-21ksoftirqd/522:34:015
8843991210,1cyclictest57-21ksoftirqd/500:06:385
8835991210,1cyclictest49-21ksoftirqd/421:56:024
883599120,1cyclictest0-21swapper/421:52:184
882499126,3cyclictest14705-21grep23:33:273
882499123,4cyclictest24042-21sshd00:05:323
882499122,4cyclictest730-21NetworkManager00:38:253
8824991210,1cyclictest709-21systemd-logind23:03:413
8824991210,1cyclictest41-21ksoftirqd/322:18:593
8824991210,1cyclictest41-21ksoftirqd/321:53:163
8816991211,1cyclictest33-21ksoftirqd/222:59:162
8816991210,1cyclictest33-21ksoftirqd/222:06:182
8816991210,1cyclictest33-21ksoftirqd/200:26:492
881699120,2cyclictest20542-21grep21:43:052
880899125,4cyclictest14344-21kworker/1:421:19:521
8808991211,1cyclictest25-21ksoftirqd/122:01:201
8808991210,1cyclictest25-21ksoftirqd/123:52:441
8808991210,1cyclictest25-21ksoftirqd/123:40:591
8808991210,1cyclictest25-21ksoftirqd/122:09:251
8808991210,1cyclictest25-21ksoftirqd/121:13:311
8808991210,1cyclictest25-21ksoftirqd/100:27:111
38112120,0sleep2321ktimersoftd/221:34:382
137002120,0sleep4471rcuc/423:25:574
109682120,0sleep50-21swapper/521:27:445
109682120,0sleep50-21swapper/521:27:445
94672110,0sleep00-21swapper/020:04:030
885999119,1cyclictest73-21ksoftirqd/722:19:417
885999119,1cyclictest73-21ksoftirqd/700:04:027
885999119,1cyclictest20412-21systemd-cgroups21:37:317
885999112,4cyclictest694-21nscd23:48:427
885999112,4cyclictest4761-21sshd22:28:167
885999112,4cyclictest30186-21sshd23:10:147
885999112,4cyclictest20832-21sshd22:42:037
8859991110,1cyclictest0-21swapper/722:08:537
885999111,4cyclictest2313-21grep22:04:047
885999111,4cyclictest20047-21bash21:54:037
885999111,4cyclictest13000-21sshd23:38:537
885999110,11cyclictest5763-21kworker/7:022:54:077
885999110,11cyclictest3084-21kworker/7:121:25:497
885999110,11cyclictest3084-21kworker/7:121:25:497
885999110,11cyclictest30065-21kworker/7:100:14:467
885999110,11cyclictest2409-21kworker/7:522:31:007
885999110,11cyclictest2409-21kworker/7:522:31:007
885999110,1cyclictest14578-21systemd22:34:167
885199119,1cyclictest65-21ksoftirqd/623:50:306
885199119,1cyclictest65-21ksoftirqd/623:24:116
885199119,1cyclictest65-21ksoftirqd/600:06:096
885199117,1cyclictest65-21ksoftirqd/621:51:046
885199115,3cyclictest27410-21sshd00:16:536
885199115,3cyclictest16852-21sshd21:59:216
885199114,2cyclictest4404-21sshd22:48:326
885199111,4cyclictest4690-21sshd21:47:436
885199110,5cyclictest23569-21sshd21:21:026
885199110,11cyclictest0-21swapper/623:45:026
885199110,10cyclictest26796-21systemd-cgroups22:22:066
884399119,1cyclictest57-21ksoftirqd/523:08:415
8843991110,1cyclictest57-21ksoftirqd/500:11:295
8843991110,1cyclictest0-21swapper/523:49:555
883599119,1cyclictest49-21ksoftirqd/423:39:264
883599119,1cyclictest49-21ksoftirqd/400:19:294
883599119,1cyclictest49-21ksoftirqd/400:19:294
883599119,1cyclictest49-21ksoftirqd/400:03:564
883599118,1cyclictest49-21ksoftirqd/421:18:554
8835991110,1cyclictest6661-21sshd22:17:174
883599110,10cyclictest3406-21systemd-cgroups21:45:454
883599110,1cyclictest10431-21awk19:09:034
882499119,1cyclictest41-21ksoftirqd/300:29:453
882499118,2cyclictest41-21ksoftirqd/323:50:533
882499115,3cyclictest19816-21systemd-cgroups23:37:253
882499113,7cyclictest15769-21sshd22:10:233
882499112,4cyclictest0-21swapper/323:42:593
8824991110,1cyclictest41-21ksoftirqd/323:11:143
882499111,4cyclictest16305-21sshd21:29:493
882499111,4cyclictest16305-21sshd21:29:493
882499111,4cyclictest15802-21bash21:35:213
882499110,7cyclictest28221-21sshd21:41:383
882499110,5cyclictest8548-21grepconf.sh21:27:363
882499110,5cyclictest8548-21grepconf.sh21:27:363
882499110,2cyclictest19213-21grep22:05:023
882499110,11cyclictest28288-21kworker/3:422:49:193
882499110,11cyclictest2038-21kworker/3:223:06:463
882499110,10cyclictest0-21swapper/322:27:163
882499110,1cyclictest24192-21sshd00:27:523
882499110,1cyclictest22381-21sshd23:15:213
882499110,1cyclictest0-21swapper/322:44:273
881699119,2cyclictest33-21ksoftirqd/223:18:522
881699119,1cyclictest33-21ksoftirqd/223:10:362
881699119,1cyclictest33-21ksoftirqd/222:38:552
881699118,2cyclictest33-21ksoftirqd/221:52:232
881699117,3cyclictest33-21ksoftirqd/223:59:552
881699117,3cyclictest33-21ksoftirqd/200:37:382
8816991110,1cyclictest33-21ksoftirqd/223:24:102
8816991110,1cyclictest33-21ksoftirqd/222:15:542
8816991110,1cyclictest33-21ksoftirqd/221:54:482
8816991110,1cyclictest33-21ksoftirqd/200:21:462
8816991110,1cyclictest33-21ksoftirqd/200:21:462
881699110,10cyclictest30250-21systemd22:24:052
880899119,1cyclictest25-21ksoftirqd/123:57:431
880899119,1cyclictest0-21swapper/100:06:041
880899114,4cyclictest6331-21sshd23:16:191
880899114,4cyclictest15675-21cp23:05:451
880899113,4cyclictest721-21dbus-daemon22:43:221
8808991110,1cyclictest25-21ksoftirqd/121:49:541
8808991110,1cyclictest25-21ksoftirqd/121:15:521
8808991110,1cyclictest25-21ksoftirqd/100:34:211
880899110,10cyclictest8282-21sshd00:23:151
880899110,10cyclictest8282-21sshd00:23:151
880899110,1cyclictest0-21swapper/122:19:491
880899110,1cyclictest0-21swapper/121:33:281
880899110,1cyclictest0-21swapper/121:33:281
880099112,5cyclictest0-21swapper/019:38:460
880099112,5cyclictest0-21swapper/019:38:460
273362110,0sleep30-21swapper/322:16:363
265292110,0sleep70-21swapper/700:13:097
230752110,1sleep623982-21kworker/6:123:00:366
885999108,1cyclictest73-21ksoftirqd/700:20:097
885999108,1cyclictest73-21ksoftirqd/700:20:097
885999103,6cyclictest730-21NetworkManager21:09:077
885999103,6cyclictest0-21swapper/723:29:077
885999103,4cyclictest3781-21bash00:37:497
885999100,4cyclictest721-21dbus-daemon23:54:247
885999100,4cyclictest1-21systemd23:34:547
885999100,4cyclictest0-21swapper/722:59:367
885199109,1cyclictest0-21swapper/621:14:386
885199108,1cyclictest65-21ksoftirqd/623:38:576
885199107,1cyclictest65-21ksoftirqd/600:37:486
885199105,4cyclictest756-21sshd23:31:526
885199104,4cyclictest85150irq/25-em1-rx-021:39:586
885199103,2cyclictest2145-21systemd23:04:586
885199102,5cyclictest730-21NetworkManager21:08:476
885199101,4cyclictest85150irq/25-em1-rx-000:09:226
885199100,9cyclictest10187-21kworker/6:021:34:156
885199100,5cyclictest0-21swapper/622:11:056
885199100,10cyclictest0-21swapper/622:49:416
884399107,2cyclictest57-21ksoftirqd/522:49:345
884399104,4cyclictest7387-21sshd21:40:245
883599108,1cyclictest49-21ksoftirqd/422:44:094
883599108,1cyclictest49-21ksoftirqd/422:40:304
883599103,4cyclictest7787-21sshd22:50:314
883599101,5cyclictest11293-21sshd23:31:234
882499109,1cyclictest41-21ksoftirqd/323:20:023
882499108,1cyclictest41-21ksoftirqd/322:40:273
882499103,6cyclictest9203-21/usr/sbin/munin21:58:583
882499103,6cyclictest709-21systemd-logind23:24:323
882499102,5cyclictest5801-21sshd23:57:063
882499101,4cyclictest23575-21sshd21:09:203
882499101,4cyclictest1-21systemd00:09:563
882499100,4cyclictest7947-21bash23:44:053
882499100,4cyclictest29483-21bash21:54:343
882499100,4cyclictest18984-21sshd22:34:323
882499100,10cyclictest0-21swapper/322:58:293
881699108,1cyclictest758-21runrttasks20:04:052
881699108,1cyclictest33-21ksoftirqd/221:21:242
881699108,1cyclictest33-21ksoftirqd/221:08:582
880899109,1cyclictest25-21ksoftirqd/123:30:191
880899109,1cyclictest25-21ksoftirqd/122:36:131
880899108,1cyclictest25-21ksoftirqd/122:30:461
880899108,1cyclictest25-21ksoftirqd/122:30:461
880899108,1cyclictest25-21ksoftirqd/100:13:021
880899108,1cyclictest1-21systemd22:54:491
880899103,4cyclictest1-21systemd23:10:431
880099100,9cyclictest7551-21grep20:58:570
31962100,0sleep20-21swapper/220:49:052
88599997,1cyclictest73-21ksoftirqd/723:04:027
88599997,1cyclictest73-21ksoftirqd/722:48:517
88599990,0cyclictest0-21swapper/700:28:347
88519997,1cyclictest65-21ksoftirqd/623:55:116
88519997,1cyclictest65-21ksoftirqd/621:29:136
88519997,1cyclictest65-21ksoftirqd/621:29:136
88519995,3cyclictest0-21swapper/623:08:596
88519990,5cyclictest709-21systemd-logind22:32:256
88519990,5cyclictest709-21systemd-logind22:32:256
88359999,0cyclictest0-21swapper/419:18:594
88359997,1cyclictest49-21ksoftirqd/423:50:104
88359994,4cyclictest0-21swapper/422:22:194
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional