You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 20:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Mar 20, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2513799144143,1cyclictest1116-21nfsd11:11:316
251059910218,41cyclictest686-21dbus-daemon11:11:312
198012960,2sleep72514599cyclictest10:02:147
152182930,2sleep72514599cyclictest12:06:457
149962860,2sleep22510599cyclictest09:50:562
149962860,2sleep22510599cyclictest09:50:562
25089997934,23cyclictest0-21swapper/011:11:310
2512299770,76cyclictest26760-21kworker/4:111:11:314
2514599570,56cyclictest4615-21kworker/7:011:11:327
59152560,0sleep10-21swapper/110:20:031
218332530,0sleep30-21swapper/311:52:073
34202500,0sleep30-21swapper/309:29:513
123062500,0sleep60-21swapper/610:18:316
71932490,0sleep6641ktimersoftd/607:31:426
13332490,0sleep70-21swapper/709:06:567
27942480,1sleep12793-21grep09:29:491
229562480,2sleep12509799cyclictest11:05:361
216962480,0sleep50-21swapper/509:32:415
14022470,1sleep51404-21id12:26:295
137202470,2sleep12509799cyclictest09:32:131
190272460,1sleep2784-21runrttasks09:30:462
138772460,0sleep413841-21sshd12:23:244
322582450,0sleep00-21swapper/012:20:480
322582450,0sleep00-21swapper/012:20:480
124262450,1sleep09-21ksoftirqd/012:12:070
72742440,2sleep32511799cyclictest10:16:283
271392440,0sleep70-21swapper/710:15:447
259362440,0sleep60-21swapper/611:18:546
166252440,0sleep60-21swapper/611:01:326
147912440,0sleep40-21swapper/410:57:384
78342430,0sleep51-21systemd11:34:395
47372430,0sleep20-21swapper/210:16:192
271632430,0sleep60-21swapper/611:39:296
221282430,2sleep52513099cyclictest12:33:105
220042420,0sleep70-21swapper/710:09:517
98312410,0sleep10-21swapper/111:21:461
36032410,0sleep20-21swapper/211:25:072
2475524130,8sleep20-21swapper/207:04:092
202752410,0sleep00-21swapper/009:10:260
8082400,0sleep70-21swapper/712:30:087
2482224029,8sleep10-21swapper/107:05:041
2472324026,10sleep60-21swapper/607:03:416
2467124029,8sleep30-21swapper/307:02:583
2466324029,8sleep40-21swapper/407:02:504
207322400,0sleep00-21swapper/011:46:360
171712400,0sleep70-21swapper/710:39:157
140612400,0sleep10-21swapper/110:50:141
2486623928,8sleep50-21swapper/507:05:405
2473523928,8sleep00-21swapper/007:03:510
2462523927,9sleep70-21swapper/707:02:217
159612380,0sleep30-21swapper/311:18:193
218152370,0sleep60-21swapper/610:32:016
156402370,0sleep70-21swapper/710:57:417
7332360,2sleep12509799cyclictest10:55:031
236762340,2sleep02508999cyclictest09:12:260
160702340,0sleep10-21swapper/111:16:331
2511799330,33cyclictest31220-21kworker/3:211:11:313
25130992614,4cyclictest57-21ksoftirqd/509:12:015
25130992612,3cyclictest57-21ksoftirqd/509:07:005
25130992515,4cyclictest57-21ksoftirqd/510:27:155
2513099245,2cyclictest57-21ksoftirqd/510:06:455
25130992411,3cyclictest57-21ksoftirqd/510:15:455
2513099239,4cyclictest57-21ksoftirqd/512:17:535
2513099239,4cyclictest57-21ksoftirqd/512:17:535
25130992319,3cyclictest492-21systemd-journal10:41:485
25130992311,1cyclictest57-21ksoftirqd/509:38:235
2513099229,1cyclictest57-21ksoftirqd/511:43:225
25130992212,1cyclictest57-21ksoftirqd/510:04:385
2513099216,3cyclictest57-21ksoftirqd/511:59:335
2513099215,4cyclictest57-21ksoftirqd/509:21:305
2513099214,3cyclictest57-21ksoftirqd/511:13:545
2513099212,5cyclictest26183-21sshd11:11:315
25130992117,3cyclictest57-21ksoftirqd/509:54:005
25130992114,3cyclictest57-21ksoftirqd/511:29:595
25130992114,3cyclictest57-21ksoftirqd/511:29:595
25130992110,3cyclictest57-21ksoftirqd/510:24:135
2509799210,20cyclictest0-21swapper/111:11:321
229262210,0sleep10-21swapper/109:17:551
223402210,0sleep40-21swapper/411:26:134
25137992013,5cyclictest65-21ksoftirqd/611:59:426
2513099208,1cyclictest57-21ksoftirqd/511:50:575
2513099206,3cyclictest57-21ksoftirqd/511:02:095
2513099206,3cyclictest57-21ksoftirqd/509:49:025
2513099206,3cyclictest57-21ksoftirqd/509:49:025
2513099206,1cyclictest57-21ksoftirqd/511:23:145
2513099205,1cyclictest57-21ksoftirqd/512:13:325
2513099204,4cyclictest57-21ksoftirqd/511:18:015
2513099204,2cyclictest57-21ksoftirqd/510:59:025
25130992013,3cyclictest57-21ksoftirqd/512:07:395
25130992012,1cyclictest57-21ksoftirqd/510:54:055
25130992010,2cyclictest57-21ksoftirqd/509:30:415
209082200,0sleep30-21swapper/310:52:243
178532200,0sleep3784-21runrttasks09:36:153
177752200,0sleep00-21swapper/010:09:360
142752200,1sleep614262-21bash10:53:556
2513099199,3cyclictest57-21ksoftirqd/509:46:125
2513099196,1cyclictest57-21ksoftirqd/512:28:275
2513099194,2cyclictest57-21ksoftirqd/510:49:115
25130991913,4cyclictest57-21ksoftirqd/510:34:105
25130991913,3cyclictest57-21ksoftirqd/510:37:195
25130991912,4cyclictest57-21ksoftirqd/509:58:195
23592190,1sleep449-21ksoftirqd/409:55:474
25137991816,1cyclictest65-21ksoftirqd/611:34:166
25137991813,3cyclictest65-21ksoftirqd/609:52:256
2513099186,2cyclictest57-21ksoftirqd/511:52:215
2513099185,1cyclictest57-21ksoftirqd/511:37:415
2513099184,1cyclictest57-21ksoftirqd/512:02:545
2513099183,3cyclictest57-21ksoftirqd/510:17:545
25137991715,1cyclictest65-21ksoftirqd/611:12:556
25137991715,1cyclictest65-21ksoftirqd/609:18:196
25137991715,1cyclictest65-21ksoftirqd/609:06:436
25137991714,2cyclictest65-21ksoftirqd/610:00:086
2513099179,3cyclictest57-21ksoftirqd/509:23:145
2513099176,11cyclictest57-21ksoftirqd/508:26:455
25097991715,1cyclictest25-21ksoftirqd/111:43:361
171312170,0sleep70-21swapper/711:24:007
306062160,1sleep730605-21bash11:43:227
2513799163,1cyclictest121rcu_preempt09:47:276
2513799163,1cyclictest121rcu_preempt09:47:276
25137991615,1cyclictest65-21ksoftirqd/611:28:426
25137991615,1cyclictest65-21ksoftirqd/611:28:426
25137991615,1cyclictest65-21ksoftirqd/610:12:566
25137991614,1cyclictest65-21ksoftirqd/610:39:486
25137991614,1cyclictest65-21ksoftirqd/610:09:046
25137991614,1cyclictest65-21ksoftirqd/610:05:146
25137991614,1cyclictest65-21ksoftirqd/609:30:396
25137991613,2cyclictest65-21ksoftirqd/612:12:136
25137991612,1cyclictest65-21ksoftirqd/609:26:276
25097991614,1cyclictest25-21ksoftirqd/112:03:411
25097991614,1cyclictest25-21ksoftirqd/109:23:171
306232150,0sleep00-21swapper/010:54:540
2514599157,7cyclictest491-21grep10:53:077
25137991514,1cyclictest65-21ksoftirqd/612:02:286
25137991514,1cyclictest65-21ksoftirqd/611:50:046
25137991514,1cyclictest65-21ksoftirqd/611:45:546
25137991514,1cyclictest65-21ksoftirqd/610:23:146
25137991513,1cyclictest65-21ksoftirqd/612:22:416
25137991513,1cyclictest65-21ksoftirqd/612:16:546
25137991513,1cyclictest65-21ksoftirqd/612:16:546
25137991513,1cyclictest65-21ksoftirqd/609:44:566
25137991513,1cyclictest65-21ksoftirqd/609:34:046
25137991513,1cyclictest65-21ksoftirqd/609:14:256
2513799150,1cyclictest131rcu_sched10:48:326
25122991513,1cyclictest49-21ksoftirqd/409:47:394
25122991513,1cyclictest49-21ksoftirqd/409:47:394
25122991512,2cyclictest49-21ksoftirqd/410:46:234
2511799150,14cyclictest1-21systemd09:18:193
25097991513,1cyclictest25-21ksoftirqd/112:13:501
180622150,2sleep22510599cyclictest10:39:182
95042140,0sleep30-21swapper/311:47:433
25137991412,2cyclictest65-21ksoftirqd/612:34:416
25137991412,1cyclictest65-21ksoftirqd/612:27:316
25137991412,1cyclictest65-21ksoftirqd/612:08:326
25137991412,1cyclictest65-21ksoftirqd/610:46:066
25137991412,1cyclictest65-21ksoftirqd/610:28:296
25137991412,1cyclictest65-21ksoftirqd/609:37:306
25130991413,1cyclictest57-21ksoftirqd/507:12:135
25130991413,1cyclictest57-21ksoftirqd/507:12:135
25130991413,0cyclictest0-21swapper/507:09:055
25130991413,0cyclictest0-21swapper/507:09:055
25130991412,2cyclictest0-21swapper/507:29:235
25130991412,1cyclictest57-21ksoftirqd/507:26:425
25122991412,1cyclictest49-21ksoftirqd/409:59:164
25117991412,1cyclictest41-21ksoftirqd/310:29:563
25105991411,2cyclictest1-21systemd09:59:242
25097991412,1cyclictest25-21ksoftirqd/110:11:411
25089991413,1cyclictest9-21ksoftirqd/011:59:300
160282140,0sleep40-21swapper/410:54:014
96822130,0sleep40-21swapper/412:10:104
70952130,0sleep10-21swapper/109:15:151
44482130,1sleep3401ktimersoftd/312:34:043
2514599135,2cyclictest686-21dbus-daemon11:53:597
2514599135,1cyclictest4007-21grepconf.sh12:13:317
2514599134,2cyclictest686-21dbus-daemon11:30:387
2514599134,2cyclictest686-21dbus-daemon11:30:387
2514599133,2cyclictest9660-21grepconf.sh12:23:097
25145991311,1cyclictest73-21ksoftirqd/712:02:197
2514599130,13cyclictest0-21swapper/708:26:547
25137991312,1cyclictest65-21ksoftirqd/611:21:546
25137991311,1cyclictest65-21ksoftirqd/611:52:566
25137991311,1cyclictest65-21ksoftirqd/611:04:456
25130991311,1cyclictest57-21ksoftirqd/508:36:415
25122991311,1cyclictest49-21ksoftirqd/411:55:454
25122991311,1cyclictest49-21ksoftirqd/411:45:284
25122991310,1cyclictest49-21ksoftirqd/410:28:524
2510599138,1cyclictest33-21ksoftirqd/212:02:152
2510599136,6cyclictest10368-21sshd10:09:102
2510599135,2cyclictest691-21systemd-logind10:05:032
2510599133,4cyclictest6792-21sshd11:14:052
2510599132,5cyclictest763-21NetworkManager12:21:372
2510599132,5cyclictest763-21NetworkManager12:21:372
25105991311,1cyclictest33-21ksoftirqd/210:20:542
2509799139,3cyclictest25-21ksoftirqd/109:56:481
25097991311,1cyclictest25-21ksoftirqd/110:44:361
25097991311,1cyclictest23742-21users07:57:031
2509799130,2cyclictest24764-21bash12:24:031
25089991311,1cyclictest9-21ksoftirqd/012:35:270
244412130,0sleep40-21swapper/412:03:304
187372130,0sleep70-21swapper/709:23:147
134432130,0sleep40-21swapper/412:30:534
132422130,0sleep013241-21systemd-cgroups11:34:580
292942120,0sleep029291-21sshd10:02:480
2514599129,3cyclictest0-21swapper/711:19:327
2514599129,3cyclictest0-21swapper/711:12:267
2514599125,1cyclictest32262-21grepconf.sh10:32:377
2514599125,1cyclictest28823-21bash11:37:407
2514599124,2cyclictest8478-21systemd09:39:257
2514599124,2cyclictest649-21systemd10:27:047
2514599124,2cyclictest32640-21grep09:44:307
2514599124,2cyclictest31460-21grep09:48:067
2514599124,2cyclictest31460-21grep09:48:067
2514599124,2cyclictest30241-21grepconf.sh11:48:577
2514599124,2cyclictest28759-21grepconf.sh10:49:117
2514599124,2cyclictest14925-21grepconf.sh11:59:147
2514599124,2cyclictest12526-21grep09:17:197
2514599124,1cyclictest29212-21systemd11:02:097
2514599124,1cyclictest26124-21grep09:57:037
2514599124,1cyclictest24909-21grep10:17:227
2514599124,1cyclictest11408-21grep12:17:387
2514599124,1cyclictest11408-21grep12:17:387
2514599123,2cyclictest686-21dbus-daemon10:24:597
2514599123,2cyclictest686-21dbus-daemon09:31:477
2514599123,2cyclictest30584-21systemd10:41:537
2514599123,2cyclictest17194-21grep09:26:557
2514599123,2cyclictest12844-21kill09:15:357
25145991210,1cyclictest73-21ksoftirqd/711:32:297
2514599120,6cyclictest8995-21systemd09:52:217
2514599120,11cyclictest13080-21sshd12:34:347
25130991210,2cyclictest0-21swapper/507:53:495
25130991210,1cyclictest57-21ksoftirqd/508:16:215
25130991210,1cyclictest57-21ksoftirqd/507:21:425
25130991210,0cyclictest57-21ksoftirqd/507:46:435
25130991210,0cyclictest57-21ksoftirqd/507:38:335
25130991210,0cyclictest0-21swapper/508:37:195
2512299128,1cyclictest49-21ksoftirqd/411:02:084
25122991210,1cyclictest49-21ksoftirqd/411:50:064
25122991210,1cyclictest49-21ksoftirqd/410:47:534
2511799128,2cyclictest41-21ksoftirqd/309:41:463
2511799128,1cyclictest41-21ksoftirqd/311:23:143
25117991210,1cyclictest9845-21sshd11:36:413
25117991210,1cyclictest41-21ksoftirqd/311:05:353
2510599129,2cyclictest6338-21bash10:44:112
2510599124,7cyclictest1-21systemd09:24:442
2510599122,4cyclictest28177-21sshd11:46:582
2510599122,4cyclictest0-21swapper/212:15:482
2510599122,4cyclictest0-21swapper/211:32:282
2510599122,4cyclictest0-21swapper/210:47:072
25105991211,1cyclictest33-21ksoftirqd/209:36:412
25105991210,2cyclictest33-21ksoftirqd/209:55:142
2510599121,5cyclictest23403-21grepconf.sh12:09:032
2510599121,5cyclictest1730-21grepconf.sh09:09:082
2510599121,5cyclictest17125-21sshd10:28:022
2509799129,1cyclictest25-21ksoftirqd/110:12:161
25097991211,1cyclictest25-21ksoftirqd/112:32:481
25097991211,1cyclictest25-21ksoftirqd/110:27:041
25097991210,1cyclictest6199-21kworker/1:309:44:561
25097991210,1cyclictest25-21ksoftirqd/111:53:341
25097991210,1cyclictest25-21ksoftirqd/110:35:371
25097991210,1cyclictest25-21ksoftirqd/110:05:401
25097991210,1cyclictest25-21ksoftirqd/109:37:131
2509799120,12cyclictest18701-21kworker/1:209:46:511
2509799120,12cyclictest18701-21kworker/1:209:46:511
2509799120,11cyclictest0-21swapper/110:40:371
2509799120,1cyclictest0-21swapper/110:58:261
2508999123,4cyclictest0-21swapper/011:41:040
25089991210,1cyclictest9-21ksoftirqd/012:03:450
25089991210,1cyclictest9-21ksoftirqd/010:58:200
25089991210,1cyclictest9-21ksoftirqd/008:46:410
25089991210,1cyclictest1-21systemd09:30:000
2508999120,12cyclictest10131-21kworker/0:112:27:440
2508999120,11cyclictest2720-21systemd-cgroups10:47:390
250862120,0sleep0101ktimersoftd/011:22:330
182992120,1sleep10-21swapper/109:08:031
159892120,0sleep30-21swapper/310:33:343
155512120,0sleep00-21swapper/011:53:400
88802110,0sleep70-21swapper/707:31:597
78692110,0sleep30-21swapper/310:49:523
2514599113,2cyclictest31172-21irqstats08:11:577
2513099119,1cyclictest57-21ksoftirqd/509:06:425
2513099119,0cyclictest0-21swapper/508:07:515
2513099119,0cyclictest0-21swapper/508:07:515
2513099117,4cyclictest57-21ksoftirqd/508:17:135
2513099112,1cyclictest57-21ksoftirqd/507:32:015
2512299119,1cyclictest49-21ksoftirqd/412:16:544
2512299119,1cyclictest49-21ksoftirqd/412:16:544
2512299119,1cyclictest49-21ksoftirqd/411:57:364
2512299119,1cyclictest49-21ksoftirqd/411:27:464
2512299119,1cyclictest49-21ksoftirqd/411:27:464
2512299119,1cyclictest49-21ksoftirqd/410:16:594
2512299119,1cyclictest49-21ksoftirqd/409:26:574
2512299118,1cyclictest49-21ksoftirqd/412:34:304
2512299118,1cyclictest49-21ksoftirqd/410:09:014
2512299114,4cyclictest25555-21bash10:11:544
2512299114,4cyclictest19961-21grepconf.sh10:31:574
25122991110,1cyclictest49-21ksoftirqd/411:11:594
25122991110,1cyclictest49-21ksoftirqd/409:43:464
2512299110,1cyclictest0-21swapper/410:21:564
2511799119,1cyclictest686-21dbus-daemon12:17:503
2511799119,1cyclictest686-21dbus-daemon12:17:503
2511799119,1cyclictest41-21ksoftirqd/311:13:103
2511799113,4cyclictest22358-21systemd-cgroups12:23:543
2511799112,4cyclictest4215-21sshd12:30:203
2511799112,4cyclictest14224-21systemd-cgroups10:07:293
2511799111,4cyclictest17687-21sshd12:03:053
2511799110,10cyclictest30273-21sshd10:45:373
2511799110,10cyclictest13929-21grepconf.sh09:52:383
2511799110,1cyclictest1-21systemd09:15:353
2511799110,1cyclictest0-21swapper/310:23:323
2510599119,2cyclictest33-21ksoftirqd/212:28:422
2510599113,2cyclictest1690-21bash12:35:502
2510599112,4cyclictest1-21systemd11:30:442
2510599112,4cyclictest1-21systemd11:30:442
2510599112,4cyclictest0-21swapper/210:22:052
2510599112,3cyclictest0-21swapper/209:40:472
2510599111,4cyclictest0-21swapper/211:54:062
2510599110,11cyclictest4303-21kworker/2:111:02:152
2510599110,11cyclictest2106-21kworker/2:411:43:432
2510599110,11cyclictest1034-21kworker/2:411:57:002
2510599110,11cyclictest0-21swapper/211:37:322
2510599110,10cyclictest7651-21kworker/2:509:43:382
2510599110,1cyclictest0-21swapper/210:57:302
2509799119,1cyclictest25-21ksoftirqd/111:48:041
2509799119,1cyclictest25-21ksoftirqd/111:36:581
2509799119,1cyclictest25-21ksoftirqd/111:16:551
2509799119,1cyclictest25-21ksoftirqd/110:24:031
2509799115,3cyclictest25-21ksoftirqd/112:30:231
25097991110,1cyclictest25-21ksoftirqd/111:57:361
25097991110,1cyclictest25-21ksoftirqd/109:53:481
2509799110,1cyclictest0-21swapper/112:19:091
2509799110,1cyclictest0-21swapper/112:19:091
2508999119,1cyclictest9-21ksoftirqd/009:52:150
2508999114,6cyclictest16179-21grepconf.sh09:58:220
2508999113,7cyclictest3055-21bash10:27:130
2508999112,4cyclictest24563-21sshd09:47:410
2508999112,4cyclictest24563-21sshd09:47:410
25089991110,1cyclictest9-21ksoftirqd/011:48:530
2508999111,4cyclictest887-21gdbus09:42:260
2508999111,4cyclictest8044-21sshd09:39:240
2508999110,5cyclictest2725-21sshd10:38:230
2508999110,4cyclictest13412-21sshd10:24:090
2508999110,11cyclictest10826-21kworker/0:511:27:180
2508999110,11cyclictest10826-21kworker/0:511:27:180
2508999110,10cyclictest7997-21kworker/0:210:13:350
2514599103,2cyclictest786-21snmpd09:01:287
2514599103,1cyclictest26464-21memory07:06:577
2514599103,1cyclictest26464-21memory07:06:577
2514599100,3cyclictest0-21swapper/708:35:377
2513099109,1cyclictest0-21swapper/508:45:495
2513099108,1cyclictest57-21ksoftirqd/507:41:565
2513099106,4cyclictest57-21ksoftirqd/508:58:135
2513099102,0cyclictest57-21ksoftirqd/508:52:455
2513099100,10cyclictest0-21swapper/508:25:015
2512299109,1cyclictest49-21ksoftirqd/410:01:524
2512299108,1cyclictest49-21ksoftirqd/411:37:144
2512299108,1cyclictest49-21ksoftirqd/409:31:464
2512299108,1cyclictest49-21ksoftirqd/409:18:304
2512299104,3cyclictest2982-21systemd-cgroups09:09:134
2512299103,4cyclictest22758-21bash10:37:384
2512299103,4cyclictest1-21systemd09:37:074
2512299101,5cyclictest31427-21sshd11:17:204
2511799108,1cyclictest17393-21sshd09:23:093
2511799104,2cyclictest12927-21bash11:29:213
2511799104,2cyclictest12927-21bash11:29:213
2511799103,4cyclictest686-21dbus-daemon12:09:163
2511799103,4cyclictest6709-21systemd12:11:523
2511799103,4cyclictest10743-21sshd11:42:123
2511799102,4cyclictest686-21dbus-daemon12:00:053
2511799100,10cyclictest0-21swapper/311:37:413
2510599102,7cyclictest8153-21httpd09:16:072
2510599100,4cyclictest686-21dbus-daemon11:17:572
2510599100,4cyclictest1-21systemd10:53:172
2510599100,4cyclictest0-21swapper/209:16:432
2509799108,1cyclictest25-21ksoftirqd/111:28:291
2509799108,1cyclictest25-21ksoftirqd/111:28:291
2509799102,4cyclictest19182-21bash12:06:561
2509799100,9cyclictest23113-21kworker/1:211:33:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional