You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 07:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed May 20, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2392199123121,2cyclictest1844-21nfsd22:16:223
162672940,2sleep62393799cyclictest21:53:396
51212900,0sleep2311rcuc/223:17:292
180542890,2sleep12390699cyclictest21:25:391
124762770,1sleep012472-21sshd23:19:430
49262760,0sleep00-21swapper/023:49:310
21362760,0sleep00-21swapper/000:25:110
172002730,0sleep50-21swapper/521:55:305
128982720,1sleep52393699cyclictest23:21:405
2392999680,67cyclictest26433-21kworker/u16:422:16:234
207552650,0sleep70-21swapper/722:08:547
23937995918,41cyclictest0-21swapper/622:16:236
149912540,0sleep30-21swapper/322:27:163
228242520,0sleep70-21swapper/723:12:537
24822510,2sleep42392999cyclictest23:41:504
238912510,0sleep00-21swapper/000:35:520
57592500,0sleep10-21swapper/100:27:201
268072490,0sleep70-21swapper/722:14:477
2375224825,8sleep10-21swapper/119:08:311
2375224825,8sleep10-21swapper/119:08:311
23752480,0sleep20-21swapper/223:13:372
91632470,1sleep69162-21sshd00:16:126
46362470,1sleep12390699cyclictest21:39:491
165452470,0sleep70-21swapper/721:21:537
87112460,0sleep60-21swapper/600:36:546
302842460,1sleep6721-21dbus-daemon00:00:266
299622460,0sleep50-21swapper/500:08:025
241292460,0sleep60-21swapper/600:30:136
2176824529,11sleep50-21swapper/519:04:115
2176824529,11sleep50-21swapper/519:04:115
115702450,0sleep611565-21sshd23:27:186
81882440,0sleep70-21swapper/721:51:167
46112440,1sleep54607-21bash21:28:395
2390699440,44cyclictest14472-21kworker/1:222:16:221
214942440,0sleep40-21swapper/421:50:094
147392440,0sleep20-21swapper/222:57:112
302932430,2sleep12390699cyclictest23:03:501
2373624330,9sleep30-21swapper/319:08:173
2373624330,9sleep30-21swapper/319:08:173
135712430,0sleep70-21swapper/722:42:107
135712430,0sleep70-21swapper/722:42:107
102602430,0sleep610256-21sshd22:38:166
98722420,1sleep0101ktimersoftd/023:27:120
169462420,0sleep30-21swapper/322:36:453
66972410,0sleep70-21swapper/721:58:457
49552410,1sleep12828-21kworker/1:123:21:121
2370624129,8sleep40-21swapper/419:07:544
2370624129,8sleep40-21swapper/419:07:544
194962410,0sleep00-21swapper/021:14:330
293512400,1sleep5758-21runrttasks00:24:525
289652400,0sleep70-21swapper/700:30:307
282932400,0sleep30-21swapper/322:58:003
23913994035,4cyclictest13550irq/24-ahci[00022:16:222
2361724027,9sleep00-21swapper/019:06:380
2361724027,9sleep00-21swapper/019:06:380
2349724027,9sleep70-21swapper/719:05:017
2349724027,9sleep70-21swapper/719:05:017
195382400,0sleep70-21swapper/722:29:207
133812400,0sleep50-21swapper/522:27:105
24672390,0sleep20-21swapper/222:34:042
2346523927,8sleep60-21swapper/619:04:366
2346523927,8sleep60-21swapper/619:04:366
16932390,0sleep50-21swapper/500:36:295
135592390,0sleep30-21swapper/300:35:153
101802390,0sleep310183-21kworker/u16:423:32:523
60672380,0sleep30-21swapper/300:16:013
301372380,0sleep70-21swapper/721:43:157
2347923827,8sleep20-21swapper/219:04:482
2347923827,8sleep20-21swapper/219:04:482
85792370,0sleep00-21swapper/021:45:400
34752350,2sleep42392999cyclictest00:21:304
2393699320,32cyclictest4370-21kworker/5:022:16:225
2391399270,8cyclictest6084-21grep23:55:132
23899992726,1cyclictest0-21swapper/022:16:230
2393699251,7cyclictest1-21systemd21:41:065
2389999252,6cyclictest4573-21sshd00:23:310
2393699242,5cyclictest1-21systemd22:21:125
2391399240,13cyclictest10213-21systemd22:28:542
2391399240,12cyclictest9656-21grep22:45:382
147122240,8sleep09-21ksoftirqd/023:31:130
23937992317,3cyclictest65-21ksoftirqd/623:19:096
2393699232,8cyclictest11709-21sshd21:19:415
2393699232,7cyclictest17599-21sshd22:31:095
2393699232,5cyclictest721-21dbus-daemon21:33:295
2393699231,7cyclictest721-21dbus-daemon23:32:215
2393699231,7cyclictest721-21dbus-daemon00:09:245
2393699231,6cyclictest8912-21grepconf.sh21:36:215
2393699231,5cyclictest0-21swapper/523:55:025
2391399231,8cyclictest721-21dbus-daemon23:04:082
2391399231,11cyclictest721-21dbus-daemon21:42:242
2391399230,8cyclictest28361-21bash00:09:452
2391399230,11cyclictest7694-21sshd23:27:042
2390699239,1cyclictest25-21ksoftirqd/121:33:591
2390699238,3cyclictest25-21ksoftirqd/121:18:151
2389999233,6cyclictest24970-21bash21:37:180
2393699222,7cyclictest23172-21cp21:52:095
2393699222,6cyclictest730-21NetworkManager21:44:455
2393699221,7cyclictest2990-21sshd00:32:495
2393699221,6cyclictest709-21systemd-logind22:59:155
2393699221,5cyclictest721-21dbus-daemon00:01:025
2393699221,5cyclictest1-21systemd22:47:165
2393699220,6cyclictest0-21swapper/522:39:175
2393699220,6cyclictest0-21swapper/522:39:175
2393699220,2cyclictest20525-21bash23:37:155
2393699220,10cyclictest30399-21sshd22:13:125
2393699220,1cyclictest0-21swapper/523:24:425
2391399223,9cyclictest857-21polkitd23:43:232
2391399223,10cyclictest8077-21id23:47:552
2391399220,9cyclictest8823-21sshd21:58:522
2391399220,9cyclictest721-21dbus-daemon21:44:072
2391399220,8cyclictest24803-21bash22:42:502
2391399220,8cyclictest24803-21bash22:42:502
2391399220,8cyclictest0-21swapper/221:35:132
2391399220,7cyclictest0-21swapper/221:21:152
2391399220,7cyclictest0-21swapper/200:25:412
2391399220,12cyclictest24006-21id22:01:342
2391399220,10cyclictest25816-21bash21:50:242
2391399220,10cyclictest21365-21grep00:14:592
2391399220,10cyclictest0-21swapper/223:58:572
2390699228,1cyclictest25-21ksoftirqd/123:11:491
2390699227,1cyclictest25-21ksoftirqd/123:42:121
23906992216,3cyclictest25-21ksoftirqd/100:13:091
23906992214,4cyclictest25-21ksoftirqd/121:56:231
23906992212,1cyclictest25-21ksoftirqd/122:32:531
2389999223,6cyclictest20846-21sshd23:16:300
2389999222,7cyclictest13911-21systemd-cgroups22:30:560
2389999222,6cyclictest721-21dbus-daemon00:05:310
2389999221,6cyclictest4080-21grep22:49:070
2389999221,4cyclictest18085-21bash22:12:280
2393699212,4cyclictest12603-21sshd22:49:305
2393699211,5cyclictest26247-21sshd22:35:225
2391399210,8cyclictest721-21dbus-daemon00:32:322
2391399210,8cyclictest31292-21sshd21:26:252
2391399210,7cyclictest8066-21sshd23:38:262
2391399210,7cyclictest0-21swapper/222:12:352
2391399210,6cyclictest11638-21sshd00:05:002
2391399210,11cyclictest7650-21sshd23:19:262
2391399210,10cyclictest721-21dbus-daemon21:12:582
2391399210,10cyclictest26618-21bash23:50:482
2391399210,10cyclictest0-21swapper/200:19:072
2390699217,1cyclictest25-21ksoftirqd/123:08:131
2390699216,2cyclictest25-21ksoftirqd/122:55:221
23906992117,3cyclictest25-21ksoftirqd/122:36:001
23906992117,1cyclictest25-21ksoftirqd/123:38:131
23906992116,3cyclictest25-21ksoftirqd/123:44:251
2389999214,7cyclictest27762-21grep21:31:510
2389999213,5cyclictest14765-21cp22:02:560
2389999213,3cyclictest721-21dbus-daemon00:10:410
2389999212,2cyclictest15069-21sshd22:34:420
2393699202,6cyclictest25432-21sshd22:05:225
2393699201,7cyclictest9712-21grep21:15:535
2393699201,7cyclictest11420-21sshd22:55:035
2393699201,6cyclictest15913-21bash23:14:185
2393699201,6cyclictest0-21swapper/521:09:055
2393699200,6cyclictest22306-21systemd-cgroups00:22:395
2393699200,5cyclictest721-21dbus-daemon00:16:565
2393699200,5cyclictest26333-21systemd-cgroups22:01:425
2393699200,4cyclictest0-21swapper/523:49:065
2391399200,9cyclictest7743-21sshd21:17:412
2391399200,9cyclictest20661-21systemd00:35:412
2391399200,8cyclictest7279-21bash22:19:172
2391399200,8cyclictest22049-21systemd22:07:042
2391399200,6cyclictest0-21swapper/223:02:032
2391399200,10cyclictest0-21swapper/222:49:062
2390699207,2cyclictest25-21ksoftirqd/122:19:161
2390699205,5cyclictest25-21ksoftirqd/122:05:081
2390699205,3cyclictest25-21ksoftirqd/100:38:501
23906992015,3cyclictest25-21ksoftirqd/123:26:491
23906992015,3cyclictest25-21ksoftirqd/121:59:591
23906992012,1cyclictest25-21ksoftirqd/122:11:441
23906992011,1cyclictest25-21ksoftirqd/100:07:071
2389999203,5cyclictest721-21dbus-daemon21:13:120
2389999203,5cyclictest2026-21id23:45:310
2389999203,4cyclictest2883-21bash21:24:450
2389999202,8cyclictest0-21swapper/021:52:210
2389999202,6cyclictest822-21bash22:20:490
2389999202,5cyclictest0-21swapper/023:11:210
2389999202,4cyclictest1-21systemd21:55:190
2389999201,8cyclictest0-21swapper/023:39:120
2389999201,3cyclictest0-21swapper/023:58:090
2389999200,6cyclictest0-21swapper/021:20:350
130732200,0sleep30-21swapper/321:53:283
2393699191,8cyclictest0-21swapper/523:10:065
2393699191,7cyclictest11707-21sshd23:04:385
2393699190,6cyclictest0-21swapper/523:39:355
2393699190,3cyclictest1-21systemd23:44:265
2391399190,7cyclictest13125-21sshd22:29:032
2391399190,6cyclictest16419-21sshd23:29:222
2391399190,11cyclictest11481-21sshd21:29:042
2390699199,1cyclictest25-21ksoftirqd/121:09:011
2390699198,3cyclictest25-21ksoftirqd/123:56:141
2390699198,2cyclictest25-21ksoftirqd/122:49:521
2390699197,1cyclictest25-21ksoftirqd/100:17:031
2390699196,3cyclictest25-21ksoftirqd/121:21:271
2390699196,1cyclictest25-21ksoftirqd/122:44:271
2390699196,1cyclictest25-21ksoftirqd/121:50:071
2390699195,2cyclictest25-21ksoftirqd/100:30:001
23906991916,1cyclictest25-21ksoftirqd/123:49:171
2389999193,3cyclictest13784-21sshd22:40:150
2389999193,3cyclictest13784-21sshd22:40:150
2389999192,7cyclictest721-21dbus-daemon22:44:020
2389999192,7cyclictest22451-21bash23:01:270
2389999192,5cyclictest721-21dbus-daemon23:59:110
2389999192,5cyclictest30942-21sshd22:05:410
2389999192,5cyclictest15389-21sshd00:31:380
2389999192,4cyclictest721-21dbus-daemon22:55:300
2389999192,4cyclictest6719-21sshd23:04:150
2389999192,3cyclictest0-21swapper/022:25:060
2389999191,7cyclictest0-21swapper/000:17:020
2389999191,6cyclictest2505-21sshd23:34:140
23937991815,3cyclictest65-21ksoftirqd/600:07:166
2390699185,1cyclictest25-21ksoftirqd/121:44:571
2390699184,3cyclictest25-21ksoftirqd/122:27:321
2390699184,1cyclictest25-21ksoftirqd/100:02:001
23906991816,1cyclictest25-21ksoftirqd/121:29:091
23906991816,1cyclictest25-21ksoftirqd/100:22:351
23906991815,2cyclictest25-21ksoftirqd/122:39:141
23906991815,2cyclictest25-21ksoftirqd/122:39:141
2390699180,2cyclictest121rcu_preempt23:29:071
326472170,0sleep40-21swapper/423:30:204
23937991716,1cyclictest65-21ksoftirqd/623:42:316
23937991715,1cyclictest65-21ksoftirqd/623:00:156
23937991713,3cyclictest65-21ksoftirqd/623:51:076
23921991710,4cyclictest41-21ksoftirqd/323:13:443
23906991715,1cyclictest25-21ksoftirqd/121:08:571
23906991712,2cyclictest25-21ksoftirqd/123:14:181
2389999172,6cyclictest1-21systemd21:39:130
2393799169,5cyclictest65-21ksoftirqd/621:23:296
23937991614,1cyclictest65-21ksoftirqd/622:31:396
23937991614,1cyclictest65-21ksoftirqd/621:40:146
23937991613,1cyclictest65-21ksoftirqd/623:18:246
23937991613,1cyclictest65-21ksoftirqd/621:28:476
23937991610,2cyclictest65-21ksoftirqd/623:13:286
2392199169,4cyclictest41-21ksoftirqd/323:36:453
2391399160,9cyclictest30860-21if_err_em219:19:102
2391399160,11cyclictest0-21swapper/219:44:172
23906991615,1cyclictest9310-21kworker/1:020:22:261
172442160,0sleep30-21swapper/323:03:043
23938991513,1cyclictest73-21ksoftirqd/722:09:407
23938991511,3cyclictest73-21ksoftirqd/722:03:257
23937991513,2cyclictest9682-21sshd22:28:526
23937991513,1cyclictest65-21ksoftirqd/623:35:166
23937991513,1cyclictest65-21ksoftirqd/623:29:186
23937991513,1cyclictest65-21ksoftirqd/622:10:286
23937991513,1cyclictest65-21ksoftirqd/621:55:026
23937991513,1cyclictest65-21ksoftirqd/600:21:136
23937991512,3cyclictest65-21ksoftirqd/623:44:246
23937991512,1cyclictest65-21ksoftirqd/623:57:296
23937991511,2cyclictest65-21ksoftirqd/600:28:096
23937991511,1cyclictest65-21ksoftirqd/600:09:386
23929991510,2cyclictest49-21ksoftirqd/422:44:554
2392199155,4cyclictest0-21swapper/321:13:403
2389999150,4cyclictest0-21swapper/019:59:120
285132140,0sleep4481ktimersoftd/423:58:324
242402140,0sleep30-21swapper/300:28:263
240842140,1sleep424075-21bash22:57:454
23938991412,1cyclictest73-21ksoftirqd/722:44:237
23938991412,1cyclictest73-21ksoftirqd/721:24:137
23938991411,3cyclictest73-21ksoftirqd/723:36:087
2393799149,4cyclictest709-21systemd-logind22:47:016
23937991413,1cyclictest65-21ksoftirqd/623:04:366
23937991413,1cyclictest65-21ksoftirqd/621:33:156
23937991413,1cyclictest65-21ksoftirqd/621:09:036
23937991412,1cyclictest65-21ksoftirqd/622:55:456
23937991412,1cyclictest65-21ksoftirqd/622:05:336
23937991412,1cyclictest65-21ksoftirqd/621:44:236
2392199149,3cyclictest41-21ksoftirqd/300:29:563
23921991410,1cyclictest41-21ksoftirqd/322:49:383
2392199140,14cyclictest18522-21kworker/3:422:45:543
2392199140,13cyclictest27855-21kworker/3:321:15:223
23906991414,0cyclictest9310-21kworker/1:020:48:261
23906991414,0cyclictest9310-21kworker/1:020:32:301
23906991413,1cyclictest9310-21kworker/1:020:13:361
23938991312,1cyclictest73-21ksoftirqd/722:49:107
2393899130,12cyclictest1796-21kworker/7:300:01:157
2393799138,3cyclictest65-21ksoftirqd/622:49:046
23937991312,1cyclictest65-21ksoftirqd/622:39:346
23937991312,1cyclictest65-21ksoftirqd/622:39:346
23937991312,1cyclictest65-21ksoftirqd/622:19:106
23937991311,1cyclictest65-21ksoftirqd/621:59:136
23937991311,1cyclictest65-21ksoftirqd/621:34:166
2393799130,12cyclictest28685-21kworker/6:421:14:096
2393699131,3cyclictest0-21swapper/519:19:165
2393699130,1cyclictest27701-21ntpq20:09:165
23921991311,1cyclictest41-21ksoftirqd/323:42:203
23921991311,1cyclictest41-21ksoftirqd/323:25:403
23921991311,1cyclictest41-21ksoftirqd/322:05:283
23921991311,1cyclictest41-21ksoftirqd/322:03:223
2392199131,1cyclictest131rcu_sched22:19:173
2392199130,13cyclictest5088-21kworker/3:621:39:153
23906991312,1cyclictest9310-21kworker/1:019:13:061
2389999131,5cyclictest30276-21cstates19:19:070
187442130,0sleep40-21swapper/421:36:554
2393899129,3cyclictest20957-21sshd00:05:347
2393899129,2cyclictest21861-21cp23:44:477
2393899128,1cyclictest73-21ksoftirqd/722:26:577
23938991210,1cyclictest73-21ksoftirqd/723:19:367
23938991210,1cyclictest73-21ksoftirqd/722:37:457
23938991210,1cyclictest73-21ksoftirqd/721:33:277
23938991210,1cyclictest73-21ksoftirqd/700:16:367
2393699124,1cyclictest57-21ksoftirqd/520:48:285
2393699122,1cyclictest11608-21fschecks_time20:39:095
2392999129,3cyclictest49-21ksoftirqd/400:37:524
2392999126,3cyclictest13359-21kworker/4:223:34:074
2392999123,5cyclictest721-21dbus-daemon00:07:484
2392999122,4cyclictest27049-21sshd00:24:444
23929991210,1cyclictest49-21ksoftirqd/400:14:054
23921991211,1cyclictest41-21ksoftirqd/321:31:423
23921991211,1cyclictest41-21ksoftirqd/321:26:173
23921991211,1cyclictest41-21ksoftirqd/321:23:263
23921991210,1cyclictest41-21ksoftirqd/323:55:443
23921991210,1cyclictest41-21ksoftirqd/322:40:383
23921991210,1cyclictest41-21ksoftirqd/322:40:383
23921991210,1cyclictest41-21ksoftirqd/322:29:073
23921991210,1cyclictest41-21ksoftirqd/322:09:013
2391399120,9cyclictest28331-21sed21:08:572
2391399120,6cyclictest0-21swapper/220:34:102
23906991212,0cyclictest9310-21kworker/1:020:55:221
23906991212,0cyclictest9310-21kworker/1:019:52:581
23906991212,0cyclictest9310-21kworker/1:019:46:021
23906991211,1cyclictest25-21ksoftirqd/120:08:571
23906991210,1cyclictest25-21ksoftirqd/120:18:571
23906991210,1cyclictest25-21ksoftirqd/120:18:571
2389999121,7cyclictest13091-21grep19:44:130
2389999121,6cyclictest28042-21kernelversion19:14:130
2389999121,3cyclictest9362-21expr19:39:070
2389999121,3cyclictest349-21cat20:19:110
2389999121,2cyclictest4223-21iostat_ios19:29:100
140162120,0sleep40-21swapper/422:59:054
111602120,0sleep70-21swapper/723:04:377
269662110,0sleep40-21swapper/421:11:004
2393899119,1cyclictest73-21ksoftirqd/723:58:227
2393899119,1cyclictest73-21ksoftirqd/722:59:097
2393899119,1cyclictest73-21ksoftirqd/700:25:457
2393899118,3cyclictest24400-21sshd23:29:517
2393899118,2cyclictest73-21ksoftirqd/721:48:507
2393899117,1cyclictest15-21kswork21:08:577
2393899115,3cyclictest73-21ksoftirqd/700:08:597
23938991110,1cyclictest73-21ksoftirqd/722:19:197
23938991110,1cyclictest73-21ksoftirqd/700:34:507
2393899110,1cyclictest0-21swapper/721:09:507
2393699114,1cyclictest57-21ksoftirqd/520:59:305
2393699111,1cyclictest4039-21expr19:29:095
2393699110,2cyclictest26012-21sed19:09:205
2392999119,1cyclictest49-21ksoftirqd/422:10:454
2392999119,1cyclictest0-21swapper/400:32:364
2392999118,2cyclictest19261-21grep22:29:194
2392999118,1cyclictest49-21ksoftirqd/421:28:454
2392999114,2cyclictest23504-21sshd21:33:304
2392999112,5cyclictest6382-21systemd22:39:494
2392999112,5cyclictest6382-21systemd22:39:494
2392999110,10cyclictest17741-21systemd22:27:264
2392999110,10cyclictest14857-21kworker/4:123:49:514
2392999110,1cyclictest0-21swapper/422:34:124
2392199119,1cyclictest41-21ksoftirqd/323:53:273
2392199119,1cyclictest41-21ksoftirqd/323:44:153
2392199119,1cyclictest41-21ksoftirqd/321:55:063
2392199119,1cyclictest41-21ksoftirqd/319:38:563
2392199119,1cyclictest41-21ksoftirqd/300:05:483
2392199117,1cyclictest41-21ksoftirqd/300:19:193
2392199116,4cyclictest41-21ksoftirqd/321:47:133
23921991110,1cyclictest41-21ksoftirqd/323:22:543
2392199110,10cyclictest1-21systemd23:14:063
2392199110,1cyclictest0-21swapper/321:34:093
2391399113,7cyclictest752-21snmpd19:15:112
2391399110,7cyclictest4386-21unixbench-2d20:24:172
2391399110,7cyclictest29193-21expr20:14:082
2391399110,7cyclictest29193-21expr20:14:082
2391399110,1cyclictest0-21swapper/219:29:542
2390699119,1cyclictest25-21ksoftirqd/119:38:561
23906991110,1cyclictest9310-21kworker/1:019:32:001
23906991110,1cyclictest9310-21kworker/1:019:23:301
23906991110,1cyclictest25-21ksoftirqd/120:59:071
23906991110,1cyclictest25-21ksoftirqd/120:03:571
2390699110,11cyclictest9310-21kworker/1:020:38:021
2389999111,5cyclictest6451-21expr19:34:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional