You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 08:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Mar 26, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
586221230,0sleep25861-21sshd23:00:332
3026921190,4sleep22235499cyclictest23:54:022
21771210937,43sleep10-21swapper/119:06:081
21901210434,40sleep30-21swapper/319:07:473
92742950,2sleep00-21swapper/023:48:070
91722910,5sleep03-21ksoftirqd/021:58:000
8772910,2sleep32512-21runrttasks20:45:103
64182870,4sleep20-21swapper/222:32:362
273992870,2sleep227395-21sshd22:10:122
27572850,2sleep22756-21sshd00:01:242
273252850,2sleep10-21swapper/123:46:331
3992840,1sleep10-21swapper/121:32:311
314812840,3sleep30-21swapper/300:26:373
281612830,0sleep00-21swapper/022:24:120
219742830,0sleep00-21swapper/021:34:520
174962830,2sleep10-21swapper/123:38:231
106232830,1sleep20-21swapper/222:22:182
191792800,3sleep20-21swapper/221:52:122
14062800,2sleep30-21swapper/323:57:523
126692800,2sleep32024-21nfsd22:05:123
30972790,2sleep10-21swapper/122:28:301
234382790,2sleep20-21swapper/223:56:442
201252780,0sleep00-21swapper/022:55:140
189802780,1sleep018976-21sshd00:39:500
135862780,2sleep20-21swapper/221:55:042
250732760,1sleep30-21swapper/321:49:283
135992760,2sleep30-21swapper/322:15:263
38162750,1sleep10-21swapper/122:46:131
322952750,2sleep32235599cyclictest22:21:073
323172740,1sleep232311-21cp22:28:072
239732740,2sleep30-21swapper/319:10:223
75632730,3sleep02235299cyclictest22:25:210
291852730,2sleep10-21swapper/123:14:101
213482730,2sleep30-21swapper/300:10:313
31992720,4sleep22235499cyclictest21:36:182
326952680,2sleep232687-21sshd23:22:172
20032640,4sleep32235599cyclictest21:32:423
2202925832,14sleep00-21swapper/019:09:240
2180125433,17sleep20-21swapper/219:06:302
240212500,0sleep224022-21sshd22:51:512
194802330,4sleep10-21swapper/100:03:161
2235299310,29cyclictest23997-21sshd22:48:280
22532300,3sleep10-21swapper/123:25:521
2235299290,25cyclictest8571-21sshd23:37:230
132112280,26sleep3144650irq/27-eth022:54:303
80332270,0sleep28036-21sshd21:30:002
39772270,0sleep23978-21bash22:46:142
2235299270,25cyclictest27561-21sshd22:03:210
2235299270,25cyclictest18930-21sshd23:56:130
108422270,0sleep30-21swapper/321:26:493
156942260,0sleep00-21swapper/022:08:580
2235299250,19cyclictest0-21swapper/021:45:120
107002250,4sleep30-21swapper/323:44:423
2235299240,7cyclictest5490-21sshd21:43:580
2235299240,23cyclictest31373-21sshd21:25:310
325272230,3sleep10-21swapper/121:12:071
311692230,21sleep1144650irq/27-eth023:54:101
2235299232,20cyclictest2066-21nscd21:22:530
2235299230,22cyclictest7127-21chrt21:19:440
2235299230,22cyclictest7127-21chrt21:19:440
2235299230,22cyclictest2024-21nfsd22:11:590
2235299230,22cyclictest14043-21bash23:12:140
2235299230,22cyclictest0-21swapper/023:52:090
2235299230,13cyclictest31887-21sshd23:43:220
2235299230,12cyclictest6158-21sshd21:36:390
162092230,1sleep10-21swapper/121:37:571
78552220,2sleep30-21swapper/300:35:043
56532220,2sleep15654-21sshd23:44:051
40262220,20sleep1144650irq/27-eth021:54:051
38842220,2sleep23885-21bash23:19:052
272822220,2sleep227281-21sshd22:16:572
263332220,1sleep30-21swapper/321:18:203
263332220,1sleep30-21swapper/321:18:193
2235299220,21cyclictest6236-21sshd21:50:470
2235299220,21cyclictest25093-21sshd00:11:000
2235299220,20cyclictest6471-21fschecks_time23:30:130
2235299220,20cyclictest0-21swapper/022:19:080
2235299220,18cyclictest0-21swapper/000:15:110
2235299220,17cyclictest3654-21sshd00:01:300
2235299220,13cyclictest22432-21sshd00:21:480
2235299220,11cyclictest3192-21sshd00:08:290
2235299220,11cyclictest2100-21snmpd23:05:580
2235299220,11cyclictest12077-21sshd23:01:150
22354992112,5cyclictest10950irq/23-ehci_hcd22:04:462
2235299210,20cyclictest11844-21bash00:31:300
2235299210,19cyclictest14946-21bash23:27:180
2235299210,18cyclictest0-21swapper/022:37:050
2235299210,17cyclictest0-21swapper/020:56:540
2235299210,16cyclictest0-21swapper/022:51:370
2235299210,13cyclictest16229-21bash21:10:220
2235299210,12cyclictest23430-21sshd00:25:420
2235299210,11cyclictest17489-21sshd22:30:130
2235299210,10cyclictest17984-21sshd23:20:380
2235499202,13cyclictest19714-21sshd22:44:312
2235499202,11cyclictest20801-21sshd22:37:352
2235499201,12cyclictest26145-21sshd00:29:382
2235299200,16cyclictest32243-21sshd22:42:150
80212190,1sleep10-21swapper/122:22:011
269162190,17sleep3144650irq/27-eth021:42:483
22353991917,1cyclictest0-21swapper/122:42:401
2235299190,11cyclictest15058-21bash23:16:190
161762190,17sleep1144650irq/27-eth000:39:311
102032190,2sleep10-21swapper/100:13:171
31302180,2sleep33121-21sshd21:53:583
2235499184,9cyclictest32694-21sshd23:10:292
2235499181,11cyclictest26259-21bash22:55:522
2235399184,3cyclictest144650irq/27-eth022:34:551
2235399183,3cyclictest9051-21bash23:15:301
22353991810,4cyclictest3393-21bash23:33:241
2235299181,16cyclictest2100-21snmpd20:18:170
2235299180,1cyclictest0-21swapper/020:30:120
2235299180,17cyclictest0-21swapper/021:02:290
2235299180,17cyclictest0-21swapper/019:25:140
2235299180,16cyclictest11399-21unixbench-2d21:05:210
2235299180,16cyclictest0-21swapper/019:50:140
2235299180,10cyclictest26096-21sadc20:30:010
2235299180,10cyclictest0-21swapper/019:30:120
107382180,1sleep30-21swapper/300:20:283
2235599178,4cyclictest11252-21latency_hist23:20:003
2235599170,8cyclictest0-21swapper/323:50:183
2235599170,15cyclictest25181-21sshd00:00:193
2235599170,15cyclictest23273-21sshd23:35:243
2235499175,4cyclictest18941-21sshd22:05:452
2235499172,9cyclictest0-21swapper/221:13:592
22354991712,3cyclictest4970-21id21:47:182
2235499170,14cyclictest15209-21sshd21:23:562
2235399171,4cyclictest16710-21sshd21:55:201
22353991714,2cyclictest0-21swapper/120:15:231
2235399170,15cyclictest0-21swapper/100:10:001
2235299177,9cyclictest0-21swapper/019:35:180
2235299170,9cyclictest2088-21snmpd20:05:170
2235299170,16cyclictest13282-21tune2fs20:00:130
2235299170,16cyclictest0-21swapper/020:45:130
2235299170,16cyclictest0-21swapper/020:40:160
2235299170,14cyclictest0-21swapper/020:21:150
2235299170,13cyclictest3058-21munin-node20:50:170
2235299170,12cyclictest10427-21munin-node19:55:200
36162160,14sleep1144650irq/27-eth023:07:181
35372160,14sleep3144650irq/27-eth000:16:163
2235599169,5cyclictest0-21swapper/300:33:143
2235599168,3cyclictest0-21swapper/323:13:523
2235599165,6cyclictest22434-21sshd23:09:253
22355991611,4cyclictest21689-21sshd22:34:163
2235599161,11cyclictest2132-21sshd21:57:123
2235499169,6cyclictest2024-21nfsd00:05:522
2235499165,9cyclictest26043-21sshd00:22:152
2235499163,12cyclictest24476-21sshd23:35:342
2235499162,9cyclictest0-21swapper/219:19:592
2235499162,8cyclictest32613-21sshd23:43:272
2235499162,13cyclictest0-21swapper/223:47:272
2235499161,9cyclictest0-21swapper/221:05:192
22354991612,3cyclictest11477-21bash23:30:412
2235499160,7cyclictest0-21swapper/200:34:262
2235399160,4cyclictest10042sleep121:29:161
2235399160,14cyclictest13939-21wc23:05:011
2235299162,8cyclictest0-21swapper/019:20:210
2235299160,1cyclictest0-21swapper/020:35:120
2235299160,15cyclictest25971-21switchtime19:15:210
2235299160,15cyclictest0-21swapper/020:10:150
2235299160,15cyclictest0-21swapper/019:10:130
2235299160,12cyclictest0-21swapper/019:45:110
2235599158,3cyclictest0-21swapper/322:10:463
22355991512,2cyclictest31080-21bash22:56:233
2235599151,13cyclictest0-21swapper/323:01:323
2235599150,13cyclictest0-21swapper/321:36:443
2235599150,13cyclictest0-21swapper/321:11:103
2235599150,11cyclictest31411-21sshd22:42:103
2235599150,10cyclictest18182-21sshd23:20:403
2235499153,11cyclictest10950irq/23-ehci_hcd20:24:262
2235499152,5cyclictest22061-21sshd00:14:482
2235499152,12cyclictest0-21swapper/219:21:522
2235499151,8cyclictest0-21swapper/219:57:152
22354991512,2cyclictest31959-21sshd23:06:512
22354991511,3cyclictest9078-21sshd21:33:282
22354991511,3cyclictest6008-21sshd21:40:302
22354991511,3cyclictest14145-21sshd00:35:392
2235499150,9cyclictest2459-21sshd00:16:092
2235499150,14cyclictest3794-21sshd21:19:232
2235499150,14cyclictest3794-21sshd21:19:232
2235399158,5cyclictest7698-21sshd22:50:111
2235399158,3cyclictest2023-21nfsd00:26:161
2235399156,4cyclictest28500-21sshd21:15:111
2235399156,4cyclictest28500-21sshd21:15:101
2235399151,5cyclictest5582-21sshd22:18:071
22353991512,2cyclictest10950irq/23-ehci_hcd20:50:361
22353991511,3cyclictest18405-21rm22:58:341
22353991511,3cyclictest12779-21bash00:20:431
22353991511,3cyclictest0-21swapper/120:41:431
2235399151,10cyclictest0-21swapper/122:11:411
2235399150,6cyclictest0-21swapper/123:55:111
2235399150,6cyclictest0-21swapper/100:15:321
2235399150,3cyclictest31840-21sshd22:00:191
2235399150,14cyclictest47-21rcuop/321:46:211
2235399150,13cyclictest12279-21taskset19:57:561
2235399150,13cyclictest0-21swapper/120:25:441
2235399150,13cyclictest0-21swapper/100:34:051
2235399150,11cyclictest22-21ksoftirqd/121:20:571
2235299150,14cyclictest0-21swapper/019:40:110
2235599147,2cyclictest27334-21sshd22:45:193
2235599142,1cyclictest144650irq/27-eth020:55:223
2235599142,11cyclictest144650irq/27-eth022:38:593
22355991411,2cyclictest10950irq/23-ehci_hcd19:25:473
22355991410,3cyclictest10950irq/23-ehci_hcd19:20:253
2235599140,5cyclictest29985-21sshd23:25:243
2235599140,5cyclictest2023-21nfsd22:01:143
2235599140,12cyclictest6077-21sshd22:25:143
2235599140,12cyclictest5348-21sort00:05:133
2235499149,4cyclictest144650irq/27-eth019:26:252
2235499147,6cyclictest0-21swapper/220:25:072
2235499145,8cyclictest0-21swapper/220:48:432
2235499145,5cyclictest10950irq/23-ehci_hcd20:05:112
22354991410,3cyclictest10950irq/23-ehci_hcd19:51:232
2235499140,5cyclictest32282-21munin-node19:30:162
2235499140,12cyclictest29792-21bash23:25:222
2235499140,12cyclictest29772-21munin-node20:35:182
2235399149,1cyclictest22-21ksoftirqd/122:05:281
2235399148,1cyclictest19557-21rm21:42:001
2235399141,3cyclictest0-21swapper/123:20:161
2235399140,12cyclictest30320-21chrt20:36:061
2235399140,12cyclictest29869-21sshd22:35:091
2235399140,12cyclictest2088-21snmpd21:09:231
2235599130,4cyclictest6838-21needreboot19:45:163
2235599130,4cyclictest25224-21fschecks_time19:15:133
2235599130,4cyclictest2512-21runrttasks19:55:253
2235599130,4cyclictest2132-21sshd23:46:403
2235599130,4cyclictest11539-21grep21:20:103
2235599130,4cyclictest10119-21sshd23:30:333
2235599130,12cyclictest0-21swapper/321:05:183
2235599130,12cyclictest0-21swapper/321:00:033
2235599130,12cyclictest0-21swapper/320:44:213
2235599130,12cyclictest0-21swapper/320:36:313
2235599130,12cyclictest0-21swapper/320:33:073
2235599130,12cyclictest0-21swapper/320:13:373
2235599130,12cyclictest0-21swapper/320:00:063
2235599130,11cyclictest4767-21ntp_states19:40:183
2235499139,3cyclictest144650irq/27-eth021:00:472
2235499139,3cyclictest144650irq/27-eth019:45:022
2235499139,3cyclictest10950irq/23-ehci_hcd19:35:412
2235499139,0cyclictest13476-21irqstats20:00:162
2235499138,3cyclictest5653-21diskstats20:55:142
2235499130,5cyclictest0-21swapper/220:51:322
2235499130,12cyclictest189292chrt20:10:432
2235499130,12cyclictest0-21swapper/220:30:522
2235499130,12cyclictest0-21swapper/219:13:492
2235399139,3cyclictest144650irq/27-eth020:10:241
2235399139,3cyclictest144650irq/27-eth019:51:551
2235399139,3cyclictest144650irq/27-eth019:25:041
2235399138,4cyclictest2023-21nfsd19:40:571
2235399136,3cyclictest10950irq/23-ehci_hcd19:20:181
2235399131,11cyclictest10950irq/23-ehci_hcd19:30:041
2235399130,5cyclictest0-21swapper/120:01:351
2235399130,12cyclictest144650irq/27-eth019:46:271
2235399130,12cyclictest0-21swapper/120:56:401
2235399130,12cyclictest0-21swapper/120:31:401
2235399130,11cyclictest7913-21df_inode21:00:121
2235399130,11cyclictest16121-21ntp_states20:05:181
22355991210,1cyclictest0-21swapper/320:26:163
2235599120,3cyclictest19846-21diskstats20:15:143
2235599120,11cyclictest0-21swapper/320:50:153
2235599120,11cyclictest0-21swapper/320:05:463
2235599120,10cyclictest32204-21iostat19:30:153
2235599120,10cyclictest22131-21munin-node20:20:133
2235599120,10cyclictest1602-21diskstats19:35:123
2235599120,10cyclictest0-21swapper/319:50:113
2235499126,2cyclictest10950irq/23-ehci_hcd19:40:172
2235499122,3cyclictest0-21swapper/220:40:012
2235499120,10cyclictest0-21swapper/220:15:132
2235399127,4cyclictest0-21swapper/120:20:121
2235399120,11cyclictest22926-21perl19:10:131
2235399120,11cyclictest0-21swapper/120:45:041
2235399120,10cyclictest1969-21munin-node19:35:141
2235399110,2cyclictest0-21swapper/119:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional