You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 05:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Sat Jan 03, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50132980,0sleep25012-21bash22:42:002
106132840,2sleep33035499cyclictest22:26:513
2967326429,18sleep00-21swapper/019:06:570
3642580,0sleep3361-21sshd00:12:553
206092560,1sleep220606-21sshd00:10:462
172292550,0sleep30-21swapper/323:21:473
289362540,0sleep00-21swapper/000:39:320
2995725331,8sleep20-21swapper/219:08:592
2995025328,21sleep30-21swapper/319:08:573
286542530,1sleep11734-21runrttasks22:40:271
115612520,0sleep10-21swapper/122:10:471
109732520,1sleep30-21swapper/322:10:413
2972925028,19sleep10-21swapper/119:07:221
248592500,0sleep30-21swapper/323:55:253
145572490,0sleep00-21swapper/000:20:360
105962490,0sleep31734-21runrttasks22:59:163
101002490,1sleep310099-21fschecks_time22:05:163
76302480,0sleep11734-21runrttasks21:38:061
283442480,0sleep10-21swapper/121:57:331
137792470,1sleep30-21swapper/323:32:003
32502460,0sleep10-21swapper/121:15:591
265842450,0sleep00-21swapper/021:51:500
231232450,0sleep223122-21bash21:56:382
117542400,1sleep211756-21id23:53:272
3035099210,5cyclictest115650irq/25-eth021:12:012
112772190,0sleep20-21swapper/222:21:332
308232180,0sleep10-21swapper/123:13:211
3035099181,5cyclictest115650irq/25-eth023:29:322
30350991811,6cyclictest18702-21fschecks_count00:05:152
3035099180,5cyclictest115650irq/25-eth000:35:212
301072180,0sleep00-21swapper/000:17:560
3035099179,4cyclictest0-21swapper/221:26:492
3035099173,13cyclictest10346-21bash23:04:372
30350991716,1cyclictest0-21swapper/222:45:042
3035099170,16cyclictest521-21sshd22:03:452
3035099170,16cyclictest3319-21sshd23:08:472
3035099170,16cyclictest1970-21bash23:24:492
3035099170,16cyclictest12126-21bash21:33:342
3035099170,13cyclictest0-21swapper/222:33:302
3035099170,13cyclictest0-21swapper/221:53:512
3034299170,3cyclictest0-21swapper/022:01:240
47092160,0sleep14703-21sshd21:48:191
3035099169,6cyclictest0-21swapper/222:54:172
3035099169,6cyclictest0-21swapper/200:26:172
3035099161,14cyclictest0-21swapper/200:01:402
30350991610,5cyclictest27033-21sshd21:20:072
3035099160,7cyclictest2171-21sshd00:18:442
3035099160,4cyclictest22486-21sshd23:17:172
3035099160,15cyclictest722-21bash22:57:322
3035099160,15cyclictest6260-21sshd23:36:082
3035099160,15cyclictest5141-21rm23:30:282
3035099160,15cyclictest30603-21bash23:45:362
3035099160,15cyclictest28219-21sshd21:46:462
3035099160,15cyclictest2413-21bash21:15:492
3035099160,15cyclictest17389-21sshd00:21:092
3035099160,15cyclictest16128-21sshd22:27:492
3035099160,15cyclictest15969-21sshd23:10:412
3035099160,15cyclictest12927-21bash22:05:372
3035099160,15cyclictest11805-21bash00:31:022
3035099160,15cyclictest11361-21rm22:37:442
3035099160,15cyclictest1083-21munin-node20:15:172
3035099160,15cyclictest10245-21sshd23:42:192
3035099160,15cyclictest0-21swapper/223:58:232
3034299168,5cyclictest0-21swapper/022:45:040
3034299165,10cyclictest0-21swapper/021:32:590
3034299164,11cyclictest3-21ksoftirqd/023:11:200
3034299163,12cyclictest3-21ksoftirqd/021:41:070
30342991611,2cyclictest3-21ksoftirqd/023:20:370
30342991611,1cyclictest594-21sshd22:19:580
3034299160,13cyclictest0-21swapper/023:37:500
3034299160,11cyclictest0-21swapper/022:39:400
118212160,1sleep11734-21runrttasks22:32:261
104062160,0sleep10-21swapper/123:15:171
3035099159,5cyclictest0-21swapper/219:15:212
3035099158,6cyclictest28254-21cat21:05:162
3035099151,8cyclictest24183-21sshd21:35:232
3035099150,7cyclictest11084-21sshd20:31:232
3035099150,6cyclictest26252-21fschecks_time20:00:152
3035099150,6cyclictest19721-21basename21:40:102
3035099150,14cyclictest8817-21sshd22:10:192
3035099150,14cyclictest3604-21sshd22:15:022
3035099150,14cyclictest30818-21cat20:10:002
3035099150,14cyclictest14752-21munin-node19:40:132
3035099150,14cyclictest13362-21ntp_states19:35:202
3034299159,5cyclictest0-21swapper/023:26:070
3034299158,6cyclictest6106-21sshd22:53:030
3034299158,6cyclictest0-21swapper/000:31:240
3034299158,3cyclictest0-21swapper/023:48:360
30342991513,1cyclictest3-21ksoftirqd/023:05:590
30342991513,1cyclictest3-21ksoftirqd/022:32:370
3034299151,13cyclictest0-21swapper/021:26:360
30342991510,1cyclictest0-21swapper/023:02:240
3034299150,1cyclictest10-21rcuc/023:55:020
3034299150,10cyclictest0-21swapper/022:40:360
206682150,1sleep320655-21sshd22:01:353
130902150,0sleep10-21swapper/122:59:431
128462150,0sleep30-21swapper/319:35:153
3035099140,13cyclictest14521-21apache_processe20:40:102
3035099140,13cyclictest0-21swapper/220:35:162
3034599149,4cyclictest0-21swapper/123:49:191
3034599147,2cyclictest0-21swapper/100:33:261
3034599141,2cyclictest0-21swapper/122:48:441
3034599140,13cyclictest0-21swapper/100:26:581
3034599140,13cyclictest0-21swapper/100:10:451
3034599140,13cyclictest0-21swapper/100:01:251
3034599140,11cyclictest0-21swapper/123:37:241
3034299148,6cyclictest0-21swapper/022:11:570
3034299148,5cyclictest0-21swapper/022:55:060
3034299148,2cyclictest0-21swapper/023:30:520
3034299147,7cyclictest0-21swapper/022:08:570
3034299144,9cyclictest3-21ksoftirqd/000:27:460
3034299142,0cyclictest3-21ksoftirqd/021:10:030
30342991413,1cyclictest3-21ksoftirqd/021:17:150
30342991412,1cyclictest3-21ksoftirqd/022:25:280
30342991412,1cyclictest24171-21kworker/0:020:12:210
30342991410,2cyclictest24171-21kworker/0:020:38:110
3034299140,3cyclictest0-21swapper/023:44:040
3034299140,3cyclictest0-21swapper/000:03:450
3034299140,11cyclictest23069-21sshd21:35:160
3035499138,4cyclictest0-21swapper/321:45:293
3035499138,1cyclictest0-21swapper/323:51:123
3035499138,1cyclictest0-21swapper/321:15:253
3035499138,1cyclictest0-21swapper/300:34:193
3035499131,1cyclictest115650irq/25-eth022:45:313
30354991310,1cyclictest115650irq/25-eth023:38:333
3035499130,9cyclictest0-21swapper/321:27:373
3035499130,3cyclictest22723-21id21:24:443
3035499130,3cyclictest0-21swapper/323:26:433
3035499130,2cyclictest31616-21id22:40:593
3035499130,2cyclictest30696-21sshd00:07:103
3035499130,2cyclictest1511-21nfsd21:10:163
3035499130,2cyclictest0-21swapper/323:40:533
3035499130,1cyclictest0-21swapper/322:54:223
3035499130,1cyclictest0-21swapper/322:15:383
3035499130,1cyclictest0-21swapper/300:25:343
3035499130,12cyclictest17171-21sshd23:16:203
3035499130,12cyclictest0-21swapper/323:47:163
3035499130,12cyclictest0-21swapper/321:51:033
3035499130,12cyclictest0-21swapper/321:36:123
3035499130,12cyclictest0-21swapper/300:22:203
3035499130,10cyclictest5454-21sshd21:32:253
3035499130,10cyclictest32323-21sshd23:02:473
3035499130,10cyclictest22610-21sshd21:40:253
3035499130,10cyclictest19954-21sshd00:37:573
3034599139,2cyclictest0-21swapper/123:59:081
3034599139,1cyclictest0-21swapper/122:09:541
3034599139,1cyclictest0-21swapper/121:24:221
3034599139,0cyclictest0-21swapper/121:25:251
3034599138,4cyclictest0-21swapper/121:12:431
3034599137,3cyclictest21-21ksoftirqd/122:35:511
3034599133,9cyclictest21-21ksoftirqd/100:05:271
30345991312,1cyclictest21-21ksoftirqd/123:21:341
3034599131,1cyclictest115650irq/25-eth023:30:261
30345991311,1cyclictest21-21ksoftirqd/122:28:171
3034599131,11cyclictest0-21swapper/122:00:111
3034599130,2cyclictest5248-21sshd23:41:261
3034599130,1cyclictest30334-21cyclictest22:52:131
3034599130,12cyclictest32431-21bash00:23:481
3034599130,12cyclictest31729-21kworker/1:223:05:041
3034599130,12cyclictest28718-21fw_conntrack21:05:181
3034599130,12cyclictest19043-21sshd21:50:301
3034599130,12cyclictest12387-21id22:16:191
3034599130,12cyclictest0-21swapper/123:00:121
3034599130,12cyclictest0-21swapper/121:44:281
3034599130,12cyclictest0-21swapper/100:38:311
3034599130,10cyclictest8972-21sshd23:52:591
3034299138,4cyclictest0-21swapper/023:54:040
3034299136,3cyclictest0-21swapper/021:22:260
3034299133,9cyclictest3-21ksoftirqd/023:15:240
30342991312,1cyclictest3-21ksoftirqd/021:45:230
30342991312,1cyclictest3-21ksoftirqd/000:11:070
30342991312,1cyclictest3-21ksoftirqd/000:05:270
30342991312,1cyclictest24171-21kworker/0:020:31:250
3034299130,13cyclictest10-21rcuc/022:20:190
3034299130,12cyclictest3-21ksoftirqd/021:55:210
3035499129,2cyclictest0-21swapper/323:05:133
3035499120,9cyclictest0-21swapper/300:00:283
3035499120,1cyclictest27415-21sshd00:17:263
3035499120,1cyclictest1596-21sshd22:22:223
3035499120,1cyclictest0-21swapper/321:56:143
3035499120,12cyclictest0-21swapper/319:20:183
3035499120,11cyclictest0-21swapper/322:35:233
3035499120,11cyclictest0-21swapper/322:30:523
3035099127,4cyclictest20869-21perl19:50:172
3035099127,4cyclictest0-21swapper/219:55:222
3035099121,10cyclictest0-21swapper/220:10:152
3035099121,10cyclictest0-21swapper/219:25:122
3034599128,1cyclictest0-21swapper/121:30:181
3034599122,1cyclictest21-21ksoftirqd/122:20:181
3034599121,2cyclictest0-21swapper/123:25:121
3034599121,10cyclictest0-21swapper/120:30:161
3034599121,10cyclictest0-21swapper/119:30:151
30345991210,1cyclictest21-21ksoftirqd/119:40:131
3034599120,3cyclictest19026-21sshd00:15:521
3034599120,11cyclictest0-21swapper/120:10:151
3034299129,2cyclictest0-21swapper/019:30:150
140472120,0sleep11734-21runrttasks20:38:261
3035499119,2cyclictest0-21swapper/320:00:153
3035499119,2cyclictest0-21swapper/319:50:193
3035499118,2cyclictest0-21swapper/323:10:083
3035499110,2cyclictest0-21swapper/320:20:133
3035499110,10cyclictest0-21swapper/321:05:143
3035499110,10cyclictest0-21swapper/320:55:153
3035499110,10cyclictest0-21swapper/320:50:123
3035499110,10cyclictest0-21swapper/320:45:133
3035499110,10cyclictest0-21swapper/320:30:133
3035499110,10cyclictest0-21swapper/320:25:163
3035499110,10cyclictest0-21swapper/319:40:133
3035499110,10cyclictest0-21swapper/319:25:133
3035499110,10cyclictest0-21swapper/319:15:023
3035099119,1cyclictest0-21swapper/221:00:162
30350991110,1cyclictest0-21swapper/220:55:162
3035099110,7cyclictest4043-21munin-node19:20:262
3035099110,6cyclictest12150irq/23-ehci_hcd20:45:142
3035099110,10cyclictest0-21swapper/219:45:172
3035099110,10cyclictest0-21swapper/219:10:212
3034599119,2cyclictest0-21swapper/119:35:201
30345991110,1cyclictest0-21swapper/120:15:151
30345991110,1cyclictest0-21swapper/119:24:011
3034599110,2cyclictest0-21swapper/121:00:171
3034599110,2cyclictest0-21swapper/120:40:111
3034599110,2cyclictest0-21swapper/120:05:121
3034599110,10cyclictest913-21munin-node19:15:011
3034599110,10cyclictest20320-21sh20:50:151
3034599110,10cyclictest0-21swapper/120:25:151
3034599110,10cyclictest0-21swapper/120:20:131
3034599110,10cyclictest0-21swapper/119:45:181
3034299118,2cyclictest0-21swapper/019:45:170
3034299118,2cyclictest0-21swapper/019:15:000
3034299110,8cyclictest0-21swapper/019:55:150
3034299110,7cyclictest0-21swapper/019:20:180
3034299110,10cyclictest0-21swapper/021:05:180
3034299110,10cyclictest0-21swapper/021:00:170
3034299110,10cyclictest0-21swapper/020:40:110
3034299110,10cyclictest0-21swapper/020:15:160
3034299110,10cyclictest0-21swapper/020:00:160
3034299110,10cyclictest0-21swapper/019:50:160
3035499109,1cyclictest0-21swapper/319:45:163
3035499109,1cyclictest0-21swapper/319:30:133
3035499108,2cyclictest0-21swapper/320:05:133
3035499108,1cyclictest26038-21fw_forwarded_lo21:00:163
3035499100,1cyclictest14525-21apache_volume20:40:103
3035499100,1cyclictest0-21swapper/320:15:163
3035499100,10cyclictest0-21swapper/320:35:173
3035499100,10cyclictest0-21swapper/319:10:173
3035099100,9cyclictest9410-21apache_volume19:30:122
3035099100,9cyclictest7910-21munin-node20:25:232
3035099100,9cyclictest3854-21munin-node20:20:132
3035099100,9cyclictest0-21swapper/220:50:152
3034599100,9cyclictest31174-21conntrack19:10:161
3034599100,9cyclictest22984-21df_inode20:55:141
3034599100,9cyclictest22781-21apache_volume19:55:111
3034599100,9cyclictest20779-21tune2fs19:50:171
3034599100,1cyclictest8467-21users19:25:231
3034599100,1cyclictest17558-21cstates20:45:141
3034599100,10cyclictest0-21swapper/120:00:151
3034299109,1cyclictest3-21ksoftirqd/019:40:150
3034299108,1cyclictest25167-21latency_hist21:00:000
3034299108,1cyclictest0-21swapper/019:25:220
3034299100,9cyclictest8-21rcu_preempt20:20:240
3034299100,9cyclictest0-21swapper/020:05:120
3034299100,9cyclictest0-21swapper/019:35:180
3034299100,1cyclictest375-21httpd20:25:150
3034299100,1cyclictest0-21swapper/020:45:130
303549998,1cyclictest0-21swapper/319:55:043
303549990,9cyclictest0-21swapper/320:10:143
303429990,9cyclictest31681-21ntp_states19:10:210
303429990,1cyclictest0-21swapper/020:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional