You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 13:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Thu Nov 20, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83421280,2sleep30-21swapper/322:12:383
3068721250,2sleep20-21swapper/223:01:302
2047321230,2sleep120470-21bash22:17:361
869721210,2sleep11355699cyclictest22:53:241
869721210,2sleep11355699cyclictest22:53:241
500321210,0sleep05004-21sshd21:39:000
2464921040,2sleep224637-21sshd23:34:572
150982970,1sleep10-21swapper/121:36:491
47352960,2sleep1211ktimersoftd/123:26:511
94232930,3sleep01355199cyclictest00:16:190
57502930,2sleep35747-21bash21:57:353
316562930,4sleep21356099cyclictest00:05:552
240162920,3sleep1211ktimersoftd/121:25:181
228012910,2sleep30-21swapper/322:39:313
144202910,4sleep31356199cyclictest22:56:553
215262900,1sleep01355199cyclictest22:48:340
134042900,2sleep1211ktimersoftd/122:04:341
297552890,1sleep30-21swapper/323:44:323
225162890,3sleep01355199cyclictest21:40:320
207282860,1sleep20-21swapper/200:37:262
1310228634,48sleep10-21swapper/119:07:391
36562850,2sleep33657-21bash23:51:063
204012850,2sleep120399-21sshd23:52:431
85552840,2sleep18549-21bash00:26:181
56182840,6sleep30-21swapper/323:30:053
1326428432,48sleep30-21swapper/319:09:513
33542830,2sleep30-21swapper/323:08:083
267992830,3sleep21356099cyclictest21:31:452
17952830,1sleep01792-21sshd21:11:030
167822820,1sleep016776-21sshd21:21:280
102162820,1sleep30-21swapper/300:04:003
247842810,4sleep31356199cyclictest23:00:553
148262810,2sleep20-21swapper/222:26:192
302742790,2sleep330275-21bash21:53:463
289972790,1sleep10-21swapper/123:10:311
142552790,1sleep10-21swapper/122:38:411
46582770,4sleep31356199cyclictest00:35:423
261802770,4sleep11355699cyclictest21:10:191
33322750,1sleep20-21swapper/223:17:252
201432740,2sleep20-21swapper/200:17:292
285602730,1sleep10-21swapper/123:59:411
237022730,2sleep20-21swapper/222:11:402
288762720,2sleep10-21swapper/123:19:571
23922720,4sleep01355199cyclictest22:40:320
136082710,0sleep313609-21sshd21:27:253
197672650,4sleep21356099cyclictest21:05:122
197672650,4sleep21356099cyclictest21:05:112
202022630,0sleep00-21swapper/023:52:430
31822610,0sleep13181-21bash21:32:361
1328726133,9sleep20-21swapper/219:09:582
71442590,2sleep10-21swapper/123:42:211
139352520,1sleep10-21swapper/123:00:011
1313624134,4sleep00-21swapper/019:08:070
201692370,2sleep20-21swapper/223:06:352
1356099369,7cyclictest16348-21sshd23:27:582
13560993631,3cyclictest12319-21sshd00:30:042
13560993628,6cyclictest2405-21runrttasks23:44:392
89572350,0sleep38952-21cp22:44:243
318312350,32sleep3135650irq/27-eth022:49:343
13560993525,6cyclictest1959-21sshd23:37:512
305272340,4sleep11355699cyclictest21:50:351
13560993426,5cyclictest26529-21bash23:59:292
176892330,3sleep317686-21df_inode21:40:113
83592320,2sleep30-21swapper/300:19:433
61832320,2sleep21848-21nfsd22:56:052
13560993227,3cyclictest8333-21sshd00:26:172
49132310,2sleep00-21swapper/023:57:230
38852310,25sleep1135650irq/27-eth000:22:341
212982310,29sleep1135650irq/27-eth023:09:561
13560993127,3cyclictest23013-21id23:22:242
13560993127,3cyclictest1848-21nfsd00:11:052
91582300,2sleep10-21swapper/121:45:261
268852300,1sleep041ktimersoftd/021:50:180
13560993026,2cyclictest1848-21nfsd23:51:292
13560993023,5cyclictest15541-21sshd00:23:482
13556993015,6cyclictest5966-21sshd00:09:441
13560992923,4cyclictest7516-21sshd23:45:242
13560992823,4cyclictest17626-21sshd00:01:372
289672270,2sleep228962-21sshd22:30:402
263472270,1sleep026349-21sshd22:08:540
160342270,2sleep30-21swapper/319:30:013
13560992721,4cyclictest18254-21sshd23:12:402
13560992713,4cyclictest0-21swapper/221:59:302
1355699279,16cyclictest22-21ksoftirqd/100:02:221
106412272,23sleep3135650irq/27-eth021:30:143
55862263,21sleep1135650irq/27-eth000:32:361
322042260,23sleep1135650irq/27-eth022:43:311
179632260,3sleep31356199cyclictest22:23:363
17312260,1sleep01724-21sshd21:57:120
53172250,2sleep30-21swapper/322:06:483
4062250,3sleep20-21swapper/222:52:362
4062250,3sleep20-21swapper/222:52:362
1356099254,7cyclictest135650irq/27-eth021:19:162
1355699259,14cyclictest22-21ksoftirqd/123:33:351
13556992514,8cyclictest22-21ksoftirqd/100:10:141
13556992512,5cyclictest22-21ksoftirqd/123:25:001
288672240,2sleep21847-21nfsd22:40:062
253642240,2sleep325352-21sshd21:22:203
13561992420,2cyclictest0-21swapper/300:13:583
1355699241,18cyclictest22-21ksoftirqd/123:36:081
13551992418,4cyclictest1959-21sshd21:34:400
90572230,2sleep20-21swapper/221:20:422
277322230,21sleep1135650irq/27-eth021:22:351
22562230,0sleep00-21swapper/000:12:230
13561992314,3cyclictest135650irq/27-eth023:55:233
1355699234,1cyclictest1847-21nfsd00:15:181
1355699230,3cyclictest14123-21sshd21:42:551
1355199231,20cyclictest12075-21bash23:45:470
1355199230,14cyclictest0-21swapper/023:20:160
202482220,1sleep020234-21sshd22:39:160
13561992214,4cyclictest27241-21bash23:35:103
1356099226,5cyclictest10950irq/23-ehci_hcd21:25:532
1356099224,6cyclictest144550irq/28-eth1-rx-22:21:202
1356099224,12cyclictest135650irq/27-eth022:37:442
1356099223,7cyclictest10892-21sshd21:36:232
1355699224,13cyclictest11093-21sshd22:07:221
1355699220,19cyclictest22-21ksoftirqd/123:46:591
1355199220,21cyclictest1848-21nfsd23:01:350
1356099217,13cyclictest0-21swapper/221:10:422
1356099216,5cyclictest26950irq/26-ahci[00021:45:242
1356099215,6cyclictest21384-21sshd22:17:422
1356099215,6cyclictest20729-21sshd22:05:132
1356099215,3cyclictest135650irq/27-eth022:46:572
1356099214,5cyclictest144550irq/28-eth1-rx-20:05:222
1356099214,5cyclictest135650irq/27-eth021:52:162
1356099212,17cyclictest7390-21sshd22:03:592
13556992113,3cyclictest1848-21nfsd00:38:191
1355199211,17cyclictest0-21swapper/023:41:380
1355199210,2cyclictest0-21swapper/000:05:560
1355199210,15cyclictest9642-21bash23:15:000
13561992013,5cyclictest3795-21sshd00:25:483
13561992012,1cyclictest1847-21nfsd00:09:093
1356099203,5cyclictest1847-21nfsd21:40:392
13560992013,5cyclictest15830-21sadc19:30:012
44052190,1sleep04403-21sshd23:17:310
13561991917,1cyclictest0-21swapper/319:17:553
13560991912,5cyclictest1915-21snmpd20:10:252
13560991910,7cyclictest22485-21munin-node20:00:252
1355699190,15cyclictest0-21swapper/122:22:441
13551991915,3cyclictest22242-21perf20:00:000
1355199191,16cyclictest0-21swapper/023:37:560
1355199191,14cyclictest18679-21sshd23:25:090
13551991910,2cyclictest0-21swapper/023:09:400
1355199190,16cyclictest0-21swapper/000:32:450
32762180,16sleep3135650irq/27-eth023:48:053
13561991815,2cyclictest27380-21sshd23:16:363
13561991812,1cyclictest22498-21sshd21:46:463
1356199180,13cyclictest1902-21nscd22:30:453
1356099183,6cyclictest15174-21munin-node20:55:192
1356099183,13cyclictest1848-21nfsd20:30:152
1356099183,13cyclictest15194-21sshd19:24:592
1356099182,14cyclictest2405-21runrttasks19:40:142
1355699187,6cyclictest0-21swapper/122:29:341
13551991813,3cyclictest30761-21sshd00:21:580
1355199181,14cyclictest5505-21sshd00:25:590
1356199178,1cyclictest23004-21id00:31:013
1356199177,7cyclictest1846-21nfsd23:20:063
1356199172,1cyclictest14124-21sshd22:01:263
1356099175,3cyclictest30590-21munin-node20:15:212
1356099173,6cyclictest10382-21latency_hist20:45:002
1356099173,12cyclictest2405-21runrttasks20:49:572
1356099173,12cyclictest2405-21runrttasks19:35:522
1356099172,14cyclictest7717-21munin-node20:35:232
1356099172,14cyclictest1848-21nfsd20:27:302
1355699174,11cyclictest13793-21sshd22:10:411
1355699170,4cyclictest4064-21sshd21:17:171
1355199170,16cyclictest0-21swapper/021:28:110
1355199170,14cyclictest18690-21sshd00:37:120
49842160,1sleep041ktimersoftd/022:03:450
1356199168,3cyclictest0-21swapper/322:29:443
1356199168,1cyclictest15905-21sshd21:12:243
13561991612,3cyclictest2236-21sshd22:19:003
13561991612,2cyclictest10950irq/23-ehci_hcd00:21:413
13561991611,3cyclictest9690-21crond23:15:003
1356199160,7cyclictest29611-21sshd23:26:053
1356099164,10cyclictest0-21swapper/221:00:132
1356099162,13cyclictest1848-21nfsd20:21:282
1356099161,6cyclictest147922sleep220:53:102
13560991613,2cyclictest0-21swapper/219:55:112
13560991612,3cyclictest19679-21memory19:53:122
13556991613,2cyclictest0-21swapper/122:45:061
13556991612,2cyclictest2050-21sshd22:31:121
13556991611,4cyclictest30831-21sshd22:55:231
1355199162,8cyclictest5315-21sshd23:33:050
1355199160,2cyclictest0-21swapper/000:04:570
1355199160,1cyclictest0-21swapper/022:33:090
1356199157,2cyclictest0-21swapper/319:49:183
1356199153,10cyclictest44-21ksoftirqd/322:51:013
1356199153,10cyclictest44-21ksoftirqd/322:51:013
1356199150,3cyclictest0-21swapper/321:18:513
1356199150,13cyclictest0-21swapper/321:05:173
1356199150,13cyclictest0-21swapper/321:05:163
1356099159,4cyclictest16455-21munin-run19:35:012
1356099155,9cyclictest0-21swapper/219:11:332
1356099151,6cyclictest1848-21nfsd19:46:182
1355699150,14cyclictest0-21swapper/119:34:541
1355699150,13cyclictest0-21swapper/121:56:061
1355699150,13cyclictest0-21swapper/119:22:161
1355199158,3cyclictest0-21swapper/022:25:510
1355199156,8cyclictest0-21swapper/022:12:470
1355199151,9cyclictest0-21swapper/022:20:280
1355199151,9cyclictest0-21swapper/021:45:140
13551991513,1cyclictest28267-21cpuspeed_turbos22:55:140
13551991513,1cyclictest0-21swapper/022:15:120
1355199150,8cyclictest11635-21sshd21:17:590
1355199150,14cyclictest0-21swapper/022:51:350
1355199150,14cyclictest0-21swapper/022:51:350
13561991411,2cyclictest0-21swapper/320:20:153
1356199140,3cyclictest135650irq/27-eth020:05:223
1356199140,13cyclictest0-21swapper/321:35:383
1355699143,6cyclictest0-21swapper/120:50:141
1355699141,10cyclictest135650irq/27-eth021:06:001
1355699141,10cyclictest135650irq/27-eth021:06:001
13556991410,3cyclictest10950irq/23-ehci_hcd21:03:201
1355699140,5cyclictest32562-21needreboot20:20:191
1355699140,3cyclictest135650irq/27-eth020:55:161
1355699140,12cyclictest24187-21awk20:01:001
1355199147,2cyclictest13979-21munin-run19:15:000
1355199143,1cyclictest0-21swapper/019:52:570
1355199140,13cyclictest0-21swapper/020:30:190
1356199139,3cyclictest10950irq/23-ehci_hcd19:35:073
1356199138,1cyclictest135650irq/27-eth019:58:033
1356199137,5cyclictest14892-21taskset19:21:083
1356199130,5cyclictest135650irq/27-eth020:35:123
1356199130,12cyclictest0-21swapper/320:55:013
1356199130,12cyclictest0-21swapper/320:47:213
1356199130,12cyclictest0-21swapper/320:40:433
1356199130,12cyclictest0-21swapper/320:32:053
1356199130,12cyclictest0-21swapper/320:25:033
1356199130,12cyclictest0-21swapper/320:10:033
1356199130,12cyclictest0-21swapper/319:44:593
1356099130,12cyclictest0-21swapper/219:16:592
1355699137,5cyclictest0-21swapper/119:55:221
1355699130,4cyclictest5258-21cat20:30:251
1355699130,12cyclictest0-21swapper/120:42:221
1355699130,12cyclictest0-21swapper/120:05:361
1355699130,12cyclictest0-21swapper/119:51:081
1355699130,12cyclictest0-21swapper/119:49:101
1355699130,12cyclictest0-21swapper/119:36:221
1355699130,12cyclictest0-21swapper/119:25:511
1355199138,2cyclictest0-21swapper/020:35:120
13551991311,1cyclictest0-21swapper/020:12:210
1355199130,1cyclictest0-21swapper/020:16:110
1355199130,1cyclictest0-21swapper/019:26:220
1355199130,12cyclictest0-21swapper/021:00:590
1355199130,12cyclictest0-21swapper/020:47:210
1355199130,12cyclictest0-21swapper/020:00:590
1355199130,12cyclictest0-21swapper/019:46:150
1355199130,12cyclictest0-21swapper/019:41:240
13561991210,1cyclictest0-21swapper/319:13:483
1356199120,4cyclictest0-21swapper/321:00:173
1356199120,11cyclictest26950irq/26-ahci[00020:15:453
1356199120,11cyclictest0-21swapper/320:50:073
1356199120,11cyclictest0-21swapper/320:00:013
1355699120,3cyclictest29816-21munin-node20:15:151
1355699120,3cyclictest0-21swapper/120:45:121
1355699120,11cyclictest28649-21unixbench_singl20:10:251
1355699120,11cyclictest0-21swapper/120:25:081
1355699120,11cyclictest0-21swapper/119:40:101
1355699120,11cyclictest0-21swapper/119:16:401
1355699120,11cyclictest0-21swapper/119:11:541
1355699120,10cyclictest0-21swapper/120:35:121
1355199128,3cyclictest0-21swapper/019:17:020
1355199127,4cyclictest0-21swapper/019:32:010
1355199125,6cyclictest0-21swapper/021:05:140
1355199125,6cyclictest0-21swapper/021:05:140
1355199120,1cyclictest0-21swapper/020:55:170
1355199120,12cyclictest0-21swapper/020:09:180
1355199120,11cyclictest0-21swapper/020:50:050
1355199120,11cyclictest0-21swapper/020:40:420
1355199120,11cyclictest0-21swapper/020:29:150
1355199120,11cyclictest0-21swapper/019:35:220
1355199120,11cyclictest0-21swapper/019:20:250
1356199110,2cyclictest0-21swapper/319:30:023
1356199110,10cyclictest135650irq/27-eth019:50:013
1355199119,1cyclictest0-21swapper/020:20:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional