You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 02:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Nov 27, 2025 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1351821450,3sleep0528199cyclictest23:30:270
2852721410,1sleep10-21swapper/100:09:031
742221310,1sleep00-21swapper/023:51:190
3200321240,3sleep10-21swapper/123:02:021
2227821170,2sleep122265-21sshd00:14:521
1876321130,1sleep218749-21sshd21:54:212
1667321060,1sleep016671-21bash00:23:570
47032990,0sleep00-21swapper/022:10:550
38152990,1sleep0528199cyclictest23:20:330
68752950,1sleep041ktimersoftd/000:33:230
39622930,2sleep23963-21bash00:19:262
269102930,1sleep041ktimersoftd/023:13:430
93202870,2sleep29317-21sshd23:48:282
215322870,0sleep00-21swapper/022:09:340
147252870,3sleep20-21swapper/222:48:082
233482860,2sleep223349-21bash23:25:242
106632850,2sleep31848-21nfsd21:23:453
228532840,1sleep20-21swapper/221:39:472
476728233,45sleep30-21swapper/319:06:513
123752820,2sleep10-21swapper/123:12:201
466628033,43sleep10-21swapper/119:05:491
223282800,1sleep10-21swapper/121:24:511
326652790,2sleep132646-21sshd21:58:371
64032770,1sleep30-21swapper/323:20:483
324072770,2sleep132405-21sshd22:16:291
184642750,2sleep218465-21sshd22:42:232
119542750,2sleep10-21swapper/121:35:411
142112740,1sleep31848-21nfsd23:15:273
56872730,2sleep15685-21sshd22:38:131
36602720,4sleep2528399cyclictest00:36:262
282112700,1sleep30-21swapper/323:01:403
20432690,3sleep30-21swapper/322:46:533
106172680,2sleep110616-21sshd00:33:481
3742670,1sleep20-21swapper/222:52:572
265172670,2sleep226513-21diskstats21:25:122
476426436,4sleep00-21swapper/019:06:480
502426132,16sleep20-21swapper/219:09:582
274652540,0sleep227466-21sshd00:21:442
140382530,2sleep214022-21sshd22:35:542
243692490,0sleep00-21swapper/022:45:540
204242440,2sleep20-21swapper/223:40:192
272382410,1sleep10-21swapper/123:56:171
239822400,3sleep30-21swapper/322:03:483
184412400,3sleep018269-21sshd22:36:200
267332380,2sleep126732-21bash23:44:021
225302320,1sleep022512-21sshd23:46:380
12232320,3sleep11216-21sshd22:28:431
87032300,2sleep10-21swapper/122:20:181
231952291,25sleep2135650irq/27-eth000:28:132
128412290,1sleep30-21swapper/323:58:033
113602280,3sleep30-21swapper/322:50:503
95942270,0sleep19590-21bash23:51:321
83042270,3sleep3528499cyclictest22:35:233
34292260,4sleep10-21swapper/123:35:371
76052250,3sleep20-21swapper/221:47:162
5283992510,6cyclictest10950irq/23-ehci_hcd23:51:092
48502250,2sleep30-21swapper/323:38:553
301522250,3sleep3528499cyclictest00:09:133
262712250,0sleep00-21swapper/021:45:580
248412250,1sleep30-21swapper/322:12:503
5282992418,3cyclictest2752-21sshd23:47:501
5281992414,5cyclictest3-21ksoftirqd/023:59:370
528199240,23cyclictest0-21swapper/023:01:230
230272240,2sleep30-21swapper/323:07:173
5283992310,4cyclictest0-21swapper/222:56:092
299172230,2sleep1528299cyclictest21:49:241
290572230,1sleep229054-21bash23:59:382
245552230,2sleep124550-21sshd22:52:081
24192230,1sleep02417-21sshd21:22:570
19472230,1sleep01945-21bash21:10:510
5284992218,2cyclictest20016-21sshd23:25:113
5284992215,5cyclictest15466-21sshd00:27:193
5283992214,6cyclictest11314-21bash23:24:232
5282992217,3cyclictest5515-21bash23:17:441
5282992215,4cyclictest30741-21sshd22:31:261
528199220,21cyclictest20394-21cp00:14:410
528199220,21cyclictest0-21swapper/000:00:510
528199220,16cyclictest0-21swapper/022:50:010
280962220,2sleep128098-21sshd23:22:541
528499212,14cyclictest44-21ksoftirqd/300:19:573
5284992117,2cyclictest8613-21sshd23:51:263
5284992117,2cyclictest26641-21bash23:31:433
5284992117,2cyclictest1902-21nscd23:47:513
5284992113,3cyclictest32097-21sshd22:25:263
528299217,1cyclictest32133-21sshd22:13:311
5281992113,4cyclictest3-21ksoftirqd/022:21:240
5281992113,2cyclictest3-21ksoftirqd/022:25:210
145142210,19sleep2135650irq/27-eth000:10:462
118292210,0sleep00-21swapper/023:27:220
5284992015,3cyclictest22971-21sshd23:40:313
5284992015,3cyclictest1959-21sshd22:20:563
5283992015,3cyclictest21719-21bash23:04:102
5283992014,4cyclictest5307-21sshd22:29:072
5282992015,4cyclictest10865-21sshd00:37:131
5282992014,4cyclictest1959-21sshd23:26:551
5282992014,3cyclictest31603-21sshd23:32:121
5282992012,4cyclictest4605-21sshd22:56:211
528199206,5cyclictest3-21ksoftirqd/022:58:060
528199201,10cyclictest2316-21id23:38:400
528199200,3cyclictest13358-21sshd22:32:520
195642200,2sleep119562-21bash21:51:201
5284991914,3cyclictest19126-21sshd00:01:413
528399191,13cyclictest32096-21sshd21:13:472
528399190,13cyclictest1846-21nfsd22:21:422
5282991915,2cyclictest1662-21sshd22:43:531
5282991914,3cyclictest1954-21id23:08:231
5282991913,5cyclictest5501-21sshd22:47:141
5282991913,4cyclictest12076-21sshd00:00:581
5282991912,5cyclictest3300-21sshd00:22:351
528199191,11cyclictest0-21swapper/022:19:300
207142190,4sleep3528499cyclictest21:36:313
528499189,8cyclictest0-21swapper/300:10:133
528499183,11cyclictest0-21swapper/300:23:003
5284991815,2cyclictest1848-21nfsd23:10:583
5284991814,2cyclictest30725-21sshd22:31:253
5284991813,3cyclictest5944-21sshd22:56:293
5284991812,4cyclictest0-21swapper/322:42:023
528399182,14cyclictest25753-21bash22:18:552
5283991812,4cyclictest32227-21sshd23:05:102
528399180,9cyclictest1846-21nfsd22:30:042
528299182,7cyclictest16545-21sshd00:17:251
528199187,7cyclictest5524-21hddtemp_smartct20:20:130
5281991814,1cyclictest0-21swapper/023:41:270
528199180,1cyclictest11738-21cp23:18:200
528199180,12cyclictest0-21swapper/000:39:310
528199180,10cyclictest0-21swapper/022:40:410
528499172,13cyclictest0-21swapper/321:27:153
5284991714,2cyclictest30625-21sshd00:35:493
5284991713,2cyclictest17105-21bash00:34:303
5284991711,5cyclictest21800-21sshd21:30:383
528499171,10cyclictest21194-21sshd21:42:333
528399174,2cyclictest0-21swapper/219:44:272
528399173,9cyclictest0-21swapper/219:28:032
528399173,5cyclictest24129-21sshd00:08:352
528399170,9cyclictest8846-21id00:00:402
528399170,3cyclictest13583-21tune2fs20:45:122
528399170,12cyclictest26040-21sshd00:31:572
5282991712,4cyclictest14213-21bash21:33:001
528199174,4cyclictest1959-21sshd00:07:470
528199170,16cyclictest135650irq/27-eth023:07:370
528199170,13cyclictest32061-21bash21:52:320
216312170,15sleep2135650irq/27-eth021:42:362
528499162,6cyclictest9272-21bash21:11:343
528499162,13cyclictest7552-21sshd22:05:153
5284991613,2cyclictest23880-21bash21:19:003
528499161,14cyclictest8442-21sshd21:47:213
528499160,15cyclictest17281-21sshd22:15:093
528399167,5cyclictest10950irq/23-ehci_hcd23:12:092
528399167,4cyclictest13565-21sshd21:20:562
528399163,3cyclictest1323-21sshd21:55:372
528399163,1cyclictest11253-21bash22:08:362
528399162,13cyclictest144550irq/28-eth1-rx-23:31:532
528399160,12cyclictest21796-21sshd22:12:332
528399160,11cyclictest3662-21bash21:32:002
5282991611,4cyclictest13917-21munin-node20:45:171
5282991611,3cyclictest1252-21sshd00:25:431
5282991611,3cyclictest0-21swapper/121:40:181
528199167,5cyclictest0-21swapper/021:15:210
528199167,4cyclictest25153-21sshd00:15:090
528199166,9cyclictest28964-21sshd22:01:110
528199160,1cyclictest12253-21sshd21:26:480
528199160,1cyclictest0-21swapper/019:10:140
528199160,11cyclictest27737-21sshd21:55:110
229122160,14sleep2135650irq/27-eth019:45:362
528499159,5cyclictest27415-21bash21:55:103
528399158,3cyclictest24944-21sshd21:16:022
528399158,3cyclictest10094-21sshd23:15:112
528399153,2cyclictest0-21swapper/220:50:312
528399152,2cyclictest0-21swapper/220:33:062
528399151,12cyclictest28350-21df20:00:132
528399150,3cyclictest4670-21sshd23:35:442
528399150,13cyclictest0-21swapper/222:00:222
528399150,11cyclictest9856-21munin-node19:20:242
528299152,4cyclictest24871-21sshd22:06:491
528299150,6cyclictest0-21swapper/121:10:241
528199158,3cyclictest0-21swapper/019:25:140
528199151,11cyclictest0-21swapper/021:42:140
528199150,5cyclictest0-21swapper/021:36:140
528199150,5cyclictest0-21swapper/019:39:060
528199150,12cyclictest4386-21bash00:26:030
528199150,12cyclictest0-21swapper/020:38:140
528199150,12cyclictest0-21swapper/020:05:230
528199150,11cyclictest0-21swapper/021:30:230
528499149,4cyclictest13873-21sshd19:26:193
528499149,4cyclictest0-21swapper/319:20:233
528499148,5cyclictest0-21swapper/320:25:363
528499148,5cyclictest0-21swapper/319:44:423
528499141,12cyclictest6750-21sshd21:50:123
5284991410,2cyclictest0-21swapper/320:45:173
528499140,13cyclictest0-21swapper/320:33:073
528399144,2cyclictest0-21swapper/221:04:062
528399144,2cyclictest0-21swapper/220:40:072
528399142,1cyclictest0-21swapper/220:15:422
528399142,11cyclictest144550irq/28-eth1-rx-19:52:512
528399142,11cyclictest135650irq/27-eth019:10:212
528399141,9cyclictest0-21swapper/220:59:462
528399141,12cyclictest144550irq/28-eth1-rx-20:05:552
528399141,12cyclictest144550irq/28-eth1-rx-19:32:502
5283991410,3cyclictest10950irq/23-ehci_hcd19:55:462
5283991410,3cyclictest10950irq/23-ehci_hcd19:55:462
528399140,3cyclictest135650irq/27-eth021:05:552
528299146,6cyclictest25126-21sshd21:25:051
528299141,12cyclictest19632-21sshd21:15:321
528299140,6cyclictest84442sleep120:30:111
528299140,13cyclictest0-21swapper/120:50:151
528299140,13cyclictest0-21swapper/120:26:161
528299140,13cyclictest0-21swapper/119:55:221
528299140,13cyclictest0-21swapper/119:55:221
528299140,13cyclictest0-21swapper/119:25:111
528299140,12cyclictest16620-21sshd22:00:091
528199147,5cyclictest0-21swapper/020:32:340
528199145,8cyclictest0-21swapper/020:29:070
528199140,9cyclictest0-21swapper/019:20:210
528199140,3cyclictest0-21swapper/019:45:210
528199140,12cyclictest0-21swapper/020:53:200
528199140,12cyclictest0-21swapper/019:33:570
528499139,3cyclictest6286-21netstat19:10:183
528499139,3cyclictest31324-21needreboot20:05:183
528499138,4cyclictest24344-21cat21:10:003
528499138,4cyclictest0-21swapper/320:38:553
528499138,4cyclictest0-21swapper/320:00:053
528499132,10cyclictest32653-21munin-node20:10:143
528499132,10cyclictest0-21swapper/320:40:103
528499131,11cyclictest21472-21nscd20:15:203
528499131,11cyclictest1848-21nfsd20:20:233
5284991311,1cyclictest0-21swapper/319:38:053
528499131,11cyclictest0-21swapper/319:30:153
528499130,5cyclictest1848-21nfsd21:02:223
528499130,12cyclictest0-21swapper/319:55:513
528499130,12cyclictest0-21swapper/319:55:503
528499130,12cyclictest0-21swapper/319:52:133
528499130,12cyclictest0-21swapper/319:48:183
528399137,4cyclictest5608-21iostat_ios20:20:142
528399134,8cyclictest144550irq/28-eth1-rx-20:35:272
528399133,2cyclictest0-21swapper/220:11:352
528399133,2cyclictest0-21swapper/219:35:072
528399131,9cyclictest135650irq/27-eth020:25:012
528399130,12cyclictest10950irq/23-ehci_hcd19:17:282
528299138,4cyclictest0-21swapper/120:21:491
528299137,5cyclictest0-21swapper/121:05:381
528299137,5cyclictest0-21swapper/120:16:081
528299130,12cyclictest1848-21nfsd19:22:291
528299130,12cyclictest0-21swapper/120:59:441
528299130,12cyclictest0-21swapper/120:43:261
528299130,12cyclictest0-21swapper/120:36:091
528299130,12cyclictest0-21swapper/120:10:321
528299130,12cyclictest0-21swapper/120:08:511
528299130,12cyclictest0-21swapper/120:02:401
528299130,12cyclictest0-21swapper/119:40:141
528299130,12cyclictest0-21swapper/119:38:071
528299130,12cyclictest0-21swapper/119:17:261
528299130,11cyclictest21565-21df_inode19:45:121
528299130,11cyclictest20759-21cut21:00:181
528199137,5cyclictest17797-21munin-node20:55:100
528199137,5cyclictest0-21swapper/021:07:110
528199137,5cyclictest0-21swapper/019:50:530
528199137,2cyclictest0-21swapper/019:15:510
5281991311,1cyclictest0-21swapper/021:00:520
528199130,12cyclictest19929-21strings19:40:160
528199130,12cyclictest0-21swapper/020:12:390
528199130,10cyclictest0-21swapper/020:45:210
528199130,10cyclictest0-21swapper/019:55:390
528199130,10cyclictest0-21swapper/019:55:380
528499128,3cyclictest7700-21cpu19:15:103
528499128,3cyclictest18741-21proc_pri20:55:173
528499128,3cyclictest1848-21nfsd20:50:193
528299120,11cyclictest24278-21iostat19:50:141
528299120,11cyclictest0-21swapper/119:30:061
528299120,11cyclictest0-21swapper/119:10:111
528199127,2cyclictest0-21swapper/020:15:490
528199120,1cyclictest0-21swapper/020:42:120
528199120,12cyclictest0-21swapper/020:04:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional