You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 12:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Nov 26, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3272421800,3sleep13031199cyclictest22:33:401
2190421620,0sleep03-21ksoftirqd/022:45:130
3071121480,5sleep13031199cyclictest22:04:451
1084521440,1sleep010839-21sshd22:40:560
1614121420,1sleep016134-21sshd23:48:380
2498621400,1sleep20-21swapper/221:51:242
3276421360,4sleep33031399cyclictest22:11:133
1808821340,0sleep00-21swapper/022:09:530
1819521300,1sleep20-21swapper/222:41:432
1839421270,1sleep318392-21bash22:44:563
2917721200,3sleep03031099cyclictest23:33:550
2534121190,1sleep10-21swapper/121:35:281
2538721030,3sleep03031099cyclictest00:39:040
182352990,1sleep30-21swapper/322:57:273
2800829533,49sleep30-21swapper/319:05:083
115812940,1sleep00-21swapper/022:12:230
87032930,2sleep20-21swapper/200:23:312
315402910,1sleep30-21swapper/323:34:103
289362910,3sleep228937-21sshd00:32:372
290342900,2sleep10-21swapper/123:27:271
289152900,3sleep03031099cyclictest22:55:190
184212900,1sleep10-21swapper/100:20:571
252482890,4sleep13031199cyclictest21:57:531
77212870,2sleep37710-21sshd21:11:503
70372870,0sleep07032-21sshd22:27:580
7872860,1sleep10-21swapper/100:39:571
290332860,2sleep00-21swapper/022:52:110
290332860,2sleep00-21swapper/022:52:110
68302850,2sleep26827-21sshd22:15:092
20002840,2sleep20-21swapper/223:21:352
217002830,2sleep321699-21sshd23:10:413
85662820,3sleep30-21swapper/323:50:573
50762820,2sleep25077-21id21:59:052
180292820,5sleep23031299cyclictest22:13:002
170772820,2sleep10-21swapper/122:47:551
163622820,1sleep20-21swapper/223:19:542
149252820,3sleep33031399cyclictest22:35:063
2999428134,43sleep10-21swapper/119:09:161
265292810,2sleep226510-21sshd22:26:402
159082790,0sleep00-21swapper/023:26:050
207692780,1sleep11847-21nfsd22:38:491
27512770,0sleep00-21swapper/023:44:050
192982760,1sleep11847-21nfsd21:28:391
236072750,1sleep30-21swapper/321:54:333
222502750,1sleep20-21swapper/223:36:212
128292750,2sleep03031099cyclictest21:15:230
217242740,1sleep221723-21bash22:32:332
142982740,2sleep20-21swapper/223:10:032
10372740,0sleep11023-21sshd00:29:391
310272730,1sleep20-21swapper/222:46:032
196142730,2sleep30-21swapper/321:31:453
105862730,4sleep33031399cyclictest23:03:123
2993626133,9sleep20-21swapper/219:08:322
2801025934,13sleep00-21swapper/019:05:090
203302590,1sleep10-21swapper/123:39:291
300372550,2sleep20-21swapper/221:45:272
47802530,1sleep04777-21sshd22:30:500
245622510,2sleep10-21swapper/122:13:401
14632490,2sleep21460-21sshd21:20:342
24272480,4sleep33031399cyclictest23:37:393
316872450,2sleep10-21swapper/100:12:281
293302440,4sleep20-21swapper/222:36:262
223632410,4sleep33031399cyclictest21:41:353
18872400,0sleep11884-21cp22:20:571
289182370,1sleep00-21swapper/000:15:230
86982320,0sleep38699-21bash00:16:383
14502320,5sleep13031199cyclictest23:34:241
91812310,2sleep19176-21bash21:24:341
319552300,0sleep00-21swapper/022:39:560
30311993018,8cyclictest0-21swapper/122:15:571
91492290,27sleep2135650irq/27-eth000:16:422
3031199290,18cyclictest22-21ksoftirqd/121:48:341
188192290,1sleep13031199cyclictest00:31:271
314602280,4sleep33031399cyclictest22:52:263
314602280,4sleep33031399cyclictest22:52:263
30311992812,11cyclictest22-21ksoftirqd/123:46:371
90822261,22sleep1135650irq/27-eth023:54:171
308272260,24sleep1135650irq/27-eth022:27:081
313502250,2sleep214486-21kworker/2:223:40:262
30313992512,4cyclictest23188-21rm21:57:393
3031199253,20cyclictest22-21ksoftirqd/122:43:511
30311992510,6cyclictest22-21ksoftirqd/121:51:081
30311992510,5cyclictest7289-21sshd23:57:131
3031099259,10cyclictest0-21swapper/021:48:310
242232250,3sleep20-21swapper/223:01:152
18202250,23sleep2135650irq/27-eth022:59:072
75442240,3sleep27538-21cp22:53:172
75442240,3sleep27538-21cp22:53:172
30322240,0sleep23028-21sshd23:47:162
3031199249,4cyclictest0-21swapper/100:03:421
30311992412,5cyclictest22-21ksoftirqd/123:40:151
3031199240,21cyclictest22-21ksoftirqd/100:17:141
30310992410,8cyclictest3-21ksoftirqd/021:50:590
179352241,20sleep3135650irq/27-eth023:45:293
30312992318,3cyclictest26315-21sshd00:35:382
30313992214,5cyclictest10024-21sshd21:21:253
3031299223,3cyclictest26950irq/26-ahci[00023:52:462
30312992216,3cyclictest30558-21sshd00:12:202
30312992212,3cyclictest0-21swapper/222:02:282
3031199227,4cyclictest22-21ksoftirqd/121:43:451
30311992217,3cyclictest5737-21ntp_states22:05:231
30311992213,6cyclictest9551-21sshd22:56:351
30310992210,3cyclictest0-21swapper/021:31:190
275492220,3sleep227548-21sshd21:29:272
203022224,16sleep110950irq/23-ehci_hcd23:00:501
3031299214,7cyclictest30480-21bash22:20:342
30312992116,3cyclictest30087-21bash23:34:002
30312992115,4cyclictest15253-21sshd22:06:192
30312992114,4cyclictest14860-21sshd00:04:212
3031199214,14cyclictest22-21ksoftirqd/121:30:321
30311992115,3cyclictest0-21swapper/121:12:011
30311992111,7cyclictest13084-21sshd23:09:581
3031199210,18cyclictest22-21ksoftirqd/123:22:571
3031099210,13cyclictest1847-21nfsd22:21:070
30312992015,3cyclictest1848-21nfsd21:10:252
30312992011,5cyclictest2314-21cp21:17:342
3031099200,2cyclictest0-21swapper/021:11:290
3031099200,18cyclictest10-21rcuc/022:01:430
3031099200,13cyclictest0-21swapper/023:39:130
173952200,3sleep317394-21sshd22:47:573
166102200,0sleep00-21swapper/000:34:430
109772200,18sleep3135650irq/27-eth022:05:523
3031399197,4cyclictest26416-21bash23:40:043
3031399191,8cyclictest3615-21sshd22:24:263
3031399190,8cyclictest10115-21sshd21:15:133
3031299197,3cyclictest0-21swapper/221:34:402
3031299195,3cyclictest8086-21missed_timers23:25:202
3031299192,15cyclictest33-21ksoftirqd/200:25:102
30312991915,3cyclictest11625-21sshd21:40:292
3031199196,5cyclictest28736-21bash23:11:251
30311991912,4cyclictest4541-21sshd21:17:471
3031199190,17cyclictest22-21ksoftirqd/123:15:011
3031099191,16cyclictest0-21swapper/021:21:260
3031099190,15cyclictest2880-21sshd23:21:390
186192190,17sleep3135650irq/27-eth000:24:373
67322180,16sleep2135650irq/27-eth023:57:112
3031399188,3cyclictest135650irq/27-eth022:17:503
3031399188,3cyclictest135650irq/27-eth000:37:273
3031399188,1cyclictest0-21swapper/323:16:403
30313991810,6cyclictest6291-21bash00:09:593
3031399180,8cyclictest0-21swapper/300:32:573
3031399180,16cyclictest25962-21sshd22:33:003
3031399180,12cyclictest16666-21sshd22:00:123
3031299181,10cyclictest13750-21sshd00:07:212
30310991813,4cyclictest3-21ksoftirqd/021:59:300
3031099180,15cyclictest23352-21bash21:25:490
273312180,16sleep3135650irq/27-eth021:45:173
3031399179,6cyclictest25429-21sshd23:07:543
30313991712,3cyclictest1317-21sshd23:27:563
30313991710,6cyclictest7607-21bash00:10:053
3031399170,13cyclictest4818-21sshd00:26:273
3031399170,13cyclictest28413-21cp22:26:513
3031399170,13cyclictest0-21swapper/321:28:373
3031299176,3cyclictest16339-21sshd21:37:522
30311991710,5cyclictest0-21swapper/122:52:001
30311991710,5cyclictest0-21swapper/122:52:001
3031099176,3cyclictest0-21swapper/021:42:350
30310991714,2cyclictest3-21ksoftirqd/022:15:410
30310991714,1cyclictest3-21ksoftirqd/000:01:030
30310991712,3cyclictest3-21ksoftirqd/023:18:570
3031099170,3cyclictest6121-21sshd23:50:420
3031399168,5cyclictest24264-21sshd21:38:383
3031399168,3cyclictest5915-21sshd23:57:053
3031399163,12cyclictest10950irq/23-ehci_hcd20:05:143
3031399161,11cyclictest0-21swapper/300:00:263
3031299164,11cyclictest10950irq/23-ehci_hcd20:41:462
3031299160,3cyclictest135650irq/27-eth019:22:482
3031199165,3cyclictest7143-21sshd00:06:391
3031099163,1cyclictest0-21swapper/020:39:540
3031099160,9cyclictest22702-21sshd00:08:180
3031099160,15cyclictest0-21swapper/021:39:060
3031099160,11cyclictest21913-21sshd23:10:430
3031399159,3cyclictest24446-21bash23:20:323
3031399153,11cyclictest10950irq/23-ehci_hcd20:56:423
3031399150,13cyclictest20475-21taskset19:59:363
3031399150,13cyclictest0-21swapper/320:25:133
3031399150,13cyclictest0-21swapper/319:24:423
3031299154,3cyclictest6078-21sshd23:09:142
3031299152,12cyclictest135650irq/27-eth019:28:322
3031299152,11cyclictest0-21swapper/219:37:192
3031199157,2cyclictest0-21swapper/120:07:231
3031199152,1cyclictest1915-21snmpd19:29:441
3031199150,13cyclictest0-21swapper/120:38:511
3031199150,13cyclictest0-21swapper/119:50:561
3031199150,13cyclictest0-21swapper/119:10:161
3031199150,12cyclictest22-21ksoftirqd/120:47:091
3031199150,11cyclictest29253-21taskset20:15:291
3031099159,2cyclictest16271-21sshd23:00:250
30310991513,1cyclictest0-21swapper/000:26:090
30310991511,3cyclictest0-21swapper/000:20:480
30310991510,1cyclictest0-21swapper/023:55:280
3031099150,4cyclictest0-21swapper/000:13:470
3031099150,11cyclictest31730-21sshd23:08:320
3031399142,11cyclictest10950irq/23-ehci_hcd20:36:473
30313991410,3cyclictest31691-21chrt20:22:043
3031399140,9cyclictest11413-21perf19:39:593
3031399140,12cyclictest8262-21pmu-power19:30:213
3031299148,5cyclictest0-21swapper/221:07:132
3031299143,1cyclictest135650irq/27-eth019:50:162
30312991410,3cyclictest10950irq/23-ehci_hcd20:09:552
3031299140,12cyclictest0-21swapper/220:27:222
3031299140,11cyclictest0-21swapper/219:46:012
3031199148,5cyclictest11627-21munin-node19:40:241
3031199144,1cyclictest0-21swapper/120:25:091
3031199140,5cyclictest0-21swapper/120:55:221
3031199140,13cyclictest135650irq/27-eth020:10:341
3031199140,13cyclictest0-21swapper/121:00:081
3031199140,13cyclictest0-21swapper/121:00:071
3031199140,13cyclictest0-21swapper/120:43:241
3031199140,13cyclictest0-21swapper/119:35:221
3031199140,12cyclictest21968-21proc_pri20:00:201
3031199140,12cyclictest1927-21snmpd19:22:121
3031099146,5cyclictest0-21swapper/020:50:220
3031099146,1cyclictest14174-21munin-node19:45:120
3031099140,12cyclictest0-21swapper/020:30:150
3031399138,4cyclictest17392-21munin-node21:00:253
3031399138,4cyclictest17392-21munin-node21:00:243
3031399132,10cyclictest10950irq/23-ehci_hcd21:05:243
3031399130,4cyclictest8044-21timerandwakeup20:40:213
3031399130,12cyclictest1848-21nfsd20:46:443
3031399130,12cyclictest1848-21nfsd20:15:153
3031399130,12cyclictest1848-21nfsd19:51:293
3031399130,12cyclictest0-21swapper/320:10:053
3031399130,12cyclictest0-21swapper/319:45:073
3031399130,12cyclictest0-21swapper/319:41:093
3031399130,12cyclictest0-21swapper/319:25:113
3031399130,12cyclictest0-21swapper/319:18:503
3031399130,12cyclictest0-21swapper/319:13:413
3031399130,11cyclictest2831-21iostat_ios20:30:173
3031399130,11cyclictest21068-21chrt20:00:143
3031299131,3cyclictest20102-21users19:55:222
3031299131,10cyclictest847-21munin-node19:15:132
3031299131,10cyclictest2827-21iostat20:30:162
3031299131,10cyclictest11867-21hwlatdetect20:50:152
3031299130,9cyclictest135650irq/27-eth020:20:212
3031299130,4cyclictest8901-21munin-node20:45:192
3031299130,4cyclictest29109-21munin-node20:15:232
3031299130,12cyclictest0-21swapper/219:41:122
3031299130,12cyclictest0-21swapper/219:11:402
3031199138,4cyclictest0-21swapper/120:30:131
3031199138,4cyclictest0-21swapper/119:55:561
3031199130,12cyclictest12179-21runrttasks20:50:191
3031199130,12cyclictest0-21swapper/119:46:371
3031199130,12cyclictest0-21swapper/119:15:151
3031199130,11cyclictest8357-21munin-node19:30:211
3031199130,11cyclictest30646-21iostat_ios20:20:161
3031199130,11cyclictest18351-21df_inode21:05:121
3031099139,1cyclictest135650irq/27-eth019:23:300
30310991312,1cyclictest0-21swapper/020:45:540
30310991311,1cyclictest0-21swapper/021:01:240
30310991311,1cyclictest0-21swapper/021:01:230
30310991311,1cyclictest0-21swapper/019:41:540
3031099130,8cyclictest0-21swapper/020:42:280
3031099130,1cyclictest0-21swapper/020:05:280
3031099130,1cyclictest0-21swapper/019:56:410
3031099130,1cyclictest0-21swapper/019:37:090
3031099130,12cyclictest5092-21sed19:25:150
3031099130,12cyclictest0-21swapper/020:17:200
225082130,1sleep00-21swapper/020:01:360
3031399120,11cyclictest0-21swapper/320:50:043
3031299128,3cyclictest1848-21nfsd20:00:042
3031299126,5cyclictest0-21swapper/220:55:432
3031299126,4cyclictest25515-21cpuspeed_turbos20:10:152
3031299120,11cyclictest1848-21nfsd20:35:132
3031299120,11cyclictest0-21swapper/221:00:092
3031299120,11cyclictest0-21swapper/221:00:092
3031299120,11cyclictest0-21swapper/219:30:072
3031099120,2cyclictest0-21swapper/021:05:460
3031099120,2cyclictest0-21swapper/019:18:330
3031099120,1cyclictest0-21swapper/020:55:140
3031099120,11cyclictest31766-21cat19:10:230
3031099120,11cyclictest0-21swapper/020:25:180
3031099120,11cyclictest0-21swapper/019:51:410
3031099120,11cyclictest0-21swapper/019:32:040
3031099116,4cyclictest0-21swapper/020:10:170
3031099110,10cyclictest0-21swapper/020:20:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional