You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 04:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Oct 20, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1434221380,0sleep114343-21sshd21:40:331
1808721360,2sleep20-21swapper/222:27:032
3091921310,1sleep00-21swapper/023:30:300
970021230,3sleep12491299cyclictest23:28:341
970021230,3sleep12491299cyclictest23:28:341
3257221180,2sleep232566-21sshd21:48:312
2462421180,2sleep12491299cyclictest00:20:261
1295221170,2sleep10-21swapper/100:25:501
1718721110,1sleep20-21swapper/200:13:052
1382121110,5sleep013817-21bash00:06:300
1058921090,2sleep30-21swapper/323:16:183
24462210733,61sleep30-21swapper/319:07:333
2073421070,2sleep30-21swapper/321:29:003
1173021040,1sleep08-21rcu_preempt21:46:290
100682970,3sleep32491499cyclictest21:40:143
95222960,2sleep20-21swapper/221:34:042
52952960,2sleep10-21swapper/122:22:461
14582940,2sleep30-21swapper/323:00:033
250672930,2sleep10-21swapper/122:52:551
290822920,1sleep00-21swapper/022:40:360
17932920,2sleep30-21swapper/321:11:453
52892910,2sleep15283-21sshd23:59:331
258262900,2sleep11847-21nfsd22:06:141
109062900,1sleep014734-21kworker/0:021:12:380
10172900,1sleep01019-21bash21:51:380
251572890,3sleep30-21swapper/322:46:363
216452890,1sleep10-21swapper/100:16:441
17572870,0sleep00-21swapper/023:21:400
166282870,2sleep216544-21sshd22:48:592
89732850,4sleep1135650irq/27-eth021:18:401
2460828526,47sleep10-21swapper/119:09:231
183972830,1sleep20-21swapper/223:48:112
15582830,1sleep10-21swapper/121:30:141
34762810,4sleep22491399cyclictest22:44:342
107812810,2sleep310780-21bash23:41:073
267792800,2sleep21959-21sshd23:24:062
98562790,2sleep29841-21sshd23:13:122
241892780,2sleep10-21swapper/123:20:421
169202780,1sleep010-21rcuc/022:45:450
162812780,2sleep30-21swapper/322:58:183
23532770,2sleep30-21swapper/322:19:263
177862770,3sleep32491499cyclictest23:57:343
111672770,3sleep10-21swapper/123:13:191
76822750,3sleep32491499cyclictest22:41:433
13202740,1sleep01311-21df21:30:130
142612730,0sleep00-21swapper/022:26:410
72402720,0sleep00-21swapper/023:56:310
320872720,1sleep20-21swapper/222:31:282
176762720,4sleep12491299cyclictest21:53:151
157922720,4sleep32491499cyclictest00:26:093
290722680,1sleep029070-21sshd00:20:520
81742660,3sleep22491399cyclictest23:00:342
78492660,2sleep10-21swapper/122:29:141
12802640,2sleep20-21swapper/221:27:072
66962630,61sleep226950irq/26-ahci[00023:09:532
53792620,1sleep025450-21kworker/0:223:46:540
2436226131,12sleep20-21swapper/219:06:302
144012610,2sleep10-21swapper/121:22:131
2460726032,4sleep00-21swapper/019:09:220
206302540,1sleep21847-21nfsd22:05:432
86512510,0sleep01848-21nfsd23:53:340
45782410,37sleep1135650irq/27-eth022:01:111
290092350,2sleep30-21swapper/321:45:073
24913993410,19cyclictest33-21ksoftirqd/222:18:512
120332331,27sleep3135650irq/27-eth022:32:423
24911993210,20cyclictest3-21ksoftirqd/023:19:300
24911993112,2cyclictest3-21ksoftirqd/023:10:470
2491199304,20cyclictest3773-21sshd23:06:230
24911993024,5cyclictest41ktimersoftd/022:58:190
24911993012,8cyclictest3-21ksoftirqd/021:25:060
24911993010,18cyclictest3-21ksoftirqd/023:40:270
307232290,2sleep10-21swapper/122:56:321
24914992915,6cyclictest7469-21cp23:28:223
24914992915,6cyclictest7469-21cp23:28:213
24911992914,2cyclictest3-21ksoftirqd/022:34:040
158632290,1sleep215861-21sshd23:16:502
284242280,1sleep228422-21sshd23:55:262
2491199288,5cyclictest3-21ksoftirqd/000:31:440
24911992812,11cyclictest3-21ksoftirqd/022:21:470
123862280,2sleep31847-21nfsd22:01:553
24913992716,9cyclictest135650irq/27-eth000:25:272
2491199273,3cyclictest3-21ksoftirqd/023:25:060
2491199273,3cyclictest3-21ksoftirqd/023:25:060
24911992716,7cyclictest3-21ksoftirqd/000:13:520
238452270,3sleep223846-21sshd21:38:292
238452270,3sleep223846-21sshd21:38:292
172182270,2sleep20-21swapper/223:38:412
24914992615,4cyclictest10950irq/23-ehci_hcd00:17:373
24911992622,3cyclictest21980-21sshd22:09:030
24911992613,12cyclictest3-21ksoftirqd/000:26:370
24911992611,13cyclictest3-21ksoftirqd/021:44:440
184152260,0sleep01848-21nfsd21:19:350
164372260,2sleep30-21swapper/321:16:093
45822250,2sleep31848-21nfsd23:12:423
24913992517,6cyclictest25-21rcuop/121:24:422
24913992515,3cyclictest36-21rcuop/221:56:362
24913992513,4cyclictest33-21ksoftirqd/221:52:492
24913992512,4cyclictest10341-21sshd00:06:082
2491199255,10cyclictest13811-21sshd23:35:130
2491199251,22cyclictest4577-21sshd22:16:290
24911992512,2cyclictest3-21ksoftirqd/021:22:510
139492250,1sleep30-21swapper/300:39:553
2491499240,22cyclictest6845-21sshd23:37:393
2491399248,4cyclictest26559-21sshd21:10:592
24912992415,1cyclictest10950irq/23-ehci_hcd22:49:421
24911992413,4cyclictest3-21ksoftirqd/022:13:470
24911992411,6cyclictest3-21ksoftirqd/000:16:190
24911992411,12cyclictest3-21ksoftirqd/000:04:510
2491199240,1cyclictest12731-21sshd22:01:570
2491199240,14cyclictest21247-21sshd21:56:360
36102230,0sleep33605-21sshd23:21:513
301552230,3sleep22491399cyclictest21:42:062
299562230,1sleep029950-21sshd22:50:140
24914992318,3cyclictest21196-21sshd00:10:203
24913992317,3cyclictest0-21swapper/223:27:112
24913992317,3cyclictest0-21swapper/223:27:112
24913992316,5cyclictest1128-21sshd22:13:102
24913992315,4cyclictest31989-21sshd00:34:462
24913992314,6cyclictest17997-21sshd23:54:322
24913992312,6cyclictest23812-21sshd22:52:482
24912992311,7cyclictest135650irq/27-eth021:11:591
24912992310,5cyclictest10950irq/23-ehci_hcd23:35:031
24911992316,4cyclictest41ktimersoftd/021:40:000
24911992316,4cyclictest41ktimersoftd/021:40:000
2491199230,22cyclictest10-21rcuc/022:39:050
186962230,14sleep1135650irq/27-eth021:25:381
317162220,20sleep1135650irq/27-eth023:30:361
24914992212,0cyclictest0-21swapper/323:53:323
24913992217,3cyclictest10946-21sshd00:35:562
24913992213,4cyclictest1847-21nfsd23:31:142
24913992212,7cyclictest0-21swapper/200:19:352
2491299227,7cyclictest135650irq/27-eth021:35:481
2491299227,7cyclictest135650irq/27-eth021:35:481
2491199220,9cyclictest11854-21sshd23:00:560
24914992110,5cyclictest10950irq/23-ehci_hcd00:03:393
2491499210,18cyclictest44-21ksoftirqd/321:32:063
24913992114,3cyclictest1076-21sshd21:17:542
24913992113,5cyclictest18509-21sshd00:23:112
24913992113,3cyclictest31390-21sshd23:40:052
24911992116,4cyclictest0-21swapper/000:36:390
180722210,2sleep20-21swapper/222:58:302
2491499209,3cyclictest1845-21nfsd23:31:403
2491499207,6cyclictest1848-21nfsd22:23:483
2491499207,6cyclictest135650irq/27-eth021:35:163
2491499207,6cyclictest135650irq/27-eth021:35:163
2491499207,5cyclictest135650irq/27-eth023:46:313
24914992015,4cyclictest6508-21sshd00:21:553
24914992013,1cyclictest135650irq/27-eth000:05:583
24914992010,3cyclictest10950irq/23-ehci_hcd22:54:103
24913992015,4cyclictest1847-21nfsd22:01:062
24913992014,5cyclictest0-21swapper/222:37:332
24913992012,4cyclictest1848-21nfsd22:21:352
24912992013,5cyclictest10950irq/23-ehci_hcd23:45:591
2491299200,16cyclictest135650irq/27-eth022:13:391
24914991914,3cyclictest0-21swapper/322:26:023
24914991911,6cyclictest1903-21nscd21:59:273
24913991914,3cyclictest0-21swapper/200:00:092
2491299198,2cyclictest9677-21bash22:41:551
2491299194,12cyclictest1959-21sshd21:57:521
2491299191,8cyclictest11264-21rm23:07:091
24912991914,4cyclictest1846-21nfsd22:19:251
24912991910,4cyclictest8012-21sshd23:50:201
233952190,17sleep1135650irq/27-eth000:13:451
14992190,17sleep110950irq/23-ehci_hcd00:38:341
119212190,17sleep3135650irq/27-eth000:32:273
2491499189,6cyclictest7214-21sshd22:13:453
24914991811,6cyclictest22606-21sshd22:09:063
2491499180,15cyclictest0-21swapper/321:20:173
2491299188,2cyclictest10950irq/23-ehci_hcd23:16:541
24912991816,1cyclictest10942-21sshd22:35:391
24912991813,3cyclictest0-21swapper/100:33:481
2491299180,5cyclictest23417-21sshd00:01:121
15562180,1sleep01377-21latency_hist19:30:010
2491499175,8cyclictest14150-21sshd23:07:263
2491499174,4cyclictest13321-21id21:52:493
24914991710,4cyclictest14661-21bash22:36:023
2491299177,3cyclictest0-21swapper/121:47:131
2491299170,9cyclictest16355-21sshd00:06:441
2491299170,3cyclictest144550irq/28-eth1-rx-23:02:381
2491499166,5cyclictest26546-21perf20:25:003
2491499160,14cyclictest0-21swapper/320:40:143
2491299164,2cyclictest11284-21sshd23:41:111
2491299161,4cyclictest20618-21sshd22:30:221
2491499156,4cyclictest10950irq/23-ehci_hcd19:10:243
2491499150,13cyclictest0-21swapper/320:35:153
24912991511,3cyclictest10950irq/23-ehci_hcd20:13:091
24912991511,3cyclictest10950irq/23-ehci_hcd19:35:021
2491399146,4cyclictest10950irq/23-ehci_hcd20:15:172
2491399142,1cyclictest135650irq/27-eth020:00:362
2491399140,3cyclictest135650irq/27-eth020:27:412
2491399140,13cyclictest0-21swapper/220:05:512
2491399140,12cyclictest0-21swapper/219:30:142
2491399140,12cyclictest0-21swapper/219:30:142
2491299147,6cyclictest4893-21threads20:45:211
2491299146,5cyclictest10950irq/23-ehci_hcd20:55:191
24912991412,1cyclictest0-21swapper/119:18:191
2491299140,9cyclictest0-21swapper/120:20:001
2491299140,3cyclictest26244-21runrttasks20:21:411
2491299140,13cyclictest2405-21runrttasks19:43:271
2491199147,6cyclictest0-21swapper/020:06:170
2491199146,5cyclictest0-21swapper/020:25:130
2491199140,13cyclictest0-21swapper/019:45:140
2491199140,13cyclictest0-21swapper/019:37:450
2491499132,10cyclictest0-21swapper/319:54:133
2491499130,4cyclictest0-21swapper/320:53:513
2491499130,12cyclictest23081-21munin-node20:15:203
2491499130,12cyclictest17302-21runrttasks20:03:383
2491499130,12cyclictest0-21swapper/320:26:273
2491499130,12cyclictest0-21swapper/320:10:353
2491499130,12cyclictest0-21swapper/320:05:353
2491499130,12cyclictest0-21swapper/319:35:223
2491499130,12cyclictest0-21swapper/319:21:423
2491499130,11cyclictest9189-21munin-node20:55:213
2491499130,11cyclictest85042sleep319:45:033
2491499130,11cyclictest6246-21munin-node19:40:183
2491499130,11cyclictest32437-21munin-node19:25:153
2491499130,11cyclictest13837-21iostat19:55:153
2491399139,3cyclictest135650irq/27-eth021:05:552
2491399138,4cyclictest3842-21diskstats20:45:132
2491399137,3cyclictest26950irq/26-ahci[00019:50:102
2491399136,4cyclictest10950irq/23-ehci_hcd21:00:202
24913991311,1cyclictest0-21swapper/219:22:582
24913991311,1cyclictest0-21swapper/219:15:102
2491399130,5cyclictest0-21swapper/219:35:182
2491399130,4cyclictest1848-21nfsd20:40:242
2491399130,12cyclictest0-21swapper/220:51:382
2491399130,12cyclictest0-21swapper/219:47:462
2491399130,12cyclictest0-21swapper/219:26:022
2491399130,12cyclictest0-21swapper/219:12:162
2491299139,3cyclictest135650irq/27-eth020:30:331
2491299138,4cyclictest11581-21processes21:00:211
2491299130,12cyclictest0-21swapper/120:53:481
2491299130,12cyclictest0-21swapper/120:40:481
2491299130,12cyclictest0-21swapper/120:37:321
2491299130,12cyclictest0-21swapper/120:25:061
2491299130,12cyclictest0-21swapper/119:58:081
2491299130,12cyclictest0-21swapper/119:53:261
2491299130,12cyclictest0-21swapper/119:45:201
2491299130,12cyclictest0-21swapper/119:31:061
2491299130,12cyclictest0-21swapper/119:31:061
2491299130,12cyclictest0-21swapper/119:26:461
2491299130,12cyclictest0-21swapper/119:21:081
2491299130,11cyclictest17833-21sort20:05:101
2491299130,11cyclictest13402-21iostat_ios21:05:161
2491199137,5cyclictest0-21swapper/020:55:550
2491199137,4cyclictest0-21swapper/019:55:290
24911991311,1cyclictest0-21swapper/019:10:020
2491199130,1cyclictest0-21swapper/020:41:280
2491199130,1cyclictest0-21swapper/019:22:250
2491199130,12cyclictest24910-21cyclictest20:51:240
2491199130,12cyclictest0-21swapper/020:31:360
2491199130,12cyclictest0-21swapper/020:12:130
2491199130,12cyclictest0-21swapper/019:30:100
2491199130,12cyclictest0-21swapper/019:30:100
2491499120,3cyclictest30197-21ntp_states20:30:183
2491499120,3cyclictest0-21swapper/319:15:153
2491499120,11cyclictest0-21swapper/320:45:093
2491499120,10cyclictest2675-21munin-node19:30:183
2491499120,10cyclictest2675-21munin-node19:30:183
2491499120,10cyclictest12961-21df_inode21:05:133
2491499120,10cyclictest11633-21munin-node21:00:213
2491399127,1cyclictest25332-21latency20:20:162
2491399120,3cyclictest6923-21hddtemp_smartct19:40:152
2491399120,11cyclictest19925-21munin-node20:10:212
2491399120,11cyclictest135650irq/27-eth019:55:112
2491399120,11cyclictest0-21swapper/220:55:512
2491399120,11cyclictest0-21swapper/220:30:062
2491399120,10cyclictest0-21swapper/220:35:182
2491299127,4cyclictest10950irq/23-ehci_hcd19:10:161
24912991210,1cyclictest0-21swapper/120:00:031
24911991210,1cyclictest0-21swapper/020:20:100
2491199120,8cyclictest0-21swapper/020:46:010
2491199120,2cyclictest0-21swapper/020:36:420
2491199120,1cyclictest0-21swapper/020:16:190
2491199120,1cyclictest0-21swapper/019:42:020
2491199120,11cyclictest0-21swapper/021:05:000
2491199120,11cyclictest0-21swapper/019:50:380
2491199120,11cyclictest0-21swapper/019:15:100
2491199116,4cyclictest0-21swapper/021:01:290
2491199110,10cyclictest0-21swapper/020:00:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional