You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 03:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Nov 25, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
380921580,3sleep01078199cyclictest23:03:160
175121440,3sleep21078399cyclictest22:50:322
2873121350,3sleep01078199cyclictest23:45:250
183621060,2sleep10-21swapper/123:45:581
1118221050,2sleep10-21swapper/121:29:021
193842980,0sleep00-21swapper/021:11:410
1051429533,58sleep10-21swapper/119:09:511
247202930,1sleep00-21swapper/022:52:490
105402910,2sleep310538-21sshd22:23:303
1047229132,41sleep30-21swapper/319:09:223
130572900,2sleep313056-21bash21:53:213
273932880,2sleep327390-21bash23:17:463
95622870,3sleep20-21swapper/223:59:162
131792870,2sleep113178-21bash23:28:411
22802860,4sleep31078499cyclictest22:01:223
295702850,2sleep10-21swapper/100:34:071
146942850,1sleep014688-21sshd22:14:460
124982850,2sleep30-21swapper/300:02:393
18672840,2sleep31866-21bash21:16:063
36122830,2sleep20-21swapper/223:43:062
41772800,5sleep31078499cyclictest00:08:123
179352790,2sleep117934-21bash21:47:421
216172780,1sleep20-21swapper/222:03:142
115082780,2sleep10-21swapper/100:28:341
180702770,2sleep11847-21nfsd23:38:161
124222770,2sleep21847-21nfsd22:17:332
307232760,1sleep330724-21sshd21:27:473
28102760,1sleep21078399cyclictest00:08:032
260802750,1sleep20-21swapper/221:33:232
24112750,1sleep20-21swapper/221:40:132
206192750,2sleep20-21swapper/221:14:562
147382750,2sleep114726-21sshd00:15:401
119142750,1sleep30-21swapper/322:39:053
1040627533,12sleep20-21swapper/219:08:282
220772740,1sleep322073-21sshd21:20:553
184732740,1sleep30-21swapper/322:58:303
225182730,2sleep222517-21bash21:39:042
53722720,3sleep11078299cyclictest00:11:311
236072720,2sleep20-21swapper/200:36:572
199822720,1sleep10-21swapper/122:03:051
182442720,0sleep00-21swapper/022:09:010
143762720,1sleep00-21swapper/000:32:260
269362710,1sleep226922-21sshd23:39:082
273082680,1sleep027288-21sshd23:39:110
37172600,1sleep10-21swapper/123:21:371
1031526034,14sleep00-21swapper/019:07:260
313142550,1sleep031305-21cp00:10:500
28222490,0sleep00-21swapper/000:21:040
53062400,0sleep00-21swapper/021:49:360
256182400,38sleep126950irq/26-ahci[00021:18:211
183232390,1sleep31847-21nfsd23:29:123
244462380,2sleep210780-21cyclictest00:03:502
1078199386,5cyclictest28679-21sshd22:31:230
1078199383,13cyclictest30823-21sshd23:58:110
1078199380,13cyclictest1848-21nfsd22:47:140
1078199370,3cyclictest0-21swapper/022:27:300
1078199370,10cyclictest0-21swapper/023:09:530
322522360,5sleep00-21swapper/023:24:240
1078199365,9cyclictest24663-21sshd22:18:430
1078199360,6cyclictest0-21swapper/022:58:280
69732350,1sleep26972-21sshd23:09:472
310792330,7sleep20-21swapper/223:45:392
148762330,30sleep1135650irq/27-eth022:58:091
1078199331,11cyclictest0-21swapper/023:34:510
1078199320,6cyclictest1959-21sshd21:43:390
1078199311,7cyclictest19971-21sshd22:39:530
1078199310,3cyclictest22612-21sshd23:41:460
1078199310,11cyclictest0-21swapper/021:55:210
191462300,22sleep3135650irq/27-eth022:52:163
1078199303,20cyclictest4050-21sshd22:01:320
94162290,2sleep10-21swapper/123:34:271
76422290,2sleep17641-21bash22:48:011
230902290,3sleep30-21swapper/300:29:513
242612280,3sleep20-21swapper/223:51:162
10784992812,6cyclictest0-21swapper/322:05:143
309502270,2sleep20-21swapper/223:21:052
160932270,24sleep1135650irq/27-eth021:32:281
1078399271,9cyclictest0-21swapper/223:10:452
1078199279,4cyclictest27504-21rm21:54:450
1078199270,25cyclictest16282-21sshd21:17:270
53702260,2sleep01078199cyclictest00:27:570
116282260,24sleep3135650irq/27-eth021:59:193
1078499260,17cyclictest44-21ksoftirqd/323:00:513
1078399267,2cyclictest0-21swapper/221:54:442
1078199250,11cyclictest0-21swapper/023:10:440
39512240,4sleep31078499cyclictest22:10:373
10784992415,5cyclictest29346-21sshd23:14:573
1078399247,1cyclictest0-21swapper/222:05:002
10783992416,6cyclictest9971-21sshd22:26:252
1078199249,14cyclictest22196-21sshd23:51:030
1078199241,6cyclictest0-21swapper/021:21:310
1078199241,22cyclictest0-21swapper/000:05:400
1078199240,8cyclictest6934-21sshd23:18:550
1078199240,23cyclictest6352-21sshd21:34:360
172402230,20sleep3135650irq/27-eth000:12:463
136162230,20sleep1135650irq/27-eth023:13:281
10784992315,4cyclictest5700-21id23:55:413
10784992310,7cyclictest135650irq/27-eth022:26:133
10784992310,5cyclictest3251-21sshd22:47:353
1078499230,22cyclictest5368-21sshd00:38:323
1078199238,3cyclictest0-21swapper/023:25:090
1078199233,8cyclictest22331-21sshd22:21:280
240522220,3sleep10-21swapper/121:24:121
174822220,2sleep10-21swapper/122:27:101
134172220,19sleep3135650irq/27-eth022:42:203
1078499229,5cyclictest14805-21sshd21:47:223
1078499226,7cyclictest5490-21sshd00:21:213
10784992213,7cyclictest18119-21sshd22:15:043
10784992211,5cyclictest135650irq/27-eth023:20:023
1078399228,2cyclictest0-21swapper/222:55:552
1078399228,2cyclictest0-21swapper/221:48:512
1078399224,1cyclictest0-21swapper/220:12:182
1078399220,5cyclictest0-21swapper/222:10:232
10782992210,5cyclictest10950irq/23-ehci_hcd22:17:381
1078199228,3cyclictest23430-21bash00:00:300
1078199221,8cyclictest0-21swapper/021:28:090
1078199220,8cyclictest32059-21cp22:40:550
1078199220,8cyclictest0-21swapper/021:38:150
1078199220,20cyclictest0-21swapper/000:16:030
319502210,2sleep22405-21runrttasks22:37:532
10784992117,2cyclictest1847-21nfsd23:37:473
10784992115,4cyclictest23539-21sshd00:33:283
10784992113,5cyclictest8358-21sshd23:09:553
10784992111,4cyclictest13634-21sshd21:41:093
1078399219,1cyclictest0-21swapper/221:56:292
1078399218,2cyclictest0-21swapper/222:45:522
1078399218,2cyclictest0-21swapper/221:19:512
1078399217,2cyclictest0-21swapper/223:25:062
1078399211,7cyclictest0-21swapper/223:01:592
1078399210,9cyclictest0-21swapper/223:32:472
1078299218,4cyclictest0-21swapper/121:58:371
10782992111,4cyclictest10950irq/23-ehci_hcd00:00:291
1078199210,1cyclictest0-21swapper/020:19:160
1078199210,1cyclictest0-21swapper/020:19:150
1078499209,8cyclictest31933-21sshd23:45:443
1078499200,19cyclictest44-21ksoftirqd/323:34:243
1078399208,2cyclictest0-21swapper/200:11:092
1078399207,3cyclictest0-21swapper/200:26:362
1078399207,2cyclictest0-21swapper/223:15:282
1078399207,2cyclictest0-21swapper/222:34:072
1078399207,2cyclictest0-21swapper/220:44:042
1078399201,8cyclictest0-21swapper/222:42:512
1078399201,7cyclictest0-21swapper/221:20:442
10783992010,1cyclictest0-21swapper/220:51:062
10782992015,3cyclictest1959-21sshd22:11:581
10782992014,4cyclictest25283-21bash00:07:001
1078299200,10cyclictest2656-21bash00:38:121
1078199208,3cyclictest0-21swapper/019:45:110
1078199200,7cyclictest0-21swapper/020:12:190
1078199200,19cyclictest0-21swapper/000:35:410
1078199200,12cyclictest0-21swapper/019:15:210
270662190,17sleep1135650irq/27-eth022:37:251
141292191,16sleep1135650irq/27-eth023:04:181
10784991912,4cyclictest135650irq/27-eth023:40:163
1078399197,2cyclictest0-21swapper/221:27:042
1078399197,2cyclictest0-21swapper/219:40:142
1078399192,7cyclictest0-21swapper/200:15:232
1078399191,7cyclictest0-21swapper/200:31:462
10783991910,4cyclictest4546-21sshd00:21:172
1078299197,2cyclictest22515-21id23:57:221
10782991910,3cyclictest10950irq/23-ehci_hcd22:24:591
1078299190,16cyclictest9652-21sshd22:05:111
10781991910,2cyclictest0-21swapper/019:26:530
1078199190,1cyclictest0-21swapper/021:06:270
1078199190,1cyclictest0-21swapper/020:54:590
1078199190,18cyclictest0-21swapper/020:28:450
1078199190,10cyclictest1834-21grep20:00:160
223312180,16sleep1135650irq/27-eth021:12:001
111992180,16sleep3135650irq/27-eth021:10:533
1078499189,4cyclictest21703-21sshd23:50:593
1078499184,4cyclictest1846-21nfsd22:31:333
10784991810,5cyclictest1959-21sshd00:19:453
1078399181,7cyclictest0-21swapper/222:24:032
10783991810,1cyclictest0-21swapper/220:28:342
1078299188,4cyclictest29227-21sshd21:36:381
1078299187,1cyclictest25296-21sshd21:54:321
10782991810,4cyclictest7633-21sshd23:09:501
1078299180,4cyclictest135650irq/27-eth022:40:581
1078299180,11cyclictest13255-21sshd23:40:501
1078199186,5cyclictest0-21swapper/019:55:160
1078199180,3cyclictest11068-21df19:10:120
1078199180,12cyclictest0-21swapper/020:20:280
170632171,14sleep3135650irq/27-eth021:38:353
1078399178,1cyclictest0-21swapper/219:26:522
1078299177,5cyclictest144550irq/28-eth1-rx-23:53:501
10782991711,4cyclictest18873-21bash22:30:221
10782991711,4cyclictest14801-21sshd23:16:331
1078199172,10cyclictest0-21swapper/019:54:160
1078199170,8cyclictest0-21swapper/019:41:060
1078199170,2cyclictest0-21swapper/020:57:250
1078199170,12cyclictest0-21swapper/020:30:330
1078199170,10cyclictest0-21swapper/019:35:160
1078199170,10cyclictest0-21swapper/019:30:160
1078499160,11cyclictest31802-21sshd21:30:503
1078399168,1cyclictest0-21swapper/220:33:532
1078299167,2cyclictest10950irq/23-ehci_hcd00:20:321
1078299160,4cyclictest31840-21ntp_states22:50:201
1078299160,13cyclictest135650irq/27-eth021:41:001
1078299160,12cyclictest25-21rcuop/119:10:001
1078199160,15cyclictest0-21swapper/020:39:230
1078199160,15cyclictest0-21swapper/020:07:310
10784991511,3cyclictest10950irq/23-ehci_hcd20:43:033
1078499150,13cyclictest0-21swapper/319:35:163
1078499150,13cyclictest0-21swapper/319:30:143
1078299156,4cyclictest10950irq/23-ehci_hcd19:55:141
1078299153,11cyclictest10950irq/23-ehci_hcd19:35:221
10782991511,3cyclictest10950irq/23-ehci_hcd21:00:101
1078299150,6cyclictest0-21swapper/120:01:131
1078299150,13cyclictest0-21swapper/121:08:431
1078199150,1cyclictest20943-21munin-node20:40:230
1078499149,4cyclictest10950irq/23-ehci_hcd20:16:103
1078499149,4cyclictest10950irq/23-ehci_hcd20:16:093
1078499142,11cyclictest16201-21sensors_temp20:30:203
10784991410,3cyclictest10950irq/23-ehci_hcd20:58:283
1078399147,6cyclictest0-21swapper/219:31:532
1078399145,3cyclictest10950irq/23-ehci_hcd20:00:152
1078399144,9cyclictest0-21swapper/219:19:462
1078399141,12cyclictest326012sleep221:06:242
1078399140,12cyclictest0-21swapper/219:35:142
1078299147,6cyclictest135650irq/27-eth020:34:341
10782991410,3cyclictest10950irq/23-ehci_hcd20:43:251
1078299140,3cyclictest135650irq/27-eth019:25:141
1078299140,2cyclictest135650irq/27-eth019:20:231
1078299140,2cyclictest0-21swapper/119:50:151
1078199140,1cyclictest0-21swapper/021:02:030
1078199140,1cyclictest0-21swapper/020:47:150
1078499139,3cyclictest135650irq/27-eth021:00:023
1078499139,1cyclictest0-21swapper/320:39:053
1078499137,5cyclictest0-21swapper/321:07:213
1078499137,5cyclictest0-21swapper/319:15:463
1078499132,3cyclictest144550irq/28-eth1-rx-20:23:083
1078499132,3cyclictest135650irq/27-eth020:01:013
1078499132,10cyclictest135650irq/27-eth019:25:023
10784991311,1cyclictest0-21swapper/320:51:133
10784991311,1cyclictest0-21swapper/319:44:543
1078499130,5cyclictest0-21swapper/319:55:473
1078499130,4cyclictest22406-21munin-node20:45:153
1078499130,4cyclictest12954-21diskstats20:25:143
1078499130,1cyclictest135650irq/27-eth020:05:193
1078499130,12cyclictest0-21swapper/319:50:183
1078499130,12cyclictest0-21swapper/319:22:103
1078499130,11cyclictest6548-21iostat_ios20:10:163
1078499130,11cyclictest2405-21runrttasks19:10:233
1078399138,4cyclictest1848-21nfsd19:11:312
1078399138,3cyclictest29303-21df19:50:142
1078399137,5cyclictest0-21swapper/219:57:422
1078399137,5cyclictest0-21swapper/219:20:042
10783991311,1cyclictest0-21swapper/220:48:472
10783991311,1cyclictest0-21swapper/220:35:272
10783991311,1cyclictest0-21swapper/220:15:102
10783991311,1cyclictest0-21swapper/220:15:102
10783991311,1cyclictest0-21swapper/220:09:052
1078299137,1cyclictest0-21swapper/120:55:131
1078299131,11cyclictest135650irq/27-eth019:16:221
1078299130,5cyclictest0-21swapper/119:33:531
1078299130,4cyclictest1927-21snmpd20:11:241
1078299130,1cyclictest135650irq/27-eth020:05:121
1078299130,12cyclictest0-21swapper/120:50:441
1078299130,12cyclictest0-21swapper/120:45:011
1078299130,12cyclictest0-21swapper/120:35:101
1078299130,12cyclictest0-21swapper/120:22:201
1078299130,12cyclictest0-21swapper/120:19:461
1078299130,12cyclictest0-21swapper/120:19:451
1078299130,12cyclictest0-21swapper/119:49:031
1078299130,12cyclictest0-21swapper/119:41:141
1078199130,1cyclictest0-21swapper/019:20:350
1078499120,11cyclictest27714-21needreboot19:45:163
1078399127,4cyclictest1848-21nfsd19:45:112
1078399127,4cyclictest0-21swapper/221:01:322
1078399120,11cyclictest12013-21runrttasks20:20:282
1078299120,11cyclictest0-21swapper/120:25:091
1078399117,3cyclictest26566-21df20:55:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional