You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 13:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat Nov 29, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
714721130,1sleep37146-21sshd00:04:463
237792880,0sleep20-21swapper/223:04:372
1408026528,19sleep00-21swapper/019:09:270
139762610,0sleep00-21swapper/023:25:140
1396226024,18sleep20-21swapper/219:07:572
225172570,1sleep122505-21sshd23:11:371
263872550,0sleep30-21swapper/300:06:513
52992540,1sleep20-21swapper/222:18:342
145222540,1sleep014520-21bash22:05:100
1176025431,18sleep30-21swapper/319:05:013
11302530,0sleep30-21swapper/322:14:303
251462520,0sleep025099-21sshd21:19:190
12212520,0sleep30-21swapper/323:45:283
43992510,0sleep00-21swapper/022:55:010
323332500,0sleep30-21swapper/321:56:123
206682490,1sleep020664-21sshd00:13:330
169492490,0sleep20-21swapper/222:01:442
1404524927,18sleep10-21swapper/119:09:011
230192470,0sleep20-21swapper/222:13:172
208292460,0sleep30-21swapper/321:36:483
158662460,0sleep115856-21sshd21:39:591
87402450,0sleep00-21swapper/023:31:430
323362450,0sleep00-21swapper/021:59:570
220682450,0sleep20-21swapper/223:26:002
107952450,0sleep20-21swapper/200:24:162
215822440,1sleep321581-21sshd21:47:473
181582400,0sleep20-21swapper/222:38:052
176322380,0sleep119-21rcuc/119:15:121
64972280,0sleep06498-21bash22:22:170
1438699231,21cyclictest0-21swapper/223:40:172
14385992320,2cyclictest31590-21sshd23:09:051
14384992321,1cyclictest32732-21sshd23:09:140
14387992219,2cyclictest0-21swapper/321:24:303
1438799220,21cyclictest0-21swapper/321:05:163
1438799220,21cyclictest0-21swapper/320:30:193
1438799220,21cyclictest0-21swapper/319:24:363
14386992220,1cyclictest0-21swapper/221:54:332
1438599220,21cyclictest0-21swapper/123:40:361
1438499220,21cyclictest0-21swapper/022:03:360
49972210,1sleep35000-21sshd22:43:553
1438799210,20cyclictest0-21swapper/319:54:063
1438699210,21cyclictest0-21swapper/221:59:062
1438699210,20cyclictest0-21swapper/223:56:202
1438699210,20cyclictest0-21swapper/219:49:052
14385992119,1cyclictest4861-21sshd21:20:311
1438499210,20cyclictest0-21swapper/023:04:510
14387992018,1cyclictest0-21swapper/321:43:233
1438799200,1cyclictest32158-21sshd23:34:263
14386992018,1cyclictest0-21swapper/222:51:552
1438699200,1cyclictest3874-21sshd23:05:512
1438699200,19cyclictest0-21swapper/222:25:192
14385992018,1cyclictest5203-21sshd23:57:041
1438599200,19cyclictest0-21swapper/122:42:361
1438799190,18cyclictest0-21swapper/323:02:213
1438799190,18cyclictest0-21swapper/300:15:173
1438699190,18cyclictest0-21swapper/221:40:172
1438599198,1cyclictest23426-21bash23:22:371
1438599198,1cyclictest23426-21bash23:22:371
1438599192,3cyclictest4453-21sshd00:04:281
14385991911,5cyclictest0-21swapper/122:00:341
1438599190,18cyclictest0-21swapper/122:29:511
1438599190,18cyclictest0-21swapper/119:35:161
1438599190,18cyclictest0-21swapper/100:20:361
1438499190,18cyclictest0-21swapper/021:51:510
1438799180,17cyclictest0-21swapper/323:05:173
1438799180,17cyclictest0-21swapper/320:50:163
1438599184,13cyclictest0-21swapper/123:50:381
1438599182,13cyclictest23898-21sshd21:40:441
1438599182,13cyclictest0-21swapper/122:49:081
14385991811,5cyclictest10034-21sshd23:39:161
14385991811,4cyclictest0-21swapper/100:38:051
1438599180,17cyclictest0-21swapper/100:05:161
14384991815,2cyclictest1959-21cstates19:50:150
1438499180,17cyclictest0-21swapper/023:40:170
1438499180,17cyclictest0-21swapper/020:25:170
1438499180,15cyclictest0-21swapper/021:26:240
1438799170,16cyclictest0-21swapper/323:54:063
1438599175,5cyclictest6522-21id22:15:061
1438599174,6cyclictest6142-21sshd21:17:071
1438599174,6cyclictest14941-21sshd22:05:121
1438599174,3cyclictest9513-21sshd21:10:131
1438599174,3cyclictest9496-21bash21:50:061
1438599174,3cyclictest4246-21sshd23:02:161
1438599174,3cyclictest31881-21bash22:10:321
1438599174,3cyclictest25496-21sshd22:35:161
1438599174,3cyclictest21585-21bash23:33:121
1438599174,3cyclictest15027-21fw_forwarded_lo23:25:161
1438599174,2cyclictest10274-21sshd22:22:431
14385991714,2cyclictest7472-21sshd21:31:441
14385991711,4cyclictest16776-21id00:13:061
14385991711,2cyclictest122450irq/25-eth000:33:181
1438499179,7cyclictest0-21swapper/022:39:530
14384991715,1cyclictest25057-21apache_processe21:30:110
1438499171,12cyclictest0-21swapper/022:30:510
1438499170,16cyclictest0-21swapper/023:55:170
1438499170,16cyclictest0-21swapper/022:53:210
1438499170,14cyclictest4012-21sshd00:31:200
196112160,0sleep30-21swapper/300:29:233
14386991614,1cyclictest0-21swapper/222:57:432
1438599164,6cyclictest1940-21sshd21:49:151
1438599164,3cyclictest29712-21sshd22:57:501
1438599164,3cyclictest2968-21sshd21:56:331
1438599164,2cyclictest13693-21sshd23:17:541
1438599163,6cyclictest7113-21diskmemload22:50:201
1438599162,13cyclictest5040-21bash23:45:551
14385991613,2cyclictest13966-21sshd00:28:351
1438599161,2cyclictest0-21swapper/121:29:251
14385991611,4cyclictest29938-21sshd22:32:081
1438499169,4cyclictest0-21swapper/023:24:210
1438499169,4cyclictest0-21swapper/023:24:210
1438499169,4cyclictest0-21swapper/022:13:410
1438499168,4cyclictest0-21swapper/000:35:490
14384991615,1cyclictest0-21swapper/000:15:300
14384991615,1cyclictest0-21swapper/000:05:030
1438499160,15cyclictest1889-21cp22:18:090
1438499160,15cyclictest0-21swapper/023:53:010
1438499160,15cyclictest0-21swapper/022:44:210
1438499160,10cyclictest0-21swapper/021:20:090
113352160,1sleep3381ktimersoftd/320:10:133
14387991513,1cyclictest2558-21cp22:29:053
14387991513,1cyclictest0-21swapper/323:25:173
1438799150,1cyclictest0-21swapper/321:28:533
1438799150,14cyclictest0-21swapper/322:09:513
1438799150,12cyclictest0-21swapper/323:21:263
1438799150,12cyclictest0-21swapper/323:21:263
1438699158,6cyclictest0-21swapper/200:16:082
14386991514,1cyclictest0-21swapper/222:21:112
1438599154,10cyclictest4930-21apache_processe21:05:121
1438599154,10cyclictest22203-21apache_processe19:25:111
1438599153,3cyclictest6311-21bash00:15:271
1438599150,14cyclictest0-21swapper/119:30:161
1438499159,3cyclictest0-21swapper/021:42:420
1438499152,2cyclictest29278-21kworker/0:200:21:480
14384991512,1cyclictest21406-21sshd22:27:320
1438499150,14cyclictest0-21swapper/021:36:270
1438499150,12cyclictest0-21swapper/023:35:550
1438799149,2cyclictest0-21swapper/323:11:323
1438799141,2cyclictest122450irq/25-eth021:15:183
14387991412,1cyclictest1510-21sshd21:31:023
14387991412,1cyclictest11182-21sshd23:43:023
14387991412,1cyclictest0-21swapper/322:36:103
1438699149,2cyclictest0-21swapper/200:09:202
1438699148,5cyclictest0-21swapper/200:39:402
1438699143,10cyclictest1051-21sshd21:45:242
1438699140,13cyclictest15627-21bash23:14:342
1438699140,13cyclictest0-21swapper/221:35:192
1438699140,13cyclictest0-21swapper/221:22:142
1438699140,13cyclictest0-21swapper/200:29:152
1438599143,10cyclictest464-21expr20:55:141
1438599143,10cyclictest22450-21users20:30:251
14385991411,2cyclictest27186-21users20:40:231
1438599140,14cyclictest0-21swapper/119:40:061
1438499149,3cyclictest8577-21sshd21:10:090
1438499148,5cyclictest0-21swapper/023:10:410
1438499148,3cyclictest0-21swapper/000:26:440
1438499146,2cyclictest24065-21kworker/0:020:53:230
1438499140,9cyclictest0-21swapper/020:35:150
1438499140,3cyclictest0-21swapper/023:48:550
1438499140,13cyclictest0-21swapper/023:15:480
1438499140,11cyclictest19776-21bash00:02:260
1438799139,3cyclictest0-21swapper/319:40:123
1438799138,2cyclictest17197-21sshd00:33:023
1438799138,2cyclictest11905-21sshd22:33:483
1438799131,11cyclictest0-21swapper/323:15:453
1438799131,11cyclictest0-21swapper/322:59:403
1438799131,11cyclictest0-21swapper/320:20:183
1438799130,2cyclictest9002-21sshd23:35:213
1438799130,1cyclictest30477-21sshd00:14:413
1438799130,12cyclictest26487-21bash22:02:513
1438799130,12cyclictest17472-21sshd21:11:023
1438799130,12cyclictest16073-21munin-node22:45:203
1438799130,12cyclictest15408-21sshd00:37:033
1438799130,12cyclictest0-21swapper/321:50:413
1438799130,12cyclictest0-21swapper/300:20:273
1438699139,2cyclictest1664-21sshd21:27:122
1438699139,1cyclictest122450irq/25-eth000:13:172
1438699138,4cyclictest4802-21sshd21:16:572
14386991310,3cyclictest0-21swapper/223:37:542
1438699130,12cyclictest11088-21bash22:30:062
1438699130,12cyclictest0-21swapper/223:47:542
1438699130,12cyclictest0-21swapper/223:21:082
1438699130,12cyclictest0-21swapper/223:21:082
1438699130,12cyclictest0-21swapper/220:30:182
1438699130,12cyclictest0-21swapper/219:50:212
1438699130,12cyclictest0-21swapper/200:02:262
1438699130,10cyclictest3308-21sshd22:40:072
1438699130,10cyclictest1102-21sshd23:16:272
1438599133,1cyclictest1668-21apache_volume19:50:131
14385991311,1cyclictest14410-21apache_volume19:10:141
1438499138,5cyclictest0-21swapper/022:45:560
1438499130,4cyclictest0-21swapper/021:48:000
1438799129,2cyclictest0-21swapper/322:50:493
1438799129,2cyclictest0-21swapper/322:15:183
1438799129,2cyclictest0-21swapper/320:55:153
1438799129,2cyclictest0-21swapper/319:55:123
1438799122,1cyclictest16810-21df19:15:023
1438799121,2cyclictest0-21swapper/321:00:133
1438799121,2cyclictest0-21swapper/320:25:133
1438799121,10cyclictest0-21swapper/319:10:213
14387991210,1cyclictest0-21swapper/322:20:193
1438799120,11cyclictest25996-21sshd23:55:393
1438799120,11cyclictest0-21swapper/320:40:213
1438699129,2cyclictest0-21swapper/223:53:132
1438699129,2cyclictest0-21swapper/222:05:152
1438699129,2cyclictest0-21swapper/221:30:072
1438699129,2cyclictest0-21swapper/220:00:192
1438699129,2cyclictest0-21swapper/219:15:192
1438699129,2cyclictest0-21swapper/200:30:422
1438699128,3cyclictest0-21swapper/221:10:002
1438699128,2cyclictest0-21swapper/222:47:102
1438699121,10cyclictest28097-21cstates20:45:152
1438699121,10cyclictest0-21swapper/220:15:162
1438699120,1cyclictest122450irq/25-eth023:31:322
1438699120,11cyclictest0-21swapper/221:05:142
1438699120,11cyclictest0-21swapper/219:30:152
1438599129,2cyclictest0-21swapper/120:35:131
1438599129,2cyclictest0-21swapper/120:20:171
1438599129,2cyclictest0-21swapper/120:15:161
1438599129,2cyclictest0-21swapper/120:00:101
1438599129,2cyclictest0-21swapper/119:45:131
1438599123,6cyclictest0-21swapper/120:50:151
1438599121,2cyclictest0-21swapper/121:00:121
1438599121,10cyclictest0-21swapper/120:05:141
1438499129,2cyclictest0-21swapper/020:10:200
1438499129,2cyclictest0-21swapper/019:20:140
1438499127,2cyclictest0-21swapper/019:40:200
1438499121,10cyclictest0-21swapper/020:00:120
1438499120,11cyclictest0-21swapper/019:25:130
1438799119,1cyclictest24088-21memory20:35:203
1438799110,2cyclictest0-21swapper/320:00:113
1438799110,2cyclictest0-21swapper/319:25:123
1438799110,1cyclictest0-21swapper/320:16:033
1438799110,10cyclictest0-21swapper/320:45:163
1438699118,2cyclictest0-21swapper/219:40:092
1438699118,2cyclictest0-21swapper/219:20:142
1438699110,9cyclictest0-21swapper/219:25:142
1438699110,2cyclictest0-21swapper/220:40:132
1438699110,1cyclictest0-21swapper/220:21:212
1438699110,10cyclictest30940-21perl20:50:162
1438699110,10cyclictest0-21swapper/221:02:092
1438699110,10cyclictest0-21swapper/220:55:132
1438699110,10cyclictest0-21swapper/220:10:192
1438699110,10cyclictest0-21swapper/220:05:122
1438699110,10cyclictest0-21swapper/219:35:212
1438599117,4cyclictest0-21swapper/119:55:151
1438599110,10cyclictest0-21swapper/120:45:151
1438599110,10cyclictest0-21swapper/120:25:161
1438599110,10cyclictest0-21swapper/120:10:131
1438599110,10cyclictest0-21swapper/119:20:231
1438499119,1cyclictest0-21swapper/021:00:150
1438499119,1cyclictest0-21swapper/019:15:020
1438499118,2cyclictest0-21swapper/021:05:130
1438499118,2cyclictest0-21swapper/020:55:150
1438499117,1cyclictest0-21swapper/020:20:170
1438499110,3cyclictest0-21swapper/019:30:180
1438499110,10cyclictest32140-21df19:45:150
1438499110,10cyclictest0-21swapper/020:45:160
1438499110,10cyclictest0-21swapper/020:15:210
1438499110,10cyclictest0-21swapper/020:05:150
1438499110,10cyclictest0-21swapper/019:55:140
1438799108,1cyclictest24594-21apache_processe19:30:123
1438799100,9cyclictest8828-21apache_processe20:05:113
1438799100,9cyclictest0-21swapper/319:35:133
1438799100,1cyclictest0-21swapper/319:45:133
1438699100,9cyclictest18317-21apache_processe20:25:122
1438699100,9cyclictest0-21swapper/220:35:202
1438699100,9cyclictest0-21swapper/219:55:122
1438699100,10cyclictest0-21swapper/219:10:152
1438499108,1cyclictest26226-21fw_forwarded_lo20:40:150
1438499100,9cyclictest0-21swapper/020:30:160
1438499100,7cyclictest0-21swapper/019:10:250
1438499100,1cyclictest27399-21diskstats19:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional