You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-19 - 05:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Fri Jul 19, 2024 00:45:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
856621480,0sleep18538-21sshd23:14:481
2348121420,0sleep00-21swapper/022:01:530
3211021230,3sleep72819299cyclictest23:41:247
3211021230,3sleep72819299cyclictest23:41:237
2475921180,1sleep02815099cyclictest23:32:340
2475921180,1sleep02815099cyclictest23:32:340
2606721170,0sleep60-21swapper/621:48:286
159021170,1sleep61589-21sshd21:57:196
3047421160,0sleep20-21swapper/223:49:362
935221070,0sleep10-21swapper/122:28:071
57862830,0sleep00-21swapper/023:44:450
57862830,0sleep00-21swapper/023:44:440
202732830,0sleep10-21swapper/123:35:011
202732830,0sleep10-21swapper/123:35:001
122122820,1sleep10-21swapper/122:14:441
214412800,0sleep70-21swapper/723:04:527
39722790,0sleep60-21swapper/623:47:166
239752790,1sleep60-21swapper/622:18:276
239752790,1sleep60-21swapper/622:18:266
109262790,0sleep00-21swapper/020:45:150
50692780,0sleep10-21swapper/122:05:481
50692780,0sleep10-21swapper/122:05:471
309082780,0sleep50-21swapper/523:19:265
257792770,1sleep4501ktimersoftd/422:40:214
32522760,0sleep70-21swapper/721:30:107
277842760,1sleep60-21swapper/600:03:036
94982750,2sleep4491rcuc/422:47:174
271182750,1sleep41037-21runrttasks22:15:524
271182750,1sleep41037-21runrttasks22:15:514
183342750,0sleep60-21swapper/621:39:396
132692750,0sleep0121rcuc/023:12:230
71062740,0sleep70-21swapper/721:11:187
242282740,0sleep60-21swapper/623:38:026
242282740,0sleep60-21swapper/623:38:016
304902730,0sleep50-21swapper/521:54:215
202642730,1sleep720242-21sshd00:02:247
124272730,1sleep712392-21sshd21:25:217
267852720,0sleep00-21swapper/000:27:250
243582720,0sleep10-21swapper/123:51:431
120212720,0sleep00-21swapper/022:22:530
106852720,1sleep71-21systemd22:25:247
275142710,0sleep00-21swapper/022:13:150
260812710,0sleep70-21swapper/700:08:257
312372700,1sleep70-21swapper/700:27:497
238482700,0sleep60-21swapper/621:12:466
128942700,0sleep70-21swapper/720:50:117
118392700,1sleep00-21swapper/022:47:300
83472690,0sleep20-21swapper/200:04:112
179832690,4sleep32816799cyclictest00:02:113
61122680,4sleep02815099cyclictest22:16:530
61122680,4sleep02815099cyclictest22:16:520
142842680,0sleep00-21swapper/022:58:450
28422670,0sleep50-21swapper/522:41:105
150992670,0sleep20-21swapper/223:26:112
203072620,0sleep10-21swapper/100:35:031
188992620,1sleep3401rcuc/322:45:163
45222600,0sleep10-21swapper/122:19:341
45222600,0sleep10-21swapper/122:19:341
2777625949,6sleep10-21swapper/119:08:071
2588725948,7sleep30-21swapper/319:05:043
60202580,0sleep40-21swapper/400:01:084
247442580,0sleep60-21swapper/623:24:236
2763225028,7sleep60-21swapper/619:06:206
2756925039,7sleep70-21swapper/719:05:327
2783924927,7sleep20-21swapper/219:08:562
2777024434,6sleep40-21swapper/419:08:024
2776424331,7sleep00-21swapper/019:07:580
4272420,1sleep1420-21sshd00:11:401
2758524030,6sleep50-21swapper/519:05:475
66732310,1sleep20-21swapper/221:27:412
40682260,1sleep14057-21sshd21:30:121
320492240,0sleep70-21swapper/722:13:387
77162230,2sleep77711-21sshd23:36:357
77162230,2sleep77711-21sshd23:36:347
316702230,0sleep631671-21sshd23:44:106
316702230,0sleep631671-21sshd23:44:106
259322230,0sleep10-21swapper/100:30:071
155512230,0sleep00-21swapper/021:44:540
65332220,1sleep56531-21sshd23:25:275
140262220,0sleep30-21swapper/321:11:543
92762200,0sleep70-21swapper/721:44:217
2816199200,1cyclictest0-21swapper/221:20:242
2816199200,1cyclictest0-21swapper/221:16:322
249532200,0sleep60-21swapper/623:18:556
173422200,1sleep6671rcuc/600:29:236
160462200,0sleep00-21swapper/023:59:200
91252190,0sleep69127-21kworker/u16:023:06:276
61312190,0sleep10-21swapper/122:22:221
297772190,1sleep30-21swapper/323:38:303
297772190,1sleep30-21swapper/323:38:303
53982180,0sleep70-21swapper/722:52:267
114822180,1sleep311489-21unixbench_singl20:45:183
65352170,1sleep40-21swapper/400:31:054
2817299170,2cyclictest0-21swapper/421:55:234
2815099170,16cyclictest560-21grep21:46:150
123392170,1sleep7761rcuc/700:37:037
80812160,0sleep10-21swapper/121:27:471
70462160,1sleep4501ktimersoftd/400:23:044
2818299160,14cyclictest587-21packagekitd21:36:125
2816799160,14cyclictest0-21swapper/323:09:593
2816799160,14cyclictest0-21swapper/322:40:323
2816199160,2cyclictest0-21swapper/223:32:342
2816199160,2cyclictest0-21swapper/223:32:342
2815799160,1cyclictest20955-21sshd22:04:301
2815099160,1cyclictest4226-21sshd22:30:200
277582160,0sleep00-21swapper/023:05:170
244892160,0sleep70-21swapper/721:59:207
179832160,1sleep41037-21runrttasks21:31:204
73562150,1sleep27354-21bash22:55:172
314242150,0sleep30-21swapper/321:29:503
2819299153,2cyclictest739-21avahi-daemon22:21:037
2819299150,13cyclictest0-21swapper/723:45:277
2819299150,13cyclictest0-21swapper/723:22:207
2818799151,12cyclictest326-21sshd21:19:006
2817299154,4cyclictest51-21ksoftirqd/400:14:424
2817299150,13cyclictest0-21swapper/422:26:034
2816799150,13cyclictest29273-21grep22:54:323
2816199150,1cyclictest13826-21sshd22:17:342
2816199150,1cyclictest13826-21sshd22:17:332
2816199150,13cyclictest708-21dbus-daemon21:12:462
2816199150,13cyclictest0-21swapper/200:35:042
2815799150,13cyclictest0-21swapper/119:31:511
255822150,0sleep40-21swapper/423:27:104
200282150,0sleep20-21swapper/200:32:162
77012140,0sleep30-21swapper/323:11:533
318952140,0sleep60-21swapper/622:10:496
303402140,0sleep50-21swapper/500:08:465
2819299148,5cyclictest1-21systemd21:15:137
2819299148,5cyclictest0-21swapper/721:54:417
2819299145,2cyclictest735-21gdbus22:15:257
2819299145,2cyclictest735-21gdbus22:15:247
2819299145,2cyclictest5576-21sshd00:17:337
2819299143,2cyclictest8628-21nscd22:30:537
2819299143,2cyclictest12826-21nscd22:01:507
2819299143,1cyclictest739-21avahi-daemon21:20:047
2819299143,1cyclictest708-21dbus-daemon23:17:377
2819299140,1cyclictest29927-21sshd00:33:077
28187991411,2cyclictest0-21swapper/600:18:356
2818799140,1cyclictest32263-21sshd00:11:366
2818799140,12cyclictest0-21swapper/622:58:286
2818299140,12cyclictest28159-21sshd22:54:255
2818299140,12cyclictest17439-21sshd22:36:575
2818299140,12cyclictest0-21swapper/523:57:205
2818299140,12cyclictest0-21swapper/523:04:465
2818299140,12cyclictest0-21swapper/500:28:475
2817299147,3cyclictest51-21ksoftirqd/423:39:154
2817299147,3cyclictest51-21ksoftirqd/423:39:144
2817299143,3cyclictest51-21ksoftirqd/423:23:384
28172991412,1cyclictest15881-21sshd23:42:484
28172991412,1cyclictest15881-21sshd23:42:474
2817299141,1cyclictest101rcu_sched00:20:004
28172991410,2cyclictest5862-21sshd23:14:354
2817299140,2cyclictest3483-21sshd21:41:014
2817299140,12cyclictest736-21gdbus21:17:544
28167991412,1cyclictest0-21swapper/321:54:343
28167991412,1cyclictest0-21swapper/321:22:583
2816799140,2cyclictest0-21swapper/319:20:293
2816799140,2cyclictest0-21swapper/319:15:473
2816799140,1cyclictest0-21swapper/319:25:193
2816799140,1cyclictest0-21swapper/319:10:193
2816799140,13cyclictest0-21swapper/320:25:143
2816799140,12cyclictest708-21dbus-daemon00:23:383
2816799140,12cyclictest6351-21sshd21:41:153
2816799140,12cyclictest26603-21sshd22:21:203
2816799140,12cyclictest23360-21sshd00:27:083
2816799140,12cyclictest0-21swapper/300:33:343
2815799140,2cyclictest8106-21sshd00:09:391
2815799140,12cyclictest463-21systemd-journal22:52:221
2815799140,12cyclictest19358-21id21:50:321
28150991411,1cyclictest0-21swapper/023:37:240
28150991411,1cyclictest0-21swapper/023:37:230
2815099140,12cyclictest0-21swapper/021:59:320
194862140,0sleep50-21swapper/522:31:405
327112130,0sleep00-21swapper/000:11:390
2819299139,3cyclictest0-21swapper/721:46:227
2819299135,1cyclictest1037-21runrttasks20:03:167
2819299134,2cyclictest735-21gdbus22:45:497
2819299134,2cyclictest687-21polkitd22:55:167
2819299134,2cyclictest17839-21sshd23:59:287
2819299134,1cyclictest589-21gdbus00:13:047
2819299133,2cyclictest8628-21nscd22:36:157
2819299133,2cyclictest735-21gdbus23:53:377
2819299133,2cyclictest708-21dbus-daemon23:34:127
2819299133,2cyclictest708-21dbus-daemon23:34:127
2819299133,2cyclictest18870-21sshd22:42:347
28192991311,1cyclictest9910-21sshd00:20:317
28192991311,1cyclictest0-21swapper/723:10:137
28192991311,1cyclictest0-21swapper/721:36:167
2819299130,1cyclictest8558-21sshd23:28:297
2819299130,12cyclictest0-21swapper/722:09:297
2819299130,12cyclictest0-21swapper/722:09:287
28187991311,1cyclictest0-21swapper/622:49:536
28187991310,2cyclictest0-21swapper/600:38:286
2818799130,12cyclictest29468-21sshd23:13:476
2818799130,12cyclictest0-21swapper/622:30:406
2818799130,12cyclictest0-21swapper/621:53:416
28182991311,1cyclictest0-21swapper/523:41:375
28182991311,1cyclictest0-21swapper/523:41:365
28182991311,1cyclictest0-21swapper/521:18:035
28182991310,2cyclictest0-21swapper/523:45:065
28182991310,2cyclictest0-21swapper/522:22:585
28182991310,2cyclictest0-21swapper/521:57:505
28182991310,1cyclictest708-21dbus-daemon22:01:035
2818299130,1cyclictest0-21swapper/522:26:215
2818299130,12cyclictest0-21swapper/521:26:155
2817299135,3cyclictest51-21ksoftirqd/422:30:444
2817299135,1cyclictest51-21ksoftirqd/422:57:574
2817299133,6cyclictest51-21ksoftirqd/421:47:354
2817299133,3cyclictest51-21ksoftirqd/423:34:294
2817299133,3cyclictest51-21ksoftirqd/423:34:294
2817299133,2cyclictest687-21polkitd23:58:494
28172991311,1cyclictest51-21ksoftirqd/423:51:334
28172991311,1cyclictest0-21swapper/423:04:214
28172991311,1cyclictest0-21swapper/422:36:394
2817299130,1cyclictest25460-21sshd00:05:314
2817299130,1cyclictest0-21swapper/400:37:384
28167991310,1cyclictest0-21swapper/323:59:103
2816799130,12cyclictest0-21swapper/322:37:033
28161991311,1cyclictest21586-21bash21:42:372
28161991310,2cyclictest0-21swapper/223:52:032
2816199130,7cyclictest0-21swapper/221:32:402
2816199130,1cyclictest0-21swapper/223:41:262
2816199130,1cyclictest0-21swapper/223:41:252
2816199130,12cyclictest0-21swapper/223:39:412
2816199130,12cyclictest0-21swapper/223:39:402
2816199130,12cyclictest0-21swapper/223:06:212
2816199130,12cyclictest0-21swapper/222:10:412
2816199130,12cyclictest0-21swapper/219:25:142
2816199130,11cyclictest0-21swapper/222:21:102
2815799139,2cyclictest0-21swapper/100:18:321
28157991311,1cyclictest0-21swapper/123:39:421
28157991311,1cyclictest0-21swapper/123:39:411
28157991311,1cyclictest0-21swapper/122:55:521
28157991311,1cyclictest0-21swapper/122:31:171
2815799130,1cyclictest0-21swapper/123:18:121
28150991311,1cyclictest708-21dbus-daemon21:38:100
28150991311,1cyclictest0-21swapper/021:23:230
28150991310,2cyclictest0-21swapper/022:50:440
2815099130,2cyclictest21417-21bash23:26:470
2815099130,2cyclictest0-21swapper/000:32:380
2815099130,12cyclictest0-21swapper/022:07:360
2815099130,12cyclictest0-21swapper/022:07:350
2815099130,12cyclictest0-21swapper/019:30:120
262992130,0sleep40-21swapper/423:49:134
2819299129,2cyclictest0-21swapper/719:10:587
2819299125,1cyclictest0-21swapper/720:20:447
2819299124,2cyclictest708-21dbus-daemon23:05:137
2819299124,1cyclictest0-21swapper/719:45:157
2819299124,1cyclictest0-21swapper/719:45:157
2819299120,1cyclictest0-21swapper/721:04:127
2819299120,1cyclictest0-21swapper/720:27:147
2819299120,1cyclictest0-21swapper/720:13:287
2819299120,1cyclictest0-21swapper/719:52:487
2819299120,1cyclictest0-21swapper/719:52:487
2819299120,1cyclictest0-21swapper/719:29:567
2819299120,1cyclictest0-21swapper/719:17:547
28187991210,1cyclictest7699-21id00:20:206
28187991210,1cyclictest32230-21sshd23:00:146
28187991210,1cyclictest21839-21sshd23:29:396
28187991210,1cyclictest0-21swapper/621:28:506
2818799120,1cyclictest0-21swapper/622:23:396
2818799120,1cyclictest0-21swapper/621:42:086
2818799120,11cyclictest2511-21bash22:41:086
28182991210,1cyclictest6537-21sshd23:30:595
28182991210,1cyclictest6537-21sshd23:30:595
28182991210,1cyclictest1-21systemd23:06:315
28182991210,1cyclictest0-21swapper/523:11:385
28182991210,1cyclictest0-21swapper/521:24:395
28182991210,1cyclictest0-21swapper/521:11:275
28182991210,1cyclictest0-21swapper/519:40:115
2818299120,1cyclictest0-21swapper/522:57:565
2818299120,1cyclictest0-21swapper/522:16:085
2818299120,1cyclictest0-21swapper/522:16:075
2818299120,11cyclictest0-21swapper/523:20:135
2818299120,11cyclictest0-21swapper/522:09:165
2818299120,11cyclictest0-21swapper/522:09:155
2817299126,3cyclictest51-21ksoftirqd/423:09:304
2817299125,3cyclictest51-21ksoftirqd/422:01:154
2817299125,3cyclictest51-21ksoftirqd/421:10:004
2817299124,5cyclictest51-21ksoftirqd/400:25:154
2817299124,1cyclictest51-21ksoftirqd/422:06:104
2817299124,1cyclictest51-21ksoftirqd/422:06:104
2817299123,4cyclictest51-21ksoftirqd/422:22:074
2817299123,3cyclictest51-21ksoftirqd/423:17:124
2817299122,3cyclictest51-21ksoftirqd/422:54:564
2817299122,3cyclictest51-21ksoftirqd/422:10:404
2817299121,1cyclictest101rcu_sched21:10:014
28172991210,1cyclictest0-21swapper/421:36:034
2817299120,11cyclictest0-21swapper/421:26:054
28167991210,1cyclictest540-40kipmi000:35:123
28167991210,1cyclictest22618-21sshd21:34:333
28167991210,1cyclictest0-21swapper/323:34:353
28167991210,1cyclictest0-21swapper/323:34:343
28167991210,1cyclictest0-21swapper/323:04:523
28167991210,1cyclictest0-21swapper/322:33:323
28167991210,1cyclictest0-21swapper/322:11:073
28167991210,1cyclictest0-21swapper/321:16:243
2816799120,1cyclictest0-21swapper/322:16:123
2816799120,1cyclictest0-21swapper/322:16:123
2816799120,1cyclictest0-21swapper/321:37:543
2816799120,11cyclictest0-21swapper/322:56:153
2816799120,11cyclictest0-21swapper/322:09:213
2816799120,11cyclictest0-21swapper/322:09:213
2816799120,10cyclictest0-21swapper/323:15:043
2816199129,2cyclictest12530-21grepconf.sh22:42:002
2816199129,2cyclictest0-21swapper/221:50:562
28161991210,1cyclictest0-21swapper/223:55:322
28161991210,1cyclictest0-21swapper/222:35:012
28161991210,1cyclictest0-21swapper/221:59:092
2816199120,1cyclictest9798-21sshd00:28:452
2816199120,1cyclictest0-21swapper/223:20:042
2816199120,1cyclictest0-21swapper/222:45:312
2816199120,1cyclictest0-21swapper/222:27:542
28157991210,1cyclictest0-21swapper/122:47:091
28157991210,1cyclictest0-21swapper/121:38:511
28157991210,1cyclictest0-21swapper/121:23:481
28157991210,1cyclictest0-21swapper/100:20:181
28157991210,1cyclictest0-21swapper/100:02:411
2815799120,1cyclictest708-21dbus-daemon23:55:331
2815799120,11cyclictest0-21swapper/123:21:481
2815099125,1cyclictest6213-21id00:06:390
28150991210,1cyclictest81ktimersoftd/022:38:380
28150991210,1cyclictest26676-21sshd21:26:360
28150991210,1cyclictest0-21swapper/023:04:270
28150991210,1cyclictest0-21swapper/000:20:570
2815099120,1cyclictest0-21swapper/021:13:390
2815099120,11cyclictest32412-21sshd22:43:460
2815099120,11cyclictest0-21swapper/021:15:100
2815099120,11cyclictest0-21swapper/020:30:170
159382120,0sleep50-21swapper/500:31:565
2819299114,1cyclictest1012-21snmpd19:35:117
2819299114,1cyclictest0-21swapper/720:35:237
2819299110,2cyclictest0-21swapper/720:42:117
2819299110,1cyclictest16082-21sed20:55:227
2819299110,1cyclictest0-21swapper/719:30:557
2818799119,1cyclictest0-21swapper/622:27:096
2818799119,1cyclictest0-21swapper/622:06:446
2818799119,1cyclictest0-21swapper/622:06:436
2818799119,1cyclictest0-21swapper/621:30:266
2818799118,2cyclictest0-21swapper/622:51:376
2818799110,1cyclictest0-21swapper/619:15:206
2818299119,1cyclictest0-21swapper/523:53:505
2818299119,1cyclictest0-21swapper/521:46:165
2818299119,1cyclictest0-21swapper/520:15:005
2818299117,2cyclictest0-21swapper/500:04:275
2818299112,8cyclictest0-21swapper/520:59:495
2818299110,10cyclictest0-21swapper/519:10:135
2818299110,0cyclictest0-21swapper/500:38:195
2817299110,9cyclictest739-21avahi-daemon21:21:374
2817299110,10cyclictest0-21swapper/419:25:164
2816799119,1cyclictest0-21swapper/322:01:103
2816799118,2cyclictest1-21systemd23:53:563
2816799110,1cyclictest0-21swapper/300:12:223
2816799110,10cyclictest0-21swapper/323:26:123
2816199119,1cyclictest0-21swapper/223:01:152
2816199119,1cyclictest0-21swapper/221:35:532
2816199115,4cyclictest1088-21in:imjournal23:14:142
2816199110,9cyclictest708-21dbus-daemon21:45:072
2815799119,1cyclictest0-21swapper/123:25:261
2815799119,1cyclictest0-21swapper/122:43:381
2815799110,1cyclictest0-21swapper/121:55:321
2815799110,10cyclictest0-21swapper/119:45:241
2815799110,10cyclictest0-21swapper/119:45:241
2815799110,0cyclictest0-21swapper/123:41:261
2815799110,0cyclictest0-21swapper/123:41:261
2815099119,1cyclictest0-21swapper/022:29:550
2815099118,2cyclictest0-21swapper/023:46:080
2815099113,2cyclictest18375-21grep00:15:500
2815099110,1cyclictest0-21swapper/023:17:540
2815099110,10cyclictest0-21swapper/023:23:050
164052110,0sleep50-21swapper/523:37:215
164052110,0sleep50-21swapper/523:37:205
2819299107,2cyclictest0-21swapper/721:05:217
2819299107,2cyclictest0-21swapper/720:33:547
2819299100,9cyclictest0-21swapper/720:05:487
2818799108,1cyclictest0-21swapper/600:30:336
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional