You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-13 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Feb 12, 2025 12:50:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
991028440,39sleep40-21swapper/407:05:054
1250528167,10sleep00-21swapper/007:09:500
990928046,30sleep30-21swapper/307:05:043
1239828046,29sleep50-21swapper/507:08:195
1246627946,29sleep60-21swapper/607:09:156
1235527845,29sleep10-21swapper/107:07:431
1226927846,28sleep70-21swapper/707:06:287
990827338,30sleep20-21swapper/207:05:022
101932560,0sleep50-21swapper/511:32:555
309622520,1sleep730965-21kernelversion07:40:157
309622520,1sleep730965-21kernelversion07:40:157
191462470,0sleep00-21swapper/011:54:200
112172470,0sleep60-21swapper/609:21:586
315602460,0sleep00-21swapper/011:43:230
304082450,0sleep40-21swapper/409:32:124
261932450,0sleep70-21swapper/711:24:177
238142440,0sleep00-21swapper/011:06:560
221402440,0sleep00-21swapper/011:55:160
137232440,0sleep70-21swapper/708:10:087
204362430,0sleep70-21swapper/710:32:127
143432400,0sleep30-21swapper/307:10:163
12952993939,0cyclictest0-21swapper/707:30:077
2910922910,0sleep60-21swapper/611:10:086
12949992910,14cyclictest0-21swapper/407:30:004
12948992929,0cyclictest0-21swapper/307:25:423
12952992525,0cyclictest0-21swapper/712:27:187
12950992525,0cyclictest0-21swapper/507:25:425
12946992525,0cyclictest0-21swapper/111:47:011
12951992424,0cyclictest0-21swapper/612:23:446
12945992424,0cyclictest0-21swapper/007:20:150
1295299236,10cyclictest73-21ksoftirqd/707:10:127
12949992310,10cyclictest0-21swapper/411:55:444
12949992210,9cyclictest0-21swapper/411:18:464
12945992222,0cyclictest0-21swapper/011:36:430
12950992120,1cyclictest561ktimersoftd/512:31:545
12949992110,9cyclictest31671-21sh11:43:284
12948992121,0cyclictest0-21swapper/312:03:443
12949992010,8cyclictest0-21swapper/409:10:094
12949992010,8cyclictest0-21swapper/409:10:094
12949992010,7cyclictest0-21swapper/411:24:524
12949992010,6cyclictest0-21swapper/412:33:114
12949992010,6cyclictest0-21swapper/412:13:284
12949992010,6cyclictest0-21swapper/409:51:024
12949992010,6cyclictest0-21swapper/408:56:384
12947992018,1cyclictest641-21nscd10:42:512
1295299190,12cyclictest73-21ksoftirqd/707:20:207
12949991918,1cyclictest0-21swapper/407:20:164
12949991910,8cyclictest0-21swapper/410:12:484
12949991910,8cyclictest0-21swapper/407:10:124
12949991910,6cyclictest0-21swapper/412:24:484
12949991910,6cyclictest0-21swapper/412:16:484
12949991910,6cyclictest0-21swapper/412:07:494
12949991910,6cyclictest0-21swapper/411:07:194
12949991910,6cyclictest0-21swapper/411:03:384
12949991910,6cyclictest0-21swapper/410:59:134
12949991910,6cyclictest0-21swapper/410:18:544
12949991910,6cyclictest0-21swapper/409:28:014
12949991910,6cyclictest0-21swapper/407:51:234
12949991910,5cyclictest0-21swapper/412:29:244
12949991910,5cyclictest0-21swapper/411:27:424
12949991910,5cyclictest0-21swapper/410:00:544
12946991917,2cyclictest0-21swapper/111:51:371
3268321810,4sleep70-21swapper/712:34:487
12949991811,6cyclictest27494-21sh10:35:204
12949991810,7cyclictest21131-21sed08:20:214
12949991810,7cyclictest13779-21ssh10:45:024
12949991810,7cyclictest0-21swapper/411:50:134
12949991810,7cyclictest0-21swapper/411:36:324
12949991810,7cyclictest0-21swapper/411:10:154
12949991810,7cyclictest0-21swapper/410:50:014
12949991810,7cyclictest0-21swapper/410:30:224
12949991810,7cyclictest0-21swapper/410:25:364
12949991810,7cyclictest0-21swapper/410:05:254
12949991810,7cyclictest0-21swapper/409:55:094
12949991810,7cyclictest0-21swapper/409:40:394
12949991810,7cyclictest0-21swapper/409:36:074
12949991810,7cyclictest0-21swapper/408:30:194
12949991810,6cyclictest0-21swapper/409:20:574
12949991810,5cyclictest0-21swapper/412:00:594
12949991810,5cyclictest0-21swapper/411:48:084
12949991810,5cyclictest0-21swapper/411:30:444
12949991810,5cyclictest0-21swapper/410:40:194
12949991810,5cyclictest0-21swapper/409:16:014
12949991810,5cyclictest0-21swapper/408:37:354
12949991810,5cyclictest0-21swapper/408:28:364
12949991810,5cyclictest0-21swapper/408:07:464
12948991810,0cyclictest0-21swapper/311:45:503
12947991817,1cyclictest321ktimersoftd/212:23:142
12947991810,0cyclictest0-21swapper/212:39:432
1294799180,18cyclictest0-21swapper/211:29:372
12946991810,3cyclictest0-21swapper/111:58:401
12945991810,5cyclictest0-21swapper/007:55:100
12945991810,5cyclictest0-21swapper/007:25:070
203002170,1sleep520294-21cron10:00:005
12952991710,0cyclictest0-21swapper/711:47:197
12950991716,1cyclictest1295-21ssh12:00:255
12949991710,7cyclictest0-21swapper/409:45:304
12949991710,7cyclictest0-21swapper/409:45:294
12949991710,7cyclictest0-21swapper/408:15:214
12949991710,6cyclictest30813-21ls10:20:184
12949991710,6cyclictest29741-21apt-get07:40:114
12949991710,6cyclictest29741-21apt-get07:40:114
12949991710,6cyclictest0-21swapper/412:35:044
12949991710,6cyclictest0-21swapper/409:00:114
12949991710,6cyclictest0-21swapper/408:55:004
12949991710,6cyclictest0-21swapper/408:50:014
12949991710,6cyclictest0-21swapper/407:55:134
12949991710,6cyclictest0-21swapper/407:45:144
12949991710,6cyclictest0-21swapper/407:15:124
12949991710,4cyclictest0-21swapper/407:38:284
12946991710,0cyclictest0-21swapper/112:26:221
12945991710,3cyclictest0-21swapper/012:10:130
915721610,3sleep2121rcu_preempt10:10:152
12952991610,6cyclictest0-21swapper/710:52:547
12952991610,0cyclictest0-21swapper/710:44:507
12951991615,0cyclictest23624-21rm12:13:036
12951991610,3cyclictest0-21swapper/608:55:106
12951991610,0cyclictest0-21swapper/612:37:206
12951991610,0cyclictest0-21swapper/612:30:206
12951991610,0cyclictest0-21swapper/611:01:466
12950991614,1cyclictest1642-21ntpd11:15:415
12950991610,0cyclictest0-21swapper/510:32:055
12949991610,6cyclictest0-21swapper/408:40:034
12949991610,6cyclictest0-21swapper/408:10:074
12949991610,6cyclictest0-21swapper/408:00:114
12949991610,6cyclictest0-21swapper/407:30:124
12949991610,5cyclictest13644-21apt-get09:05:014
12948991615,1cyclictest4645-21ssh10:24:053
12948991615,1cyclictest25639-21ssh09:13:563
12948991615,1cyclictest25639-21ssh09:13:563
12947991614,1cyclictest662-21ptp4l12:11:012
12947991610,0cyclictest0-21swapper/210:35:122
12947991610,0cyclictest0-21swapper/207:14:212
12946991616,0cyclictest0-21swapper/109:11:211
12946991616,0cyclictest0-21swapper/109:11:211
12946991610,6cyclictest0-21swapper/112:15:311
12946991610,2cyclictest0-21swapper/107:20:171
12946991610,0cyclictest0-21swapper/111:37:101
12946991610,0cyclictest0-21swapper/111:25:061
12946991610,0cyclictest0-21swapper/109:20:271
12945991610,4cyclictest0-21swapper/012:31:060
12945991610,3cyclictest0-21swapper/011:15:040
12945991610,2cyclictest0-21swapper/010:42:590
12945991610,1cyclictest0-21swapper/011:10:190
12945991610,0cyclictest0-21swapper/012:19:440
12945991610,0cyclictest0-21swapper/010:01:030
587221510,4sleep30-21swapper/307:54:373
12952991515,0cyclictest0-21swapper/711:44:307
12952991514,1cyclictest721ktimersoftd/711:01:587
12952991512,1cyclictest24650-21apt-get08:30:017
12952991510,5cyclictest0-21swapper/711:52:077
12952991510,5cyclictest0-21swapper/709:59:597
12952991510,2cyclictest25167-21kworker/7:012:38:247
12952991510,0cyclictest0-21swapper/712:01:257
12952991510,0cyclictest0-21swapper/711:55:327
12952991510,0cyclictest0-21swapper/711:28:307
12952991510,0cyclictest0-21swapper/711:10:547
12952991510,0cyclictest0-21swapper/711:09:337
12951991515,0cyclictest0-21swapper/611:19:316
12951991513,1cyclictest16820-21diskmemload09:13:186
12951991513,1cyclictest16820-21diskmemload09:13:186
12951991510,3cyclictest0-21swapper/607:55:116
12951991510,2cyclictest0-21swapper/607:25:066
12951991510,0cyclictest0-21swapper/612:29:436
12950991514,1cyclictest1642-21ntpd07:30:515
12950991514,0cyclictest29387-21ssh10:53:215
12950991511,4cyclictest0-21swapper/511:10:035
12950991511,3cyclictest14757-21nscd10:03:585
12950991510,5cyclictest0-21swapper/510:12:145
12950991510,3cyclictest0-21swapper/509:35:185
12950991510,2cyclictest0-21swapper/511:20:275
12950991510,0cyclictest0-21swapper/512:21:495
12950991510,0cyclictest0-21swapper/511:55:215
12950991510,0cyclictest0-21swapper/511:45:385
12950991510,0cyclictest0-21swapper/510:43:405
12950991510,0cyclictest0-21swapper/510:35:595
12950991510,0cyclictest0-21swapper/510:24:125
12948991515,0cyclictest0-21swapper/311:32:263
12948991514,1cyclictest647-21nscd12:20:133
12948991514,0cyclictest16820-21diskmemload11:40:003
12948991510,5cyclictest0-21swapper/309:45:313
12948991510,5cyclictest0-21swapper/309:45:313
12948991510,0cyclictest0-21swapper/310:56:003
12947991514,1cyclictest20821-21nscd11:11:392
12947991513,1cyclictest16820-21diskmemload09:28:292
12947991513,1cyclictest13616-21/usr/sbin/munin09:40:182
12947991512,3cyclictest31746-21kworker/u16:110:48:552
12947991510,5cyclictest0-21swapper/212:16:362
12947991510,5cyclictest0-21swapper/211:46:382
12947991510,4cyclictest0-21swapper/207:20:172
12947991510,3cyclictest0-21swapper/211:50:102
12947991510,2cyclictest0-21swapper/211:31:592
12947991510,0cyclictest0-21swapper/211:55:472
12947991510,0cyclictest0-21swapper/211:40:162
12947991510,0cyclictest0-21swapper/211:03:282
12947991510,0cyclictest0-21swapper/207:26:092
12946991510,5cyclictest0-21swapper/112:24:141
12946991510,5cyclictest0-21swapper/111:43:161
12946991510,5cyclictest0-21swapper/111:17:591
12946991510,1cyclictest16820-21diskmemload10:11:361
12946991510,1cyclictest10469-21nscd12:14:061
12946991510,0cyclictest0-21swapper/112:35:241
12946991510,0cyclictest0-21swapper/111:32:521
12946991510,0cyclictest0-21swapper/111:03:301
12946991510,0cyclictest0-21swapper/110:45:381
12946991510,0cyclictest0-21swapper/109:56:221
12946991510,0cyclictest0-21swapper/109:26:171
12945991514,1cyclictest641-21nscd11:46:300
12945991510,5cyclictest0-21swapper/012:28:480
12945991510,5cyclictest0-21swapper/010:21:180
12945991510,5cyclictest0-21swapper/009:43:330
12945991510,3cyclictest0-21swapper/010:33:100
12945991510,2cyclictest0-21swapper/011:00:110
12945991510,2cyclictest0-21swapper/010:11:200
12945991510,2cyclictest0-21swapper/007:30:080
12945991510,1cyclictest0-21swapper/011:31:330
12945991510,1cyclictest0-21swapper/009:56:300
12945991510,0cyclictest0-21swapper/012:36:490
12945991510,0cyclictest0-21swapper/012:07:010
12945991510,0cyclictest0-21swapper/010:48:460
12945991510,0cyclictest0-21swapper/009:18:480
12945991510,0cyclictest0-21swapper/009:11:310
12945991510,0cyclictest0-21swapper/009:11:300
12945991510,0cyclictest0-21swapper/008:35:120
12952991414,0cyclictest0-21swapper/709:11:017
12952991414,0cyclictest0-21swapper/709:11:017
12952991413,1cyclictest721ktimersoftd/710:02:067
12952991413,1cyclictest721ktimersoftd/709:45:387
12952991413,1cyclictest721ktimersoftd/709:45:387
12952991410,4cyclictest0-21swapper/710:37:337
12952991410,4cyclictest0-21swapper/709:41:577
12952991410,3cyclictest0-21swapper/711:35:147
12952991410,3cyclictest0-21swapper/711:30:267
12952991410,1cyclictest0-21swapper/710:25:057
12952991410,0cyclictest0-21swapper/712:20:527
12952991410,0cyclictest0-21swapper/712:19:167
12952991410,0cyclictest0-21swapper/712:10:147
12952991410,0cyclictest0-21swapper/712:07:177
12952991410,0cyclictest0-21swapper/710:59:147
12952991410,0cyclictest0-21swapper/710:21:367
12952991410,0cyclictest0-21swapper/710:05:217
12952991410,0cyclictest0-21swapper/709:30:097
12952991410,0cyclictest0-21swapper/709:25:567
12952991410,0cyclictest0-21swapper/708:56:117
1295299140,0cyclictest0-21swapper/708:40:127
12951991414,0cyclictest0-21swapper/610:43:186
12951991414,0cyclictest0-21swapper/609:56:446
12951991413,1cyclictest10749-21ls08:00:176
12951991412,2cyclictest32667-21sh11:28:136
12951991412,2cyclictest29096-21kworker/u16:210:25:196
12951991410,4cyclictest0-21swapper/610:16:536
12951991410,0cyclictest0-21swapper/612:15:216
12951991410,0cyclictest0-21swapper/611:39:376
12951991410,0cyclictest0-21swapper/610:24:056
12951991410,0cyclictest0-21swapper/609:44:256
12951991410,0cyclictest0-21swapper/609:35:506
12951991410,0cyclictest0-21swapper/609:31:526
12951991410,0cyclictest0-21swapper/609:15:166
12951991410,0cyclictest0-21swapper/608:25:156
12951991410,0cyclictest0-21swapper/608:20:126
12950991414,0cyclictest0-21swapper/512:15:265
12950991413,0cyclictest15859-21ls09:40:215
12950991411,1cyclictest662-21ptp4l10:49:415
12950991411,1cyclictest17316-21kworker/u16:109:53:595
12950991410,4cyclictest0-21swapper/511:40:155
12950991410,4cyclictest0-21swapper/510:55:405
12950991410,4cyclictest0-21swapper/510:09:565
12950991410,2cyclictest0-21swapper/511:38:115
12950991410,1cyclictest0-21swapper/510:16:155
12950991410,0cyclictest0-21swapper/512:37:415
12950991410,0cyclictest0-21swapper/512:25:345
12950991410,0cyclictest0-21swapper/511:50:155
12950991410,0cyclictest0-21swapper/511:01:075
12950991410,0cyclictest0-21swapper/509:10:255
12950991410,0cyclictest0-21swapper/509:10:255
12950991410,0cyclictest0-21swapper/507:20:415
12950991410,0cyclictest0-21swapper/507:10:015
12948991414,0cyclictest0-21swapper/309:23:233
12948991413,1cyclictest662-21ptp4l12:31:073
12948991413,0cyclictest9647-21ls10:10:153
12948991412,2cyclictest651-21nscd11:11:593
12948991412,2cyclictest401ktimersoftd/311:17:403
12948991412,1cyclictest16820-21diskmemload10:54:573
12948991410,4cyclictest0-21swapper/311:40:213
12948991410,4cyclictest0-21swapper/310:45:233
12948991410,3cyclictest0-21swapper/311:02:393
12948991410,0cyclictest17316-21kworker/u16:109:37:203
12948991410,0cyclictest0-21swapper/312:36:403
12948991410,0cyclictest0-21swapper/312:17:003
12948991410,0cyclictest0-21swapper/312:11:203
12948991410,0cyclictest0-21swapper/311:59:253
12948991410,0cyclictest0-21swapper/310:32:373
12947991414,0cyclictest22183-1kworker/u17:210:20:212
12947991414,0cyclictest16750irq/126-ahci[0010:10:002
12947991414,0cyclictest0-21swapper/210:02:502
12947991412,1cyclictest16820-21diskmemload09:23:052
12947991410,4cyclictest0-21swapper/212:06:282
12947991410,4cyclictest0-21swapper/211:38:202
12947991410,4cyclictest0-21swapper/211:20:382
12947991410,4cyclictest0-21swapper/210:31:362
12947991410,4cyclictest0-21swapper/209:32:432
12947991410,3cyclictest0-21swapper/212:25:332
12947991410,3cyclictest0-21swapper/210:58:292
12947991410,0cyclictest0-21swapper/212:02:552
12947991410,0cyclictest0-21swapper/211:15:512
12947991410,0cyclictest0-21swapper/210:50:172
12947991410,0cyclictest0-21swapper/210:25:022
12947991410,0cyclictest0-21swapper/209:45:462
12947991410,0cyclictest0-21swapper/209:45:462
12947991410,0cyclictest0-21swapper/209:06:212
12947991410,0cyclictest0-21swapper/207:39:512
12946991414,0cyclictest0-21swapper/110:08:091
12946991412,1cyclictest16820-21diskmemload09:45:131
12946991412,1cyclictest16820-21diskmemload09:45:131
12946991410,4cyclictest0-21swapper/111:06:531
12946991410,4cyclictest0-21swapper/110:38:261
12946991410,3cyclictest0-21swapper/111:20:051
12946991410,2cyclictest0-21swapper/110:30:301
12946991410,0cyclictest0-21swapper/112:30:131
12946991410,0cyclictest0-21swapper/112:04:411
12946991410,0cyclictest0-21swapper/111:10:191
12946991410,0cyclictest0-21swapper/110:50:171
12946991410,0cyclictest0-21swapper/110:28:461
12946991410,0cyclictest0-21swapper/110:24:391
12946991410,0cyclictest0-21swapper/109:50:161
12946991410,0cyclictest0-21swapper/109:40:121
12946991410,0cyclictest0-21swapper/109:35:191
12946991410,0cyclictest0-21swapper/109:30:171
12946991410,0cyclictest0-21swapper/109:15:181
12946991410,0cyclictest0-21swapper/108:30:241
12946991410,0cyclictest0-21swapper/107:15:141
12945991410,4cyclictest0-21swapper/010:50:540
12945991410,4cyclictest0-21swapper/008:25:150
12945991410,2cyclictest0-21swapper/010:15:020
12945991410,2cyclictest0-21swapper/009:27:300
12945991410,0cyclictest0-21swapper/012:00:110
12945991410,0cyclictest0-21swapper/011:25:520
12945991410,0cyclictest0-21swapper/011:21:240
12945991410,0cyclictest0-21swapper/010:58:120
12945991410,0cyclictest0-21swapper/010:35:510
12945991410,0cyclictest0-21swapper/010:09:030
12945991410,0cyclictest0-21swapper/009:49:580
12945991410,0cyclictest0-21swapper/009:49:580
12945991410,0cyclictest0-21swapper/007:40:030
12945991410,0cyclictest0-21swapper/007:40:020
258921310,0sleep60-21swapper/612:01:166
12952991312,1cyclictest721ktimersoftd/710:10:187
12952991312,1cyclictest16820-21diskmemload09:53:317
12952991312,1cyclictest12802-21smartctl09:00:207
12952991312,1cyclictest10364-21sh11:15:477
12952991311,1cyclictest662-21ptp4l08:00:277
12952991311,1cyclictest3100-21ssh09:35:117
12952991310,3cyclictest0-21swapper/709:20:127
12952991310,3cyclictest0-21swapper/708:45:587
12952991310,3cyclictest0-21swapper/708:35:137
12952991310,3cyclictest0-21swapper/708:25:237
12952991310,3cyclictest0-21swapper/707:45:107
12952991310,0cyclictest0-21swapper/710:45:537
12952991310,0cyclictest0-21swapper/710:15:227
12952991310,0cyclictest0-21swapper/709:16:097
12952991310,0cyclictest0-21swapper/709:05:137
12952991310,0cyclictest0-21swapper/708:20:177
12952991310,0cyclictest0-21swapper/707:55:137
12951991313,0cyclictest0-21swapper/609:09:516
12951991312,1cyclictest3052-1kworker/u17:110:30:306
12951991312,1cyclictest16820-21diskmemload11:07:306
12951991311,1cyclictest16820-21diskmemload10:45:096
12951991311,1cyclictest16820-21diskmemload10:37:526
12951991310,3cyclictest0-21swapper/608:49:106
12951991310,3cyclictest0-21swapper/608:40:166
12951991310,3cyclictest0-21swapper/608:32:596
12951991310,2cyclictest0-21swapper/610:00:236
12951991310,2cyclictest0-21swapper/607:10:096
12951991310,0cyclictest0-21swapper/612:06:386
12951991310,0cyclictest0-21swapper/611:58:286
12951991310,0cyclictest0-21swapper/611:53:336
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional