You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-14 - 23:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Wed May 14, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173952208170,25sleep20-21swapper/207:08:552
174782203148,42sleep10-21swapper/107:09:581
172272199160,25sleep30-21swapper/307:06:423
172072197157,26sleep00-21swapper/007:06:280
7432650,0sleep30-21swapper/310:18:193
34492580,0sleep20-21swapper/211:02:562
17578992214,7cyclictest28-21ksoftirqd/209:35:132
179472200,0sleep00-21swapper/007:10:130
129892190,0sleep10-21swapper/108:05:171
269082170,1sleep010573-21diskmemload11:35:140
17565991616,0cyclictest9-21ksoftirqd/010:34:090
143772160,0sleep30-21swapper/311:19:543
1756599159,1cyclictest9-21ksoftirqd/010:48:100
17565991515,0cyclictest9-21ksoftirqd/009:28:360
17565991515,0cyclictest9-21ksoftirqd/009:15:060
17565991514,1cyclictest9-21ksoftirqd/009:47:570
17565991414,0cyclictest9-21ksoftirqd/012:02:180
17565991414,0cyclictest9-21ksoftirqd/011:34:580
17565991414,0cyclictest9-21ksoftirqd/011:18:210
17565991414,0cyclictest9-21ksoftirqd/011:05:020
17565991414,0cyclictest9-21ksoftirqd/011:00:590
17565991414,0cyclictest9-21ksoftirqd/010:42:520
1756599139,4cyclictest9-21ksoftirqd/009:32:320
1756599134,6cyclictest9-21ksoftirqd/011:55:560
17565991313,0cyclictest9-21ksoftirqd/012:27:120
17565991313,0cyclictest9-21ksoftirqd/012:18:220
17565991313,0cyclictest9-21ksoftirqd/012:10:050
17565991313,0cyclictest9-21ksoftirqd/011:53:030
17565991313,0cyclictest9-21ksoftirqd/011:40:160
17565991313,0cyclictest9-21ksoftirqd/010:02:230
17565991313,0cyclictest9-21ksoftirqd/009:50:410
17565991313,0cyclictest9-21ksoftirqd/009:43:050
17565991313,0cyclictest9-21ksoftirqd/009:39:000
17565991313,0cyclictest9-21ksoftirqd/009:24:460
17565991313,0cyclictest9-21ksoftirqd/009:10:430
17565991310,0cyclictest9-21ksoftirqd/012:08:350
115622130,0sleep30-21swapper/312:39:223
1757899124,8cyclictest28-21ksoftirqd/208:15:172
17578991211,1cyclictest28-21ksoftirqd/212:15:152
17578991211,1cyclictest28-21ksoftirqd/211:30:002
1756599128,4cyclictest9-21ksoftirqd/012:21:550
1756599127,1cyclictest9-21ksoftirqd/010:58:560
1756599124,7cyclictest9-21ksoftirqd/011:45:560
17565991212,0cyclictest9-21ksoftirqd/012:35:160
17565991212,0cyclictest9-21ksoftirqd/011:13:260
17565991212,0cyclictest9-21ksoftirqd/010:24:270
17565991211,1cyclictest9-21ksoftirqd/012:31:510
17565991211,1cyclictest9-21ksoftirqd/011:20:200
17565991211,1cyclictest9-21ksoftirqd/008:30:130
17565991210,1cyclictest9-21ksoftirqd/008:09:590
1756599120,12cyclictest0-21swapper/007:40:000
17578991110,1cyclictest28-21ksoftirqd/211:35:132
17578991110,1cyclictest28-21ksoftirqd/210:40:002
17578991110,1cyclictest28-21ksoftirqd/208:35:002
1757899110,0cyclictest0-21swapper/212:12:042
1757899110,0cyclictest0-21swapper/212:06:442
1756599117,3cyclictest9-21ksoftirqd/010:13:230
1756599116,4cyclictest10573-21diskmemload10:15:270
17565991111,0cyclictest9-21ksoftirqd/011:25:180
17565991111,0cyclictest9-21ksoftirqd/009:55:200
17565991110,1cyclictest9-21ksoftirqd/010:52:300
17565991110,1cyclictest9-21ksoftirqd/010:26:010
17565991110,1cyclictest9-21ksoftirqd/008:00:120
17565991110,1cyclictest9-21ksoftirqd/007:50:020
191752100,1sleep319174-21sed12:05:203
1757899109,1cyclictest28-21ksoftirqd/212:04:592
1757899109,1cyclictest28-21ksoftirqd/210:10:162
1757899109,1cyclictest28-21ksoftirqd/209:15:152
1757899109,1cyclictest28-21ksoftirqd/207:54:592
1757899109,1cyclictest28-21ksoftirqd/207:35:012
1757899109,1cyclictest28-21ksoftirqd/207:25:012
1757899108,1cyclictest28-21ksoftirqd/212:30:122
1757899108,1cyclictest28-21ksoftirqd/212:20:152
1757899108,1cyclictest28-21ksoftirqd/210:25:012
1757899108,1cyclictest28-21ksoftirqd/208:24:592
17578991010,0cyclictest0-21swapper/210:16:562
1757899100,10cyclictest0-21swapper/210:50:542
1756599109,1cyclictest9-21ksoftirqd/009:00:120
1756599102,8cyclictest9-21ksoftirqd/007:15:150
17565991010,0cyclictest9-21ksoftirqd/010:35:160
17565991010,0cyclictest9-21ksoftirqd/010:05:130
1756599101,4cyclictest27707-21perf07:30:010
175869998,1cyclictest35-21ksoftirqd/308:35:013
175869994,2cyclictest18652-21apt-get11:25:123
175869990,2cyclictest30835-21/usr/sbin/munin10:55:223
175789998,1cyclictest28-21ksoftirqd/212:00:012
175789998,1cyclictest28-21ksoftirqd/208:05:002
175789998,1cyclictest271rcuc/209:10:002
175789997,1cyclictest28-21ksoftirqd/212:25:002
175789997,1cyclictest28-21ksoftirqd/209:35:012
175789997,1cyclictest28-21ksoftirqd/207:45:012
175659999,0cyclictest9-21ksoftirqd/008:35:190
175659998,1cyclictest9-21ksoftirqd/008:40:120
175659997,1cyclictest1935-21cut08:50:150
175659997,1cyclictest0-21swapper/007:30:150
175659991,8cyclictest101rcuc/007:24:500
175659991,1cyclictest7655-21apt07:55:130
175659991,0cyclictest101rcuc/008:48:090
175869987,1cyclictest35-21ksoftirqd/312:05:003
175869987,1cyclictest35-21ksoftirqd/311:40:013
175869987,1cyclictest35-21ksoftirqd/307:25:003
175869980,5cyclictest24185-21ssh11:30:233
175869980,4cyclictest0-21swapper/310:43:283
175869980,4cyclictest0-21swapper/308:40:123
175869980,3cyclictest10573-21diskmemload09:47:273
175789988,0cyclictest28-21ksoftirqd/210:30:122
175789988,0cyclictest28-21ksoftirqd/210:00:212
175789987,1cyclictest28-21ksoftirqd/211:20:132
175789987,1cyclictest28-21ksoftirqd/211:10:212
175789987,1cyclictest28-21ksoftirqd/211:00:002
175789987,1cyclictest28-21ksoftirqd/210:45:502
175789987,1cyclictest28-21ksoftirqd/210:40:142
175789987,1cyclictest28-21ksoftirqd/209:55:212
175789987,1cyclictest28-21ksoftirqd/209:40:172
175789987,1cyclictest28-21ksoftirqd/209:10:122
175789987,1cyclictest28-21ksoftirqd/208:25:152
175789987,1cyclictest28-21ksoftirqd/207:55:162
175789987,1cyclictest0-21swapper/211:19:442
175789986,1cyclictest60950irq/123-eno111:52:422
175789986,1cyclictest60950irq/123-eno109:50:132
175789986,1cyclictest60950irq/123-eno109:20:222
175789986,1cyclictest28-21ksoftirqd/207:14:592
175699980,4cyclictest0-21swapper/107:35:151
175659988,0cyclictest9-21ksoftirqd/007:45:130
175659987,1cyclictest9-21ksoftirqd/009:05:140
175659980,8cyclictest9-21ksoftirqd/008:55:060
175659980,8cyclictest9-21ksoftirqd/008:25:060
175659980,8cyclictest9-21ksoftirqd/008:20:170
175659980,8cyclictest9-21ksoftirqd/008:17:060
175659980,8cyclictest9-21ksoftirqd/008:10:060
175659980,8cyclictest9-21ksoftirqd/007:35:260
175869977,0cyclictest10573-21diskmemload11:40:293
175869976,1cyclictest23210-21apt-get09:25:133
175869975,1cyclictest35-21ksoftirqd/309:05:003
175869975,1cyclictest1449-21ntpd08:05:023
175869971,3cyclictest13413-21apt-get10:35:123
175869971,2cyclictest0-21swapper/311:59:073
175869970,6cyclictest10573-21diskmemload09:16:153
175869970,5cyclictest1148-21basename08:50:013
175869970,4cyclictest0-21swapper/310:10:153
175789977,0cyclictest28-21ksoftirqd/209:29:112
175789977,0cyclictest28-21ksoftirqd/208:55:222
175789976,1cyclictest60950irq/123-eno110:25:142
175789976,1cyclictest28-21ksoftirqd/211:30:152
175789976,1cyclictest28-21ksoftirqd/208:50:172
175789976,1cyclictest28-21ksoftirqd/208:09:592
175789976,1cyclictest28-21ksoftirqd/207:30:002
175789976,0cyclictest60950irq/123-eno112:36:522
175789976,0cyclictest60950irq/123-eno109:46:232
175789975,1cyclictest28-21ksoftirqd/208:40:012
175789975,1cyclictest28-21ksoftirqd/207:15:012
175789970,3cyclictest0-21swapper/207:45:142
175699976,1cyclictest0-21swapper/109:10:161
175699971,4cyclictest0-21swapper/108:35:171
175699970,5cyclictest0-21swapper/108:25:171
175699970,4cyclictest0-21swapper/112:05:001
175699970,3cyclictest0-21swapper/112:05:141
175699970,3cyclictest0-21swapper/110:30:121
175699970,2cyclictest0-21swapper/109:20:201
175869966,0cyclictest1449-21ntpd08:35:013
175869965,1cyclictest5391-21ssh09:41:443
175869965,1cyclictest4391-21ssh12:30:063
175869965,1cyclictest3900-21ssh11:45:383
175869965,1cyclictest29461-21ssh09:31:123
175869965,1cyclictest2732-21ssh11:01:023
175869965,1cyclictest24009-21ssh12:12:293
175869965,1cyclictest22867-21ssh09:24:583
175869965,1cyclictest21375-21ssh10:45:043
175869965,1cyclictest20406-21ssh10:00:263
175869965,1cyclictest1897-21ssh10:20:133
175869965,1cyclictest16549-21ssh11:20:243
175869965,1cyclictest1449-21ntpd07:10:023
175869964,1cyclictest1583-21missed_timers12:25:143
175869963,1cyclictest254-21systemd-journal08:53:573
175869962,2cyclictest254-21systemd-journal08:20:003
175869961,4cyclictest10573-21diskmemload09:55:123
175869961,1cyclictest10573-21diskmemload11:51:203
175869960,3cyclictest0-21swapper/312:20:013
175869960,3cyclictest0-21swapper/309:35:143
175869960,2cyclictest0-21swapper/311:10:183
175869960,2cyclictest0-21swapper/311:05:493
175869960,2cyclictest0-21swapper/310:05:563
175869960,1cyclictest0-21swapper/312:15:123
175869960,1cyclictest0-21swapper/309:10:133
175789966,0cyclictest60950irq/123-eno109:00:212
175789966,0cyclictest60950irq/123-eno108:10:162
175789966,0cyclictest60950irq/123-eno107:35:162
175789966,0cyclictest28-21ksoftirqd/211:40:212
175789965,1cyclictest28-21ksoftirqd/211:05:512
175789964,1cyclictest28-21ksoftirqd/208:45:142
175789964,1cyclictest28-21ksoftirqd/208:35:152
175789963,2cyclictest0-21swapper/211:45:132
175789961,3cyclictest0-21swapper/210:05:102
175699966,0cyclictest0-21swapper/110:51:341
175699961,3cyclictest0-21swapper/110:45:141
175699961,3cyclictest0-21swapper/108:30:211
175699961,2cyclictest0-21swapper/112:38:241
175699960,6cyclictest0-21swapper/111:35:081
175699960,6cyclictest0-21swapper/111:18:221
175699960,6cyclictest0-21swapper/108:00:161
175699960,5cyclictest0-21swapper/111:25:171
175699960,3cyclictest0-21swapper/112:30:141
175699960,3cyclictest0-21swapper/111:09:051
175699960,3cyclictest0-21swapper/110:55:161
175699960,3cyclictest0-21swapper/110:39:031
175699960,3cyclictest0-21swapper/110:09:491
175699960,3cyclictest0-21swapper/109:56:061
175699960,3cyclictest0-21swapper/109:26:431
175699960,2cyclictest0-21swapper/112:15:211
175699960,2cyclictest0-21swapper/111:54:021
175699960,2cyclictest0-21swapper/111:46:301
175699960,2cyclictest0-21swapper/111:40:251
175699960,2cyclictest0-21swapper/111:30:161
175699960,2cyclictest0-21swapper/111:14:481
175699960,2cyclictest0-21swapper/111:04:081
175699960,2cyclictest0-21swapper/110:25:511
175699960,2cyclictest0-21swapper/110:16:261
175699960,2cyclictest0-21swapper/110:01:181
175699960,2cyclictest0-21swapper/109:45:141
175699960,2cyclictest0-21swapper/109:40:441
175699960,2cyclictest0-21swapper/109:35:161
175699960,2cyclictest0-21swapper/108:20:131
175699960,1cyclictest0-21swapper/112:25:091
175699960,1cyclictest0-21swapper/110:13:261
175699960,0cyclictest0-21swapper/111:55:331
175869955,0cyclictest1449-21ntpd07:50:023
175869955,0cyclictest0-21swapper/310:50:093
175869954,1cyclictest9056-21sensors07:55:213
175869954,1cyclictest35-21ksoftirqd/308:12:433
175869954,0cyclictest10573-21diskmemload10:25:343
175869953,1cyclictest20815-21apt-get07:15:153
175869953,1cyclictest10573-21diskmemload09:50:203
175869951,3cyclictest22959-21ntpq08:25:173
175869951,1cyclictest8912-21cstates09:05:133
175869951,1cyclictest10573-21diskmemload10:30:223
175869950,1cyclictest30403-21cpu07:35:163
175869950,1cyclictest0-21swapper/307:25:183
175699951,1cyclictest0-21swapper/109:15:141
175699950,5cyclictest0-21swapper/112:20:161
175699950,5cyclictest0-21swapper/111:20:171
175699950,4cyclictest0-21swapper/109:51:331
175699950,4cyclictest0-21swapper/108:50:181
175699950,3cyclictest0-21swapper/108:00:001
175699950,2cyclictest0-21swapper/112:11:001
175699950,2cyclictest0-21swapper/108:45:201
175699950,2cyclictest0-21swapper/108:15:171
175699950,2cyclictest0-21swapper/107:45:141
175699950,1cyclictest0-21swapper/110:43:111
175699950,1cyclictest0-21swapper/110:20:141
175699950,1cyclictest0-21swapper/109:30:311
175869943,1cyclictest35-21ksoftirqd/308:21:573
175869943,1cyclictest28038-21cut07:30:153
175869943,1cyclictest15652sleep307:40:233
175869942,1cyclictest3997-21tr08:55:143
175869942,1cyclictest3409-21fschecks_time07:45:153
175869941,1cyclictest10104-21aten_r1power_fr08:00:133
175699940,4cyclictest7378-21chrt07:54:391
175699940,4cyclictest0-21swapper/107:25:261
175699940,2cyclictest0-21swapper/107:30:191
175699940,1cyclictest0-21swapper/107:10:121
175699940,0cyclictest0-21swapper/109:05:211
175699940,0cyclictest0-21swapper/107:15:011
175699931,1cyclictest0-21swapper/108:55:111
175699931,1cyclictest0-21swapper/108:11:271
175699931,1cyclictest0-21swapper/107:20:141
175699930,3cyclictest0-21swapper/109:00:131
175699930,3cyclictest0-21swapper/108:40:011
175699930,0cyclictest0-21swapper/107:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional