You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sat Jul 27, 2024 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223542210155,44sleep10-21swapper/119:07:351
225192203161,28sleep20-21swapper/219:09:442
224062202164,25sleep30-21swapper/319:08:173
222642199161,25sleep00-21swapper/019:06:240
296632620,0sleep2271rcuc/220:30:132
243852610,0sleep00-21swapper/023:40:160
232162170,0sleep20-21swapper/222:05:292
2263199150,14cyclictest5369-21ntp_states21:40:192
2263199150,14cyclictest30512-21irqstats00:35:152
2263199150,14cyclictest0-21swapper/200:25:132
2263199140,13cyclictest30382-21perf19:25:012
2263199140,13cyclictest12903-21users21:50:272
2263199140,13cyclictest0-21swapper/223:26:202
2263199140,13cyclictest0-21swapper/223:00:242
2263199140,0cyclictest25377-21munin-node19:15:002
2263199134,8cyclictest15452-21diskmemload21:25:332
2263199130,12cyclictest4881-21aten_r1power_en00:00:112
2263199130,12cyclictest0-21swapper/220:10:142
2263199130,12cyclictest0-21swapper/200:00:002
2263199130,1cyclictest0-21swapper/222:55:172
2263199130,0cyclictest15452-21diskmemload22:30:132
2263199130,0cyclictest0-21swapper/223:05:212
2263199130,0cyclictest0-21swapper/222:22:092
2263199130,0cyclictest0-21swapper/200:05:162
181392130,0sleep10-21swapper/123:31:201
2263199121,10cyclictest15452-21diskmemload22:25:132
2263199121,10cyclictest15452-21diskmemload21:45:542
2263199120,12cyclictest0-21swapper/221:33:552
2263199120,11cyclictest0-21swapper/223:24:482
2263199120,11cyclictest0-21swapper/221:23:252
2263199120,1cyclictest61250irq/122-eno123:17:122
2263199120,1cyclictest0-21swapper/221:57:472
2263199120,1cyclictest0-21swapper/221:35:032
2263199120,0cyclictest15452-21diskmemload23:40:092
2263199120,0cyclictest15452-21diskmemload22:48:092
2263199120,0cyclictest15452-21diskmemload22:35:302
2263199120,0cyclictest0-21swapper/223:50:122
2263199120,0cyclictest0-21swapper/222:00:232
2263199120,0cyclictest0-21swapper/221:15:192
2263199120,0cyclictest0-21swapper/220:50:192
2263199120,0cyclictest0-21swapper/220:05:112
2263199112,8cyclictest15452-21diskmemload00:20:222
2263199111,9cyclictest306192sleep222:16:182
2263199111,9cyclictest0-21swapper/221:10:102
2263199111,10cyclictest0-21swapper/200:30:092
2263199110,11cyclictest0-21swapper/223:35:102
2263199110,10cyclictest0-21swapper/223:45:182
2263199110,10cyclictest0-21swapper/222:11:242
2263199110,1cyclictest0-21swapper/223:30:092
2263199110,0cyclictest15452-21diskmemload00:10:192
2263199110,0cyclictest0-21swapper/223:14:512
2263199110,0cyclictest0-21swapper/222:40:582
2263199110,0cyclictest0-21swapper/219:55:152
2263199110,0cyclictest0-21swapper/200:19:082
2262499113,4cyclictest21949-21cat20:14:590
2263199101,8cyclictest0-21swapper/219:25:222
2263199100,9cyclictest0-21swapper/222:50:252
2263199100,0cyclictest0-21swapper/220:45:132
2262499109,1cyclictest9-21ksoftirqd/000:35:110
130142100,0sleep10-21swapper/122:39:231
30605290,0sleep10-21swapper/100:35:181
226329992,4cyclictest15452-21diskmemload21:46:403
226319990,9cyclictest0-21swapper/219:45:212
226319990,8cyclictest0-21swapper/220:40:242
226319990,0cyclictest0-21swapper/220:15:182
226249997,1cyclictest9-21ksoftirqd/021:45:110
226249990,6cyclictest0-21swapper/000:10:230
31699286,1sleep09-21ksoftirqd/019:25:170
226329986,1cyclictest19745-21snmpd20:41:343
226329986,1cyclictest19745-21snmpd19:28:593
226329983,3cyclictest0-21swapper/322:37:433
226329982,5cyclictest25144-21ntp_states22:55:233
226329982,2cyclictest15705-21apt-get21:10:103
226329981,4cyclictest35-21ksoftirqd/322:25:203
226329981,3cyclictest0-21swapper/323:28:553
226329980,3cyclictest0-21swapper/320:55:113
226319981,6cyclictest3291-21apt-get19:35:112
226319980,8cyclictest0-21swapper/220:35:152
226319980,7cyclictest9178-21fschecks_count20:55:152
226319980,7cyclictest1817-21grep19:30:172
226319980,6cyclictest259-21systemd-journal20:05:002
226319980,5cyclictest259-21systemd-journal21:09:592
226319980,5cyclictest259-21systemd-journal19:44:592
226319980,1cyclictest0-21swapper/220:25:212
226319980,0cyclictest0-21swapper/219:10:112
226289980,7cyclictest0-21swapper/121:40:001
226289980,5cyclictest0-21swapper/121:00:121
226249987,1cyclictest9-21ksoftirqd/022:55:150
226249987,1cyclictest9-21ksoftirqd/021:10:140
226249987,1cyclictest9-21ksoftirqd/000:25:140
226249987,1cyclictest9-21ksoftirqd/000:15:150
226249986,2cyclictest2760-21sendmail_mailtr23:55:230
226249986,1cyclictest9-21ksoftirqd/023:33:320
226249984,1cyclictest534-21nscd23:37:390
226249981,6cyclictest5322-21ssh21:40:180
226249981,1cyclictest28365-21ssh00:32:030
226249980,8cyclictest32468-21kworker/0:121:15:230
226249980,7cyclictest28833-21ssh23:46:120
226249980,7cyclictest21964-21ssh00:24:440
226249980,7cyclictest15452-21diskmemload23:16:310
226249980,7cyclictest15452-21diskmemload00:05:580
226249980,7cyclictest10911-21ssh23:21:050
226249980,1cyclictest4998-21head19:35:250
226249980,1cyclictest32120-21ssh23:50:340
11150280,0sleep30-21swapper/300:08:483
226329977,0cyclictest0-21swapper/323:06:313
226329976,1cyclictest31591-21/usr/sbin/munin20:35:183
226329976,1cyclictest29127-21cat19:20:153
226329976,1cyclictest19745-21snmpd22:30:573
226329975,1cyclictest21154-21ssh23:35:213
226329975,1cyclictest19745-21snmpd23:18:593
226329975,1cyclictest19745-21snmpd21:26:593
226329975,1cyclictest19745-21snmpd21:22:013
226329975,1cyclictest19745-21snmpd21:15:143
226329975,1cyclictest19745-21snmpd20:06:393
226329973,2cyclictest259-21systemd-journal22:44:593
226329972,1cyclictest259-21systemd-journal19:44:593
226329971,4cyclictest15452-21diskmemload00:30:153
226329970,5cyclictest0-21swapper/323:48:223
226329970,4cyclictest0-21swapper/300:37:513
226329970,4cyclictest0-21swapper/300:23:013
226329970,2cyclictest0-21swapper/323:58:363
226329970,2cyclictest0-21swapper/322:20:083
226319970,6cyclictest24545-21aten_r1power_cu20:20:112
226319970,6cyclictest11081-21aten_r1power_po21:00:142
226319970,6cyclictest10406-21aten_r1power_en19:50:092
226289975,1cyclictest0-21swapper/119:20:011
226289971,1cyclictest0-21swapper/100:01:311
226289970,6cyclictest196-21jbd2/sda2-822:30:191
226289970,6cyclictest0-21swapper/122:20:141
226289970,6cyclictest0-21swapper/121:15:181
226289970,4cyclictest0-21swapper/123:37:391
226289970,4cyclictest0-21swapper/119:20:111
226289970,1cyclictest0-21swapper/123:12:221
226289970,1cyclictest0-21swapper/121:31:471
226289970,1cyclictest0-21swapper/119:56:441
226249977,0cyclictest9-21ksoftirqd/023:28:180
226249977,0cyclictest9-21ksoftirqd/020:05:150
226249977,0cyclictest0-21swapper/023:03:270
226249976,1cyclictest9-21ksoftirqd/020:24:590
226249976,1cyclictest9-21ksoftirqd/000:00:160
226249976,1cyclictest19745-21snmpd20:49:540
226249976,1cyclictest19745-21snmpd19:18:320
226249975,1cyclictest32402-21ssh22:20:130
226249975,1cyclictest19745-21snmpd19:57:300
226249971,5cyclictest14038-21ssh22:40:130
226249970,7cyclictest10110-21telnet22:35:130
226249970,7cyclictest0-21swapper/022:10:120
226249970,6cyclictest7661-21ssh22:30:180
226249970,6cyclictest3658-21ssh21:39:210
226249970,6cyclictest29366-21hddtemp_smartct22:15:150
226249970,6cyclictest227302sleep021:20:010
226249970,6cyclictest18168-21ssh22:00:120
226249970,6cyclictest16944-21ssh22:45:010
226249970,6cyclictest16556-21ssh21:55:570
226249970,6cyclictest15452-21diskmemload23:10:160
226249970,6cyclictest15452-21diskmemload22:05:020
226249970,6cyclictest0-21swapper/022:25:200
226249970,6cyclictest0-21swapper/020:35:100
226249970,3cyclictest0-21swapper/019:10:110
226249970,2cyclictest15452-21diskmemload21:30:280
226249970,1cyclictest5664-21apt-get19:40:110
226249970,1cyclictest32677-21ssh23:05:250
226249970,1cyclictest26765-21ssh21:25:200
226249970,1cyclictest0-21swapper/021:05:130
226249970,1cyclictest0-21swapper/019:45:140
226329965,1cyclictest672-21ssh23:53:473
226329965,1cyclictest6408-21ssh21:41:533
226329965,1cyclictest6029-21ntpq00:00:203
226329965,1cyclictest4029-21ssh23:11:233
226329965,1cyclictest19745-21snmpd21:52:153
226329965,1cyclictest19745-21snmpd21:01:013
226329965,1cyclictest19745-21snmpd19:50:383
226329965,1cyclictest19745-21snmpd19:13:223
226329965,1cyclictest19745-21snmpd00:14:423
226329965,1cyclictest18394-21ssh23:32:093
226329965,1cyclictest15929-21ssh00:15:133
226329965,0cyclictest15452-21diskmemload21:56:333
226329964,1cyclictest27297-21ssh22:11:503
226329964,1cyclictest19916-21ssh22:00:303
226329964,1cyclictest19745-21snmpd20:21:303
226329963,2cyclictest15452-21diskmemload22:05:563
226329963,1cyclictest15452-21diskmemload23:20:113
226329962,3cyclictest15452-21diskmemload00:25:093
226329962,2cyclictest15452-21diskmemload22:45:233
226329961,3cyclictest1900-21/usr/sbin/munin21:35:203
226329960,3cyclictest0-21swapper/323:40:343
226329960,3cyclictest0-21swapper/322:51:513
226329960,3cyclictest0-21swapper/322:15:083
226329960,3cyclictest0-21swapper/320:00:103
226329960,1cyclictest0-21swapper/321:30:573
226289965,1cyclictest0-21swapper/122:41:001
226289961,3cyclictest0-21swapper/122:04:071
226289961,3cyclictest0-21swapper/121:40:101
226289961,3cyclictest0-21swapper/100:25:021
226289961,2cyclictest0-21swapper/123:25:201
226289960,6cyclictest0-21swapper/123:47:591
226289960,6cyclictest0-21swapper/121:56:181
226289960,6cyclictest0-21swapper/121:45:121
226289960,6cyclictest0-21swapper/120:46:571
226289960,6cyclictest0-21swapper/120:20:211
226289960,6cyclictest0-21swapper/119:49:201
226289960,6cyclictest0-21swapper/119:37:071
226289960,6cyclictest0-21swapper/119:30:561
226289960,6cyclictest0-21swapper/100:05:201
226289960,5cyclictest0-21swapper/120:40:161
226289960,5cyclictest0-21swapper/120:33:491
226289960,5cyclictest0-21swapper/100:30:151
226289960,4cyclictest0-21swapper/123:53:511
226289960,4cyclictest0-21swapper/121:52:451
226289960,4cyclictest0-21swapper/121:25:361
226289960,3cyclictest0-21swapper/123:55:121
226289960,3cyclictest0-21swapper/123:05:111
226289960,3cyclictest0-21swapper/122:15:091
226289960,3cyclictest0-21swapper/100:23:371
226289960,2cyclictest0-21swapper/122:06:351
226289960,2cyclictest0-21swapper/120:55:121
226289960,1cyclictest0-21swapper/122:51:541
226249965,1cyclictest9-21ksoftirqd/020:55:140
226249965,1cyclictest11261-21cat19:50:150
226249964,1cyclictest9-21ksoftirqd/020:15:140
226249962,1cyclictest11109-21apt-get21:50:120
226249961,3cyclictest20738-21cpuspeed_turbos22:50:110
226249960,4cyclictest259-21systemd-journal19:24:550
226249960,0cyclictest0-21swapper/020:54:510
23279250,0sleep10-21swapper/123:40:101
226329954,1cyclictest29328-21ssh23:00:483
226329954,1cyclictest27028-21ntpq19:15:193
226329954,1cyclictest19745-21snmpd20:10:453
226329953,1cyclictest14092-21sed21:05:163
226329950,5cyclictest0-21swapper/320:53:473
226329950,5cyclictest0-21swapper/320:34:043
226289955,0cyclictest0-21swapper/122:47:261
226289953,1cyclictest398-21chrt19:29:211
226289952,1cyclictest0-21swapper/119:15:001
226289951,2cyclictest0-21swapper/121:20:011
226289950,5cyclictest0-21swapper/120:53:161
226289950,5cyclictest0-21swapper/100:10:221
226289950,4cyclictest0-21swapper/123:01:501
226289950,4cyclictest0-21swapper/119:40:121
226289950,3cyclictest0-21swapper/123:15:391
226289950,3cyclictest0-21swapper/122:57:331
226289950,2cyclictest0-21swapper/122:26:371
226289950,2cyclictest0-21swapper/120:25:091
226289950,2cyclictest0-21swapper/120:10:111
226289950,2cyclictest0-21swapper/100:18:411
226249955,0cyclictest0-21swapper/020:25:220
226249954,1cyclictest9-21ksoftirqd/020:00:130
226249953,1cyclictest1544-21apt20:40:120
226249950,5cyclictest0-21swapper/021:00:190
226249950,5cyclictest0-21swapper/020:30:130
226249950,5cyclictest0-21swapper/019:30:080
18143250,0sleep10-21swapper/121:12:421
226329943,1cyclictest9393-21sendmail_mailtr19:45:213
226329943,1cyclictest4542-21cut20:45:133
226329943,1cyclictest22962-21expr20:15:143
226329942,1cyclictest26969-21aten_r1power_fr20:25:103
226329940,2cyclictest259-21systemd-journal19:35:003
226329940,2cyclictest0-21swapper/319:30:113
226329940,0cyclictest0-21swapper/319:55:483
226289944,0cyclictest0-21swapper/120:15:361
226289940,4cyclictest0-21swapper/120:36:421
226289940,3cyclictest0-21swapper/122:10:081
226289940,2cyclictest0-21swapper/123:20:471
226289940,2cyclictest0-21swapper/119:50:211
226289940,1cyclictest0-21swapper/121:05:121
226289931,1cyclictest0-21swapper/120:05:201
226289930,3cyclictest0-21swapper/120:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional