You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 09:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Fri Apr 26, 2024 00:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191882200160,26sleep00-21swapper/019:06:040
194912199161,25sleep10-21swapper/119:09:591
193662198158,26sleep20-21swapper/219:08:242
191762197158,25sleep30-21swapper/319:05:543
324712720,1sleep212655-21diskmemload21:35:212
24792610,0sleep30-21swapper/322:23:093
178942610,0sleep30-21swapper/323:28:323
6772190,0sleep10-21swapper/123:05:111
1957099157,5cyclictest0-21swapper/323:57:023
19570991412,2cyclictest14217-21apt-get20:05:123
19570991412,1cyclictest29853-21apt-get23:45:103
19570991312,1cyclictest12655-21diskmemload23:10:073
19570991310,2cyclictest27514-21sort19:25:003
1957099128,3cyclictest1129-21cut20:45:103
1957099123,6cyclictest737-21irqstats19:35:163
1957099123,6cyclictest22881-21grep22:05:243
1957099122,9cyclictest16081-21sh21:14:313
19570991211,1cyclictest31074-21ssh22:17:453
19570991211,1cyclictest0-21swapper/321:55:093
19570991211,1cyclictest0-21swapper/321:54:283
19570991211,1cyclictest0-21swapper/320:15:193
19570991211,1cyclictest0-21swapper/300:02:173
19570991210,2cyclictest16340-21ssh22:40:443
19570991210,1cyclictest19845-21/usr/sbin/munin00:15:103
19570991210,1cyclictest0-21swapper/320:10:133
19566991212,0cyclictest28-21ksoftirqd/221:26:502
1956499124,4cyclictest31852-21latency_hist22:20:000
19564991210,1cyclictest9-21ksoftirqd/020:55:000
1957099119,2cyclictest0-21swapper/322:33:043
1957099119,1cyclictest0-21swapper/323:01:533
1957099117,3cyclictest0-21swapper/323:38:503
1957099114,5cyclictest12655-21diskmemload00:05:133
1957099113,8cyclictest12655-21diskmemload23:16:043
1957099113,7cyclictest0-21swapper/300:35:203
1957099112,8cyclictest25722-21apt-get23:40:003
1957099112,1cyclictest11552-21runrttasks19:59:313
19570991111,0cyclictest0-21swapper/323:07:473
19570991111,0cyclictest0-21swapper/321:25:113
19570991110,1cyclictest25780-21ssh00:22:293
19570991110,1cyclictest20320-21ssh22:46:363
19570991110,1cyclictest12655-21diskmemload23:20:443
19570991110,1cyclictest12655-21diskmemload22:36:253
19570991110,1cyclictest12655-21diskmemload22:26:543
19570991110,1cyclictest0-21swapper/321:46:573
19570991110,1cyclictest0-21swapper/321:20:163
19570991110,1cyclictest0-21swapper/320:55:203
19570991110,1cyclictest0-21swapper/320:35:093
1957099111,7cyclictest12655-21diskmemload00:10:223
1956699119,1cyclictest28-21ksoftirqd/221:50:012
1956699119,1cyclictest18573-21/usr/sbin/munin22:00:212
19566991111,0cyclictest28-21ksoftirqd/222:55:222
19566991110,1cyclictest28-21ksoftirqd/200:03:362
1956699110,0cyclictest0-21swapper/200:14:492
1956499119,2cyclictest5488-21fschecks_time23:55:160
1956499113,4cyclictest9590-21perf21:50:020
98632100,1sleep10-21swapper/122:33:161
1957099109,1cyclictest0-21swapper/322:50:113
1957099109,1cyclictest0-21swapper/320:50:143
1957099108,2cyclictest0-21swapper/323:52:293
1957099107,2cyclictest12655-21diskmemload00:30:373
1957099104,4cyclictest0-21swapper/321:35:193
1957099104,3cyclictest3387-21ntp_states19:40:203
1957099103,7cyclictest0-21swapper/322:01:093
1957099102,4cyclictest28918-21mailstats19:25:253
1957099102,1cyclictest27514-21ssh21:30:073
1957099102,1cyclictest16640-21ssh21:15:133
19570991010,0cyclictest0-21swapper/323:30:523
1956699109,1cyclictest28-21ksoftirqd/223:30:122
1956699109,1cyclictest28-21ksoftirqd/223:25:172
1956699109,1cyclictest28-21ksoftirqd/223:15:182
1956699109,1cyclictest28-21ksoftirqd/222:30:152
1956699109,1cyclictest28-21ksoftirqd/221:13:222
1956699109,1cyclictest28-21ksoftirqd/221:00:012
1956699108,1cyclictest28-21ksoftirqd/222:35:102
1956699108,1cyclictest28-21ksoftirqd/200:15:262
1956699104,3cyclictest61250irq/122-eno119:59:232
1956699100,9cyclictest0-21swapper/222:29:522
1956499109,1cyclictest9-21ksoftirqd/023:40:000
1956499109,1cyclictest9-21ksoftirqd/022:05:000
1956499109,1cyclictest9-21ksoftirqd/019:35:010
1956499101,4cyclictest19268-21perf00:14:590
1956499100,9cyclictest27161-21ssh00:25:110
1956499100,5cyclictest2029-21perf19:40:000
195709998,1cyclictest0-21swapper/322:55:213
195709998,1cyclictest0-21swapper/322:10:063
195709998,1cyclictest0-21swapper/321:40:293
195709998,1cyclictest0-21swapper/321:00:163
195709998,1cyclictest0-21swapper/320:25:093
195709998,1cyclictest0-21swapper/300:25:123
195669998,1cyclictest28-21ksoftirqd/223:20:152
195669998,1cyclictest28-21ksoftirqd/222:20:252
195669998,1cyclictest28-21ksoftirqd/222:10:012
195669998,1cyclictest28-21ksoftirqd/221:20:252
195669998,1cyclictest28-21ksoftirqd/220:45:002
195669998,1cyclictest28-21ksoftirqd/200:20:102
195669997,1cyclictest28-21ksoftirqd/223:56:492
195669997,1cyclictest28-21ksoftirqd/219:45:002
195669994,4cyclictest28-21ksoftirqd/220:20:192
195659990,6cyclictest0-21swapper/100:35:201
195649998,1cyclictest9-21ksoftirqd/021:25:130
195649993,5cyclictest22085-21perf23:35:010
195649993,5cyclictest1884-21munin-run00:35:000
195649992,6cyclictest4374-21latency_hist19:45:010
195649990,1cyclictest259-21systemd-journal21:15:000
195709987,1cyclictest0-21swapper/320:24:003
195709986,2cyclictest0-21swapper/319:14:563
195709986,1cyclictest31954-21hddtemp_smartct20:40:143
195709981,3cyclictest0-21swapper/320:30:143
195669988,0cyclictest28-21ksoftirqd/223:45:152
195669988,0cyclictest28-21ksoftirqd/223:35:142
195669988,0cyclictest28-21ksoftirqd/220:35:212
195669988,0cyclictest28-21ksoftirqd/200:35:212
195669987,1cyclictest28-21ksoftirqd/223:40:232
195669987,1cyclictest28-21ksoftirqd/223:10:162
195669987,1cyclictest28-21ksoftirqd/223:05:122
195669987,1cyclictest28-21ksoftirqd/223:04:582
195669987,1cyclictest28-21ksoftirqd/221:50:172
195669987,1cyclictest28-21ksoftirqd/221:31:012
195669987,1cyclictest28-21ksoftirqd/221:10:002
195669987,1cyclictest28-21ksoftirqd/219:25:172
195669987,1cyclictest28-21ksoftirqd/200:27:212
195669987,1cyclictest28-21ksoftirqd/200:06:142
195669986,1cyclictest8849-21snmpd23:52:552
195669986,1cyclictest8849-21snmpd20:03:142
195669986,1cyclictest61250irq/122-eno121:55:142
195669986,1cyclictest61250irq/122-eno120:30:212
195669986,1cyclictest61250irq/122-eno100:30:132
195659981,4cyclictest0-21swapper/121:30:011
195659980,5cyclictest0-21swapper/100:15:201
195659980,4cyclictest0-21swapper/122:15:181
195659980,2cyclictest0-21swapper/100:00:091
195649987,1cyclictest9-21ksoftirqd/023:45:000
195649987,1cyclictest15011-21/usr/sbin/munin23:25:220
195649986,1cyclictest9-21ksoftirqd/020:20:000
195649986,1cyclictest8849-21snmpd21:08:200
195649986,1cyclictest8849-21snmpd00:06:460
195649986,1cyclictest1422-21ntpd22:35:290
195649981,6cyclictest29800-21ssh23:45:010
195649981,6cyclictest27867-21ssh21:30:120
195649981,6cyclictest16541-21ssh21:15:120
195649981,1cyclictest22565-21ssh21:22:010
195649980,7cyclictest5532-21ssh22:26:200
195649980,7cyclictest25165-21ssh00:20:460
195649980,7cyclictest10940-21ssh23:19:410
195649980,1cyclictest5355-21ssh21:43:280
28195270,2sleep10-21swapper/123:40:571
20164270,5sleep00-21swapper/022:46:100
195709977,0cyclictest0-21swapper/321:05:533
195709977,0cyclictest0-21swapper/320:02:173
195709976,1cyclictest0-21swapper/319:45:013
195709974,2cyclictest7635-21df19:50:163
195709974,2cyclictest30422-21diskstats19:30:123
195709974,2cyclictest22825-21apt-get19:15:103
195669976,1cyclictest61250irq/122-eno122:10:092
195669976,1cyclictest61250irq/122-eno121:15:232
195669976,1cyclictest28-21ksoftirqd/222:40:112
195669976,1cyclictest28-21ksoftirqd/222:15:162
195669976,1cyclictest28-21ksoftirqd/221:40:102
195669976,1cyclictest28-21ksoftirqd/220:55:002
195669976,1cyclictest28-21ksoftirqd/220:15:092
195669976,0cyclictest61250irq/122-eno122:50:112
195669975,1cyclictest61250irq/122-eno120:25:162
195669975,1cyclictest61250irq/122-eno119:15:202
195669970,1cyclictest0-21swapper/220:45:102
195669970,1cyclictest0-21swapper/219:39:092
195659971,6cyclictest0-21swapper/120:51:151
195659970,7cyclictest0-21swapper/123:40:001
195659970,6cyclictest0-21swapper/123:00:221
195659970,4cyclictest0-21swapper/123:10:551
195659970,4cyclictest0-21swapper/122:35:201
195659970,2cyclictest0-21swapper/100:10:121
195659970,1cyclictest0-21swapper/120:22:261
195659970,1cyclictest0-21swapper/120:11:461
195659970,1cyclictest0-21swapper/119:45:181
195649976,1cyclictest8849-21snmpd22:40:130
195649976,1cyclictest8849-21snmpd19:13:560
195649976,1cyclictest23875-21ssh22:51:170
195649975,1cyclictest0-21swapper/023:10:200
195649974,1cyclictest14250irq/124-ahci[0020:34:550
195649971,6cyclictest5787-21/usr/sbin/munin20:55:260
195649971,5cyclictest4774-21/usr/sbin/munin19:45:170
195649970,7cyclictest0-21swapper/019:17:210
195649970,7cyclictest0-21swapper/000:16:310
195649970,6cyclictest26677-21ssh22:10:450
195649970,6cyclictest26578-21ssh22:55:190
195649970,6cyclictest22591-21sed22:05:220
195649970,6cyclictest13498-21ssh21:55:090
195649970,6cyclictest0-21swapper/023:20:260
195649970,6cyclictest0-21swapper/023:05:180
195649970,6cyclictest0-21swapper/022:20:110
195649970,4cyclictest0-21swapper/023:54:030
195649970,1cyclictest4932-21ssh00:38:110
195649970,1cyclictest31213-21/usr/sbin/munin20:40:090
195649970,1cyclictest30579-21/usr/sbin/munin23:00:230
195649970,1cyclictest10912-21ssh00:02:170
195669966,0cyclictest61250irq/122-eno120:06:402
195669966,0cyclictest61250irq/122-eno119:23:022
195669964,1cyclictest61250irq/122-eno122:45:132
195669964,1cyclictest61250irq/122-eno119:50:132
195669964,1cyclictest61250irq/122-eno119:45:122
195669960,5cyclictest16321-21cron20:14:562
195659965,1cyclictest0-21swapper/120:47:081
195659961,3cyclictest0-21swapper/100:25:251
195659960,6cyclictest0-21swapper/122:59:281
195659960,6cyclictest0-21swapper/122:45:561
195659960,6cyclictest0-21swapper/121:55:371
195659960,6cyclictest0-21swapper/120:17:221
195659960,6cyclictest0-21swapper/119:34:151
195659960,6cyclictest0-21swapper/119:19:141
195659960,5cyclictest0-21swapper/120:35:291
195659960,5cyclictest0-21swapper/120:30:171
195659960,5cyclictest0-21swapper/119:55:101
195659960,5cyclictest0-21swapper/100:24:411
195659960,4cyclictest0-21swapper/122:28:221
195659960,4cyclictest0-21swapper/121:19:501
195659960,3cyclictest0-21swapper/123:50:151
195659960,3cyclictest0-21swapper/123:24:351
195659960,3cyclictest0-21swapper/122:51:531
195659960,3cyclictest0-21swapper/122:00:411
195659960,3cyclictest0-21swapper/121:49:351
195659960,3cyclictest0-21swapper/120:25:101
195659960,3cyclictest0-21swapper/100:05:341
195659960,2cyclictest0-21swapper/121:05:511
195659960,1cyclictest0-21swapper/123:25:161
195659960,1cyclictest0-21swapper/121:20:121
195659960,1cyclictest0-21swapper/119:25:421
195659960,0cyclictest0-21swapper/123:56:261
195659960,0cyclictest0-21swapper/123:33:431
195659960,0cyclictest0-21swapper/123:15:381
195659960,0cyclictest0-21swapper/121:38:171
195649965,1cyclictest9854-21telnet21:50:110
195649965,1cyclictest9-21ksoftirqd/021:02:340
195649965,1cyclictest1422-21ntpd20:45:300
195649962,2cyclictest259-21systemd-journal20:24:590
195649960,6cyclictest9095-21ssh22:31:000
195649960,6cyclictest0-21swapper/020:07:130
195649960,6cyclictest0-21swapper/019:25:240
195649960,5cyclictest31172-21ssh21:35:030
195649960,0cyclictest0-21swapper/019:50:320
195669955,0cyclictest61250irq/122-eno121:00:192
195669952,1cyclictest29911-21apt-get19:30:092
195669950,2cyclictest259-21systemd-journal19:14:592
195659955,0cyclictest0-21swapper/123:49:211
195659951,3cyclictest0-21swapper/120:55:141
195659950,5cyclictest0-21swapper/121:50:071
195659950,5cyclictest0-21swapper/121:43:301
195659950,5cyclictest0-21swapper/121:00:171
195659950,5cyclictest0-21swapper/119:41:161
195659950,5cyclictest0-21swapper/119:14:121
195659950,3cyclictest0-21swapper/100:32:051
195659950,2cyclictest0-21swapper/122:21:521
195659950,2cyclictest0-21swapper/122:10:091
195659950,2cyclictest0-21swapper/122:05:361
195659950,1cyclictest0-21swapper/122:42:221
195659950,1cyclictest0-21swapper/121:30:201
195659950,1cyclictest0-21swapper/121:10:001
195659950,0cyclictest0-21swapper/119:35:141
195649955,0cyclictest0-21swapper/019:20:220
195649954,1cyclictest9-21ksoftirqd/020:25:010
195649950,5cyclictest0-21swapper/019:55:230
195649950,4cyclictest16561-21/usr/sbin/munin20:10:130
195649950,4cyclictest11856-21/usr/sbin/munin20:00:160
195649950,3cyclictest0-21swapper/020:35:100
195659941,3cyclictest0-21swapper/120:03:591
195659941,2cyclictest0-21swapper/120:05:131
195659940,4cyclictest268552sleep119:20:271
195659940,4cyclictest0-21swapper/119:50:421
195659940,1cyclictest0-21swapper/120:40:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional