You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 08:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Fri Apr 19, 2024 00:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141322205150,42sleep10-21swapper/119:05:411
142642201158,24sleep20-21swapper/219:07:232
144162200160,26sleep00-21swapper/019:09:220
142352198160,25sleep30-21swapper/319:07:003
210142750,1sleep10-21swapper/120:30:001
308092660,0sleep10-21swapper/122:24:221
229342650,0sleep10-21swapper/122:55:221
121132600,0sleep30-21swapper/320:10:123
6452550,0sleep30-21swapper/300:38:343
99852380,0sleep30-21swapper/300:06:423
1456599210,0cyclictest0-21swapper/119:55:081
35032130,0sleep30-21swapper/323:59:253
14556991210,1cyclictest9-21ksoftirqd/022:10:000
1455699120,11cyclictest21293-21/usr/sbin/munin22:55:120
1455699112,4cyclictest16915-21perf19:15:000
14556991110,1cyclictest9-21ksoftirqd/022:45:010
14556991110,1cyclictest9-21ksoftirqd/020:20:000
1457499108,1cyclictest35-21ksoftirqd/320:10:003
1457499100,8cyclictest0-21swapper/321:47:213
1457499100,7cyclictest7674-21apt-get21:10:013
1457199101,8cyclictest61250irq/122-eno100:35:112
1455699109,1cyclictest9-21ksoftirqd/023:00:100
1455699109,1cyclictest9-21ksoftirqd/000:10:000
1455699109,1cyclictest9-21ksoftirqd/000:05:000
1455699108,1cyclictest9-21ksoftirqd/020:45:000
14556991010,0cyclictest9-21ksoftirqd/000:25:000
136692100,0sleep10-21swapper/121:15:421
145719998,1cyclictest28-21ksoftirqd/221:44:322
145569998,1cyclictest9-21ksoftirqd/020:50:170
145569998,1cyclictest9-21ksoftirqd/020:35:120
145569997,1cyclictest9-21ksoftirqd/023:40:000
145569996,2cyclictest0-21swapper/021:56:180
145569992,1cyclictest259-21systemd-journal00:40:000
916280,1sleep10-21swapper/123:55:151
145749986,1cyclictest8849-21snmpd23:53:413
145749986,1cyclictest8849-21snmpd23:48:173
145749986,1cyclictest8849-21snmpd19:47:153
145749986,1cyclictest16665-21ntp_kernel_pll_21:20:163
145749983,1cyclictest19231-21apt-get21:25:123
145749981,3cyclictest4014-21apt-get00:00:113
145749980,4cyclictest26631-21ssh00:30:143
145719986,1cyclictest61250irq/122-eno123:25:112
145719986,1cyclictest61250irq/122-eno123:05:152
145719986,1cyclictest61250irq/122-eno122:56:102
145719986,1cyclictest61250irq/122-eno122:40:232
145719986,1cyclictest61250irq/122-eno122:05:142
145719986,1cyclictest61250irq/122-eno121:30:092
145719986,1cyclictest28-21ksoftirqd/220:40:522
145719985,1cyclictest61250irq/122-eno121:35:012
145719983,2cyclictest283-21systemd-udevd21:53:152
145719982,6cyclictest61250irq/122-eno123:12:572
145719982,3cyclictest29117-21apt-get23:50:112
145719980,5cyclictest0-21swapper/223:58:022
145719980,0cyclictest0-21swapper/222:39:012
145659980,4cyclictest0-21swapper/100:15:201
145569987,1cyclictest9-21ksoftirqd/022:10:110
145569987,1cyclictest9-21ksoftirqd/021:20:130
145569986,1cyclictest9-21ksoftirqd/021:00:010
145569986,1cyclictest1247-21cat23:55:160
145569981,6cyclictest24191-21ssh22:15:110
145569980,7cyclictest4657-21ssh22:31:160
145569980,7cyclictest32002-21perf23:10:000
145569980,7cyclictest2473-21wc22:30:000
145569980,7cyclictest22562-21gltestperf23:40:130
145569980,7cyclictest19648-21ssh22:51:010
145569980,6cyclictest29982-21kworker/0:020:10:130
9794270,0sleep10-21swapper/121:55:151
145749976,1cyclictest8849-21snmpd21:51:223
145749976,1cyclictest8849-21snmpd00:22:483
145749976,1cyclictest19771-21cat20:25:143
145749975,1cyclictest8849-21snmpd23:00:543
145749975,1cyclictest8849-21snmpd21:37:003
145749975,1cyclictest8849-21snmpd21:05:173
145749975,1cyclictest8849-21snmpd20:55:023
145749975,1cyclictest8849-21snmpd20:15:523
145749975,1cyclictest8849-21snmpd20:04:373
145749975,1cyclictest35-21ksoftirqd/319:16:583
145749975,1cyclictest12174-21ssh21:59:103
145749974,2cyclictest8849-21snmpd19:59:453
145749973,4cyclictest32367-21kworker/u8:123:30:003
145749973,2cyclictest530-21systemd-logind21:30:203
145749972,4cyclictest28605-21/usr/sbin/munin23:05:193
145749971,4cyclictest0-21swapper/323:10:103
145749970,4cyclictest0-21swapper/322:56:523
145749970,4cyclictest0-21swapper/322:00:133
145749970,2cyclictest14653-21ssh21:18:293
145719976,1cyclictest8849-21snmpd19:47:272
145719976,1cyclictest61250irq/122-eno123:35:172
145719976,1cyclictest61250irq/122-eno122:45:102
145719976,1cyclictest61250irq/122-eno121:55:092
145719976,1cyclictest61250irq/122-eno120:35:122
145719976,1cyclictest61250irq/122-eno100:31:302
145719976,1cyclictest61250irq/122-eno100:27:072
145719976,1cyclictest61250irq/122-eno100:11:012
145719976,0cyclictest61250irq/122-eno122:50:032
145719976,0cyclictest61250irq/122-eno100:15:122
145719975,1cyclictest8849-21snmpd20:30:432
145719975,1cyclictest61250irq/122-eno123:40:132
145719975,1cyclictest61250irq/122-eno122:25:132
145719975,1cyclictest61250irq/122-eno122:00:252
145719975,1cyclictest61250irq/122-eno120:55:222
145719975,1cyclictest61250irq/122-eno100:20:252
145719974,2cyclictest4912-21cron21:50:002
145719973,3cyclictest0-21swapper/220:00:122
145719973,2cyclictest530-21systemd-logind20:45:222
145719971,1cyclictest0-21swapper/222:23:062
145719970,6cyclictest28324-21ssh23:48:302
145719970,6cyclictest27213-21ssh22:19:362
145719970,6cyclictest0-21swapper/221:08:322
145719970,6cyclictest0-21swapper/219:23:262
145719970,5cyclictest0-21swapper/220:16:492
145719970,4cyclictest0-21swapper/221:15:352
145719970,2cyclictest530-21systemd-logind19:15:012
145659971,1cyclictest0-21swapper/123:12:151
145659970,6cyclictest0-21swapper/123:26:341
145659970,4cyclictest0-21swapper/100:12:301
145659970,2cyclictest0-21swapper/122:10:091
145659970,2cyclictest0-21swapper/121:40:281
145659970,1cyclictest0-21swapper/121:20:151
145569976,1cyclictest9-21ksoftirqd/022:45:120
145569976,1cyclictest9-21ksoftirqd/022:35:010
145569976,1cyclictest9-21ksoftirqd/022:20:130
145569976,1cyclictest9-21ksoftirqd/019:50:100
145569976,1cyclictest9-21ksoftirqd/019:41:530
145569976,1cyclictest9-21ksoftirqd/019:25:080
145569976,1cyclictest8849-21snmpd19:21:380
145569975,1cyclictest8223-21ntpq20:00:210
145569975,1cyclictest17688-21ntp_states20:20:190
145569971,6cyclictest29105-21ssh21:37:280
145569971,5cyclictest8849-21snmpd23:10:220
145569970,7cyclictest0-21swapper/019:45:140
145569970,6cyclictest5478-21ssh23:15:550
145569970,6cyclictest30727-21timerwakeupswit23:50:230
145569970,6cyclictest30337-21ssh21:40:100
145569970,6cyclictest17195-21ssh23:33:020
145569970,6cyclictest13848-21ssh21:16:140
145569970,6cyclictest13402-21fschecks_time22:00:160
145569970,6cyclictest12277-21ssh23:25:200
145569970,6cyclictest0-21swapper/021:30:120
145569970,5cyclictest16502-21which00:15:210
145569970,1cyclictest8203-21ssh23:20:150
145569970,1cyclictest8119-21ssh21:10:070
145569970,1cyclictest4267-21ssh21:48:060
145569970,1cyclictest27414-21ssh23:45:490
145569970,1cyclictest25771-21ssh00:29:310
145569970,1cyclictest21376-21aten_r1power_vo20:30:110
145569970,1cyclictest0-21swapper/000:30:120
8200260,0sleep10-21swapper/100:05:161
7300260,1sleep10-21swapper/121:51:151
145749966,0cyclictest35-21ksoftirqd/322:21:443
145749965,1cyclictest8849-21snmpd19:41:333
145749965,1cyclictest26872-21sshd19:32:523
145749965,1cyclictest21492-21ssh22:10:163
145749965,1cyclictest20326-21ssh23:36:313
145749965,1cyclictest17604-21ssh00:17:243
145749965,1cyclictest16882-21ssh23:32:073
145749965,1cyclictest13294-21ssh22:44:273
145749964,1cyclictest8849-21snmpd20:36:133
145749963,2cyclictest8849-21snmpd19:52:393
145749963,1cyclictest7661-21diskmemload22:35:083
145749961,1cyclictest30808-21df_inode21:40:123
145749960,5cyclictest16077-21awk19:10:213
145749960,4cyclictest0-21swapper/323:20:403
145749960,4cyclictest0-21swapper/322:52:123
145749960,3cyclictest0-21swapper/300:12:443
145749960,2cyclictest0-21swapper/322:05:153
145749960,1cyclictest0-21swapper/323:40:163
145749960,1cyclictest0-21swapper/322:32:293
145749960,1cyclictest0-21swapper/321:00:153
145749960,0cyclictest7661-21diskmemload22:16:563
145719966,0cyclictest61250irq/122-eno123:16:002
145719966,0cyclictest61250irq/122-eno123:00:002
145719966,0cyclictest61250irq/122-eno122:30:032
145719966,0cyclictest61250irq/122-eno121:10:202
145719966,0cyclictest61250irq/122-eno120:20:482
145719966,0cyclictest61250irq/122-eno120:05:092
145719966,0cyclictest61250irq/122-eno119:51:212
145719966,0cyclictest61250irq/122-eno119:11:142
145719966,0cyclictest61250irq/122-eno100:00:202
145719965,1cyclictest61250irq/122-eno121:00:112
145719965,1cyclictest61250irq/122-eno119:41:572
145719965,1cyclictest19157-21ssh21:25:002
145719964,1cyclictest61250irq/122-eno123:20:092
145719964,1cyclictest61250irq/122-eno120:25:202
145719962,3cyclictest7661-21diskmemload22:10:092
145719960,6cyclictest0-21swapper/221:20:182
145719960,6cyclictest0-21swapper/200:05:072
145719960,5cyclictest61250irq/122-eno119:30:182
145719960,5cyclictest0-21swapper/223:30:162
145719960,2cyclictest0-21swapper/219:55:082
145659965,1cyclictest0-21swapper/100:01:591
145659961,5cyclictest0-21swapper/119:45:451
145659961,3cyclictest0-21swapper/121:00:121
145659960,6cyclictest0-21swapper/122:51:001
145659960,6cyclictest0-21swapper/120:45:051
145659960,6cyclictest0-21swapper/119:41:031
145659960,6cyclictest0-21swapper/119:33:241
145659960,5cyclictest0-21swapper/122:48:121
145659960,3cyclictest0-21swapper/123:45:181
145659960,3cyclictest0-21swapper/123:37:541
145659960,3cyclictest0-21swapper/123:32:291
145659960,3cyclictest0-21swapper/122:31:481
145659960,3cyclictest0-21swapper/122:26:551
145659960,3cyclictest0-21swapper/120:50:091
145659960,2cyclictest0-21swapper/123:05:131
145659960,2cyclictest0-21swapper/122:05:091
145659960,2cyclictest0-21swapper/122:00:131
145659960,2cyclictest0-21swapper/121:11:431
145659960,2cyclictest0-21swapper/121:05:151
145659960,2cyclictest0-21swapper/100:30:361
145659960,1cyclictest0-21swapper/123:50:111
145659960,1cyclictest0-21swapper/123:22:041
145659960,1cyclictest0-21swapper/121:28:391
145659960,1cyclictest0-21swapper/119:35:101
145659960,1cyclictest0-21swapper/119:25:081
145659960,0cyclictest0-21swapper/121:45:381
145659960,0cyclictest0-21swapper/120:05:101
145569966,0cyclictest9-21ksoftirqd/019:15:220
145569965,1cyclictest9-21ksoftirqd/019:55:140
145569964,1cyclictest27065-21perf19:35:000
145569960,6cyclictest0-21swapper/020:45:490
145569960,6cyclictest0-21swapper/020:05:520
145569960,5cyclictest7661-21diskmemload21:25:120
145569960,5cyclictest5145-21ssh21:50:000
145569960,5cyclictest0-21swapper/021:05:250
145569960,3cyclictest259-21systemd-journal20:30:000
145569960,0cyclictest0-21swapper/000:11:060
145749955,0cyclictest0-21swapper/320:52:083
145749954,1cyclictest8849-21snmpd20:45:203
145749954,1cyclictest8849-21snmpd19:35:093
145749954,1cyclictest22470-21ssh00:25:053
145749953,1cyclictest8849-21snmpd19:21:203
145749953,1cyclictest24541-21seq19:28:113
145749952,2cyclictest21357-21aten2.4-expect20:30:113
145749952,0cyclictest899-21ssh22:26:013
145749950,4cyclictest0-21swapper/323:15:103
145749950,2cyclictest0-21swapper/322:45:023
145719954,1cyclictest61250irq/122-eno119:35:112
145719953,1cyclictest11837-21cut20:10:102
145719952,2cyclictest24269-21grep19:25:202
145719950,2cyclictest259-21systemd-journal20:50:012
145659951,3cyclictest0-21swapper/122:35:211
145659950,5cyclictest0-21swapper/122:15:121
145659950,5cyclictest0-21swapper/120:32:161
145659950,5cyclictest0-21swapper/120:13:371
145659950,5cyclictest0-21swapper/119:18:321
145659950,5cyclictest0-21swapper/119:11:561
145659950,3cyclictest0-21swapper/123:02:341
145659950,3cyclictest0-21swapper/100:38:061
145659950,2cyclictest0-21swapper/123:40:111
145659950,2cyclictest0-21swapper/122:42:491
145659950,2cyclictest0-21swapper/119:50:101
145659950,2cyclictest0-21swapper/100:25:111
145659950,2cyclictest0-21swapper/100:20:151
145659950,1cyclictest0-21swapper/123:15:241
145659950,1cyclictest0-21swapper/121:33:231
145659950,1cyclictest0-21swapper/120:00:011
145659950,0cyclictest0-21swapper/121:35:381
145569950,5cyclictest0-21swapper/021:01:540
145569950,0cyclictest0-21swapper/019:35:120
145749943,1cyclictest8849-21snmpd20:22:343
145749943,1cyclictest26278-21cstates20:40:143
145659944,0cyclictest0-21swapper/120:22:081
145659942,1cyclictest15319-21chrt20:15:181
145659941,2cyclictest0-21swapper/120:55:111
145659940,1cyclictest22011-21chrt19:20:561
145659940,1cyclictest0-21swapper/120:44:581
145659940,0cyclictest0-21swapper/120:39:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional