You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-15 - 08:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Mon Apr 15, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
234049799130,11cyclictest0-21swapper/319:35:073
234049799120,1cyclictest0-21swapper/321:00:043
234049799120,12cyclictest0-21swapper/323:35:083
234049799120,0cyclictest0-21swapper/300:10:083
2340497991111,0cyclictest0-21swapper/319:10:073
234049799110,11cyclictest2435261-21turbostat23:04:563
234049799110,11cyclictest0-21swapper/323:50:153
234049799110,11cyclictest0-21swapper/323:20:063
234049799110,11cyclictest0-21swapper/323:00:003
234049799110,11cyclictest0-21swapper/322:00:063
234049799110,11cyclictest0-21swapper/321:35:013
234049799110,11cyclictest0-21swapper/321:35:003
234049799110,11cyclictest0-21swapper/320:20:053
234049799110,11cyclictest0-21swapper/300:05:073
234049799110,0cyclictest0-21swapper/322:35:133
234049799110,0cyclictest0-21swapper/321:55:013
234049799110,0cyclictest0-21swapper/321:35:013
234049799110,0cyclictest0-21swapper/321:25:133
234049799110,0cyclictest0-21swapper/321:10:053
234049799109,1cyclictest0-21swapper/319:30:043
2340497991010,0cyclictest0-21swapper/322:25:043
234049799100,10cyclictest0-21swapper/323:15:003
234049799100,10cyclictest0-21swapper/322:50:093
234049799100,10cyclictest0-21swapper/321:05:133
234049799100,10cyclictest0-21swapper/320:00:123
234049799100,0cyclictest0-21swapper/320:19:553
234049799100,0cyclictest0-21swapper/319:40:163
234049799100,0cyclictest0-21swapper/300:20:133
23404979999,0cyclictest0-21swapper/323:25:133
23404979999,0cyclictest0-21swapper/322:50:013
23404979990,9cyclictest0-21swapper/321:20:123
23404979988,0cyclictest0-21swapper/322:30:133
23404979988,0cyclictest0-21swapper/322:10:013
23404979986,1cyclictest0-21swapper/320:10:073
23404979980,8cyclictest0-21swapper/300:30:053
2340000281,4sleep30-21swapper/319:05:523
23404979977,0cyclictest0-21swapper/323:55:063
23404979977,0cyclictest0-21swapper/321:15:123
23404979977,0cyclictest0-21swapper/320:55:013
23404979977,0cyclictest0-21swapper/320:50:013
23404979977,0cyclictest0-21swapper/319:45:063
23404979970,7cyclictest0-21swapper/322:24:353
23404979960,1cyclictest0-21swapper/319:15:003
23404979960,0cyclictest0-21swapper/322:00:003
13129860,2rtkit-daemon717-21lldpd19:05:240
23404979955,0cyclictest0-21swapper/321:42:013
23404979955,0cyclictest0-21swapper/300:40:013
23404979950,5cyclictest0-21swapper/319:55:123
23404979950,4cyclictest0-21swapper/319:25:063
2339554251,2sleep20-21swapper/219:05:142
13129850,3rtkit-daemon2342467-21munin-node23:28:370
13129850,2rtkit-daemon356-21systemd-journal00:04:290
23404979944,0cyclictest0-21swapper/300:19:243
23404979942,2cyclictest2439511-21turbostat23:10:013
23404979941,2cyclictest0-21swapper/322:10:043
23404979941,1cyclictest0-21swapper/323:30:073
23404979941,1cyclictest0-21swapper/321:45:063
23404979940,3cyclictest0-21swapper/322:17:343
23404979940,3cyclictest0-21swapper/320:38:103
23404979940,3cyclictest0-21swapper/320:32:283
23404979940,2cyclictest0-21swapper/323:45:063
23404979940,2cyclictest0-21swapper/323:40:053
23404979940,2cyclictest0-21swapper/320:40:063
23404979940,2cyclictest0-21swapper/320:25:053
23404979940,2cyclictest0-21swapper/319:50:053
2339428240,2sleep12339553-21wc19:05:131
13129840,2rtkit-daemon717-21lldpd23:42:060
13129840,2rtkit-daemon717-21lldpd00:38:390
13129840,2rtkit-daemon356-21systemd-journal20:07:290
13129840,2rtkit-daemon1-21systemd19:25:060
13129840,1rtkit-daemon717-21lldpd22:40:380
13129840,1rtkit-daemon717-21lldpd22:18:210
13129840,1rtkit-daemon3191333-21snmpd22:23:000
23404979933,0cyclictest0-21swapper/319:20:093
23404979933,0cyclictest0-21swapper/300:27:243
23404979931,1cyclictest0-21swapper/323:15:053
23404979931,1cyclictest0-21swapper/320:45:053
23404979931,1cyclictest0-21swapper/300:00:063
23404979930,0cyclictest0-21swapper/320:05:073
13129830,2rtkit-daemon3191333-21snmpd21:26:520
13129830,2rtkit-daemon2121-21packagekitd19:40:130
13129830,1rtkit-daemon717-21lldpd23:31:070
13129830,1rtkit-daemon717-21lldpd22:47:520
13129830,1rtkit-daemon717-21lldpd22:29:220
13129830,1rtkit-daemon717-21lldpd22:05:220
13129830,1rtkit-daemon717-21lldpd21:30:200
13129830,1rtkit-daemon717-21lldpd21:30:200
13129830,1rtkit-daemon717-21lldpd21:10:370
13129830,1rtkit-daemon717-21lldpd21:03:250
13129830,1rtkit-daemon717-21lldpd20:53:540
13129830,1rtkit-daemon717-21lldpd20:47:370
13129830,1rtkit-daemon717-21lldpd20:30:240
13129830,1rtkit-daemon714-21ntpd21:45:110
13129830,1rtkit-daemon617-21gmain21:24:410
13129830,1rtkit-daemon617-21gmain00:33:050
13129830,1rtkit-daemon539-21wpa_supplicant22:01:540
13129830,1rtkit-daemon375-21systemd-udevd21:56:300
13129830,1rtkit-daemon356-21systemd-journal23:47:290
13129830,1rtkit-daemon356-21systemd-journal22:12:510
13129830,1rtkit-daemon356-21systemd-journal21:52:300
13129830,1rtkit-daemon356-21systemd-journal21:16:420
13129830,1rtkit-daemon356-21systemd-journal00:26:300
13129830,1rtkit-daemon3191333-21snmpd23:55:590
13129830,1rtkit-daemon3191333-21snmpd19:52:550
13129830,1rtkit-daemon3191333-21snmpd19:30:030
13129830,1rtkit-daemon2364931-21df20:10:090
13129830,1rtkit-daemon2342467-21munin-node19:45:030
13129830,1rtkit-daemon1-21systemd23:21:300
13129830,1rtkit-daemon1-21systemd23:16:530
13129830,1rtkit-daemon1-21systemd22:52:010
13129830,1rtkit-daemon1-21systemd20:40:130
13129830,1rtkit-daemon1-21systemd19:36:290
2464822220,1sleep12426403-21kworker/1:200:08:421
2457672220,1sleep22457880-21timerwakeupswit23:50:142
2446634220,1sleep22446859-21ntpq23:25:132
2444799220,1sleep22444916-21/usr/sbin/munin23:20:132
2428604220,0sleep10-21swapper/122:44:501
2426146220,0sleep20-21swapper/222:39:182
2422241220,1sleep20-21swapper/222:30:062
2419880220,1sleep12419908-21systemd22:25:011
2418133220,1sleep22418312-21tr22:20:092
2415501220,0sleep10-21swapper/122:14:001
2413163220,0sleep20-21swapper/222:07:332
2406193220,1sleep22406413-21sed21:50:162
2405627220,1sleep12405659-21fw_packets21:50:111
2383822220,0sleep22383848-21apt-get21:00:042
2366620220,1sleep12366866-21diskstats20:15:091
2362350220,1sleep10-21swapper/120:05:011
2344001220,1sleep12344247-21sed19:15:131
2343852220,1sleep02344000-21python319:15:130
23404979920,0cyclictest0-21swapper/322:40:043
13129820,1rtkit-daemon617-21gmain19:11:010
13129820,1rtkit-daemon3191333-21snmpd23:05:310
13129820,1rtkit-daemon3191333-21snmpd22:31:200
13129820,1rtkit-daemon3191333-21snmpd20:56:170
13129820,1rtkit-daemon269977-21sendmail-mta23:00:160
13129820,1rtkit-daemon2342467-21munin-node22:36:210
13129820,1rtkit-daemon2342467-21munin-node21:05:320
13129820,1rtkit-daemon2342467-21munin-node20:25:030
13129820,1rtkit-daemon2342467-21munin-node00:05:110
13129820,1rtkit-daemon1-21systemd23:50:110
13129820,1rtkit-daemon1-21systemd21:36:300
13129820,1rtkit-daemon1-21systemd20:21:230
13129820,1rtkit-daemon1-21systemd20:16:170
13129820,1rtkit-daemon1-21systemd19:56:190
13129820,0rtkit-daemon617-21gmain23:36:010
13129820,0rtkit-daemon0-21swapper/023:10:030
13129820,0rtkit-daemon0-21swapper/022:55:190
13129820,0rtkit-daemon0-21swapper/021:40:140
13129820,0rtkit-daemon0-21swapper/020:35:030
13129820,0rtkit-daemon0-21swapper/020:00:210
13129820,0rtkit-daemon0-21swapper/019:21:030
13129820,0rtkit-daemon0-21swapper/000:20:020
13129820,0rtkit-daemon0-21swapper/000:15:040
13129820,0rtkit-daemon0-21swapper/000:10:140
2476013210,0sleep20-21swapper/200:35:092
2475917210,0sleep10-21swapper/100:35:081
2473865210,0sleep20-21swapper/200:30:082
2473769210,0sleep10-21swapper/100:30:071
2471600210,0sleep10-21swapper/100:25:071
2471592210,0sleep20-21swapper/200:25:032
2469557210,0sleep20-21swapper/200:20:082
2469490210,0sleep10-21swapper/100:20:071
2467776210,0sleep20-21swapper/200:15:122
2467577210,0sleep12467773-21df_inode00:15:111
2465250210,0sleep20-21swapper/200:10:062
2465221210,0sleep10-21swapper/100:10:061
2463366210,0sleep20-21swapper/200:05:112
2460990210,0sleep20-21swapper/200:00:072
2460726210,0sleep10-21swapper/100:00:021
2459756210,0sleep22459930-21ssh23:55:142
2459128210,0sleep10-21swapper/123:55:101
2456480210,0sleep10-21swapper/123:50:011
2455580210,0sleep10-21swapper/123:45:131
2454603210,0sleep20-21swapper/223:45:062
2452774210,0sleep10-21swapper/123:40:091
2452224210,0sleep20-21swapper/223:40:012
2450382210,0sleep12387442-21diskmemload23:35:081
2450109210,0sleep20-21swapper/223:35:012
2448262210,0sleep10-21swapper/123:30:081
2447986210,0sleep20-21swapper/223:30:012
2446115210,0sleep10-21swapper/123:25:081
2444057210,0sleep10-21swapper/123:20:081
2442231210,0sleep20-21swapper/223:15:082
2442005210,0sleep10-21swapper/123:15:071
2440514210,0sleep20-21swapper/223:10:122
2439761210,0sleep10-21swapper/123:10:071
2439001210,0sleep20-21swapper/223:05:482
2438390210,0sleep10-21swapper/123:05:111
2436394210,0sleep10-21swapper/123:00:141
2435536210,0sleep20-21swapper/223:00:072
2434749210,0sleep20-21swapper/222:55:512
2433365210,0sleep10-21swapper/122:55:061
2432466210,0sleep20-21swapper/222:50:192
2431283210,0sleep10-21swapper/122:50:101
2428897210,0sleep20-21swapper/222:45:072
2428665210,0sleep10-21swapper/122:45:021
2426785210,0sleep20-21swapper/222:40:062
2424461210,0sleep10-21swapper/122:35:091
2423026210,0sleep10-21swapper/122:30:131
2420547210,0sleep10-21swapper/122:25:091
2419909210,1sleep20-21swapper/222:25:022
2417190210,0sleep20-21swapper/222:15:212
2416119210,0sleep10-21swapper/122:15:081
2414137210,0sleep20-21swapper/222:10:092
2411609210,0sleep10-21swapper/122:05:071
2409980210,0sleep10-21swapper/122:00:111
2409458210,0sleep20-21swapper/222:00:042
2407608210,0sleep20-21swapper/221:55:082
2407426210,0sleep10-21swapper/121:55:071
2403153210,0sleep20-21swapper/221:45:072
2403095210,0sleep10-21swapper/121:45:061
2401897210,0sleep10-21swapper/121:40:141
2400980210,0sleep20-21swapper/221:40:062
2398833210,0sleep20-21swapper/221:35:032
2398339210,0sleep10-21swapper/121:35:021
2396905210,0sleep20-21swapper/221:30:102
2396905210,0sleep20-21swapper/221:30:092
2396749210,0sleep10-21swapper/121:30:091
2396749210,0sleep10-21swapper/121:30:091
2394832210,0sleep20-21swapper/221:25:102
2394340210,0sleep10-21swapper/121:25:051
2393245210,0sleep20-21swapper/221:20:142
2392642210,0sleep10-21swapper/121:20:091
2390222210,0sleep10-21swapper/121:15:081
2389797210,0sleep20-21swapper/221:15:052
2388050210,0sleep10-21swapper/121:10:081
2387672210,0sleep20-21swapper/221:10:052
2385933210,0sleep20-21swapper/221:05:092
2385778210,0sleep10-21swapper/121:05:081
2384725210,0sleep10-21swapper/121:00:111
2382688210,0sleep20-21swapper/220:55:132
2381972210,0sleep10-21swapper/120:55:081
2380109210,0sleep20-21swapper/220:50:082
2379985210,0sleep10-21swapper/120:50:071
2379383210,0sleep10-21swapper/120:45:501
2378149210,0sleep20-21swapper/220:45:072
2376194210,0sleep20-21swapper/220:40:082
2376126210,0sleep10-21swapper/120:40:071
2374186210,0sleep20-21swapper/220:35:072
2374157210,0sleep10-21swapper/120:35:061
2372384210,0sleep20-21swapper/220:30:062
2372260210,0sleep10-21swapper/120:30:061
2371604210,0sleep20-21swapper/220:25:152
2370307210,0sleep10-21swapper/120:25:061
2368473210,0sleep20-21swapper/220:20:072
2368122210,0sleep10-21swapper/120:20:021
2366867210,0sleep20-21swapper/220:15:092
2364937210,0sleep20-21swapper/220:10:102
2364273210,0sleep10-21swapper/120:10:011
2363333210,0sleep20-21swapper/220:05:142
2362692210,0sleep10-21swapper/120:05:091
2361110210,0sleep20-21swapper/220:00:092
2359094210,0sleep10-21swapper/119:55:081
2358482210,0sleep20-21swapper/219:55:012
2357221210,0sleep10-21swapper/119:50:081
2356295210,0sleep20-21swapper/219:50:012
2355087210,0sleep10-21swapper/119:45:111
2354370210,0sleep20-21swapper/219:45:002
2354044210,0sleep10-21swapper/119:40:521
2352870210,0sleep20-21swapper/219:40:092
2350802210,0sleep20-21swapper/219:35:082
2350743210,0sleep10-21swapper/119:35:071
2349571210,0sleep20-21swapper/219:30:112
2349425210,0sleep10-21swapper/119:30:111
2347123210,0sleep20-21swapper/219:25:082
2346949210,0sleep10-21swapper/119:25:071
2346372210,0sleep20-21swapper/219:21:282
2345068210,0sleep10-21swapper/119:20:061
2343278210,0sleep20-21swapper/219:15:062
2341099210,0sleep20-21swapper/219:10:112
2340633200,0sleep10-21swapper/119:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional