You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 22:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Thu Apr 25, 2024 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
65146699120,1cyclictest0-21swapper/309:50:113
65146699120,11cyclictest0-21swapper/307:15:123
651466991111,0cyclictest0-21swapper/310:30:103
651466991110,1cyclictest0-21swapper/310:00:103
65146699110,11cyclictest0-21swapper/312:35:113
65146699110,11cyclictest0-21swapper/307:30:103
65146699110,10cyclictest0-21swapper/308:25:113
65146699110,0cyclictest0-21swapper/307:10:113
651466991010,0cyclictest0-21swapper/311:20:013
651466991010,0cyclictest0-21swapper/310:40:013
651466991010,0cyclictest0-21swapper/309:00:093
651466991010,0cyclictest0-21swapper/308:55:003
65146699100,10cyclictest0-21swapper/311:25:213
65146699100,10cyclictest0-21swapper/309:12:483
65146699100,10cyclictest0-21swapper/308:34:083
65146699100,0cyclictest0-21swapper/311:35:213
65146699100,0cyclictest0-21swapper/309:15:103
65146699100,0cyclictest0-21swapper/308:10:133
6514669999,0cyclictest0-21swapper/312:10:143
6514669999,0cyclictest0-21swapper/311:30:113
6514669999,0cyclictest0-21swapper/310:25:203
6514669999,0cyclictest0-21swapper/307:50:103
6514669990,9cyclictest0-21swapper/310:06:483
6514669990,9cyclictest0-21swapper/309:50:003
6514669990,0cyclictest0-21swapper/311:50:193
651160290,6sleep20-21swapper/207:07:552
6514669988,0cyclictest0-21swapper/312:00:023
6514669988,0cyclictest0-21swapper/311:10:203
6514669988,0cyclictest0-21swapper/310:55:203
6514669988,0cyclictest0-21swapper/310:40:103
6514669988,0cyclictest0-21swapper/308:45:173
6514669987,0cyclictest0-21swapper/308:05:093
6514669980,7cyclictest0-21swapper/311:00:123
6514669980,0cyclictest0-21swapper/309:30:103
6514669980,0cyclictest0-21swapper/307:25:223
6514669977,0cyclictest0-21swapper/312:00:113
6514669977,0cyclictest0-21swapper/309:58:283
6514669977,0cyclictest0-21swapper/307:40:233
6514669977,0cyclictest0-21swapper/307:25:013
6514669970,7cyclictest0-21swapper/310:11:513
6514669970,0cyclictest0-21swapper/311:40:503
650407271,4sleep30-21swapper/307:05:193
6514669966,0cyclictest0-21swapper/312:20:163
6514669966,0cyclictest0-21swapper/310:20:003
6514669966,0cyclictest0-21swapper/309:25:013
6514669966,0cyclictest0-21swapper/309:25:003
6514669966,0cyclictest0-21swapper/308:40:003
6514669966,0cyclictest0-21swapper/308:15:103
6514669964,2cyclictest0-21swapper/309:10:003
6514669960,6cyclictest0-21swapper/310:50:013
13129860,2rtkit-daemon356-21systemd-journal07:06:360
6514669952,3cyclictest0-21swapper/312:20:013
6514669952,0cyclictest0-21swapper/308:55:193
6514669950,0cyclictest0-21swapper/310:50:103
649439250,3sleep10-21swapper/107:05:011
13129850,2rtkit-daemon538-21systemd-logind12:39:290
688469240,1sleep2688501-21/usr/sbin/munin08:40:172
6514669944,0cyclictest0-21swapper/312:25:163
6514669944,0cyclictest0-21swapper/310:20:103
6514669944,0cyclictest0-21swapper/309:41:553
6514669942,2cyclictest689401-21chrt08:44:573
6514669940,4cyclictest0-21swapper/308:20:123
6514669940,3cyclictest0-21swapper/311:23:063
6514669940,3cyclictest0-21swapper/309:35:393
6514669940,3cyclictest0-21swapper/307:56:233
6514669940,2cyclictest0-21swapper/311:45:133
6514669940,2cyclictest0-21swapper/307:35:123
13129840,2rtkit-daemon717-21lldpd12:05:210
13129840,2rtkit-daemon717-21lldpd11:43:500
13129840,2rtkit-daemon717-21lldpd10:43:120
13129840,2rtkit-daemon717-21lldpd10:24:120
13129840,2rtkit-daemon538-21systemd-logind11:04:300
13129840,1rtkit-daemon717-21lldpd10:48:280
13129840,1rtkit-daemon539-21wpa_supplicant11:50:220
13129840,1rtkit-daemon356-21systemd-journal09:55:010
13129840,0rtkit-daemon0-21swapper/009:18:370
768131230,1sleep1768141-21apt-get11:50:011
747407230,0sleep20-21swapper/211:00:192
652452230,0sleep10-21swapper/107:10:191
6514669933,0cyclictest0-21swapper/312:30:333
6514669931,1cyclictest0-21swapper/312:05:103
6514669930,3cyclictest0-21swapper/307:45:113
6514669930,2cyclictest0-21swapper/311:05:123
6514669930,2cyclictest0-21swapper/308:00:153
13129830,2rtkit-daemon617-21gmain09:51:200
13129830,2rtkit-daemon3191333-21snmpd11:13:130
13129830,2rtkit-daemon269977-21sendmail-mta09:30:290
13129830,2rtkit-daemon0-21swapper/011:45:450
13129830,1rtkit-daemon726824-21cat10:10:200
13129830,1rtkit-daemon722227-21open_files10:00:200
13129830,1rtkit-daemon717-21lldpd12:31:450
13129830,1rtkit-daemon717-21lldpd12:11:310
13129830,1rtkit-daemon717-21lldpd11:27:130
13129830,1rtkit-daemon717-21lldpd11:06:190
13129830,1rtkit-daemon717-21lldpd10:35:420
13129830,1rtkit-daemon717-21lldpd09:00:420
13129830,1rtkit-daemon717-21lldpd08:25:400
13129830,1rtkit-daemon717-21lldpd07:43:100
13129830,1rtkit-daemon653446-21munin-node12:25:050
13129830,1rtkit-daemon539-21wpa_supplicant11:30:120
13129830,1rtkit-daemon490-21rpcbind12:16:080
13129830,1rtkit-daemon356-21systemd-journal12:04:550
13129830,1rtkit-daemon356-21systemd-journal10:50:010
13129830,1rtkit-daemon356-21systemd-journal07:50:290
13129830,1rtkit-daemon3191333-21snmpd08:15:220
13129830,1rtkit-daemon3191333-21snmpd07:30:230
13129830,1rtkit-daemon269977-21sendmail-mta10:57:290
13129830,1rtkit-daemon1-21systemd12:23:580
13129830,1rtkit-daemon1-21systemd10:32:150
13129830,1rtkit-daemon1-21systemd10:29:390
13129830,1rtkit-daemon1-21systemd10:16:090
13129830,1rtkit-daemon1-21systemd10:09:100
13129830,1rtkit-daemon1-21systemd09:46:250
13129830,1rtkit-daemon1-21systemd09:43:050
13129830,1rtkit-daemon1-21systemd09:35:340
13129830,1rtkit-daemon1-21systemd09:29:300
13129830,1rtkit-daemon1-21systemd09:21:010
13129830,1rtkit-daemon1-21systemd09:11:550
13129830,1rtkit-daemon1-21systemd08:35:250
13129830,1rtkit-daemon1-21systemd08:34:160
13129830,1rtkit-daemon1-21systemd07:15:200
13129830,0rtkit-daemon0-21swapper/008:20:480
773180220,1sleep1773334-21diskstats12:00:141
755249221,1sleep128-21ksoftirqd/111:18:511
753061220,1sleep20-21swapper/211:13:172
738412220,1sleep10-21swapper/110:40:091
737011220,1sleep20-21swapper/210:35:182
731784220,1sleep1731811-21systemd-run10:25:001
725384220,0sleep10-21swapper/110:09:521
718638220,0sleep10-21swapper/109:53:591
716618220,0sleep20-21swapper/209:49:482
709739220,1sleep20-21swapper/209:33:152
707771220,1sleep10-21swapper/109:29:331
705962220,1sleep20-21swapper/209:25:112
692638220,1sleep20-21swapper/208:50:242
675368220,1sleep0675376-21apt-get08:10:000
674869220,1sleep10-21swapper/108:05:211
671321222,0sleep236-21ksoftirqd/207:57:462
654703220,1sleep20-21swapper/207:15:192
13129820,1rtkit-daemon714-21ntpd07:56:170
13129820,1rtkit-daemon653446-21munin-node09:05:450
13129820,1rtkit-daemon653446-21munin-node08:41:190
13129820,1rtkit-daemon524-21avahi-daemon08:51:130
13129820,1rtkit-daemon3191333-21snmpd11:55:350
13129820,1rtkit-daemon3191333-21snmpd08:45:140
13129820,1rtkit-daemon269977-21sendmail-mta07:45:440
13129820,1rtkit-daemon2121-21packagekitd11:36:030
13129820,1rtkit-daemon1-21systemd08:55:080
13129820,1rtkit-daemon1-21systemd07:10:430
13129820,0rtkit-daemon1-21systemd07:25:050
13129820,0rtkit-daemon0-21swapper/011:20:490
13129820,0rtkit-daemon0-21swapper/011:15:070
13129820,0rtkit-daemon0-21swapper/008:05:130
13129820,0rtkit-daemon0-21swapper/008:00:250
13129820,0rtkit-daemon0-21swapper/007:35:060
13129820,0rtkit-daemon0-21swapper/007:20:400
787818210,0sleep20-21swapper/212:35:132
787756210,0sleep10-21swapper/112:35:121
785630210,0sleep20-21swapper/212:30:122
785617210,0sleep10-21swapper/112:30:071
783985210,0sleep20-21swapper/212:25:172
783504210,0sleep10-21swapper/112:25:121
781570210,0sleep10-21swapper/112:20:191
781390210,0sleep20-21swapper/212:20:122
779291210,0sleep10-21swapper/112:15:151
779239210,0sleep20-21swapper/212:15:082
777348210,0sleep20-21swapper/212:10:162
777195210,0sleep10-21swapper/112:10:141
775275210,0sleep10-21swapper/112:05:141
775037210,0sleep20-21swapper/212:05:112
772899210,0sleep20-21swapper/212:00:112
771189210,0sleep10-21swapper/111:55:141
770761210,0sleep20-21swapper/211:55:112
768644210,0sleep20-21swapper/211:50:102
766703210,0sleep10-21swapper/111:45:171
766049210,0sleep20-21swapper/211:45:022
764441210,0sleep10-21swapper/111:40:181
763878210,0sleep20-21swapper/211:40:032
762443210,0sleep10-21swapper/111:35:161
762018210,0sleep20-21swapper/211:35:132
761267210,0sleep20-21swapper/211:30:492
760344210,0sleep10-21swapper/111:30:161
758239210,0sleep20-21swapper/211:25:182
758207210,0sleep10-21swapper/111:25:171
756079210,0sleep20-21swapper/211:20:132
755811210,0sleep10-21swapper/111:20:121
754285210,0sleep20-21swapper/211:15:202
752399210,0sleep10-21swapper/111:10:241
749453210,0sleep20-21swapper/211:05:162
749214210,0sleep10-21swapper/111:05:151
747001210,0sleep10-21swapper/111:00:141
745218210,0sleep10-21swapper/110:55:151
744857210,0sleep20-21swapper/210:55:122
742688210,0sleep20-21swapper/210:50:112
742641210,0sleep10-21swapper/110:50:061
741948210,0sleep20-21swapper/210:46:112
740596210,0sleep10-21swapper/110:45:141
738441210,0sleep20-21swapper/210:40:112
736024210,0sleep10-21swapper/110:35:011
734389210,0sleep10-21swapper/110:30:141
734155210,0sleep20-21swapper/210:30:102
732533210,0sleep20-21swapper/210:25:192
732161210,0sleep10-21swapper/110:25:131
729643210,0sleep20-21swapper/210:20:012
728028210,0sleep10-21swapper/110:15:131
727525210,0sleep20-21swapper/210:15:012
725780210,0sleep20-21swapper/210:10:142
725680210,0sleep10-21swapper/110:10:121
723568210,0sleep20-21swapper/210:05:122
722743210,0sleep10-21swapper/110:00:231
721510210,0sleep20-21swapper/210:00:122
719306210,0sleep20-21swapper/209:55:132
719282210,0sleep10-21swapper/109:55:111
716892210,0sleep20-21swapper/209:50:082
714803210,0sleep10-21swapper/109:45:101
713152210,0sleep20-21swapper/209:40:202
712772210,0sleep10-21swapper/109:40:141
710790210,0sleep10-21swapper/109:35:181
710542210,0sleep20-21swapper/209:35:152
708069210,0sleep10-21swapper/109:30:051
703837210,0sleep10-21swapper/109:20:131
703576210,0sleep20-21swapper/209:20:102
702855210,0sleep20-21swapper/209:16:182
701168210,0sleep10-21swapper/109:15:021
700097210,0sleep20-21swapper/209:10:222
699046210,0sleep10-21swapper/109:10:001
697795210,0sleep10-21swapper/109:05:161
697148210,0sleep20-21swapper/209:05:012
695513210,0sleep10-21swapper/109:00:211
695176210,0sleep20-21swapper/209:00:012
693600210,0sleep10-21swapper/108:55:121
693252210,0sleep20-21swapper/208:55:022
691681210,0sleep10-21swapper/108:50:151
689803210,0sleep20-21swapper/208:45:122
689709210,0sleep10-21swapper/108:45:121
687981210,0sleep10-21swapper/108:40:111
686393210,0sleep20-21swapper/208:35:192
685846210,0sleep10-21swapper/108:35:141
684039210,0sleep20-21swapper/208:30:112
683884210,0sleep10-21swapper/108:30:101
682218210,0sleep10-21swapper/108:25:141
681941210,0sleep20-21swapper/208:25:122
680008210,0sleep20-21swapper/208:20:112
678492210,0sleep20-21swapper/208:15:142
678245210,0sleep10-21swapper/108:15:131
676112210,0sleep20-21swapper/208:10:192
675908210,0sleep10-21swapper/108:10:141
673698210,0sleep20-21swapper/208:05:102
672285210,0sleep10-21swapper/108:00:211
671939210,0sleep20-21swapper/208:00:182
670248210,0sleep10-21swapper/107:55:131
668507210,0sleep10-21swapper/107:50:161
667656210,0sleep20-21swapper/207:50:012
666407210,0sleep10-21swapper/107:45:161
666049210,0sleep20-21swapper/207:45:132
664578210,0sleep10-21swapper/107:40:171
664188210,0sleep20-21swapper/207:40:142
662439210,0sleep10-21swapper/107:35:151
662034210,0sleep20-21swapper/207:35:122
660344210,0sleep20-21swapper/207:30:122
660154210,0sleep10-21swapper/107:30:111
658296210,0sleep20-21swapper/207:25:172
658202210,0sleep10-21swapper/107:25:161
656404210,0sleep10-21swapper/107:20:141
655982210,0sleep20-21swapper/207:20:112
654259210,0sleep10-21swapper/107:15:141
652156210,0sleep20-21swapper/207:10:162
679997200,0sleep10-21swapper/108:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional