You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 18:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Dec 10, 2023 12:45:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1809121360,2sleep12021-21lldpd11:54:081
1568721360,1sleep215677-21sshd09:39:302
1635021300,8sleep1138550irq/27-eth012:33:211
792021220,1sleep17919-21sshd10:24:271
973721020,3sleep32035-21lldpd-portmirro09:59:443
79912990,4sleep22674999cyclictest12:32:172
193322990,2sleep20-21swapper/211:54:172
143412970,2sleep22674999cyclictest09:43:392
66142940,2sleep00-21swapper/009:42:370
263762940,3sleep126377-21sshd09:49:241
24392940,3sleep32035-21lldpd-portmirro11:16:443
227352920,1sleep01955-21snmpd09:10:420
227352920,1sleep01955-21snmpd09:10:420
180512920,0sleep018039-21cp11:30:290
289632910,3sleep22021-21lldpd11:35:412
97312900,1sleep00-21swapper/010:49:150
84112900,3sleep32675399cyclictest09:51:063
238342900,2sleep32675399cyclictest10:59:143
208432900,3sleep22021-21lldpd12:18:102
178892900,2sleep32035-21lldpd-portmirro11:22:383
261012890,3sleep226099-21sshd10:39:032
193102890,1sleep026735-21cyclictest09:27:210
255332880,1sleep10-21swapper/110:05:431
273422870,1sleep02035-21lldpd-portmirro11:15:460
123592870,4sleep10-21swapper/109:30:361
144972850,2sleep31875-21nfsd10:08:333
260552790,2sleep12021-21lldpd11:35:241
73562780,1sleep07351-21bash12:28:180
326482780,5sleep32675399cyclictest11:40:113
142602770,1sleep00-21swapper/010:21:020
36922740,2sleep12674499cyclictest09:42:151
62682710,0sleep00-21swapper/010:03:220
232692690,1sleep02035-21lldpd-portmirro10:13:570
166022660,1sleep016598-21bash10:58:180
98772610,3sleep12035-21lldpd-portmirro10:03:501
90402490,0sleep39039-21sshd11:33:213
308522380,35sleep2138550irq/27-eth009:16:022
137222370,0sleep00-21swapper/011:53:350
206402350,33sleep2138550irq/27-eth010:42:252
261392340,1sleep20-21swapper/210:22:362
202542340,31sleep2138550irq/27-eth012:37:482
64812320,3sleep12035-21lldpd-portmirro11:13:151
96912310,1sleep09677-21sshd12:20:410
9272310,3sleep12674499cyclictest12:27:311
41642310,3sleep14160-21bash12:00:201
241342310,29sleep2138550irq/27-eth010:55:132
97532302,26sleep2138550irq/27-eth010:45:152
96652300,3sleep22035-21lldpd-portmirro10:16:152
76372300,2sleep10-21swapper/111:40:571
321672300,2sleep31955-21snmpd10:31:393
98592290,2sleep12035-21lldpd-portmirro10:32:581
53532290,26sleep2138550irq/27-eth010:52:482
125002283,22sleep2138550irq/27-eth010:04:132
64992270,1sleep01943-21snmpd09:46:460
265752270,1sleep32675399cyclictest09:24:093
91722260,0sleep11955-21snmpd07:40:341
178102260,0sleep22021-21lldpd09:22:582
30572250,1sleep22674999cyclictest11:28:432
29752251,21sleep2138550irq/27-eth007:27:022
2674999258,7cyclictest2021-21lldpd07:16:522
26741992523,1cyclictest2021-21lldpd07:31:210
2674499241,16cyclictest0-21swapper/112:05:411
26741992420,2cyclictest2035-21lldpd-portmirro10:30:120
219982240,21sleep2138550irq/27-eth011:23:112
96262230,20sleep2138550irq/27-eth009:13:252
96262230,20sleep2138550irq/27-eth009:13:252
278422230,21sleep2138550irq/27-eth011:43:312
275382230,2sleep12035-21lldpd-portmirro10:51:261
2675399233,11cyclictest0-21swapper/311:29:243
26753992317,4cyclictest6664-21sshd10:36:333
2674999235,7cyclictest1955-21snmpd12:20:352
2674999231,3cyclictest0-21swapper/212:28:062
2674999230,17cyclictest33-21ksoftirqd/212:11:082
2674499230,7cyclictest4213-21sshd10:40:211
2674199233,3cyclictest24682-21sshd11:46:590
2674199232,20cyclictest1805-40kipmi007:15:290
24952230,20sleep2138550irq/27-eth011:56:062
11052230,1sleep01943-21snmpd09:33:230
101142230,3sleep22021-21lldpd07:45:012
2674999227,5cyclictest28314-21sshd12:07:112
2674499229,5cyclictest30409-21sshd09:37:071
2674499223,13cyclictest0-21swapper/110:46:181
2674499222,15cyclictest0-21swapper/109:09:201
2674499222,14cyclictest2035-21lldpd-portmirro07:15:261
26744992210,7cyclictest2035-21lldpd-portmirro09:24:191
2674499220,1cyclictest21686-21sshd10:26:081
26741992219,1cyclictest8234-21sshd10:53:100
22642220,3sleep12035-21lldpd-portmirro11:20:391
106622222,18sleep2138550irq/27-eth012:01:032
2675399214,12cyclictest2035-21lldpd-portmirro10:28:393
2675399214,11cyclictest21611-21sshd09:27:413
2675399210,15cyclictest25686-21sshd09:15:263
2674999217,6cyclictest2035-21lldpd-portmirro08:11:242
2674999211,4cyclictest27502-21sshd10:10:152
26749992112,7cyclictest24697-21sshd10:30:372
2674999210,3cyclictest138550irq/27-eth009:57:152
2674999210,3cyclictest138550irq/27-eth009:49:102
2674499216,11cyclictest2035-21lldpd-portmirro09:54:211
2674499213,8cyclictest2021-21lldpd11:31:281
26744992117,2cyclictest6663-21sshd10:36:331
2674499210,15cyclictest2021-21lldpd10:18:291
2674499210,13cyclictest0-21swapper/108:05:431
2674499210,13cyclictest0-21swapper/108:05:421
2674199213,5cyclictest0-21swapper/007:12:330
2674199213,14cyclictest2021-21lldpd07:54:000
26741992116,4cyclictest3-21ksoftirqd/009:35:220
2674199211,19cyclictest0-21swapper/008:30:440
26741992110,5cyclictest2021-21lldpd11:13:100
2674199210,3cyclictest12145-21sshd09:55:460
2674199210,17cyclictest0-21swapper/007:47:340
138652210,19sleep2138550irq/27-eth011:45:392
2675399208,7cyclictest0-21swapper/310:00:163
2675399206,10cyclictest30664-21rm11:00:053
2675399205,11cyclictest29962-21sshd10:14:493
2675399203,12cyclictest6011-21sshd10:44:453
2675399203,12cyclictest2021-21lldpd11:54:103
2675399201,5cyclictest0-21swapper/308:13:393
2675399201,5cyclictest0-21swapper/307:16:293
26753992015,4cyclictest2021-21lldpd11:39:143
26753992015,4cyclictest11714-21sshd09:38:573
26753992014,4cyclictest5680-21sshd12:28:063
26753992014,4cyclictest28593-21bash10:18:463
26753992014,4cyclictest23503-21sshd12:30:203
26753992013,4cyclictest2021-21lldpd11:55:083
2674999207,5cyclictest2021-21lldpd08:00:572
2674999207,5cyclictest2021-21lldpd08:00:562
26749992016,3cyclictest7241-21sshd10:28:282
26749992015,3cyclictest28655-21bash11:03:532
2674999200,18cyclictest33-21ksoftirqd/211:31:292
2674499207,9cyclictest1955-21snmpd07:30:411
2674499204,9cyclictest2035-21lldpd-portmirro11:06:281
2674499204,8cyclictest20267-21sshd10:58:461
2674499204,11cyclictest2021-21lldpd12:12:281
2674499203,11cyclictest1955-21snmpd10:12:101
26744992015,3cyclictest18219-21sshd12:21:431
2674499200,9cyclictest12384-21sshd11:29:521
2674499200,19cyclictest0-21swapper/108:53:461
2674499200,15cyclictest21041-21sshd09:27:371
2674499200,14cyclictest12586-21sshd12:36:481
2674199206,1cyclictest2035-21lldpd-portmirro12:10:410
2674199205,9cyclictest0-21swapper/012:03:050
2674199205,2cyclictest0-21swapper/010:06:400
2674199204,2cyclictest1943-21snmpd11:06:480
2674199202,4cyclictest0-21swapper/007:39:120
2674199202,15cyclictest0-21swapper/008:24:020
2674199202,14cyclictest1955-21snmpd07:21:520
26741992018,1cyclictest2035-21lldpd-portmirro10:44:390
26741992018,1cyclictest2021-21lldpd08:09:460
26741992018,1cyclictest2021-21lldpd08:09:460
26741992018,1cyclictest0-21swapper/007:58:070
26741992016,3cyclictest1605-21avahi-daemon12:08:110
26741992015,2cyclictest3-21ksoftirqd/011:26:550
2674199200,19cyclictest1955-21snmpd08:53:470
2674199200,17cyclictest0-21swapper/009:05:070
2674199200,14cyclictest600-21sshd12:19:410
113552200,2sleep311343-21sshd12:01:073
2675399195,4cyclictest344-21ntpdc12:15:373
2675399195,2cyclictest2035-21lldpd-portmirro10:53:133
2675399191,7cyclictest1326-21sshd12:35:273
26753991914,4cyclictest30051-21sshd12:07:253
26753991914,3cyclictest6888-21bash12:12:273
26753991914,3cyclictest2021-21lldpd10:22:103
26753991913,4cyclictest27135-21sshd11:47:193
26753991913,4cyclictest21590-21sshd09:40:173
26753991912,5cyclictest2021-21lldpd09:46:323
2675399190,18cyclictest0-21swapper/308:53:463
2674999199,3cyclictest138550irq/27-eth011:08:212
2674999197,6cyclictest2021-21lldpd08:44:442
2674999197,5cyclictest2035-21lldpd-portmirro09:05:382
26749991914,3cyclictest6992-21bash09:50:542
26749991914,3cyclictest22396-21bash10:05:252
2674499196,9cyclictest1943-21snmpd08:40:171
2674499196,7cyclictest1955-21snmpd08:00:251
2674499196,7cyclictest1955-21snmpd08:00:251
2674499193,11cyclictest7259-21sshd09:13:071
2674499193,11cyclictest7259-21sshd09:13:071
2674499193,10cyclictest0-21swapper/112:19:101
26744991914,3cyclictest11533-21sshd11:01:381
2674499191,11cyclictest1943-21snmpd09:59:341
2674499190,5cyclictest2021-21lldpd08:32:151
2674499190,14cyclictest1943-21snmpd11:18:551
2674199199,9cyclictest0-21swapper/008:16:250
2674199199,4cyclictest2035-21lldpd-portmirro11:39:340
2674199199,4cyclictest0-21swapper/009:01:200
2674199199,3cyclictest0-21swapper/009:21:420
2674199193,9cyclictest0-21swapper/011:23:580
2674199193,6cyclictest10-21rcuc/009:54:370
2674199193,11cyclictest10-21rcuc/010:16:110
2674199192,4cyclictest0-21swapper/008:58:370
2674199192,2cyclictest24774-21sshd11:03:230
2674199192,14cyclictest0-21swapper/008:12:220
2674199192,12cyclictest0-21swapper/008:35:040
2674199191,6cyclictest17981-21cp10:25:390
26741991916,2cyclictest3-21ksoftirqd/010:36:320
26741991912,3cyclictest26341-21id11:55:090
26741991912,3cyclictest2035-21lldpd-portmirro12:39:350
26741991910,4cyclictest0-21swapper/008:46:150
26741991910,4cyclictest0-21swapper/008:00:070
26741991910,4cyclictest0-21swapper/008:00:060
189802190,16sleep2138550irq/27-eth008:05:002
189802190,16sleep2138550irq/27-eth008:05:002
2675399183,11cyclictest2035-21lldpd-portmirro10:45:143
2675399183,11cyclictest2021-21lldpd12:20:433
2675399181,8cyclictest2021-21lldpd07:20:133
26753991814,3cyclictest2021-21lldpd09:13:503
26753991814,3cyclictest2021-21lldpd09:13:503
26753991813,4cyclictest2021-21lldpd08:23:533
26753991813,3cyclictest2021-21lldpd07:50:293
26753991813,3cyclictest1955-21snmpd11:05:023
2675399181,13cyclictest0-21swapper/307:56:273
2675399180,8cyclictest7570-21sshd09:30:043
2675399180,8cyclictest31126-21id11:12:153
2675399180,13cyclictest3487-21munin-node07:30:433
2674999184,12cyclictest2035-21lldpd-portmirro11:15:142
2674999181,6cyclictest2035-21lldpd-portmirro08:30:402
26749991814,2cyclictest2021-21lldpd09:32:262
26749991813,3cyclictest3264-21bash09:25:182
26749991812,4cyclictest33-21ksoftirqd/211:10:592
2674999181,15cyclictest0-21swapper/208:18:052
2674999180,9cyclictest0-21swapper/207:34:472
2674999180,9cyclictest0-21swapper/207:13:302
2674499186,10cyclictest2021-21lldpd07:21:031
2674499183,11cyclictest2021-21lldpd08:45:191
26744991812,4cyclictest2035-21lldpd-portmirro11:55:081
2674499181,11cyclictest0-21swapper/111:45:251
2674499180,8cyclictest23175-21sshd09:15:111
2674499180,12cyclictest2035-21lldpd-portmirro07:47:321
2674499180,12cyclictest2035-21lldpd-portmirro07:28:111
2674199184,9cyclictest0-21swapper/007:40:450
2674199183,9cyclictest2021-21lldpd12:30:520
2674199183,4cyclictest0-21swapper/008:43:120
2674199183,2cyclictest1955-21snmpd08:26:570
2674199183,11cyclictest1943-21snmpd09:16:230
26741991810,2cyclictest2807-21sshd11:44:250
2675399175,4cyclictest2021-21lldpd07:35:063
2675399173,6cyclictest2035-21lldpd-portmirro07:41:343
2675399173,12cyclictest0-21swapper/307:26:543
2675399172,14cyclictest1943-21snmpd07:10:003
2675399171,3cyclictest0-21swapper/307:47:483
2675399171,2cyclictest147450irq/28-eth1-rx-08:09:053
2675399171,2cyclictest147450irq/28-eth1-rx-08:09:043
26753991712,4cyclictest2021-21lldpd08:04:403
26753991712,4cyclictest2021-21lldpd08:04:403
26753991711,5cyclictest2035-21lldpd-portmirro09:00:323
26753991711,5cyclictest1955-21snmpd08:18:043
2674999171,5cyclictest2021-21lldpd07:47:112
2674999171,4cyclictest2021-21lldpd08:54:462
2674999171,4cyclictest2021-21lldpd07:37:112
2674999171,4cyclictest0-21swapper/208:56:132
2674999171,15cyclictest0-21swapper/208:21:102
2674999171,15cyclictest0-21swapper/207:51:582
2674999170,5cyclictest2035-21lldpd-portmirro08:45:052
2674999170,15cyclictest0-21swapper/207:20:292
2674499176,7cyclictest2121-21runrttasks08:35:561
2674499173,5cyclictest1955-21snmpd07:55:321
2674499172,6cyclictest2021-21lldpd07:50:591
2674499172,11cyclictest0-21swapper/109:01:531
2674499170,15cyclictest2035-21lldpd-portmirro08:21:231
2674499170,15cyclictest2021-21lldpd08:56:591
2674499170,15cyclictest2021-21lldpd08:11:411
2674499170,13cyclictest2035-21lldpd-portmirro07:37:261
26741991710,2cyclictest2021-21lldpd07:25:510
2675399164,3cyclictest1955-21snmpd08:46:323
2675399162,13cyclictest1955-21snmpd09:05:323
26753991611,4cyclictest2035-21lldpd-portmirro08:40:483
26753991611,4cyclictest1955-21snmpd08:25:223
2675399160,4cyclictest2021-21lldpd08:37:203
2674999161,3cyclictest0-21swapper/207:55:212
2674999161,13cyclictest2035-21lldpd-portmirro08:25:012
2674999161,13cyclictest2021-21lldpd09:00:312
2674999160,4cyclictest2021-21lldpd08:35:262
2674499160,8cyclictest1943-21snmpd07:11:101
2674499160,7cyclictest2021-21lldpd08:25:511
2674499160,7cyclictest1955-21snmpd08:15:141
2675399153,3cyclictest1943-21snmpd08:55:003
2675399151,6cyclictest1955-21snmpd08:30:183
2674999120,10cyclictest26792-21cat07:10:012
265452120,10sleep32021-21lldpd07:09:393
264822120,10sleep10-21swapper/107:09:011
265322111,2sleep00-21swapper/007:09:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional