You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Fri Jul 26, 2024 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50555799650,2cyclictest667270-21sshd11:43:301
505557996242,18cyclictest590916-21kworker/1:210:15:131
505557996157,2cyclictest531063-21kworker/1:008:30:121
505557996144,15cyclictest3394639-1kworker/1:0H08:49:301
505557996043,15cyclictest542399-21kworker/1:209:25:141
505557996042,17cyclictest518392-21kworker/1:308:05:121
505557996042,17cyclictest503599-21kworker/1:107:10:141
505557995943,15cyclictest613458-21kworker/1:010:40:221
505557995943,15cyclictest542399-21kworker/1:209:05:011
505557995843,14cyclictest683363-21kworker/1:112:16:361
505557995843,14cyclictest664779-21kworker/1:312:00:211
505557995843,14cyclictest613458-21kworker/1:011:16:361
505557995843,14cyclictest613458-21kworker/1:011:10:161
505557995843,14cyclictest613458-21kworker/1:011:10:161
505557995843,14cyclictest613458-21kworker/1:010:35:151
505557995843,14cyclictest542399-21kworker/1:209:24:071
505557995843,14cyclictest518392-21kworker/1:307:50:001
505557995842,15cyclictest590916-21kworker/1:210:10:061
505557995842,15cyclictest542399-21kworker/1:209:10:131
505557995842,15cyclictest535716-21kworker/1:308:40:131
505557995842,15cyclictest518392-21kworker/1:308:15:061
505557995842,15cyclictest514304-21kworker/1:107:35:071
505557995842,15cyclictest3394639-1kworker/1:0H11:24:071
505557995842,15cyclictest3394639-1kworker/1:0H08:55:151
505557995838,18cyclictest503599-21kworker/1:107:15:021
505557995754,2cyclictest0-21swapper/109:32:361
505557995742,14cyclictest664779-21kworker/1:312:05:171
505557995742,14cyclictest613458-21kworker/1:011:30:061
505557995742,14cyclictest613458-21kworker/1:010:55:001
505557995742,14cyclictest607752-21kworker/1:210:28:071
505557995742,14cyclictest582116-21kworker/1:010:00:131
505557995742,14cyclictest518392-21kworker/1:308:20:141
505557995742,14cyclictest518392-21kworker/1:308:10:011
505557995742,14cyclictest518392-21kworker/1:307:55:121
505557995742,14cyclictest511067-21kworker/1:007:30:141
505557995741,15cyclictest683363-21kworker/1:112:20:321
505557995741,15cyclictest664779-21kworker/1:312:13:471
505557995741,15cyclictest664779-21kworker/1:311:51:371
505557995741,15cyclictest582116-21kworker/1:010:05:011
505557995741,15cyclictest577759-21kworker/1:309:50:151
505557995741,15cyclictest515948-21kworker/1:207:40:021
50555799571,2cyclictest0-21swapper/108:28:301
505557995641,14cyclictest687675-21kworker/1:012:25:121
505557995641,14cyclictest518392-21kworker/1:308:00:151
505557995640,15cyclictest687675-21kworker/1:012:36:411
505557995640,15cyclictest630517-21kworker/1:211:00:161
505557995640,15cyclictest531063-21kworker/1:008:35:131
505557995640,15cyclictest3394639-1kworker/1:0H07:25:131
505557995639,16cyclictest613458-21kworker/1:011:05:211
505557995639,16cyclictest567230-21kworker/1:009:45:131
505557995638,17cyclictest613458-21kworker/1:011:35:131
505557995540,14cyclictest664779-21kworker/1:311:45:031
505557995540,14cyclictest613458-21kworker/1:010:51:361
505557995540,14cyclictest607752-21kworker/1:210:30:121
505557995540,14cyclictest535716-21kworker/1:308:50:131
505557995538,16cyclictest503599-21kworker/1:107:20:121
505559995448,4cyclictest491731-21kworker/2:008:55:112
505557995439,14cyclictest664779-21kworker/1:311:58:061
505557995439,14cyclictest542399-21kworker/1:209:15:111
505557995439,14cyclictest515948-21kworker/1:207:45:001
505557995338,14cyclictest3394639-1kworker/1:0H11:25:471
505554995348,3cyclictest278-1kworker/0:2H08:10:230
505554995338,13cyclictest509186-21kworker/0:208:50:130
505563995249,2cyclictest490100-21kworker/3:107:17:063
505563995248,3cyclictest520804-21kworker/3:007:52:013
505559995246,3cyclictest2322723-1kworker/2:0H07:40:012
505559995245,5cyclictest592809-21kworker/2:011:10:002
505557995249,2cyclictest26250irq/16-i801_smb10:21:031
505557995237,14cyclictest687675-21kworker/1:012:34:361
505557995237,14cyclictest621444-21kworker/1:310:45:141
505557995237,14cyclictest542399-21kworker/1:209:35:181
505557995236,15cyclictest542399-21kworker/1:209:01:361
505563995147,2cyclictest675221-21kworker/3:112:15:493
505559995146,3cyclictest491731-21kworker/2:008:40:112
505559995145,3cyclictest2322723-1kworker/2:0H11:02:012
505559995145,3cyclictest2322723-1kworker/2:0H07:40:002
505557995136,14cyclictest567230-21kworker/1:009:44:071
505554995142,7cyclictest278-1kworker/0:2H11:35:120
505563995046,3cyclictest583921-21kworker/3:010:17:363
505563995046,2cyclictest675221-21kworker/3:112:07:353
505559995046,2cyclictest592809-21kworker/2:010:45:302
505559995046,2cyclictest491731-21kworker/2:009:25:352
505559995045,3cyclictest656213-21kworker/2:012:13:212
505559995045,3cyclictest2322723-1kworker/2:0H09:55:062
505554995045,3cyclictest634706-21kworker/0:111:05:270
505563994946,2cyclictest511066-21kworker/3:007:28:063
505563994945,3cyclictest516014-21kworker/3:207:40:273
505559994945,2cyclictest573114-21kworker/2:109:50:222
505559994944,3cyclictest656213-21kworker/2:011:55:392
505559994944,3cyclictest2322723-1kworker/2:0H10:50:302
50555799490,48cyclictest0-21swapper/109:55:121
505563994844,2cyclictest571492-21kworker/3:109:57:073
505563994844,2cyclictest511066-21kworker/3:007:24:013
505559994845,2cyclictest573114-21kworker/2:110:02:362
505559994843,3cyclictest2322723-1kworker/2:0H10:27:362
505559994842,3cyclictest2322723-1kworker/2:0H12:20:362
505563994744,2cyclictest540509-21kworker/3:209:01:093
505563994744,2cyclictest532420-21kworker/3:108:35:273
505563994743,3cyclictest631830-21kworker/3:010:59:123
505563994743,2cyclictest3394600-1kworker/3:2H09:25:003
505559994744,2cyclictest656213-21kworker/2:011:52:322
505559994743,2cyclictest491731-21kworker/2:009:18:352
505559994743,2cyclictest491731-21kworker/2:007:15:212
505559994742,2cyclictest2322723-1kworker/2:0H08:45:142
505554994744,2cyclictest666126-21kworker/0:011:50:120
505554994744,2cyclictest278-1kworker/0:2H12:20:020
505554994738,7cyclictest278-1kworker/0:2H07:55:120
505563994643,2cyclictest662551-21kworker/3:211:40:263
505563994643,2cyclictest3394600-1kworker/3:2H09:43:013
505563994641,3cyclictest3394600-1kworker/3:2H10:35:273
505563994641,2cyclictest3394600-1kworker/3:2H08:40:113
505563994640,4cyclictest3394600-1kworker/3:2H12:39:353
505559994643,2cyclictest656213-21kworker/2:011:42:362
505559994641,3cyclictest2322723-1kworker/2:0H11:17:052
505559994638,5cyclictest2322723-1kworker/2:0H09:30:192
505554994641,3cyclictest540513-21kworker/0:109:45:120
505554994641,3cyclictest278-1kworker/0:2H10:30:160
505563994542,2cyclictest687420-21kworker/3:012:26:033
505563994542,2cyclictest571492-21kworker/3:109:51:353
505563994542,2cyclictest3394600-1kworker/3:2H07:34:353
505563994540,3cyclictest3394600-1kworker/3:2H11:33:293
505559994542,2cyclictest640475-21kworker/2:211:10:462
505559994542,2cyclictest640475-21kworker/2:211:10:462
505559994542,2cyclictest491731-21kworker/2:007:30:112
505559994540,3cyclictest2322723-1kworker/2:0H10:30:062
505559994539,4cyclictest2322723-1kworker/2:0H12:05:002
505554994540,3cyclictest278-1kworker/0:2H11:57:370
505563994441,2cyclictest610943-21kworker/3:110:32:013
505563994440,3cyclictest644260-21kworker/3:111:27:563
505563994439,3cyclictest3394600-1kworker/3:2H10:22:013
505559994441,2cyclictest573114-21kworker/2:110:05:212
505559994440,2cyclictest2322723-1kworker/2:0H12:38:352
505559994439,3cyclictest2322723-1kworker/2:0H09:10:012
505559994439,2cyclictest2322723-1kworker/2:0H07:55:122
505554994440,3cyclictest617064-21kworker/0:010:54:110
505554994439,3cyclictest509186-21kworker/0:208:05:190
505554994439,3cyclictest278-1kworker/0:2H11:45:360
505554994438,3cyclictest278-1kworker/0:2H12:05:130
505554994436,6cyclictest278-1kworker/0:2H10:15:130
505563994340,2cyclictest675221-21kworker/3:112:00:273
505563994340,2cyclictest511066-21kworker/3:007:36:203
505563994340,2cyclictest3394600-1kworker/3:2H10:04:563
505563994339,2cyclictest3394600-1kworker/3:2H09:30:053
505563994336,4cyclictest3394600-1kworker/3:2H08:28:303
505559994340,2cyclictest592809-21kworker/2:010:41:352
505559994340,2cyclictest491731-21kworker/2:009:04:422
505559994340,2cyclictest491731-21kworker/2:007:12:062
505559994338,3cyclictest2322723-1kworker/2:0H08:20:142
505559994337,4cyclictest2322723-1kworker/2:0H09:23:362
505554994340,2cyclictest670301-21kworker/0:212:18:360
505554994339,3cyclictest278-1kworker/0:2H10:11:030
505554994338,3cyclictest540513-21kworker/0:110:25:000
505554994338,3cyclictest278-1kworker/0:2H11:30:150
505554994338,3cyclictest278-1kworker/0:2H10:41:410
505554994337,3cyclictest278-1kworker/0:2H11:22:300
505554994337,3cyclictest278-1kworker/0:2H09:20:140
505554994336,5cyclictest540513-21kworker/0:109:55:130
505563994239,2cyclictest532420-21kworker/3:108:47:013
505559994239,2cyclictest491731-21kworker/2:008:51:052
505559994239,2cyclictest491731-21kworker/2:007:53:062
505559994238,3cyclictest2322723-1kworker/2:0H07:45:052
505559994238,2cyclictest2322723-1kworker/2:0H12:30:032
505559994237,3cyclictest2322723-1kworker/2:0H10:10:382
505554994239,2cyclictest509186-21kworker/0:208:30:190
505554994239,2cyclictest278-1kworker/0:2H08:58:360
505554994239,2cyclictest278-1kworker/0:2H07:15:270
505554994238,3cyclictest278-1kworker/0:2H07:40:320
505554994237,3cyclictest587288-21kworker/0:010:05:000
505554994230,10cyclictest0-21swapper/009:15:160
505563994138,2cyclictest519192-21kworker/3:107:55:483
505563994137,2cyclictest3394600-1kworker/3:2H12:10:363
505563994136,3cyclictest561222-21kworker/3:209:35:233
505559994138,2cyclictest491731-21kworker/2:009:35:422
505554994138,2cyclictest278-1kworker/0:2H12:02:350
505554994137,2cyclictest278-1kworker/0:2H12:11:180
505554994137,2cyclictest278-1kworker/0:2H09:25:360
505554994136,3cyclictest278-1kworker/0:2H10:35:140
50555499411,5cyclictest378-21systemd-journal07:21:300
505563994037,2cyclictest3394600-1kworker/3:2H08:19:553
505563994036,2cyclictest3394600-1kworker/3:2H11:20:333
505563994035,3cyclictest3394600-1kworker/3:2H09:45:163
505563994035,3cyclictest3394600-1kworker/3:2H08:10:003
505559994037,2cyclictest656213-21kworker/2:011:35:192
505559994037,2cyclictest592809-21kworker/2:010:55:202
505559994037,2cyclictest2322723-1kworker/2:0H08:08:372
505559994036,2cyclictest592809-21kworker/2:010:35:322
505559994036,2cyclictest2322723-1kworker/2:0H11:45:032
505559994036,2cyclictest2322723-1kworker/2:0H08:00:152
505559994034,3cyclictest2322723-1kworker/2:0H11:32:302
505554994036,2cyclictest278-1kworker/0:2H08:20:480
505554994036,2cyclictest278-1kworker/0:2H07:32:070
505563993936,2cyclictest519192-21kworker/3:108:05:003
505563993936,2cyclictest3394600-1kworker/3:2H09:25:043
505563993936,2cyclictest3394600-1kworker/3:2H08:14:553
505563993934,3cyclictest3394600-1kworker/3:2H11:12:303
505563993934,3cyclictest3394600-1kworker/3:2H11:12:303
505559993936,2cyclictest491731-21kworker/2:009:42:062
505559993936,2cyclictest491731-21kworker/2:007:27:012
505559993934,3cyclictest2322723-1kworker/2:0H08:26:362
505559993934,2cyclictest2322723-1kworker/2:0H08:30:122
505554993936,2cyclictest50350irq/160-enp0s2907:35:170
505554993936,2cyclictest278-1kworker/0:2H10:56:360
505554993935,2cyclictest509186-21kworker/0:208:25:490
505554993935,2cyclictest278-1kworker/0:2H12:35:120
505554993935,2cyclictest278-1kworker/0:2H11:40:120
505554993931,6cyclictest278-1kworker/0:2H08:20:000
50555499391,3cyclictest378-21systemd-journal10:50:000
505563993833,3cyclictest3394600-1kworker/3:2H09:10:133
505559993835,2cyclictest491731-21kworker/2:008:38:012
505554993835,2cyclictest278-1kworker/0:2H09:44:060
505554993835,2cyclictest278-1kworker/0:2H08:36:350
505554993834,2cyclictest278-1kworker/0:2H09:50:150
505563993734,2cyclictest3394600-1kworker/3:2H11:17:303
505563993733,3cyclictest3394600-1kworker/3:2H11:54:363
505563993733,2cyclictest3394600-1kworker/3:2H08:55:153
505563993732,3cyclictest3394600-1kworker/3:2H08:33:303
505559993734,2cyclictest640475-21kworker/2:211:25:422
505559993732,3cyclictest2322723-1kworker/2:0H12:05:242
505559993732,3cyclictest2322723-1kworker/2:0H11:20:232
505554993734,2cyclictest278-1kworker/0:2H07:28:360
505554993732,3cyclictest540513-21kworker/0:109:13:350
505563993633,2cyclictest3394600-1kworker/3:2H10:28:363
505563993632,3cyclictest3394600-1kworker/3:2H10:45:063
505563993631,3cyclictest3394600-1kworker/3:2H11:59:293
505563993631,3cyclictest3394600-1kworker/3:2H10:44:553
505563993631,3cyclictest3394600-1kworker/3:2H10:10:133
50556399360,34cyclictest0-21swapper/311:45:463
505554993633,2cyclictest278-1kworker/0:2H09:30:520
505554993632,2cyclictest278-1kworker/0:2H11:00:160
50555499360,8cyclictest569109-21systemd09:40:000
505563993532,2cyclictest3394600-1kworker/3:2H12:23:033
505563993531,3cyclictest3394600-1kworker/3:2H12:30:293
505563993531,3cyclictest3394600-1kworker/3:2H11:39:363
505563993530,3cyclictest623301-21kworker/3:210:55:003
50556399351,3cyclictest505547-21cyclictest11:03:433
505559993531,3cyclictest2322723-1kworker/2:0H09:45:062
505559993531,2cyclictest2322723-1kworker/2:0H12:17:122
505554993532,2cyclictest278-1kworker/0:2H08:47:360
50555499350,2cyclictest0-21swapper/011:10:390
50555499350,2cyclictest0-21swapper/011:10:380
505563993432,1cyclictest631830-21kworker/3:011:09:553
505563993431,2cyclictest3394600-1kworker/3:2H09:05:273
505559993431,2cyclictest656213-21kworker/2:012:29:302
50555499341,5cyclictest378-21systemd-journal07:50:000
505554993328,3cyclictest278-1kworker/0:2H09:05:220
50555499330,3cyclictest0-21swapper/012:30:210
505563993228,2cyclictest3394600-1kworker/3:2H08:25:003
505559993229,2cyclictest2322723-1kworker/2:0H10:15:582
50555499327,23cyclictest519865-21perl07:50:150
505554993229,2cyclictest634706-21kworker/0:111:28:060
50555499322,27cyclictest592778-21latency_hist10:10:000
50555499321,8cyclictest545423-21diskmemload11:18:090
50555499321,7cyclictest608761-21munin-run10:30:000
50555499321,3cyclictest0-21swapper/007:15:010
505563993024,3cyclictest3394600-1kworker/3:2H09:19:553
505559993028,1cyclictest592809-21kworker/2:010:23:112
505554993027,2cyclictest509186-21kworker/0:209:02:360
50555499300,5cyclictest537334-21unin-run08:45:000
505563992925,3cyclictest3394600-1kworker/3:2H08:50:393
505563992925,2cyclictest3394600-1kworker/3:2H07:50:003
505559992926,2cyclictest2322723-1kworker/2:0H07:20:062
50555499280,9cyclictest688145-21grep12:25:120
50555799273,22cyclictest0-21swapper/107:10:011
505554992724,2cyclictest278-1kworker/0:2H08:00:010
505559992621,3cyclictest2322723-1kworker/2:0H09:10:572
50555999250,12cyclictest527543-21/usr/sbin/munin08:15:232
505563992420,3cyclictest3394600-1kworker/3:2H07:10:013
50555999231,11cyclictest0-21swapper/208:10:122
50555499229,11cyclictest490367-21kworker/0:007:10:010
50556399213,12cyclictest590755-21ssh10:05:413
50556399129,2cyclictest0-21swapper/307:10:013
50555999129,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional