You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 10:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Sun Jul 13, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3693212996562,2cyclictest0-21swapper/120:54:011
3693216996435,21cyclictest1501592-1kworker/2:2H21:18:022
3693212996461,2cyclictest0-21swapper/123:32:151
3693212996460,2cyclictest0-21swapper/123:54:411
3693212996361,1cyclictest0-21swapper/121:00:411
3693212996360,2cyclictest0-21swapper/123:15:291
3693212996245,16cyclictest3782225-21kworker/1:123:45:201
3693212996244,16cyclictest3693050-1kworker/1:1H22:15:171
3693212996159,1cyclictest0-21swapper/120:28:301
3693212996045,14cyclictest3757635-21kworker/1:222:45:151
3693212996043,16cyclictest3740903-21kworker/1:121:58:441
369321299600,59cyclictest0-21swapper/100:14:111
369321299600,1cyclictest0-21swapper/122:27:301
3693212995957,1cyclictest0-21swapper/100:19:291
3693212995944,14cyclictest3768171-21kworker/1:023:00:161
3693212995944,14cyclictest3685218-21kworker/1:220:00:011
3693212995942,16cyclictest3693050-1kworker/1:1H20:25:001
3693212995856,1cyclictest0-21swapper/119:30:111
3693212995855,2cyclictest0-21swapper/122:01:121
3693212995843,15cyclictest3736806-21kworker/1:221:20:061
3693212995843,14cyclictest3782225-21kworker/1:123:40:151
3693212995843,14cyclictest3768171-21kworker/1:023:05:161
3693212995843,14cyclictest3768171-21kworker/1:022:55:171
3693212995843,14cyclictest3757635-21kworker/1:222:35:171
3693212995843,14cyclictest3705793-21kworker/1:019:45:291
3693212995843,14cyclictest3685218-21kworker/1:220:40:171
3693212995843,14cyclictest3685218-21kworker/1:220:38:291
3693212995843,14cyclictest3685218-21kworker/1:219:20:191
3693212995842,15cyclictest3775366-21kworker/1:223:24:291
369321299580,56cyclictest3732566-21fschecks_count21:05:171
3693216995751,4cyclictest1501592-1kworker/2:2H21:55:462
3693212995755,1cyclictest0-21swapper/122:33:231
3693212995755,1cyclictest0-21swapper/120:48:351
3693212995742,14cyclictest3799992-21kworker/1:000:35:011
3693212995742,14cyclictest3799992-21kworker/1:000:30:011
3693212995742,14cyclictest3793841-21kworker/1:200:24:551
3693212995742,14cyclictest3782225-21kworker/1:123:55:161
3693212995742,14cyclictest3775366-21kworker/1:223:25:001
3693212995742,14cyclictest3757635-21kworker/1:222:50:181
3693212995742,14cyclictest3757635-21kworker/1:222:20:171
3693212995742,14cyclictest3740903-21kworker/1:122:10:001
3693212995742,14cyclictest3736806-21kworker/1:221:25:151
3693212995742,14cyclictest3728789-21kworker/1:121:12:291
3693212995742,14cyclictest3693050-1kworker/1:1H19:57:531
3693212995742,14cyclictest3685218-21kworker/1:220:14:541
3693212995741,15cyclictest3685218-21kworker/1:220:15:171
3693212995740,16cyclictest3685218-21kworker/1:219:30:001
3693212995641,14cyclictest3793841-21kworker/1:200:25:191
3693212995641,14cyclictest3693050-1kworker/1:1H20:55:171
3693212995641,14cyclictest3685218-21kworker/1:220:33:021
3693212995640,15cyclictest3740903-21kworker/1:121:45:171
3693217995545,7cyclictest59116-1kworker/3:2H23:32:443
3693216995550,3cyclictest1501592-1kworker/2:2H23:55:482
3693212995553,1cyclictest0-21swapper/119:44:291
3693212995540,14cyclictest3768171-21kworker/1:023:10:161
3693212995540,14cyclictest3740903-21kworker/1:122:05:171
3693212995539,15cyclictest3782225-21kworker/1:100:05:011
3693212995539,15cyclictest3693050-1kworker/1:1H21:15:241
3693216995446,6cyclictest1501592-1kworker/2:2H20:40:242
3693212995439,14cyclictest3740903-21kworker/1:121:44:291
3693212995438,15cyclictest3782225-21kworker/1:100:03:371
3693212995438,15cyclictest3693050-1kworker/1:1H19:15:181
3693212995438,15cyclictest3685218-21kworker/1:219:10:171
3693212995437,16cyclictest3780037-21kworker/1:323:35:171
3693216995337,13cyclictest1501592-1kworker/2:2H20:22:532
3693212995351,1cyclictest0-21swapper/119:50:061
3693212995351,1cyclictest0-21swapper/119:50:051
3693212995339,14cyclictest3685218-21kworker/1:220:05:471
3693212995338,14cyclictest3740903-21kworker/1:121:50:201
3693212995337,15cyclictest3685218-21kworker/1:219:35:181
3693211995349,3cyclictest3798367-21kworker/0:100:35:150
3693217995248,2cyclictest3555590-21kworker/3:219:11:293
3693216995247,3cyclictest1501592-1kworker/2:2H20:56:352
3693216995236,9cyclictest1501592-1kworker/2:2H23:12:292
3693211995245,4cyclictest3442112-1kworker/0:0H00:25:140
3693216995146,3cyclictest1501592-1kworker/2:2H00:14:112
3693211995148,2cyclictest3442112-1kworker/0:0H20:25:150
3693211995147,2cyclictest3755152-21kworker/0:022:18:290
3693211995147,2cyclictest3721958-21kworker/0:221:12:540
3693211995147,2cyclictest3704941-21kworker/0:219:55:060
3693211995146,3cyclictest3761881-21kworker/0:022:38:160
3693217995046,3cyclictest59116-1kworker/3:2H21:28:353
3693216995046,3cyclictest1501592-1kworker/2:2H19:59:042
3693216995045,3cyclictest1501592-1kworker/2:2H20:04:592
3693216995044,4cyclictest1501592-1kworker/2:2H23:32:512
3693212995035,14cyclictest3757635-21kworker/1:222:40:141
3693212995035,14cyclictest3740903-21kworker/1:121:30:141
369321299500,49cyclictest0-21swapper/121:35:501
3693211995047,2cyclictest3771886-21kworker/0:023:04:290
3693211995047,2cyclictest3691540-21kworker/0:019:31:080
3693211995047,2cyclictest3691540-21kworker/0:019:15:400
3693217994942,4cyclictest59116-1kworker/3:2H22:05:163
3693216994945,2cyclictest1501592-1kworker/2:2H23:47:352
3693216994944,3cyclictest1501592-1kworker/2:2H19:45:152
3693216994944,3cyclictest1501592-1kworker/2:2H19:33:592
3693216994942,4cyclictest1501592-1kworker/2:2H23:15:152
3693211994946,2cyclictest3761881-21kworker/0:022:43:590
3693211994945,3cyclictest3442112-1kworker/0:0H00:02:540
3693217994844,3cyclictest3761882-21kworker/3:123:24:553
3693217994843,3cyclictest59116-1kworker/3:2H00:35:023
3693216994844,2cyclictest3716524-21kworker/2:123:00:012
3693216994837,8cyclictest1501592-1kworker/2:2H19:12:452
3693211994845,2cyclictest3740315-21kworker/0:221:52:300
3693211994844,3cyclictest3704941-21kworker/0:220:00:470
3693211994843,3cyclictest3691540-21kworker/0:019:26:560
3693211994841,4cyclictest3442112-1kworker/0:0H22:00:170
3693217994744,2cyclictest3708424-21kworker/3:021:44:543
3693216994744,2cyclictest1501592-1kworker/2:2H21:45:232
3693216994743,3cyclictest1501592-1kworker/2:2H22:30:262
3693216994742,4cyclictest1501592-1kworker/2:2H22:50:582
3693216994742,3cyclictest1501592-1kworker/2:2H22:40:112
3693211994744,2cyclictest3771886-21kworker/0:023:08:570
3693211994744,2cyclictest3736809-21kworker/0:021:35:410
3693211994744,2cyclictest3736809-21kworker/0:021:33:110
3693211994744,2cyclictest3721958-21kworker/0:221:05:350
3693211994743,2cyclictest3778793-21kworker/0:123:45:000
3693211994743,2cyclictest3716574-21kworker/0:220:20:060
3693211994741,4cyclictest3442112-1kworker/0:0H19:54:290
3693211994741,4cyclictest3442112-1kworker/0:0H19:54:280
3693217994643,2cyclictest59116-1kworker/3:2H20:03:243
3693216994643,2cyclictest1501592-1kworker/2:2H22:38:232
3693216994642,3cyclictest1501592-1kworker/2:2H21:23:052
3693216994640,4cyclictest1501592-1kworker/2:2H19:45:012
3693216994635,8cyclictest1501592-1kworker/2:2H20:27:542
3693211994643,2cyclictest3776740-21kworker/0:223:20:430
3693217994542,2cyclictest59116-1kworker/3:2H21:15:293
3693217994542,2cyclictest3761882-21kworker/3:123:29:553
3693217994541,3cyclictest59116-1kworker/3:2H22:31:283
3693217994541,3cyclictest59116-1kworker/3:2H19:53:553
3693217994541,3cyclictest59116-1kworker/3:2H19:53:553
3693217994539,4cyclictest59116-1kworker/3:2H23:10:163
3693217994539,3cyclictest59116-1kworker/3:2H23:45:183
3693217994539,3cyclictest59116-1kworker/3:2H21:30:143
3693216994542,2cyclictest1501592-1kworker/2:2H22:06:282
3693216994542,2cyclictest1501592-1kworker/2:2H00:06:282
3693216994541,3cyclictest3776803-21kworker/2:223:40:232
3693216994541,2cyclictest1501592-1kworker/2:2H23:50:162
3693216994531,3cyclictest1501592-1kworker/2:2H19:15:182
3693211994542,2cyclictest3765138-21kworker/0:122:45:360
3693211994542,2cyclictest3721958-21kworker/0:221:18:090
3693211994540,2cyclictest3442112-1kworker/0:0H21:25:150
3693216994441,2cyclictest3688656-21kworker/2:019:35:162
3693216994439,3cyclictest3688656-21kworker/2:020:05:162
3693216994439,3cyclictest1501592-1kworker/2:2H00:36:592
3693216994433,2cyclictest1501592-1kworker/2:2H19:22:472
3693211994441,2cyclictest3721958-21kworker/0:220:38:280
3693211994439,3cyclictest3442112-1kworker/0:0H23:19:290
3693211994439,3cyclictest3442112-1kworker/0:0H22:10:140
3693217994339,3cyclictest59116-1kworker/3:2H23:40:323
3693217994339,3cyclictest59116-1kworker/3:2H20:46:533
3693217994338,2cyclictest59116-1kworker/3:2H19:27:483
3693216994339,2cyclictest1501592-1kworker/2:2H20:30:162
3693216994330,3cyclictest1501592-1kworker/2:2H00:03:362
3693211994338,3cyclictest3743549-21kworker/0:121:45:000
3693217994239,2cyclictest59116-1kworker/3:2H21:45:293
3693217994239,1cyclictest59116-1kworker/3:2H21:55:153
3693217994237,3cyclictest59116-1kworker/3:2H19:17:523
369321799420,40cyclictest0-21swapper/322:15:063
3693216994237,3cyclictest1501592-1kworker/2:2H00:26:202
3693211994239,2cyclictest3442112-1kworker/0:0H21:04:540
3693211994239,2cyclictest3442112-1kworker/0:0H00:15:010
3693216994138,2cyclictest3716524-21kworker/2:120:45:212
3693216994138,2cyclictest1501592-1kworker/2:2H00:22:592
3693216994137,3cyclictest1501592-1kworker/2:2H22:26:262
3693216994137,3cyclictest1501592-1kworker/2:2H22:12:282
3693216994137,3cyclictest1501592-1kworker/2:2H00:18:342
3693216994137,2cyclictest1501592-1kworker/2:2H22:03:172
3693216994135,3cyclictest1501592-1kworker/2:2H19:52:532
3693216994135,3cyclictest1501592-1kworker/2:2H19:52:532
3693211994137,2cyclictest3442112-1kworker/0:0H23:15:010
3693211994137,2cyclictest3442112-1kworker/0:0H20:11:530
3693211994136,3cyclictest3442112-1kworker/0:0H23:47:290
3693211994136,3cyclictest3442112-1kworker/0:0H23:25:250
3693211994136,3cyclictest3442112-1kworker/0:0H21:56:100
3693217994038,1cyclictest59116-1kworker/3:2H23:54:553
3693217994037,2cyclictest59116-1kworker/3:2H20:39:563
3693217994036,3cyclictest59116-1kworker/3:2H22:13:423
3693217994036,3cyclictest59116-1kworker/3:2H21:00:293
3693217994036,3cyclictest59116-1kworker/3:2H00:13:563
3693217994036,3cyclictest3761882-21kworker/3:123:40:003
3693216994037,2cyclictest1501592-1kworker/2:2H22:23:252
3693216994037,2cyclictest1501592-1kworker/2:2H21:40:052
3693216994035,3cyclictest1501592-1kworker/2:2H21:11:032
3693216994035,3cyclictest1501592-1kworker/2:2H20:53:042
3693211994037,2cyclictest3442112-1kworker/0:0H20:35:010
3693211994036,2cyclictest3442112-1kworker/0:0H20:15:560
3693211994035,3cyclictest3442112-1kworker/0:0H00:23:400
3693217993936,2cyclictest59116-1kworker/3:2H22:58:503
3693217993935,3cyclictest59116-1kworker/3:2H00:20:003
3693217993934,3cyclictest59116-1kworker/3:2H00:00:143
3693216993936,2cyclictest1501592-1kworker/2:2H23:35:362
3693216993936,2cyclictest1501592-1kworker/2:2H20:36:012
3693216993934,3cyclictest1501592-1kworker/2:2H20:10:172
3693211993935,3cyclictest3442112-1kworker/0:0H00:30:250
3693211993934,3cyclictest3442112-1kworker/0:0H19:45:160
3693217993835,2cyclictest3761882-21kworker/3:100:00:003
3693217993834,2cyclictest59116-1kworker/3:2H21:05:163
3693217993833,3cyclictest59116-1kworker/3:2H22:40:223
3693217993833,3cyclictest59116-1kworker/3:2H21:35:163
3693216993834,2cyclictest1501592-1kworker/2:2H21:36:592
3693211993835,2cyclictest3442112-1kworker/0:0H23:55:160
3693211993835,2cyclictest3442112-1kworker/0:0H19:24:550
3693211993834,2cyclictest3442112-1kworker/0:0H23:50:150
3693217993734,2cyclictest59116-1kworker/3:2H19:34:563
3693217993733,2cyclictest59116-1kworker/3:2H20:30:153
3693217993733,2cyclictest59116-1kworker/3:2H19:55:303
3693211993733,3cyclictest3442112-1kworker/0:0H22:30:560
3693217993633,2cyclictest3710042-21kworker/3:322:24:553
3693217993633,2cyclictest3708424-21kworker/3:020:59:553
3693217993631,3cyclictest59116-1kworker/3:2H20:05:163
3693216993633,2cyclictest1501592-1kworker/2:2H21:30:232
3693211993632,2cyclictest3442112-1kworker/0:0H00:20:010
3693211993631,3cyclictest3442112-1kworker/0:0H21:20:160
3693217993532,2cyclictest59116-1kworker/3:2H22:52:293
3693217993530,3cyclictest59116-1kworker/3:2H19:40:203
3693216993532,2cyclictest1501592-1kworker/2:2H22:49:302
3693216993532,2cyclictest1501592-1kworker/2:2H21:00:242
3693216993531,3cyclictest1501592-1kworker/2:2H23:06:292
3693216993530,3cyclictest1501592-1kworker/2:2H19:27:492
3693211993532,2cyclictest3442112-1kworker/0:0H22:57:540
3693211993532,2cyclictest3442112-1kworker/0:0H20:47:570
3693217993431,2cyclictest59116-1kworker/3:2H20:54:553
3693217993431,2cyclictest3761882-21kworker/3:123:19:563
3693217993430,3cyclictest59116-1kworker/3:2H00:24:553
3693217993430,2cyclictest59116-1kworker/3:2H19:37:293
3693217993428,3cyclictest59116-1kworker/3:2H00:08:373
3693216993431,2cyclictest1501592-1kworker/2:2H20:15:252
3693211993431,2cyclictest3442112-1kworker/0:0H20:05:170
3693217993330,2cyclictest59116-1kworker/3:2H22:38:483
3693217993329,3cyclictest59116-1kworker/3:2H21:14:553
3693217993325,5cyclictest59116-1kworker/3:2H20:40:173
369321799330,4cyclictest0-21swapper/319:45:163
3693216993330,2cyclictest1501592-1kworker/2:2H23:20:582
3693216993330,2cyclictest1501592-1kworker/2:2H23:02:562
3693211993327,4cyclictest3757026-21kworker/0:122:20:170
3693217993229,2cyclictest3754879-21kworker/3:422:25:263
3693217993228,3cyclictest59116-1kworker/3:2H19:22:593
3693217993228,2cyclictest59116-1kworker/3:2H22:00:173
3693216993228,3cyclictest1501592-1kworker/2:2H22:19:542
3693216993227,3cyclictest1501592-1kworker/2:2H23:27:542
3693211993228,2cyclictest3442112-1kworker/0:0H23:35:170
3693211993228,2cyclictest3442112-1kworker/0:0H23:30:170
3693217993126,3cyclictest59116-1kworker/3:2H20:22:283
3693217993118,11cyclictest3771835-21unixbench_singl23:00:233
3693216993027,2cyclictest1501592-1kworker/2:2H21:51:012
3693211993025,3cyclictest3442112-1kworker/0:0H00:05:190
3693217992926,2cyclictest3708424-21kworker/3:021:50:183
3693217992925,3cyclictest59116-1kworker/3:2H00:26:563
3693211992926,2cyclictest3442112-1kworker/0:0H20:54:540
369321199290,8cyclictest0-21swapper/022:05:240
3693217992825,2cyclictest3708424-21kworker/3:020:14:543
3693211992824,3cyclictest3442112-1kworker/0:0H21:49:550
369321799270,3cyclictest151rcu_preempt22:45:133
3693217992622,3cyclictest59116-1kworker/3:2H00:35:303
3693211992623,2cyclictest3757026-21kworker/0:122:25:190
3693217992520,3cyclictest59116-1kworker/3:2H23:08:513
3693217992510,4cyclictest40-21ksoftirqd/320:15:143
369321699254,11cyclictest0-21swapper/200:35:002
3693212992521,2cyclictest3693265-21cat19:10:011
3693211992521,2cyclictest3442112-1kworker/0:0H22:50:170
369321199240,14cyclictest3702799-21awk19:35:190
3693217992319,3cyclictest59116-1kworker/3:2H21:24:553
3693211992219,2cyclictest3721958-21kworker/0:220:40:160
3693211992217,2cyclictest3704740-21sed19:40:240
369321699211,9cyclictest0-21swapper/221:05:152
369321799202,8cyclictest3719203-21cut20:25:163
369321199201,12cyclictest3693325-21apt-get19:10:150
369321199200,11cyclictest3729443-21/usr/sbin/munin20:55:210
369321699185,10cyclictest654-21snmpd21:30:002
369321699171,9cyclictest0-21swapper/219:10:012
369321199123,5cyclictest3693258-21cat19:10:010
369321799101,6cyclictest391rcuc/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional