You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Sat Jul 12, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3484244997541,33cyclictest1340270-1kworker/1:0H23:45:151
3484244996863,3cyclictest0-21swapper/120:01:571
3484244996663,2cyclictest0-21swapper/120:31:521
3484244996662,3cyclictest0-21swapper/121:57:541
3484244996562,2cyclictest0-21swapper/122:12:291
3484244996461,2cyclictest0-21swapper/119:55:361
3484244996461,2cyclictest0-21swapper/100:24:271
3484244996460,2cyclictest0-21swapper/119:36:031
3484244996459,3cyclictest3488701-21fschecks_count19:20:131
3484244996447,16cyclictest3572317-21kworker/1:223:55:151
3484244996443,18cyclictest3484077-21kworker/1:019:50:001
3484244996342,19cyclictest3543125-21kworker/1:122:30:141
3484244996338,20cyclictest3555206-21kworker/1:222:55:151
348424499630,62cyclictest0-21swapper/123:08:531
348424499630,62cyclictest0-21swapper/122:49:281
3484244996258,3cyclictest0-21swapper/122:50:051
3484244996241,19cyclictest1340270-1kworker/1:0H22:05:001
3484244996241,19cyclictest1340270-1kworker/1:0H00:10:001
3484244996233,26cyclictest1340270-1kworker/1:0H20:15:141
348424499620,1cyclictest0-21swapper/122:38:281
3484244996156,3cyclictest0-21swapper/100:10:061
3484244996143,17cyclictest1340270-1kworker/1:0H23:20:061
3484244996141,19cyclictest3563184-21kworker/1:123:10:181
3484244996141,19cyclictest3506483-21kworker/1:220:21:271
3484244996141,18cyclictest3580494-21kworker/1:300:00:161
3484244996141,18cyclictest3580494-21kworker/1:300:00:151
3484244996141,18cyclictest3563184-21kworker/1:123:25:141
3484244996043,16cyclictest3555206-21kworker/1:222:41:051
3484244996043,16cyclictest3511553-21kworker/1:120:55:141
3484244996043,16cyclictest1340270-1kworker/1:0H23:00:151
3484244996042,17cyclictest3572317-21kworker/1:223:50:191
3484244996042,17cyclictest1340270-1kworker/1:0H22:05:151
3484244996042,16cyclictest3511553-21kworker/1:121:05:021
3484244996041,17cyclictest3529396-21kworker/1:021:40:161
3484244996040,19cyclictest3572317-21kworker/1:223:35:191
3484244996040,19cyclictest3501304-21kworker/1:120:05:161
3484244996040,18cyclictest3484077-21kworker/1:019:11:531
3484244995942,16cyclictest3501304-21kworker/1:120:10:141
3484244995941,17cyclictest3529396-21kworker/1:021:30:141
3484244995941,17cyclictest3511553-21kworker/1:120:50:001
3484244995941,16cyclictest3511553-21kworker/1:120:40:011
3484244995941,16cyclictest3511553-21kworker/1:120:37:051
3484244995941,16cyclictest3484077-21kworker/1:019:41:591
3484244995940,18cyclictest3572317-21kworker/1:223:40:001
3484244995940,18cyclictest3506483-21kworker/1:220:29:551
3484244995940,17cyclictest3563184-21kworker/1:123:17:301
3484244995940,17cyclictest3543125-21kworker/1:122:15:181
3484244995940,17cyclictest3511553-21kworker/1:121:02:081
3484244995939,19cyclictest3529396-21kworker/1:021:45:161
3484244995939,18cyclictest3529396-21kworker/1:021:25:021
3484244995939,18cyclictest3484077-21kworker/1:019:25:011
3484244995841,16cyclictest3526742-21kworker/1:221:21:571
3484244995841,16cyclictest3484077-21kworker/1:019:50:161
3484244995841,16cyclictest3484077-21kworker/1:019:50:161
3484244995839,18cyclictest3591842-21kworker/1:100:35:151
3484244995839,16cyclictest3529396-21kworker/1:021:35:051
3484244995838,18cyclictest1340270-1kworker/1:0H00:30:051
3484244995739,17cyclictest3511553-21kworker/1:120:50:001
3484244995739,17cyclictest3484077-21kworker/1:019:17:281
3484244995737,19cyclictest3563184-21kworker/1:123:30:141
3484244995735,20cyclictest3484077-21kworker/1:019:30:141
3484244995639,16cyclictest3526742-21kworker/1:221:15:161
3484244995639,15cyclictest3543125-21kworker/1:122:25:011
3484249995449,3cyclictest59116-1kworker/3:2H00:04:553
3484249995449,3cyclictest59116-1kworker/3:2H00:04:553
3484244995450,2cyclictest0-21swapper/121:13:571
3484244995438,15cyclictest1340270-1kworker/1:0H00:25:061
3484246995348,4cyclictest1501592-1kworker/2:2H23:06:532
3484244995349,3cyclictest0-21swapper/121:50:181
3484244995348,2cyclictest0-21swapper/122:27:581
3484249995248,2cyclictest3482565-21kworker/3:019:42:333
3484249995247,3cyclictest59116-1kworker/3:2H22:19:523
3484249995247,3cyclictest59116-1kworker/3:2H21:49:553
3484249995247,3cyclictest3514788-21kworker/3:020:50:393
3484244995237,14cyclictest3582653-21kworker/1:000:15:001
3484243995247,3cyclictest3442112-1kworker/0:0H00:37:580
3484243995246,3cyclictest3442112-1kworker/0:0H20:20:170
3484249995147,2cyclictest3557460-21kworker/3:022:56:583
3484249995147,2cyclictest3497827-21kworker/3:219:51:323
3484249995147,2cyclictest3497827-21kworker/3:219:51:323
3484249995146,3cyclictest3569067-21kworker/3:023:22:273
3484249995146,3cyclictest3482565-21kworker/3:019:10:393
3484246995146,3cyclictest1501592-1kworker/2:2H00:15:152
3484243995145,4cyclictest3442112-1kworker/0:0H21:50:000
3484249995044,3cyclictest59116-1kworker/3:2H21:25:163
3484246995045,3cyclictest1501592-1kworker/2:2H22:52:522
3484243995045,3cyclictest3442112-1kworker/0:0H23:15:150
3484249994945,2cyclictest59116-1kworker/3:2H00:10:163
3484249994945,2cyclictest3564453-21kworker/3:023:14:003
3484249994945,2cyclictest3514788-21kworker/3:020:47:273
3484249994945,2cyclictest3508042-21kworker/3:220:30:283
3484249994945,2cyclictest3482565-21kworker/3:019:37:053
3484249994944,3cyclictest3546108-21kworker/3:222:34:283
3484249994939,8cyclictest59116-1kworker/3:2H21:15:183
3484246994943,3cyclictest1501592-1kworker/2:2H23:55:142
3484243994944,3cyclictest3522901-21kworker/0:021:10:140
3484249994845,2cyclictest3546108-21kworker/3:222:42:593
3484249994844,3cyclictest59116-1kworker/3:2H20:37:273
3484249994844,2cyclictest3560946-21kworker/3:223:07:383
3484249994844,2cyclictest3506423-21kworker/3:120:16:263
3484249994836,7cyclictest59116-1kworker/3:2H21:38:593
3484246994843,3cyclictest1501592-1kworker/2:2H22:10:152
3484246994833,13cyclictest1501592-1kworker/2:2H21:05:012
3484243994844,2cyclictest3557459-21kworker/0:123:10:470
3484243994843,3cyclictest3442112-1kworker/0:0H19:30:140
3484249994744,2cyclictest3529400-21kworker/3:021:35:003
3484249994744,2cyclictest3519662-21kworker/3:121:06:333
3484249994741,5cyclictest59116-1kworker/3:2H19:49:553
3484246994744,2cyclictest1501592-1kworker/2:2H23:16:192
3484243994742,3cyclictest3442112-1kworker/0:0H23:25:000
3484243994742,3cyclictest3442112-1kworker/0:0H20:10:010
3484249994643,2cyclictest59116-1kworker/3:2H20:57:123
3484249994641,3cyclictest59116-1kworker/3:2H20:20:393
3484246994642,2cyclictest3527769-21kworker/2:122:02:212
3484243994643,2cyclictest3442112-1kworker/0:0H19:12:020
3484243994642,2cyclictest3442112-1kworker/0:0H19:22:320
3484249994542,2cyclictest59116-1kworker/3:2H21:41:263
3484249994541,3cyclictest3549366-21kworker/3:122:28:583
3484249994541,3cyclictest3482565-21kworker/3:019:32:273
3484249994541,2cyclictest59116-1kworker/3:2H21:50:173
3484249994541,2cyclictest59116-1kworker/3:2H19:24:553
3484246994542,2cyclictest3590275-21kworker/2:200:40:012
3484246994541,2cyclictest1501592-1kworker/2:2H19:11:532
3484243994542,2cyclictest3478160-21kworker/0:219:45:000
3484243994542,2cyclictest3442112-1kworker/0:0H19:50:430
3484243994542,2cyclictest3442112-1kworker/0:0H19:50:430
3484243994541,2cyclictest3578786-21kworker/0:100:05:410
3484243994541,2cyclictest3442112-1kworker/0:0H22:57:310
3484243994540,3cyclictest3442112-1kworker/0:0H21:22:130
3484243994539,4cyclictest3442112-1kworker/0:0H00:05:010
3484243994539,4cyclictest3442112-1kworker/0:0H00:05:000
3484249994441,2cyclictest59116-1kworker/3:2H20:11:583
3484249994437,3cyclictest59116-1kworker/3:2H21:00:163
3484246994440,2cyclictest1501592-1kworker/2:2H22:42:532
3484246994439,3cyclictest1501592-1kworker/2:2H20:20:162
3484246994439,3cyclictest1501592-1kworker/2:2H19:20:022
3484246994438,4cyclictest1501592-1kworker/2:2H23:41:042
3484246994438,3cyclictest1501592-1kworker/2:2H21:55:182
3484243994441,2cyclictest3442112-1kworker/0:0H22:02:020
3484243994439,3cyclictest3442112-1kworker/0:0H20:30:140
3484243994438,4cyclictest3442112-1kworker/0:0H21:03:130
3484249994339,3cyclictest59116-1kworker/3:2H22:01:093
3484249994339,2cyclictest59116-1kworker/3:2H00:39:323
3484249994339,2cyclictest3577181-21kworker/3:223:52:533
3484249994332,8cyclictest59116-1kworker/3:2H23:35:203
3484246994339,3cyclictest1501592-1kworker/2:2H23:51:532
3484246994339,2cyclictest3542923-21kworker/2:222:35:142
3484246994338,3cyclictest1501592-1kworker/2:2H20:02:012
3484243994339,3cyclictest3442112-1kworker/0:0H22:15:020
3484243994337,3cyclictest3442112-1kworker/0:0H21:30:000
3484243994334,6cyclictest3478160-21kworker/0:219:45:170
3484249994239,2cyclictest59116-1kworker/3:2H22:21:383
3484249994238,2cyclictest3529400-21kworker/3:021:22:273
3484249994237,3cyclictest59116-1kworker/3:2H23:45:133
3484246994239,2cyclictest1501592-1kworker/2:2H23:12:542
3484246994238,3cyclictest1501592-1kworker/2:2H20:10:382
3484246994238,2cyclictest1501592-1kworker/2:2H21:05:142
3484246994237,3cyclictest1501592-1kworker/2:2H21:45:282
3484243994239,2cyclictest3536388-21kworker/0:222:05:070
3484243994239,2cyclictest3478160-21kworker/0:220:03:270
3484243994239,2cyclictest3478160-21kworker/0:219:26:090
3484243994237,4cyclictest3442112-1kworker/0:0H20:50:430
3484243994237,3cyclictest3442112-1kworker/0:0H19:18:320
3484243994236,4cyclictest3442112-1kworker/0:0H22:40:440
3484249994137,3cyclictest59116-1kworker/3:2H20:02:283
3484249994137,2cyclictest3542868-21kworker/3:122:05:453
3484243994138,2cyclictest3570695-21kworker/0:223:30:140
3484243994138,2cyclictest3442112-1kworker/0:0H20:48:570
3484243994137,3cyclictest3442112-1kworker/0:0H21:50:470
3484243994136,4cyclictest3442112-1kworker/0:0H22:46:040
3484249994037,2cyclictest59116-1kworker/3:2H23:55:233
3484249994037,2cyclictest59116-1kworker/3:2H20:40:243
3484249994037,2cyclictest59116-1kworker/3:2H00:05:273
3484249994037,2cyclictest3567417-21kworker/3:123:29:273
3484246994037,2cyclictest1501592-1kworker/2:2H23:25:242
3484246994037,2cyclictest1501592-1kworker/2:2H20:44:272
3484246994035,3cyclictest1501592-1kworker/2:2H23:22:352
3484246994035,3cyclictest1501592-1kworker/2:2H22:45:152
3484243994035,3cyclictest3442112-1kworker/0:0H00:10:150
3484249993936,2cyclictest59116-1kworker/3:2H23:31:273
3484249993936,2cyclictest3497827-21kworker/3:220:09:033
3484249993934,3cyclictest59116-1kworker/3:2H00:34:553
3484249993924,13cyclictest59116-1kworker/3:2H00:15:233
3484246993936,2cyclictest1501592-1kworker/2:2H22:27:532
3484246993935,3cyclictest1501592-1kworker/2:2H20:40:002
3484246993934,3cyclictest1501592-1kworker/2:2H20:15:162
3484246993933,3cyclictest1501592-1kworker/2:2H00:05:012
3484246993933,3cyclictest1501592-1kworker/2:2H00:05:002
348424699390,2cyclictest0-21swapper/222:21:272
3484243993934,3cyclictest3503191-21kworker/0:120:27:030
3484243993934,3cyclictest3442112-1kworker/0:0H20:12:020
3484243993933,4cyclictest3442112-1kworker/0:0H20:40:160
3484243993931,3cyclictest3442112-1kworker/0:0H23:53:580
3484246993835,2cyclictest1501592-1kworker/2:2H22:30:282
3484246993835,2cyclictest1501592-1kworker/2:2H19:48:522
3484246993834,3cyclictest1501592-1kworker/2:2H19:28:522
3484243993835,2cyclictest3442112-1kworker/0:0H22:22:390
3484243993834,3cyclictest3442112-1kworker/0:0H23:39:590
3484249993734,2cyclictest59116-1kworker/3:2H22:14:283
3484249993734,2cyclictest59116-1kworker/3:2H19:15:383
3484249993733,3cyclictest59116-1kworker/3:2H23:44:593
3484246993734,2cyclictest3462567-21kworker/2:019:15:162
3484246993733,2cyclictest1501592-1kworker/2:2H21:20:002
3484243993734,2cyclictest3442112-1kworker/0:0H21:07:150
3484243993732,3cyclictest3572315-21kworker/0:023:49:220
3484243993730,4cyclictest3442112-1kworker/0:0H19:55:170
348424999361,13cyclictest384844-21systemd-journal22:55:003
3484249993611,22cyclictest384844-21systemd-journal19:30:003
3484246993633,2cyclictest1501592-1kworker/2:2H23:46:572
3484246993632,3cyclictest1501592-1kworker/2:2H20:31:262
3484246993632,3cyclictest1501592-1kworker/2:2H19:40:022
3484246993632,2cyclictest1501592-1kworker/2:2H00:20:132
3484243993634,1cyclictest3549615-21kworker/0:222:30:160
3484249993532,2cyclictest3586916-21kworker/3:000:26:253
348424999353,11cyclictest384844-21systemd-journal00:20:183
3484246993532,2cyclictest3554265-21kworker/2:123:00:192
3484246993532,2cyclictest1501592-1kworker/2:2H23:35:292
3484246993529,4cyclictest1501592-1kworker/2:2H23:34:592
3484246993527,4cyclictest1501592-1kworker/2:2H22:57:322
3484243993532,2cyclictest3442112-1kworker/0:0H21:32:210
348424999347,7cyclictest384844-21systemd-journal19:55:213
3484249993431,2cyclictest59116-1kworker/3:2H23:03:533
3484249993431,2cyclictest59116-1kworker/3:2H20:26:333
3484243993431,2cyclictest3524521-21kworker/0:121:15:160
3484243993430,3cyclictest3557459-21kworker/0:123:00:140
3484243993430,2cyclictest3557459-21kworker/0:123:27:530
3484249993330,2cyclictest59116-1kworker/3:2H22:35:273
3484249993330,2cyclictest59116-1kworker/3:2H21:12:563
3484246993329,2cyclictest1501592-1kworker/2:2H20:55:142
3484246993328,4cyclictest1501592-1kworker/2:2H19:57:072
3484246993328,3cyclictest1501592-1kworker/2:2H19:50:392
3484246993328,3cyclictest1501592-1kworker/2:2H19:50:392
3484243993328,3cyclictest3442112-1kworker/0:0H20:35:240
3484243993328,3cyclictest3442112-1kworker/0:0H00:26:210
3484246993228,2cyclictest1501592-1kworker/2:2H21:12:092
3484246993227,3cyclictest1501592-1kworker/2:2H20:05:592
3484243993229,2cyclictest3549615-21kworker/0:222:25:220
3484243993229,2cyclictest3541230-21kworker/0:022:14:530
3484243993226,3cyclictest3442112-1kworker/0:0H20:57:060
3484249993126,3cyclictest59116-1kworker/3:2H22:00:003
348424999311,5cyclictest384844-21systemd-journal23:20:003
3484246993125,4cyclictest1501592-1kworker/2:2H20:45:242
3484243993128,2cyclictest14-21ksoftirqd/023:05:130
348424399310,2cyclictest0-21swapper/021:55:230
3484246993027,2cyclictest1501592-1kworker/2:2H00:34:312
3484246993026,3cyclictest1501592-1kworker/2:2H21:20:332
3484246992926,2cyclictest3462567-21kworker/2:019:35:142
3484246992926,2cyclictest1501592-1kworker/2:2H21:40:282
3484246992926,2cyclictest1501592-1kworker/2:2H21:30:362
3484243992926,2cyclictest3580416-21kworker/0:200:31:570
3484243992926,2cyclictest3529404-21kworker/0:121:40:140
3484244992823,3cyclictest3484311-21latency_hist19:10:011
3484243992825,2cyclictest3572315-21kworker/0:023:40:130
3484243992824,2cyclictest3442112-1kworker/0:0H00:00:010
3484246992725,1cyclictest3527769-21kworker/2:121:25:172
3484246992723,3cyclictest1501592-1kworker/2:2H00:25:112
348424699270,23cyclictest3547278-21proc_pri22:15:222
3484243992723,2cyclictest3529404-21kworker/0:121:35:160
3484243992723,2cyclictest3442112-1kworker/0:0H20:17:030
348424399270,24cyclictest3493233-21apt-get19:35:130
3484246992620,5cyclictest654-21snmpd20:51:042
3484243992622,2cyclictest3442112-1kworker/0:0H00:15:050
348424699252,7cyclictest3539140-21ntp_offset21:50:212
348424699251,3cyclictest0-21swapper/200:10:172
348424399257,11cyclictest3557459-21kworker/0:122:51:440
3484243992522,2cyclictest3442112-1kworker/0:0H22:37:300
3484243992422,1cyclictest3580416-21kworker/0:200:22:570
3484246992320,2cyclictest1501592-1kworker/2:2H22:09:592
348424699231,9cyclictest3491616-21apt-get19:30:122
3484246992216,5cyclictest3534166-21sensors21:35:212
348424999210,14cyclictest3557510-21true22:50:003
348424699219,5cyclictest0-21swapper/200:05:102
348424699211,10cyclictest3510212-21apt-get20:25:122
348424999120,6cyclictest3484039-21latency_hist19:10:013
348424699123,7cyclictest0-21swapper/219:10:012
348424399105,2cyclictest0-21swapper/019:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional