You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-14 - 05:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Sun Sep 14, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
508696997237,33cyclictest1010445-1kworker/1:0H22:00:001
508696997042,27cyclictest600822-21kworker/1:100:00:151
508696996763,2cyclictest513966-21cron19:25:001
508696996742,24cyclictest525311-21kworker/1:120:10:121
508696996735,31cyclictest550178-21kworker/1:221:25:181
50869699660,64cyclictest0-21swapper/120:09:041
508696996562,2cyclictest0-21swapper/120:16:541
508696996537,24cyclictest600822-21kworker/1:100:05:211
508696996534,30cyclictest591044-21kworker/1:223:25:161
50869699650,64cyclictest0-21swapper/120:32:461
50869699650,63cyclictest0-21swapper/122:32:551
50869699650,63cyclictest0-21swapper/120:40:041
50869699650,2cyclictest0-21swapper/119:51:381
508696996430,33cyclictest564855-21kworker/1:222:00:161
50869699640,2cyclictest0-21swapper/123:50:531
508696996258,2cyclictest0-21swapper/120:20:211
508696996243,18cyclictest1010445-1kworker/1:0H20:27:321
508696996240,20cyclictest1010445-1kworker/1:0H22:45:151
508696996238,23cyclictest1010445-1kworker/1:0H00:40:001
508696996237,20cyclictest535360-21kworker/1:020:50:161
508696996224,37cyclictest558913-21kworker/1:021:55:001
508696996159,1cyclictest0-21swapper/120:59:091
508696996141,18cyclictest584547-21kworker/1:023:15:161
508696996136,24cyclictest571903-21kworker/1:122:50:151
508696996130,29cyclictest1010445-1kworker/1:0H22:55:141
508696996042,17cyclictest591044-21kworker/1:223:40:141
50869699601,2cyclictest556439-21cron21:35:001
508696995943,15cyclictest525311-21kworker/1:120:00:391
508696995942,15cyclictest1010445-1kworker/1:0H23:05:161
508696995942,15cyclictest1010445-1kworker/1:0H00:10:161
508696995938,20cyclictest591044-21kworker/1:223:20:191
508696995937,20cyclictest1010445-1kworker/1:0H21:49:591
508696995931,27cyclictest569726-21kworker/1:022:20:161
508696995855,2cyclictest0-21swapper/100:25:161
508696995843,14cyclictest591044-21kworker/1:223:45:061
508696995843,14cyclictest556486-21kworker/1:121:36:381
508696995843,14cyclictest550178-21kworker/1:221:20:061
508696995843,14cyclictest517247-21kworker/1:219:38:391
508696995841,16cyclictest578052-21kworker/1:222:40:151
508696995840,17cyclictest571903-21kworker/1:122:25:201
508696995840,17cyclictest564855-21kworker/1:222:10:171
508696995831,25cyclictest608967-21kworker/1:200:15:171
508696995824,30cyclictest1756130-21systemd-journal22:40:011
508696995748,8cyclictest0-21swapper/122:15:161
508696995742,14cyclictest550178-21kworker/1:221:17:061
508696995742,14cyclictest535360-21kworker/1:021:03:411
508696995742,14cyclictest510727-21kworker/1:019:15:041
508696995741,15cyclictest600822-21kworker/1:123:55:141
508696995738,18cyclictest584547-21kworker/1:023:00:171
508696995732,24cyclictest517247-21kworker/1:219:45:151
508696995730,26cyclictest584547-21kworker/1:023:10:161
508705995650,4cyclictest2433131-1kworker/3:1H21:17:443
508696995648,7cyclictest611204-21fschecks_time00:20:151
508696995648,7cyclictest611204-21fschecks_time00:20:151
508696995640,15cyclictest591044-21kworker/1:223:35:071
508696995640,15cyclictest558913-21kworker/1:021:41:391
508696995640,15cyclictest517247-21kworker/1:219:58:061
508696995640,15cyclictest517247-21kworker/1:219:40:161
508696995627,28cyclictest564855-21kworker/1:222:05:161
508696995552,2cyclictest0-21swapper/119:33:461
508696995540,14cyclictest535360-21kworker/1:021:10:141
508696995539,15cyclictest611159-21kworker/1:100:30:271
508696995539,15cyclictest510727-21kworker/1:019:25:171
508692995550,3cyclictest585908-21kworker/0:223:02:400
508701995449,3cyclictest533734-1kworker/2:1H20:59:382
508701995442,7cyclictest533734-1kworker/2:1H00:15:172
508696995439,14cyclictest1010445-1kworker/1:0H20:35:201
508696995438,15cyclictest535360-21kworker/1:021:05:091
508696995438,15cyclictest535360-21kworker/1:020:45:391
508705995342,7cyclictest526951-21kworker/3:020:05:003
508701995348,3cyclictest520518-21kworker/2:120:28:042
508696995338,14cyclictest591044-21kworker/1:223:30:141
508692995349,3cyclictest2111315-1kworker/0:0H19:50:230
508692995349,2cyclictest587529-21kworker/0:023:25:110
508692995349,2cyclictest548301-21kworker/0:221:15:200
508696995237,14cyclictest508506-21kworker/1:119:10:141
508692995248,2cyclictest527451-21kworker/0:120:10:070
508705995146,3cyclictest559930-21kworker/3:121:48:143
508701995147,3cyclictest551618-21kworker/2:100:38:072
508701995147,2cyclictest551618-21kworker/2:123:28:402
508701995145,3cyclictest533734-1kworker/2:1H00:00:012
508692995146,3cyclictest566421-21kworker/0:022:10:000
508705995046,2cyclictest566434-21kworker/3:122:48:013
508705995046,2cyclictest505557-21kworker/3:119:36:003
508705995045,3cyclictest2433131-1kworker/3:1H23:55:413
508705995045,3cyclictest2433131-1kworker/3:1H21:37:453
508705995045,3cyclictest2433131-1kworker/3:1H19:33:083
508705995045,3cyclictest2433131-1kworker/3:1H00:10:413
508705995036,6cyclictest2433131-1kworker/3:1H22:37:483
508701995047,2cyclictest551618-21kworker/2:121:27:072
508701995047,2cyclictest551618-21kworker/2:100:28:152
508701995046,3cyclictest520518-21kworker/2:120:50:032
508701995045,3cyclictest533734-1kworker/2:1H23:07:522
508701995041,6cyclictest2429468-1kworker/2:0H19:38:022
508692995046,2cyclictest533689-21kworker/0:020:25:440
508705994945,3cyclictest2433131-1kworker/3:1H22:25:103
508705994945,2cyclictest566434-21kworker/3:122:55:063
508705994944,3cyclictest2433131-1kworker/3:1H22:42:403
508705994944,3cyclictest2433131-1kworker/3:1H00:25:163
508705994940,7cyclictest2433131-1kworker/3:1H19:15:003
508701994946,2cyclictest551618-21kworker/2:121:22:372
508701994946,2cyclictest3462929-21kworker/2:019:27:252
508701994945,2cyclictest551618-21kworker/2:122:08:062
508701994944,3cyclictest2429468-1kworker/2:0H20:02:432
508692994946,2cyclictest2111315-1kworker/0:0H21:50:230
508692994945,2cyclictest587529-21kworker/0:023:14:400
508692994945,2cyclictest510165-21kworker/0:119:19:090
508692994944,3cyclictest2111315-1kworker/0:0H22:20:230
508705994845,2cyclictest2433131-1kworker/3:1H21:26:393
508705994844,3cyclictest2433131-1kworker/3:1H19:53:393
508705994843,3cyclictest2433131-1kworker/3:1H20:52:093
508705994840,6cyclictest2433131-1kworker/3:1H20:39:563
508705994839,7cyclictest2433131-1kworker/3:1H19:20:163
508701994845,2cyclictest551618-21kworker/2:122:30:252
508701994845,2cyclictest545080-21kworker/2:221:13:092
508701994845,2cyclictest3462929-21kworker/2:019:32:272
508701994844,3cyclictest2429468-1kworker/2:0H19:47:402
508701994844,2cyclictest520518-21kworker/2:120:35:502
508692994845,2cyclictest600041-21kworker/0:223:52:190
508692994845,2cyclictest553191-21kworker/0:021:27:440
508692994843,3cyclictest2111315-1kworker/0:0H23:05:160
508692994842,3cyclictest2111315-1kworker/0:0H20:42:330
508705994744,2cyclictest595894-21kworker/3:100:17:593
508705994743,3cyclictest2433131-1kworker/3:1H23:53:133
508705994743,3cyclictest2433131-1kworker/3:1H21:08:043
508705994743,2cyclictest566434-21kworker/3:122:15:063
508705994742,3cyclictest2433131-1kworker/3:1H00:00:333
508701994744,2cyclictest551618-21kworker/2:123:37:072
508701994742,3cyclictest2429468-1kworker/2:0H19:17:232
508692994744,2cyclictest587529-21kworker/0:023:30:040
508692994743,3cyclictest540445-21kworker/0:120:46:390
508692994743,3cyclictest2111315-1kworker/0:0H19:45:160
508692994742,3cyclictest2111315-1kworker/0:0H21:57:430
508705994643,2cyclictest533684-21kworker/3:120:33:383
508705994641,3cyclictest2433131-1kworker/3:1H23:08:093
508705994637,6cyclictest2433131-1kworker/3:1H00:22:593
508705994637,6cyclictest2433131-1kworker/3:1H00:22:583
508705994634,9cyclictest2433131-1kworker/3:1H23:50:013
508701994643,2cyclictest551618-21kworker/2:123:54:102
508701994643,2cyclictest551618-21kworker/2:100:24:412
508701994643,2cyclictest551618-21kworker/2:100:24:402
508701994643,2cyclictest520518-21kworker/2:120:42:092
508701994642,3cyclictest533734-1kworker/2:1H20:45:122
508701994642,2cyclictest533734-1kworker/2:1H23:45:002
508701994641,3cyclictest533734-1kworker/2:1H21:08:092
508701994639,4cyclictest533734-1kworker/2:1H00:05:342
508692994642,2cyclictest2111315-1kworker/0:0H20:35:000
508692994642,2cyclictest2111315-1kworker/0:0H20:09:090
508705994542,2cyclictest2433131-1kworker/3:1H21:55:403
508705994541,2cyclictest526951-21kworker/3:020:16:383
508701994541,2cyclictest533734-1kworker/2:1H23:00:152
508701994540,3cyclictest533734-1kworker/2:1H21:02:432
508701994540,3cyclictest520518-21kworker/2:120:19:592
508692994542,2cyclictest602388-21kworker/0:100:19:110
508692994542,2cyclictest568298-21kworker/0:222:12:580
508692994542,2cyclictest538825-21kworker/0:020:50:560
508692994542,2cyclictest510165-21kworker/0:119:25:400
508692994542,2cyclictest2111315-1kworker/0:0H23:35:420
508692994541,2cyclictest554811-21kworker/0:121:35:130
508692994540,3cyclictest2111315-1kworker/0:0H23:59:120
508705994441,2cyclictest595894-21kworker/3:123:32:393
508705994439,3cyclictest2433131-1kworker/3:1H21:03:103
508701994441,2cyclictest551618-21kworker/2:123:15:462
508701994441,2cyclictest551618-21kworker/2:121:54:102
508701994441,2cyclictest545080-21kworker/2:221:19:412
508701994440,3cyclictest551618-21kworker/2:123:35:002
508701994440,3cyclictest533734-1kworker/2:1H21:43:452
508701994440,3cyclictest533734-1kworker/2:1H00:33:522
508692994441,2cyclictest587529-21kworker/0:023:45:060
508692994441,2cyclictest587529-21kworker/0:023:20:390
508692994441,2cyclictest540445-21kworker/0:121:08:090
508692994439,3cyclictest587529-21kworker/0:023:17:400
508705994339,3cyclictest518806-21kworker/3:219:57:043
508705994339,2cyclictest518806-21kworker/3:219:42:593
508705994338,3cyclictest526951-21kworker/3:020:05:063
508705994338,3cyclictest2433131-1kworker/3:1H21:44:103
508701994340,2cyclictest533734-1kworker/2:1H22:17:392
508701994340,2cyclictest520518-21kworker/2:119:58:062
508701994340,2cyclictest517245-21kworker/2:219:40:192
508701994340,2cyclictest3462929-21kworker/2:019:23:312
508701994340,2cyclictest2429468-1kworker/2:0H19:12:282
508701994339,2cyclictest533734-1kworker/2:1H20:34:202
508701994338,3cyclictest533734-1kworker/2:1H22:52:402
508701994338,3cyclictest533734-1kworker/2:1H22:45:142
508701994332,7cyclictest533734-1kworker/2:1H00:12:102
508692994340,2cyclictest510165-21kworker/0:119:35:450
508692994339,2cyclictest611132-21kworker/0:000:25:250
508692994338,3cyclictest554811-21kworker/0:121:45:400
508705994239,2cyclictest559930-21kworker/3:121:52:523
508705994239,2cyclictest2433131-1kworker/3:1H23:38:093
508705994239,2cyclictest2433131-1kworker/3:1H23:20:203
508705994238,2cyclictest553180-21kworker/3:221:24:083
508705994238,2cyclictest526951-21kworker/3:020:24:553
508705994237,3cyclictest2433131-1kworker/3:1H20:30:003
508705994236,5cyclictest2433131-1kworker/3:1H20:44:553
508705994236,4cyclictest2433131-1kworker/3:1H22:01:393
508701994239,2cyclictest551618-21kworker/2:122:20:062
508701994239,2cyclictest2429468-1kworker/2:0H20:07:432
508701994237,3cyclictest533734-1kworker/2:1H00:03:042
508701994236,3cyclictest2429468-1kworker/2:0H20:22:332
508692994239,2cyclictest568298-21kworker/0:222:25:190
508692994239,2cyclictest553191-21kworker/0:021:34:050
508692994239,2cyclictest2111315-1kworker/0:0H19:58:380
508692994238,2cyclictest540445-21kworker/0:120:55:160
508705994137,3cyclictest2433131-1kworker/3:1H19:17:303
508705994137,2cyclictest566434-21kworker/3:122:09:403
508705994136,3cyclictest2433131-1kworker/3:1H20:49:563
508701994138,2cyclictest2429468-1kworker/2:0H20:10:432
508701994137,2cyclictest551618-21kworker/2:122:41:392
508701994135,3cyclictest533734-1kworker/2:1H22:55:152
508701994135,3cyclictest533734-1kworker/2:1H21:35:142
508705994036,3cyclictest505557-21kworker/3:119:29:553
508705994036,2cyclictest526951-21kworker/3:020:14:093
508701994036,3cyclictest551618-21kworker/2:121:34:592
508692994037,2cyclictest554811-21kworker/0:121:41:440
508692994037,2cyclictest532047-21kworker/0:120:22:460
508692994037,2cyclictest512324-21kworker/0:219:23:010
508692994036,3cyclictest548301-21kworker/0:221:22:530
508692994035,3cyclictest2111315-1kworker/0:0H19:32:260
508705993936,2cyclictest595894-21kworker/3:100:36:093
508705993934,3cyclictest2433131-1kworker/3:1H22:32:403
508705993934,3cyclictest2433131-1kworker/3:1H19:47:103
508705993933,4cyclictest2433131-1kworker/3:1H23:11:453
508705993926,11cyclictest2433131-1kworker/3:1H22:50:173
508701993935,3cyclictest551618-21kworker/2:123:23:402
508701993935,3cyclictest2429468-1kworker/2:0H19:52:102
508701993935,2cyclictest533734-1kworker/2:1H22:39:392
508692993936,2cyclictest540445-21kworker/0:121:00:380
508692993935,3cyclictest602388-21kworker/0:100:21:070
508692993935,3cyclictest602388-21kworker/0:100:21:060
508692993935,3cyclictest576211-21kworker/0:322:45:060
508692993934,3cyclictest532047-21kworker/0:120:35:440
508705993835,2cyclictest566434-21kworker/3:123:17:583
508705993833,3cyclictest2433131-1kworker/3:1H22:24:403
508705993833,3cyclictest2433131-1kworker/3:1H21:31:483
508705993832,4cyclictest2433131-1kworker/3:1H21:10:503
508692993833,3cyclictest517197-21kworker/0:319:44:090
508692993832,3cyclictest2111315-1kworker/0:0H22:55:140
508692993831,4cyclictest2111315-1kworker/0:0H22:35:150
508705993734,2cyclictest2433131-1kworker/3:1H20:59:553
508705993733,3cyclictest2433131-1kworker/3:1H23:43:013
508701993733,3cyclictest533734-1kworker/2:1H23:14:102
50869699360,3cyclictest508712-21latency_hist19:10:011
508692993633,2cyclictest587529-21kworker/0:023:44:130
508692993632,3cyclictest617037-21kworker/0:100:36:420
508692993632,3cyclictest2111315-1kworker/0:0H00:13:030
508692993631,3cyclictest2111315-1kworker/0:0H22:00:160
508705993532,2cyclictest2433131-1kworker/3:1H00:05:483
508701993532,2cyclictest533734-1kworker/2:1H23:49:122
508701993532,2cyclictest533734-1kworker/2:1H21:55:062
508701993530,3cyclictest533734-1kworker/2:1H22:12:102
508692993531,2cyclictest574535-21kworker/0:022:32:390
508692993531,2cyclictest53250irq/160-enp0s2919:10:140
508701993430,3cyclictest533734-1kworker/2:1H21:45:402
508692993429,3cyclictest566421-21kworker/0:022:15:100
508705993330,2cyclictest2433131-1kworker/3:1H23:03:033
508705993328,3cyclictest2433131-1kworker/3:1H00:32:413
508701993229,2cyclictest533734-1kworker/2:1H22:27:532
508701993228,2cyclictest533734-1kworker/2:1H22:02:422
50870599306,20cyclictest592941-21apt-get23:25:143
508692993026,2cyclictest523741-21kworker/0:320:19:390
508692993025,3cyclictest548301-21kworker/0:221:11:060
508692992826,1cyclictest602388-21kworker/0:100:07:150
50870599273,10cyclictest569564-21unixbench_multi22:10:213
508692992714,10cyclictest1756130-21systemd-journal22:44:340
508692992623,2cyclictest614049-21kworker/0:200:31:080
508692992621,3cyclictest2111315-1kworker/0:0H20:00:150
50870599231,4cyclictest508757-21latency_hist19:10:003
50869299230,3cyclictest0-21swapper/022:50:190
50869299221,13cyclictest604330-21apt-get00:00:120
50869299132,6cyclictest0-21swapper/019:10:000
50870199105,3cyclictest508755-21wc19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional