You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 15:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Thu Sep 18, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1431013996745,21cyclictest1492087-21kworker/1:022:30:001
143101399650,2cyclictest0-21swapper/119:39:551
1431013996445,17cyclictest1511208-21kworker/1:123:20:141
143101399640,62cyclictest0-21swapper/119:22:381
143101399640,1cyclictest0-21swapper/123:10:321
1431013996044,15cyclictest1523681-21kworker/1:000:08:261
1431013996043,16cyclictest1492087-21kworker/1:022:40:021
1431013995956,2cyclictest0-21swapper/119:30:391
1431013995944,14cyclictest1492087-21kworker/1:022:38:321
1431013995944,14cyclictest1477962-21kworker/1:122:00:141
1431013995944,14cyclictest1477962-21kworker/1:121:56:331
1431013995943,15cyclictest1471984-21kworker/1:221:15:171
1431013995941,17cyclictest1492087-21kworker/1:023:05:151
1431013995941,17cyclictest1477962-21kworker/1:122:15:141
1431013995941,16cyclictest1492087-21kworker/1:023:19:341
1431013995941,16cyclictest1492087-21kworker/1:022:20:171
1431013995939,19cyclictest1423251-1kworker/1:1H00:40:011
1431013995939,18cyclictest1477962-21kworker/1:121:40:011
143101399590,58cyclictest0-21swapper/120:45:281
143101399590,58cyclictest0-21swapper/120:45:281
1431013995843,14cyclictest909594-21kworker/1:019:15:031
1431013995843,14cyclictest1523681-21kworker/1:000:10:201
1431013995843,14cyclictest1511208-21kworker/1:123:42:431
1431013995843,14cyclictest1477962-21kworker/1:122:05:161
1431013995842,15cyclictest1449845-21kworker/1:120:19:031
1431013995842,15cyclictest1423251-1kworker/1:1H20:39:571
1431013995841,16cyclictest1477962-21kworker/1:121:40:151
1431013995840,17cyclictest1457918-21kworker/1:220:40:141
1431013995839,18cyclictest1464401-21kworker/1:021:05:001
1431013995838,18cyclictest1523681-21kworker/1:023:55:161
1431018995745,5cyclictest483976-1kworker/3:1H20:29:553
1431013995742,14cyclictest1521283-21kworker/1:323:50:281
1431013995742,14cyclictest1492087-21kworker/1:023:00:071
1431013995742,14cyclictest1492087-21kworker/1:022:45:211
1431013995742,14cyclictest1477962-21kworker/1:121:52:161
1431013995742,14cyclictest1477962-21kworker/1:121:52:161
1431013995742,14cyclictest1464401-21kworker/1:020:50:181
1431013995742,14cyclictest1452011-21kworker/1:020:12:321
1431013995741,15cyclictest909594-21kworker/1:019:28:031
1431013995741,15cyclictest1523681-21kworker/1:000:00:121
1431013995741,15cyclictest1519588-21kworker/1:023:47:331
1431013995741,15cyclictest1449845-21kworker/1:120:25:171
1431013995741,15cyclictest1423251-1kworker/1:1H21:10:101
1431013995740,16cyclictest1529597-21kworker/1:100:20:151
1431013995740,14cyclictest1511208-21kworker/1:123:30:241
1431013995740,14cyclictest1511208-21kworker/1:123:30:241
1431013995739,16cyclictest1511208-21kworker/1:123:35:161
1431013995641,14cyclictest1477962-21kworker/1:122:10:031
1431013995641,14cyclictest1449845-21kworker/1:120:20:221
1431013995641,14cyclictest1449845-21kworker/1:120:05:021
1431013995641,14cyclictest1444723-21kworker/1:219:55:011
1431013995640,15cyclictest1464401-21kworker/1:021:22:431
1431013995540,14cyclictest909594-21kworker/1:019:41:571
1431013995540,14cyclictest909594-21kworker/1:019:10:011
1431013995540,14cyclictest1511208-21kworker/1:123:25:001
1431013995540,14cyclictest1511208-21kworker/1:123:25:001
1431013995540,14cyclictest1492087-21kworker/1:022:30:151
1431013995540,14cyclictest1477962-21kworker/1:121:47:151
1431013995540,14cyclictest1464401-21kworker/1:021:07:061
1431013995538,16cyclictest1492087-21kworker/1:022:55:161
1431013995538,16cyclictest1444723-21kworker/1:220:00:151
1431013995537,17cyclictest1443058-21kworker/1:119:45:171
1431010995550,3cyclictest2111315-1kworker/0:0H00:31:570
1431016995449,3cyclictest3572569-1kworker/2:1H22:40:232
1431013995450,2cyclictest1475396-21fschecks_time21:25:151
1431013995439,14cyclictest1529597-21kworker/1:100:30:001
1431013995439,14cyclictest1464401-21kworker/1:021:32:111
1431013995438,15cyclictest1529597-21kworker/1:100:17:061
1431013995438,15cyclictest1464401-21kworker/1:020:57:361
1431013995438,15cyclictest1423251-1kworker/1:1H20:30:221
1431013995437,16cyclictest1492087-21kworker/1:022:50:161
1431018995348,2cyclictest483976-1kworker/3:1H23:35:163
1431018995347,4cyclictest483976-1kworker/3:1H20:35:003
1431016995349,3cyclictest3572569-1kworker/2:1H19:22:322
1431016995349,3cyclictest1483173-21kworker/2:200:30:432
1431016995349,2cyclictest1461221-21kworker/2:120:53:042
1431016995348,3cyclictest1483173-21kworker/2:200:23:432
1431016995348,3cyclictest1483173-21kworker/2:200:11:042
1431016995345,6cyclictest3572569-1kworker/2:1H20:15:152
1431013995338,14cyclictest1444723-21kworker/1:219:50:011
143101399530,2cyclictest0-21swapper/100:26:311
1431018995248,3cyclictest1502039-21kworker/3:222:55:323
1431018995248,2cyclictest1476350-21kworker/3:121:32:413
1431018995247,3cyclictest483976-1kworker/3:1H21:45:123
1431018995247,3cyclictest483976-1kworker/3:1H00:16:043
1431016995248,2cyclictest1483173-21kworker/2:223:28:022
1431016995248,2cyclictest1483173-21kworker/2:223:28:022
1431010995246,3cyclictest2111315-1kworker/0:0H20:10:160
1431010995243,6cyclictest2111315-1kworker/0:0H23:27:410
1431010995243,6cyclictest2111315-1kworker/0:0H23:27:400
1431018995148,2cyclictest1464658-21kworker/3:120:55:273
1431018995146,3cyclictest1443059-21kworker/3:120:01:553
1431016995148,2cyclictest1483173-21kworker/2:222:08:002
1431016995147,3cyclictest3572569-1kworker/2:1H23:48:532
1431016995147,2cyclictest1483173-21kworker/2:222:34:062
1431010995146,3cyclictest2111315-1kworker/0:0H22:20:250
1431010995145,4cyclictest2111315-1kworker/0:0H19:25:120
1431018995047,2cyclictest1531460-21kworker/3:200:25:593
1431018995047,2cyclictest1514721-21kworker/3:223:29:323
1431018995047,2cyclictest1514721-21kworker/3:223:29:313
1431018995047,2cyclictest1491470-21kworker/3:022:25:313
1431018995047,2cyclictest1481227-21kworker/3:021:56:113
1431018995047,2cyclictest1451407-21kworker/3:220:06:573
1431016995046,3cyclictest1427963-21kworker/2:019:15:252
1431016995046,2cyclictest1461221-21kworker/2:120:55:392
1431016995045,3cyclictest1461221-21kworker/2:121:00:062
1431016995038,8cyclictest3572569-1kworker/2:1H23:35:322
1431010995045,3cyclictest2111315-1kworker/0:0H19:51:580
1431018994946,2cyclictest1509580-21kworker/3:023:18:313
1431018994946,2cyclictest1481227-21kworker/3:022:05:573
1431018994946,2cyclictest1474730-21kworker/3:221:25:463
1431018994940,7cyclictest483976-1kworker/3:1H22:10:323
1431016994946,2cyclictest1483173-21kworker/2:222:52:022
1431016994944,3cyclictest3572569-1kworker/2:1H19:12:112
1431010994945,3cyclictest2111315-1kworker/0:0H23:42:410
1431010994944,3cyclictest2111315-1kworker/0:0H20:05:160
1431018994845,2cyclictest1487972-21kworker/3:222:17:023
1431018994845,2cyclictest1477968-21kworker/3:221:40:073
1431018994843,3cyclictest1443059-21kworker/3:120:00:003
1431016994843,3cyclictest1483173-21kworker/2:200:04:332
1431018994743,3cyclictest483976-1kworker/3:1H20:42:323
1431016994743,3cyclictest3572569-1kworker/2:1H20:20:012
1431016994742,3cyclictest3572569-1kworker/2:1H23:30:132
1431016994742,3cyclictest3572569-1kworker/2:1H23:30:122
1431016994742,3cyclictest3572569-1kworker/2:1H22:00:142
1431016994742,3cyclictest3572569-1kworker/2:1H19:28:322
1431010994744,2cyclictest1508219-21kworker/0:123:45:160
1431010994743,2cyclictest2111315-1kworker/0:0H19:15:170
1431010994743,2cyclictest1453040-21kworker/0:220:20:200
1431010994742,3cyclictest2111315-1kworker/0:0H19:57:570
1431010994741,4cyclictest2111315-1kworker/0:0H21:20:140
1431018994643,2cyclictest483976-1kworker/3:1H22:54:553
1431018994643,2cyclictest1534722-21kworker/3:000:35:293
1431018994643,2cyclictest1514721-21kworker/3:200:01:313
1431018994643,2cyclictest1481227-21kworker/3:021:52:373
1431018994643,2cyclictest1481227-21kworker/3:021:52:373
1431016994643,2cyclictest1483173-21kworker/2:222:29:082
1431016994642,3cyclictest3572569-1kworker/2:1H19:50:182
1431010994643,2cyclictest2111315-1kworker/0:0H00:25:170
1431010994642,2cyclictest2111315-1kworker/0:0H22:15:140
1431010994642,2cyclictest2111315-1kworker/0:0H20:19:590
1431010994641,3cyclictest2111315-1kworker/0:0H00:21:310
1431010994638,5cyclictest2111315-1kworker/0:0H23:20:000
1431018994543,1cyclictest1474730-21kworker/3:221:24:033
1431018994543,1cyclictest1432504-21kworker/3:219:44:033
1431018994542,2cyclictest483976-1kworker/3:1H23:54:563
1431018994542,2cyclictest483976-1kworker/3:1H23:40:163
1431018994542,2cyclictest1514721-21kworker/3:223:33:183
1431018994542,2cyclictest1514721-21kworker/3:223:33:183
1431018994542,2cyclictest1451407-21kworker/3:220:10:323
1431018994540,3cyclictest483976-1kworker/3:1H23:55:033
1431016994541,3cyclictest3572569-1kworker/2:1H00:06:322
1431016994534,2cyclictest3572569-1kworker/2:1H00:38:332
1431010994542,2cyclictest2111315-1kworker/0:0H21:45:190
1431010994540,3cyclictest2111315-1kworker/0:0H23:10:370
1431010994539,4cyclictest2111315-1kworker/0:0H21:35:270
1431018994441,2cyclictest1491470-21kworker/3:022:44:023
1431018994441,2cyclictest1464658-21kworker/3:121:07:323
1431018994441,2cyclictest1462797-21kworker/3:220:54:083
1431016994441,2cyclictest1483173-21kworker/2:223:10:482
1431016994441,2cyclictest1461221-21kworker/2:120:45:282
1431016994441,2cyclictest1461221-21kworker/2:120:45:282
1431016994440,3cyclictest1483173-21kworker/2:222:35:402
1431016994439,3cyclictest3572569-1kworker/2:1H21:28:572
1431016994439,3cyclictest3572569-1kworker/2:1H00:25:142
1431018994341,1cyclictest1454654-21kworker/3:120:22:103
1431018994340,2cyclictest483976-1kworker/3:1H23:24:553
1431018994340,2cyclictest1502039-21kworker/3:223:00:313
1431018994340,2cyclictest1491470-21kworker/3:022:38:013
1431018994340,2cyclictest1432504-21kworker/3:219:17:043
1431016994340,2cyclictest3572569-1kworker/2:1H20:30:122
1431016994340,2cyclictest1483173-21kworker/2:221:55:192
1431016994340,2cyclictest1437978-21kworker/2:119:41:482
1431016994339,3cyclictest3572569-1kworker/2:1H21:11:312
1431010994340,2cyclictest1526348-21kworker/0:200:35:130
1431010994339,3cyclictest2111315-1kworker/0:0H23:57:020
1431010994339,3cyclictest1508219-21kworker/0:123:36:470
1431010994338,3cyclictest2111315-1kworker/0:0H21:10:000
1431010994337,4cyclictest2111315-1kworker/0:0H21:02:100
1431018994239,2cyclictest1527961-21kworker/3:000:07:393
1431018994239,2cyclictest1507965-21kworker/3:123:08:023
1431018994238,3cyclictest483976-1kworker/3:1H21:12:323
1431018994238,2cyclictest1432504-21kworker/3:219:22:383
1431016994239,2cyclictest3572569-1kworker/2:1H21:41:572
1431016994239,2cyclictest1461221-21kworker/2:121:45:072
1431016994239,2cyclictest1461221-21kworker/2:121:37:022
1431016994238,3cyclictest3572569-1kworker/2:1H22:11:312
1431016994237,3cyclictest3572569-1kworker/2:1H23:50:022
1431010994240,1cyclictest1521208-21kworker/0:000:05:010
1431010994239,2cyclictest2111315-1kworker/0:0H20:48:010
1431010994239,2cyclictest2111315-1kworker/0:0H20:48:010
1431010994239,2cyclictest1467715-21kworker/0:321:15:000
1431010994237,3cyclictest2111315-1kworker/0:0H00:15:280
1431010994236,4cyclictest2111315-1kworker/0:0H20:25:560
1431010994235,4cyclictest2111315-1kworker/0:0H21:32:100
1431018994138,2cyclictest1514721-21kworker/3:223:45:313
1431018994136,3cyclictest483976-1kworker/3:1H00:23:033
1431018994136,3cyclictest1481227-21kworker/3:022:00:143
1431016994138,2cyclictest3572569-1kworker/2:1H20:35:312
1431016994138,2cyclictest3572569-1kworker/2:1H19:45:062
1431016994137,3cyclictest3572569-1kworker/2:1H23:16:172
1431010994138,2cyclictest2111315-1kworker/0:0H22:13:320
1431010994136,4cyclictest2111315-1kworker/0:0H19:49:560
1431010994136,3cyclictest2111315-1kworker/0:0H22:55:270
1431010994136,3cyclictest2111315-1kworker/0:0H19:10:070
1431010994135,4cyclictest2111315-1kworker/0:0H22:54:570
1431018994037,2cyclictest483976-1kworker/3:1H20:19:563
1431018994037,2cyclictest1443059-21kworker/3:119:46:323
1431018994037,2cyclictest1432504-21kworker/3:219:30:433
1431016994038,1cyclictest3572569-1kworker/2:1H19:30:382
1431016994037,2cyclictest3572569-1kworker/2:1H23:58:532
1431016994037,2cyclictest3572569-1kworker/2:1H23:20:152
1431016994036,2cyclictest3572569-1kworker/2:1H23:00:162
1431016994035,3cyclictest3572569-1kworker/2:1H19:55:132
1431010994037,2cyclictest1503083-21kworker/0:023:05:150
1431010994037,2cyclictest1491471-21kworker/0:022:25:220
1431010994036,3cyclictest2111315-1kworker/0:0H19:30:270
1431010994036,3cyclictest1503083-21kworker/0:023:02:260
1431010994035,3cyclictest2111315-1kworker/0:0H21:27:100
1431010994034,4cyclictest2111315-1kworker/0:0H19:22:130
1431018993936,2cyclictest1491470-21kworker/3:022:20:433
1431018993935,3cyclictest483976-1kworker/3:1H21:39:553
1431016993936,2cyclictest3572569-1kworker/2:1H23:06:592
1431016993936,2cyclictest3572569-1kworker/2:1H20:03:572
1431016993936,1cyclictest3572569-1kworker/2:1H21:30:182
1431016993935,2cyclictest3572569-1kworker/2:1H21:07:062
1431010993934,3cyclictest2111315-1kworker/0:0H21:15:270
1431010993934,3cyclictest2111315-1kworker/0:0H20:40:390
1431018993835,2cyclictest483976-1kworker/3:1H20:45:333
1431018993835,2cyclictest483976-1kworker/3:1H20:45:333
1431018993835,2cyclictest483976-1kworker/3:1H19:12:163
1431018993835,2cyclictest1443059-21kworker/3:119:50:293
1431018993832,4cyclictest483976-1kworker/3:1H19:39:553
1431016993835,2cyclictest3572569-1kworker/2:1H22:59:322
1431016993835,2cyclictest3572569-1kworker/2:1H22:15:582
1431016993834,3cyclictest3572569-1kworker/2:1H19:35:302
1431010993834,3cyclictest2111315-1kworker/0:0H22:35:310
1431010993832,4cyclictest2111315-1kworker/0:0H20:34:570
1431016993734,2cyclictest3572569-1kworker/2:1H21:50:382
1431016993734,2cyclictest3572569-1kworker/2:1H21:50:382
1431016993733,3cyclictest3572569-1kworker/2:1H20:40:332
1431016993732,3cyclictest3572569-1kworker/2:1H21:17:122
1431010993732,3cyclictest2111315-1kworker/0:0H22:47:550
1431010993732,3cyclictest2111315-1kworker/0:0H21:55:110
1431010993732,3cyclictest2111315-1kworker/0:0H21:53:570
1431010993732,3cyclictest2111315-1kworker/0:0H21:53:570
1431018993633,2cyclictest1491470-21kworker/3:022:49:593
1431018993631,3cyclictest483976-1kworker/3:1H23:13:073
1431018993631,3cyclictest483976-1kworker/3:1H00:13:543
1431010993633,2cyclictest2111315-1kworker/0:0H23:20:060
1431010993633,2cyclictest1521208-21kworker/0:023:50:580
1431010993631,3cyclictest2111315-1kworker/0:0H19:41:320
143101899341,15cyclictest1496383-21dump-pmu-power22:35:003
1431010993431,2cyclictest1478017-21kworker/0:222:08:310
1431010993328,3cyclictest2111315-1kworker/0:0H22:40:070
1431018993227,3cyclictest483976-1kworker/3:1H21:04:023
1431018993127,2cyclictest483976-1kworker/3:1H00:30:023
143101399313,3cyclictest0-21swapper/119:10:001
1431010993127,3cyclictest2111315-1kworker/0:0H20:55:070
1431010993127,3cyclictest2111315-1kworker/0:0H00:03:480
1431016993025,3cyclictest3572569-1kworker/2:1H20:10:172
1431010993027,2cyclictest1459521-21kworker/0:020:37:020
143101099300,27cyclictest1480469-21if_err_enp0s29f21:40:170
1431016992924,3cyclictest3572569-1kworker/2:1H00:18:382
143101699290,2cyclictest151rcu_preempt20:05:202
1431010992925,3cyclictest2111315-1kworker/0:0H00:10:010
143101099270,15cyclictest0-21swapper/019:35:120
143101899265,19cyclictest0-21swapper/319:30:003
1431010992621,3cyclictest2111315-1kworker/0:0H20:00:150
1431010992620,4cyclictest2111315-1kworker/0:0H23:30:070
1431010992620,4cyclictest2111315-1kworker/0:0H23:30:070
1431016992522,2cyclictest3572569-1kworker/2:1H20:25:182
1431016992521,3cyclictest654-21snmpd22:24:122
1431016992520,3cyclictest3572569-1kworker/2:1H21:20:322
1431010992518,4cyclictest2111315-1kworker/0:0H22:32:240
143101099250,11cyclictest1466044-21latency_hist20:55:000
1431016992421,2cyclictest0-21swapper/223:44:492
143101899231,14cyclictest1471694-21apt-get21:15:133
143101899222,15cyclictest1459810-21apt-get20:35:123
143101899198,9cyclictest1431042-21sed19:10:003
1431010991911,5cyclictest0-21swapper/022:03:260
1431016991815,2cyclictest3572569-1kworker/2:1H22:45:092
143101099165,8cyclictest1430865-21latency_hist19:10:000
143101699102,5cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional