You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 22:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3.osadl.org (updated Mon Jun 17, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1539796996536,28cyclictest1546534-21kworker/1:207:50:001
1539796996536,28cyclictest1546534-21kworker/1:207:50:001
153979699650,64cyclictest0-21swapper/110:16:421
1539796996462,1cyclictest0-21swapper/108:09:171
153979699640,2cyclictest0-21swapper/109:09:471
1539796996361,1cyclictest0-21swapper/110:09:421
1539796996360,2cyclictest0-21swapper/110:39:071
1539796996359,2cyclictest0-21swapper/108:48:121
1539796996260,1cyclictest0-21swapper/111:26:421
1539796996260,1cyclictest0-21swapper/109:47:121
153979699610,2cyclictest0-21swapper/112:13:111
1539796996043,16cyclictest3479722-1kworker/1:1H11:30:221
1539796996043,15cyclictest3479722-1kworker/1:1H09:50:171
1539796996037,14cyclictest1535431-21kworker/1:107:18:071
1539796995957,1cyclictest0-21swapper/110:59:571
1539796995957,1cyclictest0-21swapper/107:52:421
1539796995941,16cyclictest1665666-21kworker/1:011:09:431
1539796995939,19cyclictest1689803-21kworker/1:211:50:121
1539796995839,18cyclictest1689803-21kworker/1:211:40:011
1539796995837,20cyclictest3479722-1kworker/1:1H10:10:191
1539796995834,23cyclictest3479722-1kworker/1:1H07:40:001
1539797995744,11cyclictest3368625-1kworker/2:0H08:35:162
1539796995754,2cyclictest0-21swapper/107:10:421
1539796995742,14cyclictest1705597-21kworker/1:011:55:001
1539796995742,14cyclictest1635027-21kworker/1:010:20:161
1539796995741,15cyclictest1572294-21kworker/1:209:00:161
1539796995736,18cyclictest1546534-21kworker/1:207:30:001
1539796995641,14cyclictest3479722-1kworker/1:1H09:14:421
1539796995641,14cyclictest1701236-21kworker/1:111:45:171
1539796995641,14cyclictest1665666-21kworker/1:011:10:141
1539796995641,14cyclictest1654813-21kworker/1:110:45:161
1539796995641,14cyclictest1635027-21kworker/1:010:40:271
1539796995641,14cyclictest1603204-21kworker/1:210:00:021
1539796995641,14cyclictest1546534-21kworker/1:208:04:531
1539796995641,14cyclictest1544375-21kworker/1:007:20:131
1539796995640,15cyclictest3479722-1kworker/1:1H11:00:171
1539796995637,18cyclictest1654813-21kworker/1:110:50:141
1539798995550,3cyclictest4136088-1kworker/3:0H07:50:173
1539797995541,11cyclictest3368625-1kworker/2:0H10:40:272
1539797995537,15cyclictest3368625-1kworker/2:0H10:30:152
1539796995540,14cyclictest3479722-1kworker/1:1H12:16:231
1539796995540,14cyclictest1732635-21kworker/1:212:29:551
1539796995540,14cyclictest1728151-21kworker/1:112:25:001
1539796995540,14cyclictest1689803-21kworker/1:211:40:131
1539796995540,14cyclictest1675467-21kworker/1:211:15:171
1539796995540,14cyclictest1589743-21kworker/1:109:30:151
1539796995540,14cyclictest1572294-21kworker/1:208:55:141
1539796995540,14cyclictest1560085-21kworker/1:108:35:171
1539796995540,14cyclictest1560085-21kworker/1:108:29:071
1539796995539,15cyclictest1705597-21kworker/1:012:05:501
1539796995539,15cyclictest1635027-21kworker/1:010:30:221
1539796995539,15cyclictest1589743-21kworker/1:109:40:331
1539796995539,15cyclictest1589743-21kworker/1:109:35:311
1539796995539,15cyclictest1560085-21kworker/1:108:20:211
153979699551,53cyclictest0-21swapper/108:11:141
1539797995449,3cyclictest3368625-1kworker/2:0H11:30:432
1539796995439,14cyclictest3479722-1kworker/1:1H09:20:141
1539796995439,14cyclictest1635027-21kworker/1:010:25:181
1539796995439,14cyclictest1546534-21kworker/1:207:40:001
1539796995438,15cyclictest3479722-1kworker/1:1H11:20:101
1539796995438,15cyclictest1603204-21kworker/1:209:55:011
1539792995450,2cyclictest1724455-21kworker/0:012:23:410
1539797995348,3cyclictest3368625-1kworker/2:0H07:32:132
1539797995347,4cyclictest3368625-1kworker/2:0H07:40:062
1539796995337,15cyclictest1572294-21kworker/1:208:52:421
1539796995337,15cyclictest1560085-21kworker/1:108:30:171
153979699530,52cyclictest0-21swapper/108:18:091
1539792995348,3cyclictest3644074-1kworker/0:1H08:30:220
1539797995248,2cyclictest1539700-21kworker/2:207:54:122
1539797995247,3cyclictest3368625-1kworker/2:0H09:05:122
1539797995236,14cyclictest3368625-1kworker/2:0H10:25:232
1539796995237,14cyclictest1732635-21kworker/1:212:30:131
1539796995236,15cyclictest1579809-21kworker/1:309:15:161
1539797995146,3cyclictest1539700-21kworker/2:207:49:532
1539797995146,3cyclictest1539700-21kworker/2:207:49:532
1539797995134,14cyclictest3368625-1kworker/2:0H11:10:192
1539796995136,14cyclictest1732635-21kworker/1:212:35:121
1539796995135,15cyclictest1546534-21kworker/1:207:26:141
1539792995148,2cyclictest1570405-21kworker/0:108:50:480
1539798995043,5cyclictest4136088-1kworker/3:0H09:45:173
1539797995046,2cyclictest3368625-1kworker/2:0H08:21:482
1539796995034,15cyclictest1560085-21kworker/1:108:40:131
1539792995047,2cyclictest1527298-21kworker/0:007:16:460
1539792995046,2cyclictest3644074-1kworker/0:1H10:45:160
1539792995044,4cyclictest3644074-1kworker/0:1H10:05:350
1539792995044,3cyclictest3644074-1kworker/0:1H07:55:200
1539798994945,2cyclictest4136088-1kworker/3:0H09:33:543
1539798994944,3cyclictest4136088-1kworker/3:0H08:15:153
1539798994943,3cyclictest4136088-1kworker/3:0H07:40:003
1539797994944,3cyclictest3368625-1kworker/2:0H12:30:562
1539797994944,3cyclictest3368625-1kworker/2:0H08:40:172
1539797994944,3cyclictest3368625-1kworker/2:0H08:00:002
1539797994944,3cyclictest1698985-21kworker/2:212:00:002
1539792994945,2cyclictest1576659-21kworker/0:009:11:070
1539792994944,3cyclictest3644074-1kworker/0:1H09:40:160
1539798994845,2cyclictest4136088-1kworker/3:0H10:57:413
1539798994845,2cyclictest1652441-21kworker/3:110:46:033
1539798994842,4cyclictest4136088-1kworker/3:0H11:52:433
1539797994844,3cyclictest1698985-21kworker/2:212:10:432
1539797994844,3cyclictest1568668-21kworker/2:109:00:002
1539797994844,3cyclictest1539700-21kworker/2:208:13:332
1539797994843,3cyclictest1650255-21kworker/2:011:27:392
1539797994843,2cyclictest1539700-21kworker/2:208:05:162
1539796994833,14cyclictest1589743-21kworker/1:109:25:011
1539792994845,2cyclictest1547449-21kworker/0:107:39:300
1539792994844,2cyclictest1553654-21kworker/0:007:50:290
1539792994843,3cyclictest3644074-1kworker/0:1H09:25:160
1539792994843,2cyclictest3644074-1kworker/0:1H10:35:170
1539798994744,2cyclictest1592047-21kworker/3:210:20:073
1539798994744,2cyclictest1579758-21kworker/3:009:15:283
1539798994743,3cyclictest1541249-21kworker/3:007:17:283
1539797994744,2cyclictest3368625-1kworker/2:0H07:20:012
1539797994743,2cyclictest3368625-1kworker/2:0H11:04:062
1539797994743,2cyclictest1743908-21kworker/2:212:40:002
1539797994740,4cyclictest3368625-1kworker/2:0H07:18:072
1539796994727,19cyclictest1705597-21kworker/1:012:00:131
1539792994742,3cyclictest3644074-1kworker/0:1H10:50:070
1539792994741,4cyclictest3644074-1kworker/0:1H07:45:160
1539792994741,4cyclictest3644074-1kworker/0:1H07:45:160
1539798994643,2cyclictest4136088-1kworker/3:0H09:25:283
1539798994643,2cyclictest1541249-21kworker/3:007:44:553
1539798994641,3cyclictest4136088-1kworker/3:0H08:05:433
1539797994643,2cyclictest1650255-21kworker/2:010:52:122
1539797994643,2cyclictest1568668-21kworker/2:109:20:182
1539797994641,3cyclictest1724242-21kworker/2:012:15:122
1539797994640,4cyclictest3368625-1kworker/2:0H08:50:212
1539796994630,15cyclictest3479722-1kworker/1:1H07:57:411
1539792994641,3cyclictest3644074-1kworker/0:1H07:20:130
1539792994640,4cyclictest3644074-1kworker/0:1H10:01:420
1539792994639,4cyclictest3644074-1kworker/0:1H11:45:480
1539798994541,2cyclictest1563449-21kworker/3:008:44:073
1539798994540,3cyclictest4136088-1kworker/3:0H12:11:423
1539798994540,3cyclictest4136088-1kworker/3:0H11:10:013
1539797994542,2cyclictest1614969-21kworker/2:310:24:122
1539797994541,3cyclictest1614969-21kworker/2:310:15:222
1539797994541,3cyclictest1539700-21kworker/2:208:25:132
1539797994541,2cyclictest1650255-21kworker/2:010:57:072
1539797994539,3cyclictest3368625-1kworker/2:0H09:25:072
1539792994540,3cyclictest3644074-1kworker/0:1H08:13:070
1539792994540,3cyclictest1588170-21kworker/0:209:23:060
1539798994441,2cyclictest1644332-21kworker/3:010:34:553
1539798994441,2cyclictest1541249-21kworker/3:007:33:073
1539798994441,2cyclictest1541249-21kworker/3:007:24:553
1539798994440,3cyclictest4136088-1kworker/3:0H10:42:073
1539798994440,3cyclictest4136088-1kworker/3:0H10:10:273
1539798994440,3cyclictest1686064-21kworker/3:111:37:073
1539798994440,2cyclictest1563449-21kworker/3:008:31:123
1539798994439,3cyclictest4136088-1kworker/3:0H12:00:273
1539798994439,3cyclictest4136088-1kworker/3:0H09:53:073
1539798994439,3cyclictest1707566-21kworker/3:111:55:143
1539798994439,3cyclictest1556730-21kworker/3:108:00:553
1539797994441,2cyclictest1614969-21kworker/2:310:35:062
1539797994440,3cyclictest3368625-1kworker/2:0H12:00:242
1539797994440,3cyclictest1650255-21kworker/2:011:40:062
1539797994440,2cyclictest1614969-21kworker/2:310:07:072
1539797994439,3cyclictest3368625-1kworker/2:0H12:10:002
1539797994439,3cyclictest3368625-1kworker/2:0H09:45:112
1539797994439,3cyclictest1614969-21kworker/2:310:10:172
1539792994440,2cyclictest1583570-21kworker/0:109:46:410
1539792994439,3cyclictest3644074-1kworker/0:1H08:20:120
1539792994438,4cyclictest3644074-1kworker/0:1H10:23:120
1539798994340,2cyclictest1592047-21kworker/3:210:06:133
1539798994339,3cyclictest1592047-21kworker/3:210:01:083
1539798994338,3cyclictest4136088-1kworker/3:0H12:35:173
1539798994338,3cyclictest4136088-1kworker/3:0H09:10:253
1539798994338,3cyclictest1727963-21kworker/3:012:30:013
1539797994339,3cyclictest1568668-21kworker/2:109:50:232
1539797994339,2cyclictest1568668-21kworker/2:109:15:532
1539797994337,3cyclictest3368625-1kworker/2:0H09:35:162
1539792994341,1cyclictest1719267-21kworker/0:212:15:340
1539792994341,1cyclictest1527298-21kworker/0:007:28:120
1539792994339,3cyclictest3644074-1kworker/0:1H12:25:130
1539792994339,3cyclictest1631538-21kworker/0:110:30:120
1539792994338,3cyclictest3644074-1kworker/0:1H08:55:330
1539792994337,4cyclictest3644074-1kworker/0:1H11:51:040
1539792994336,4cyclictest3644074-1kworker/0:1H12:15:000
1539798994239,2cyclictest1686064-21kworker/3:111:34:483
1539798994239,2cyclictest1576658-21kworker/3:109:04:473
1539798994239,2cyclictest1553651-21kworker/3:207:56:423
1539798994238,2cyclictest4136088-1kworker/3:0H08:45:163
1539797994237,3cyclictest3368625-1kworker/2:0H07:14:112
1539797994236,3cyclictest3368625-1kworker/2:0H08:15:162
1539792994239,2cyclictest1605511-21kworker/0:209:57:090
1539792994237,3cyclictest3644074-1kworker/0:1H11:14:580
1539792994236,4cyclictest3644074-1kworker/0:1H11:25:130
1539798994138,2cyclictest1592047-21kworker/3:210:19:413
1539798994138,2cyclictest1563449-21kworker/3:008:35:433
1539798994136,3cyclictest4136088-1kworker/3:0H11:18:073
1539798994136,3cyclictest4136088-1kworker/3:0H10:25:403
1539798994136,3cyclictest1563449-21kworker/3:008:25:223
1539797994138,2cyclictest3368625-1kworker/2:0H10:47:112
1539797994138,2cyclictest1724242-21kworker/2:012:28:132
1539797994137,3cyclictest3368625-1kworker/2:0H08:45:302
1539797994137,2cyclictest3368625-1kworker/2:0H08:31:432
1539797994136,3cyclictest3368625-1kworker/2:0H11:46:422
1539797994136,3cyclictest3368625-1kworker/2:0H07:37:422
1539797994136,3cyclictest1614969-21kworker/2:309:56:422
1539792994136,3cyclictest1631538-21kworker/0:110:25:330
1539792994135,3cyclictest3644074-1kworker/0:1H11:35:480
1539792994135,3cyclictest3644074-1kworker/0:1H07:10:140
1539798994037,2cyclictest1699535-21kworker/3:011:44:553
1539798994037,2cyclictest1563449-21kworker/3:008:54:553
1539798994036,2cyclictest4136088-1kworker/3:0H11:22:083
1539798994036,2cyclictest4136088-1kworker/3:0H10:35:073
1539797994037,2cyclictest1568668-21kworker/2:109:11:122
1539792994037,2cyclictest1605511-21kworker/0:209:52:430
1539792994035,3cyclictest3644074-1kworker/0:1H12:05:330
1539792994035,3cyclictest3644074-1kworker/0:1H12:00:330
1539798993936,2cyclictest1703461-21kworker/3:211:48:373
1539798993936,2cyclictest1686064-21kworker/3:111:27:173
1539798993936,2cyclictest1592047-21kworker/3:209:55:253
1539798993935,3cyclictest4136088-1kworker/3:0H09:35:313
1539798993935,2cyclictest4136088-1kworker/3:0H09:40:173
1539798993934,3cyclictest4136088-1kworker/3:0H12:30:133
1539797993935,2cyclictest3368625-1kworker/2:0H10:00:062
1539797993935,2cyclictest3368625-1kworker/2:0H08:03:072
1539797993934,3cyclictest3368625-1kworker/2:0H11:05:482
1539797993934,3cyclictest1698985-21kworker/2:211:53:072
1539792993934,3cyclictest3644074-1kworker/0:1H09:04:410
1539792993932,4cyclictest3644074-1kworker/0:1H10:20:010
1539798993835,2cyclictest1560077-21kworker/3:208:14:553
1539798993834,2cyclictest4136088-1kworker/3:0H11:00:173
1539798993834,2cyclictest1541249-21kworker/3:007:29:443
1539797993834,3cyclictest3368625-1kworker/2:0H07:26:422
1539797993833,3cyclictest3368625-1kworker/2:0H11:20:322
1539792993835,2cyclictest1724455-21kworker/0:012:35:220
1539792993834,2cyclictest3644074-1kworker/0:1H11:30:460
1539792993833,3cyclictest3644074-1kworker/0:1H08:35:330
1539792993832,4cyclictest3644074-1kworker/0:1H11:40:380
1539798993734,2cyclictest1652441-21kworker/3:110:50:303
1539797993733,3cyclictest3368625-1kworker/2:0H11:37:422
1539797993733,2cyclictest3368625-1kworker/2:0H09:01:412
1539797993732,3cyclictest3368625-1kworker/2:0H12:23:072
1539792993730,4cyclictest3644074-1kworker/0:1H08:05:180
1539798993633,2cyclictest4136088-1kworker/3:0H11:15:003
1539797993633,2cyclictest3368625-1kworker/2:0H09:41:412
1539792993630,4cyclictest1656004-21kworker/0:210:55:170
1539792993630,4cyclictest1646614-21kworker/0:011:05:230
1539792993630,3cyclictest3644074-1kworker/0:1H11:15:450
1539798993530,3cyclictest4136088-1kworker/3:0H07:45:283
1539798993530,3cyclictest4136088-1kworker/3:0H07:45:283
1539798993524,2cyclictest4136088-1kworker/3:0H09:20:133
1539797993532,2cyclictest1650255-21kworker/2:011:15:332
1539792993530,4cyclictest3644074-1kworker/0:1H11:23:420
1539792993530,3cyclictest3644074-1kworker/0:1H11:00:310
1539792993529,4cyclictest1527298-21kworker/0:007:30:120
1539792993528,4cyclictest3644074-1kworker/0:1H08:50:000
1539798993430,3cyclictest4136088-1kworker/3:0H12:09:543
1539798993430,3cyclictest4136088-1kworker/3:0H09:05:273
1539798993429,3cyclictest4136088-1kworker/3:0H12:20:143
1539792993429,3cyclictest51650irq/160-enp0s2909:30:120
1539792993429,3cyclictest3644074-1kworker/0:1H09:20:000
153979699331,18cyclictest26-21ksoftirqd/107:10:011
1539792993328,3cyclictest3644074-1kworker/0:1H08:26:070
1539792993327,4cyclictest3644074-1kworker/0:1H11:55:350
1539798993228,2cyclictest1560077-21kworker/3:208:20:063
1539798993127,3cyclictest4136088-1kworker/3:0H12:15:333
1539792993128,2cyclictest3644074-1kworker/0:1H08:18:090
1539798993027,2cyclictest1539639-21kworker/3:207:12:303
1539797993027,2cyclictest3368625-1kworker/2:0H09:30:582
1539792993026,3cyclictest3644074-1kworker/0:1H10:15:000
1539792993024,3cyclictest3644074-1kworker/0:1H10:45:000
1539798992925,3cyclictest1563449-21kworker/3:008:59:123
1539792992623,2cyclictest1724455-21kworker/0:012:30:130
1539792992622,2cyclictest1576659-21kworker/0:009:07:010
1539792992620,4cyclictest3644074-1kworker/0:1H08:00:160
153979299251,22cyclictest1571735-21/usr/sbin/munin08:40:300
153979299250,23cyclictest1600632-21/usr/sbin/munin09:35:220
1539792992216,4cyclictest1551266-21/usr/sbin/munin07:40:170
1539797991917,1cyclictest0-21swapper/207:10:012
153979299161,13cyclictest0-21swapper/007:10:010
1539798991411,2cyclictest1539656-21latency_hist07:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional