You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 12:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Wed Jul 02, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1448783996737,28cyclictest1547489-21kworker/1:200:35:161
1448783996638,26cyclictest928648-1kworker/1:1H22:50:161
144878399661,63cyclictest0-21swapper/100:09:541
1448783996542,21cyclictest928648-1kworker/1:1H21:30:011
1448783996461,2cyclictest0-21swapper/120:34:241
1448783996437,26cyclictest1496703-21kworker/1:122:10:191
1448783996346,16cyclictest928648-1kworker/1:1H19:25:401
1448783996340,23cyclictest1486725-21kworker/1:021:10:551
1448783996243,17cyclictest928648-1kworker/1:1H22:55:161
1448783996241,20cyclictest1496703-21kworker/1:122:20:001
1448783996142,18cyclictest1461120-21kworker/1:219:55:211
1448783996043,16cyclictest1486725-21kworker/1:021:20:001
1448783996041,18cyclictest1496703-21kworker/1:122:00:061
1448783996037,21cyclictest1480835-21kworker/1:220:55:171
1448783996035,23cyclictest1486725-21kworker/1:021:05:161
1448783995956,2cyclictest0-21swapper/120:52:581
144878399594,52cyclictest384844-21systemd-journal19:25:001
1448783995944,14cyclictest1523247-21kworker/1:123:00:161
1448783995944,14cyclictest1461120-21kworker/1:219:45:161
1448783995942,16cyclictest1533239-21kworker/1:023:50:131
1448783995941,17cyclictest1496703-21kworker/1:122:05:171
1448783995937,21cyclictest1469222-21kworker/1:120:10:161
1448783995935,19cyclictest928648-1kworker/1:1H21:45:001
1448783995930,28cyclictest1490523-21kworker/1:221:20:571
1448783995843,14cyclictest1547489-21kworker/1:200:10:011
1448783995843,14cyclictest1523247-21kworker/1:123:10:151
1448783995843,14cyclictest1515904-21kworker/1:022:37:281
1448783995843,14cyclictest1496703-21kworker/1:122:30:171
1448783995841,16cyclictest1457272-21kworker/1:119:35:161
1448783995840,17cyclictest1533239-21kworker/1:023:45:181
1448783995839,17cyclictest928648-1kworker/1:1H20:45:241
1448783995743,14cyclictest1461120-21kworker/1:220:09:541
1448783995742,14cyclictest928648-1kworker/1:1H22:45:161
1448783995742,14cyclictest1515904-21kworker/1:022:40:211
1448783995742,14cyclictest1496703-21kworker/1:121:52:201
1448783995740,16cyclictest1523247-21kworker/1:123:20:161
1448783995739,16cyclictest1435662-21kworker/1:219:30:151
1448783995738,17cyclictest1533239-21kworker/1:023:55:191
1448783995737,19cyclictest1435662-21kworker/1:219:15:151
144878399571,54cyclictest0-21swapper/100:05:001
144878399571,53cyclictest0-21swapper/123:35:491
1448789995651,3cyclictest3359109-1kworker/3:0H20:39:533
1448783995642,14cyclictest1547489-21kworker/1:200:25:071
1448783995642,14cyclictest1496703-21kworker/1:121:45:191
1448783995642,13cyclictest1469222-21kworker/1:120:15:171
1448783995641,14cyclictest928648-1kworker/1:1H20:25:191
1448783995641,14cyclictest1547489-21kworker/1:200:19:551
1448783995641,14cyclictest1533239-21kworker/1:023:33:051
1448783995641,14cyclictest1533239-21kworker/1:023:25:191
1448783995641,14cyclictest1523247-21kworker/1:123:15:151
1448783995641,14cyclictest1496703-21kworker/1:122:25:191
1448783995641,14cyclictest1496703-21kworker/1:121:55:151
1448783995641,14cyclictest1496703-21kworker/1:121:39:561
1448783995641,14cyclictest1494882-21kworker/1:321:34:191
1448783995641,14cyclictest1480835-21kworker/1:221:02:191
1448783995641,14cyclictest1469222-21kworker/1:120:40:011
1448783995641,14cyclictest1461120-21kworker/1:219:50:151
1448783995633,22cyclictest1496703-21kworker/1:122:23:061
1448782995651,3cyclictest3103946-1kworker/0:1H21:10:240
1448789995549,3cyclictest3359109-1kworker/3:0H23:00:173
1448783995541,14cyclictest1435662-21kworker/1:219:11:491
1448783995540,14cyclictest928648-1kworker/1:1H20:38:231
1448783995540,14cyclictest1547489-21kworker/1:200:34:541
1448783995540,14cyclictest1469222-21kworker/1:120:20:011
1448783995540,14cyclictest1461120-21kworker/1:220:00:171
1448783995539,15cyclictest1457272-21kworker/1:119:44:251
1448783995538,15cyclictest928648-1kworker/1:1H23:05:191
1448783995435,17cyclictest1533239-21kworker/1:023:40:201
1448789995348,3cyclictest3359109-1kworker/3:0H00:00:403
1448785995349,2cyclictest824389-1kworker/2:0H19:10:162
1448782995348,3cyclictest3103946-1kworker/0:1H20:44:190
1448785995247,3cyclictest824389-1kworker/2:0H23:22:552
1448785995247,3cyclictest824389-1kworker/2:0H20:06:542
1448782995247,3cyclictest3103946-1kworker/0:1H00:31:200
1448782995247,3cyclictest3103946-1kworker/0:1H00:08:100
1448789995141,7cyclictest3359109-1kworker/3:0H23:30:203
1448785995146,3cyclictest824389-1kworker/2:0H20:49:552
1448785995146,3cyclictest824389-1kworker/2:0H19:44:542
1448783995135,15cyclictest928648-1kworker/1:1H00:22:431
1448789995044,3cyclictest3359109-1kworker/3:0H21:30:153
1448785995039,9cyclictest824389-1kworker/2:0H21:05:162
1448782995046,2cyclictest1522900-21kworker/0:123:40:140
1448789994944,3cyclictest3359109-1kworker/3:0H22:10:353
1448785994946,2cyclictest1496501-21kworker/2:121:35:012
1448785994944,3cyclictest824389-1kworker/2:0H22:40:202
1448782994946,1cyclictest3103946-1kworker/0:1H20:45:150
1448789994844,2cyclictest3359109-1kworker/3:0H23:10:003
1448785994842,3cyclictest824389-1kworker/2:0H22:40:012
1448785994842,3cyclictest824389-1kworker/2:0H19:16:482
1448785994836,9cyclictest824389-1kworker/2:0H23:40:002
1448782994844,3cyclictest3103946-1kworker/0:1H19:32:530
1448789994742,3cyclictest3359109-1kworker/3:0H22:20:003
1448789994741,3cyclictest3359109-1kworker/3:0H21:37:193
1448785994742,3cyclictest824389-1kworker/2:0H19:28:592
1448785994742,3cyclictest824389-1kworker/2:0H00:35:582
1448785994741,3cyclictest824389-1kworker/2:0H20:00:002
1448782994744,2cyclictest3103946-1kworker/0:1H22:20:410
1448782994742,3cyclictest3103946-1kworker/0:1H22:12:240
1448789994641,3cyclictest3359109-1kworker/3:0H23:46:533
1448789994641,3cyclictest3359109-1kworker/3:0H00:24:553
1448785994641,3cyclictest824389-1kworker/2:0H00:15:012
1448785994612,29cyclictest384844-21systemd-journal22:05:002
1448782994642,3cyclictest3103946-1kworker/0:1H22:00:290
1448782994642,2cyclictest3103946-1kworker/0:1H20:15:150
1448782994642,2cyclictest1480230-21kworker/0:020:58:190
1448789994542,2cyclictest3359109-1kworker/3:0H20:59:553
1448789994542,2cyclictest1454038-21kworker/3:222:20:173
1448789994540,3cyclictest3359109-1kworker/3:0H19:35:543
1448782994541,2cyclictest1460528-21kworker/0:120:00:170
1448782994540,3cyclictest3103946-1kworker/0:1H23:45:190
1448789994438,3cyclictest3359109-1kworker/3:0H20:47:093
1448785994441,2cyclictest824389-1kworker/2:0H20:26:542
1448785994439,3cyclictest824389-1kworker/2:0H00:05:332
1448785994433,9cyclictest824389-1kworker/2:0H19:35:162
1448782994441,2cyclictest3103946-1kworker/0:1H20:36:210
1448782994440,2cyclictest3103946-1kworker/0:1H21:40:360
1448782994440,2cyclictest3103946-1kworker/0:1H19:55:090
1448782994440,2cyclictest1529378-21kworker/0:223:20:150
1448789994339,3cyclictest3359109-1kworker/3:0H22:55:553
1448789994338,3cyclictest3359109-1kworker/3:0H00:27:433
1448785994340,2cyclictest824389-1kworker/2:0H19:23:542
1448785994338,3cyclictest824389-1kworker/2:0H20:17:102
1448785994337,3cyclictest824389-1kworker/2:0H20:35:172
1448785994330,11cyclictest824389-1kworker/2:0H23:45:192
1448782994339,3cyclictest3103946-1kworker/0:1H23:34:540
1448782994339,3cyclictest3103946-1kworker/0:1H21:45:160
1448782994339,2cyclictest3103946-1kworker/0:1H20:20:150
1448789994238,3cyclictest3359109-1kworker/3:0H21:19:563
1448789994238,2cyclictest3359109-1kworker/3:0H23:55:183
1448789994237,3cyclictest3359109-1kworker/3:0H23:16:543
1448789994237,3cyclictest3359109-1kworker/3:0H21:44:543
1448789994237,3cyclictest3359109-1kworker/3:0H20:30:173
1448789994237,3cyclictest3359109-1kworker/3:0H20:07:533
1448785994238,3cyclictest824389-1kworker/2:0H22:18:542
1448785994238,3cyclictest824389-1kworker/2:0H20:32:252
1448785994234,5cyclictest824389-1kworker/2:0H23:55:002
1448785994138,2cyclictest824389-1kworker/2:0H20:42:542
1448785994138,2cyclictest824389-1kworker/2:0H20:04:532
1448785994128,6cyclictest824389-1kworker/2:0H23:55:192
1448782994137,2cyclictest1488593-21kworker/0:121:20:000
1448782994136,3cyclictest3103946-1kworker/0:1H00:05:000
1448782994136,2cyclictest3103946-1kworker/0:1H21:27:160
1448789994037,2cyclictest3359109-1kworker/3:0H21:22:553
1448789994037,2cyclictest3359109-1kworker/3:0H19:14:553
1448789994035,3cyclictest3359109-1kworker/3:0H20:11:543
1448785994037,2cyclictest824389-1kworker/2:0H22:28:252
1448785994037,2cyclictest824389-1kworker/2:0H20:52:172
1448785994035,3cyclictest824389-1kworker/2:0H00:32:512
144878599400,28cyclictest654-21snmpd19:48:042
1448782994036,2cyclictest3103946-1kworker/0:1H21:07:130
1448789993935,3cyclictest3359109-1kworker/3:0H19:50:203
1448789993934,3cyclictest3359109-1kworker/3:0H23:39:553
1448789993934,3cyclictest3359109-1kworker/3:0H22:52:303
1448789993934,3cyclictest3359109-1kworker/3:0H19:25:163
1448789993934,2cyclictest3359109-1kworker/3:0H19:21:493
1448789993933,4cyclictest3359109-1kworker/3:0H23:11:533
1448785993936,2cyclictest824389-1kworker/2:0H22:48:542
1448785993936,2cyclictest824389-1kworker/2:0H21:50:402
1448785993936,2cyclictest824389-1kworker/2:0H00:22:552
1448785993935,3cyclictest824389-1kworker/2:0H23:05:342
1448785993934,3cyclictest824389-1kworker/2:0H23:40:202
1448785993934,3cyclictest824389-1kworker/2:0H20:55:152
1448782993936,2cyclictest3103946-1kworker/0:1H22:35:210
1448782993936,2cyclictest3103946-1kworker/0:1H20:12:340
1448782993935,2cyclictest3103946-1kworker/0:1H23:25:180
1448782993931,5cyclictest3103946-1kworker/0:1H00:00:010
1448789993835,2cyclictest3359109-1kworker/3:0H19:15:033
1448789993834,3cyclictest3359109-1kworker/3:0H22:40:543
1448789993833,3cyclictest3359109-1kworker/3:0H23:52:183
1448789993833,3cyclictest3359109-1kworker/3:0H21:10:013
1448789993833,2cyclictest3359109-1kworker/3:0H22:27:273
1448785993834,3cyclictest824389-1kworker/2:0H20:12:002
1448785993833,3cyclictest824389-1kworker/2:0H23:25:062
1448785993833,3cyclictest824389-1kworker/2:0H22:50:352
1448785993833,3cyclictest824389-1kworker/2:0H21:57:272
1448785993833,3cyclictest824389-1kworker/2:0H21:24:302
1448785993812,17cyclictest824389-1kworker/2:0H22:30:192
144878599380,35cyclictest1491101-21ntpq21:15:202
1448782993836,1cyclictest1511031-21kworker/0:022:29:550
1448782993835,2cyclictest3103946-1kworker/0:1H22:45:000
1448782993833,3cyclictest3103946-1kworker/0:1H19:40:540
1448789993734,2cyclictest3359109-1kworker/3:0H21:10:543
1448789993733,3cyclictest3359109-1kworker/3:0H23:40:253
1448789993730,5cyclictest3359109-1kworker/3:0H19:56:583
1448785993734,2cyclictest824389-1kworker/2:0H21:35:352
1448785993732,3cyclictest824389-1kworker/2:0H21:27:182
144878599371,33cyclictest1457286-21munin-run19:34:592
1448782993734,2cyclictest3103946-1kworker/0:1H21:52:550
1448782993734,2cyclictest1545880-21kworker/0:200:25:220
1448789993633,2cyclictest3359109-1kworker/3:0H23:20:343
1448789993631,3cyclictest3359109-1kworker/3:0H00:39:533
1448789993628,4cyclictest3359109-1kworker/3:0H00:33:263
1448785993632,2cyclictest824389-1kworker/2:0H00:00:162
1448785993631,3cyclictest824389-1kworker/2:0H21:47:312
1448782993633,2cyclictest3103946-1kworker/0:1H23:05:550
1448782993633,2cyclictest3103946-1kworker/0:1H00:36:530
1448782993633,2cyclictest1488593-21kworker/0:121:39:190
1448782993631,3cyclictest3103946-1kworker/0:1H21:55:140
1448789993532,2cyclictest3359109-1kworker/3:0H00:12:533
1448789993531,3cyclictest3359109-1kworker/3:0H21:27:233
1448789993530,3cyclictest3359109-1kworker/3:0H00:07:203
1448785993531,3cyclictest824389-1kworker/2:0H21:03:532
1448785993531,3cyclictest824389-1kworker/2:0H20:20:012
144878599351,19cyclictest0-21swapper/222:09:562
1448782993533,1cyclictest1460528-21kworker/0:120:05:090
1448782993531,3cyclictest3103946-1kworker/0:1H00:10:290
1448782993530,3cyclictest3103946-1kworker/0:1H22:57:320
144878299350,2cyclictest0-21swapper/021:34:480
1448789993429,3cyclictest3359109-1kworker/3:0H22:30:333
1448785993431,2cyclictest824389-1kworker/2:0H22:22:332
1448785993431,2cyclictest824389-1kworker/2:0H19:50:382
1448785993429,3cyclictest824389-1kworker/2:0H23:17:542
144878599340,31cyclictest0-21swapper/222:10:222
1448782993431,2cyclictest3103946-1kworker/0:1H23:17:380
1448782993431,2cyclictest3103946-1kworker/0:1H23:10:300
1448782993430,2cyclictest3103946-1kworker/0:1H19:46:570
1448789993330,2cyclictest3359109-1kworker/3:0H20:20:143
1448789993330,2cyclictest1512681-21kworker/3:122:47:283
1448789993328,3cyclictest3359109-1kworker/3:0H21:05:003
1448789993328,3cyclictest3359109-1kworker/3:0H00:17:413
1448782993330,2cyclictest3103946-1kworker/0:1H22:52:370
1448782993330,2cyclictest3103946-1kworker/0:1H21:20:570
1448789993222,7cyclictest1502956-21cron21:55:003
1448782993229,2cyclictest3103946-1kworker/0:1H23:38:060
1448782993229,2cyclictest1447123-21kworker/0:219:25:530
1448782993227,3cyclictest3103946-1kworker/0:1H22:45:190
1448789993127,3cyclictest3359109-1kworker/3:0H20:00:403
1448789993126,3cyclictest3359109-1kworker/3:0H22:05:133
1448789993124,4cyclictest3359109-1kworker/3:0H22:02:213
1448782993128,2cyclictest3103946-1kworker/0:1H23:50:060
1448782993128,2cyclictest3103946-1kworker/0:1H20:50:180
1448789993027,2cyclictest3359109-1kworker/3:0H22:37:353
1448789993025,3cyclictest3359109-1kworker/3:0H20:54:553
1448789993024,4cyclictest40-21ksoftirqd/319:40:133
144878999302,10cyclictest1303966-21sendmail-mta19:48:573
144878599301,25cyclictest1528255-21cat23:10:142
144878599300,26cyclictest1524962-21grep23:00:172
144878599300,17cyclictest1488619-21apt-get21:10:132
1448782993027,2cyclictest3103946-1kworker/0:1H22:30:550
1448782993027,2cyclictest3103946-1kworker/0:1H22:15:540
1448782993027,2cyclictest3103946-1kworker/0:1H20:34:540
1448782993026,3cyclictest3103946-1kworker/0:1H23:00:340
1448789992923,3cyclictest3359109-1kworker/3:0H20:17:033
1448785992923,3cyclictest824389-1kworker/2:0H21:40:142
1448785992912,10cyclictest824389-1kworker/2:0H00:25:162
144878599291,15cyclictest1536038-21cat23:35:002
144878599290,14cyclictest0-21swapper/200:15:182
1448782992925,2cyclictest3103946-1kworker/0:1H22:10:000
1448782992925,2cyclictest3103946-1kworker/0:1H19:50:150
1448782992912,13cyclictest1549891-21hwlatdetect00:15:150
144878599281,14cyclictest1523510-21if_err_enp0s29f22:55:182
1448782992826,1cyclictest1550798-21kworker/0:100:22:480
1448782992826,1cyclictest1460528-21kworker/0:120:29:580
1448782992824,3cyclictest3103946-1kworker/0:1H19:10:540
1448789992722,2cyclictest3359109-1kworker/3:0H20:42:093
144878999267,15cyclictest1504287-21xargs21:55:223
144878399261,21cyclictest0-21swapper/119:10:001
1448782992623,2cyclictest3103946-1kworker/0:1H19:18:550
1448782992622,3cyclictest3103946-1kworker/0:1H19:38:540
1448789992521,3cyclictest40-21ksoftirqd/323:27:583
1448789992520,3cyclictest3359109-1kworker/3:0H19:34:543
1448789992511,11cyclictest0-21swapper/321:45:143
1448789992413,8cyclictest1474071-21/usr/sbin/munin20:25:163
1448782992219,2cyclictest3103946-1kworker/0:1H21:01:540
144878299221,12cyclictest1452694-21apt-get19:20:120
144878599211,16cyclictest1448601-21latency_hist19:10:002
144878999179,6cyclictest0-21swapper/319:10:013
144878299131,4cyclictest1448780-21cyclictest19:09:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional