You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 18:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Wed Jul 02, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1274554991812,1cyclictest1285033-21chrt07:35:013
127455499150,2cyclictest0-21swapper/308:25:133
127455499140,12cyclictest0-21swapper/309:10:133
127455499130,1cyclictest0-21swapper/307:45:133
127455499130,12cyclictest0-21swapper/308:45:133
127455499130,11cyclictest0-21swapper/311:05:013
127455499129,1cyclictest0-21swapper/310:25:133
127455499120,8cyclictest0-21swapper/308:35:163
127455499120,11cyclictest0-21swapper/311:50:153
127455499120,11cyclictest0-21swapper/310:45:143
127455499120,11cyclictest0-21swapper/309:40:153
127455499120,11cyclictest0-21swapper/307:37:293
1274554991111,0cyclictest0-21swapper/310:40:153
1274554991110,0cyclictest0-21swapper/312:05:133
127455499110,10cyclictest0-21swapper/311:40:183
127455499110,10cyclictest0-21swapper/310:35:203
127455499110,10cyclictest0-21swapper/310:15:213
127455499110,10cyclictest0-21swapper/308:34:033
127455499110,0cyclictest0-21swapper/311:45:153
127455499109,0cyclictest0-21swapper/311:10:133
1274554991010,0cyclictest0-21swapper/311:30:213
1274554991010,0cyclictest0-21swapper/311:25:153
1274554991010,0cyclictest0-21swapper/310:10:003
1274554991010,0cyclictest0-21swapper/307:50:173
1274554991010,0cyclictest0-21swapper/307:13:433
127455499100,9cyclictest0-21swapper/308:43:533
127455499100,9cyclictest0-21swapper/308:00:153
127455499100,0cyclictest0-21swapper/310:55:203
127455499100,0cyclictest0-21swapper/309:30:003
127455499100,0cyclictest0-21swapper/309:00:143
12745549990,0cyclictest0-21swapper/310:30:263
12745549988,0cyclictest0-21swapper/312:25:133
12745549988,0cyclictest0-21swapper/312:15:203
12745549988,0cyclictest0-21swapper/312:12:183
12745549988,0cyclictest0-21swapper/311:55:153
12745549988,0cyclictest0-21swapper/311:39:493
12745549988,0cyclictest0-21swapper/311:20:203
12745549988,0cyclictest0-21swapper/310:00:163
12745549988,0cyclictest0-21swapper/309:35:173
12745549988,0cyclictest0-21swapper/308:05:133
12745549980,7cyclictest0-21swapper/307:20:013
12745549977,0cyclictest0-21swapper/312:35:213
12745549977,0cyclictest0-21swapper/311:01:143
12745549977,0cyclictest0-21swapper/308:55:143
12745549976,0cyclictest0-21swapper/309:30:133
12745549975,1cyclictest0-21swapper/308:15:123
12745549970,0cyclictest0-21swapper/309:05:173
1273404271,4sleep30-21swapper/307:05:203
12745549966,0cyclictest0-21swapper/312:01:513
12745549966,0cyclictest0-21swapper/310:23:323
12745549966,0cyclictest0-21swapper/309:20:143
12745549966,0cyclictest0-21swapper/308:10:393
12745549965,0cyclictest0-21swapper/309:15:143
12745549960,5cyclictest0-21swapper/309:45:223
1399944250,4sleep21399147-21/usr/sbin/munin12:15:192
13989850,3rtkit-daemon436-21systemd-udevd10:15:501
13989850,2rtkit-daemon0-21swapper/107:05:081
1325565250,4sleep01325669-21dpkg09:20:010
12745549954,0cyclictest0-21swapper/309:57:553
12745549953,1cyclictest0-21swapper/309:50:183
12745549950,5cyclictest0-21swapper/307:40:223
12745549950,4cyclictest0-21swapper/312:30:133
12745549950,4cyclictest0-21swapper/310:50:153
1274212250,1sleep20-21swapper/207:08:592
13989840,2rtkit-daemon1404609-21unixbench_singl12:25:221
13989840,2rtkit-daemon1362038-21ntp_states10:45:241
13989840,2rtkit-daemon1-21systemd09:59:121
13989840,1rtkit-daemon1380346-21apt-get11:30:141
1396440243,1sleep01392659-21kworker/0:0+events12:06:520
1371939240,1sleep11371965-21apt-get11:10:131
12745549944,0cyclictest0-21swapper/312:20:463
12745549944,0cyclictest0-21swapper/308:50:063
12745549944,0cyclictest0-21swapper/307:55:133
12745549944,0cyclictest0-21swapper/307:25:153
12745549940,3cyclictest1374019-21chrt11:15:073
12745549940,2cyclictest0-21swapper/310:10:133
12745549940,2cyclictest0-21swapper/308:20:103
12745549940,2cyclictest0-21swapper/307:20:133
1273533241,1sleep00-21swapper/007:05:210
13989830,2rtkit-daemon760-21snmpd10:44:411
13989830,2rtkit-daemon760-21snmpd10:05:121
13989830,2rtkit-daemon417-21systemd-journal10:11:501
13989830,2rtkit-daemon1399-21sendmail-mta08:29:181
13989830,2rtkit-daemon1276759-21munin-node12:00:021
13989830,2rtkit-daemon1276759-21munin-node10:36:151
13989830,2rtkit-daemon1-21systemd09:21:191
13989830,1rtkit-daemon762-21ntpd12:20:271
13989830,1rtkit-daemon762-21ntpd09:50:511
13989830,1rtkit-daemon762-21ntpd07:18:421
13989830,1rtkit-daemon760-21snmpd08:40:211
13989830,1rtkit-daemon684-21gmain07:49:481
13989830,1rtkit-daemon331-21plymouthd12:38:321
13989830,1rtkit-daemon331-21plymouthd12:15:591
13989830,1rtkit-daemon331-21plymouthd11:55:091
13989830,1rtkit-daemon331-21plymouthd11:52:321
13989830,1rtkit-daemon331-21plymouthd11:35:251
13989830,1rtkit-daemon331-21plymouthd11:06:441
13989830,1rtkit-daemon331-21plymouthd10:34:561
13989830,1rtkit-daemon331-21plymouthd08:35:171
13989830,1rtkit-daemon331-21plymouthd07:20:181
13989830,1rtkit-daemon1399-21sendmail-mta09:27:181
13989830,1rtkit-daemon1398909-21munin-run12:15:011
13989830,1rtkit-daemon1342922-21cat10:00:171
13989830,1rtkit-daemon1332247-21cpu09:35:171
13989830,1rtkit-daemon1276759-21munin-node12:07:471
13989830,1rtkit-daemon1-21systemd12:32:311
13989830,1rtkit-daemon1-21systemd11:26:071
13989830,1rtkit-daemon1-21systemd10:56:161
13989830,1rtkit-daemon1-21systemd10:53:571
13989830,1rtkit-daemon1-21systemd09:32:341
13989830,1rtkit-daemon1-21systemd08:05:171
13989830,1rtkit-daemon1-21systemd07:53:131
13989830,1rtkit-daemon1-21systemd07:11:581
13989830,0rtkit-daemon331-21plymouthd08:02:061
13989830,0rtkit-daemon0-21swapper/111:45:181
1350731230,1sleep11350759-21apt-get10:20:141
1281110230,1sleep11281136-21apt-get07:25:151
1407215220,1sleep01407217-21ssh12:34:220
1402918220,0sleep00-21swapper/012:23:250
13989820,1rtkit-daemon760-21snmpd11:20:311
13989820,1rtkit-daemon760-21snmpd08:11:251
13989820,1rtkit-daemon614-21wpa_supplicant11:40:351
13989820,1rtkit-daemon331-21plymouthd11:15:161
13989820,1rtkit-daemon331-21plymouthd09:15:111
13989820,1rtkit-daemon1276759-21munin-node11:01:301
13989820,1rtkit-daemon1-21systemd08:55:181
13989820,1rtkit-daemon1-21systemd07:40:031
13989820,0rtkit-daemon331-21plymouthd09:05:201
13989820,0rtkit-daemon331-21plymouthd09:00:561
13989820,0rtkit-daemon331-21plymouthd08:45:171
13989820,0rtkit-daemon331-21plymouthd08:20:211
13989820,0rtkit-daemon331-21plymouthd07:37:141
13989820,0rtkit-daemon0-21swapper/110:25:101
13989820,0rtkit-daemon0-21swapper/109:45:401
13989820,0rtkit-daemon0-21swapper/109:41:171
13989820,0rtkit-daemon0-21swapper/109:10:161
13989820,0rtkit-daemon0-21swapper/108:50:171
13989820,0rtkit-daemon0-21swapper/108:30:161
13989820,0rtkit-daemon0-21swapper/108:15:111
13989820,0rtkit-daemon0-21swapper/107:55:241
13989820,0rtkit-daemon0-21swapper/107:30:111
1392580220,1sleep00-21swapper/011:59:520
1388815220,1sleep21389013-21tr11:50:172
1366946220,0sleep00-21swapper/010:57:360
1364158220,1sleep01364329-21python310:50:270
1361692220,1sleep21361774-21irqstats10:45:212
1361280220,1sleep01361392-21hostname10:45:150
1360992220,1sleep21361006-21latency_hist10:45:012
1358692220,0sleep00-21swapper/010:38:170
1349356220,1sleep01349398-21ntp_states10:15:210
1345063220,0sleep00-21swapper/010:05:200
1328253220,1sleep21328500-21diskstats09:25:162
1321826220,1sleep01321852-21apt-get09:10:130
1320011220,1sleep21320172-21cpuspeed_turbos09:05:182
1313263220,1sleep21313512-21users08:45:212
1312343220,1sleep01312638-21df08:45:150
1309752220,0sleep00-21swapper/008:36:260
1294918222,0sleep20-21swapper/208:00:062
1289158220,1sleep21289184-21apt-get07:45:132
1279252220,1sleep01279285-21/usr/sbin/munin07:20:140
1275490220,1sleep01275645-21ntp_states07:10:170
1408723210,0sleep00-21swapper/012:35:220
1407733210,0sleep20-21swapper/212:35:162
1405443210,0sleep20-21swapper/212:30:082
1403356210,0sleep00-21swapper/012:25:130
1403346210,0sleep20-21swapper/212:25:072
1401460210,0sleep20-21swapper/212:20:192
1400634210,0sleep00-21swapper/012:16:570
1398504210,0sleep00-21swapper/012:11:360
1398038210,0sleep20-21swapper/212:10:222
1395025210,0sleep20-21swapper/212:05:142
1394179210,0sleep00-21swapper/012:00:240
1392879210,0sleep20-21swapper/212:00:142
1390516210,0sleep20-21swapper/211:55:012
1388691210,0sleep00-21swapper/011:50:150
1387227210,0sleep20-21swapper/211:45:212
1386976210,0sleep00-21swapper/011:45:190
1384788210,0sleep00-21swapper/011:40:180
1383609210,0sleep00-21swapper/011:35:220
1382401210,0sleep20-21swapper/211:35:122
1382068210,0sleep20-21swapper/211:34:162
1380320210,0sleep00-21swapper/011:30:140
1379174210,0sleep00-21swapper/011:25:210
1378914210,0sleep20-21swapper/211:25:192
1377734210,0sleep20-21swapper/211:22:552
1376141210,0sleep00-21swapper/011:20:130
1375427210,0sleep00-21swapper/011:16:080
1374060210,0sleep20-21swapper/211:15:152
1373365210,0sleep00-21swapper/011:11:250
1372454210,0sleep20-21swapper/211:10:182
1371585210,1sleep00-21swapper/011:09:080
1370658210,0sleep20-21swapper/211:05:222
1369187210,1sleep00-21swapper/011:03:440
1368450210,0sleep20-21swapper/211:00:262
1366963210,0sleep20-21swapper/210:57:462
1363085210,0sleep20-21swapper/210:50:012
1359191210,0sleep00-21swapper/010:40:140
1357857210,0sleep20-21swapper/210:35:202
1355816210,0sleep00-21swapper/010:30:260
1355502210,0sleep20-21swapper/210:30:242
1352972210,0sleep20-21swapper/210:25:162
1352624210,0sleep00-21swapper/010:25:010
1351266210,0sleep20-21swapper/210:20:192
1350453210,0sleep00-21swapper/010:20:010
1348592210,0sleep20-21swapper/210:15:032
1346718210,0sleep00-21swapper/010:10:170
1346554210,0sleep20-21swapper/210:10:152
1343930210,0sleep00-21swapper/010:02:480
1342845210,1sleep21342969-21/usr/sbin/munin10:00:182
1341551210,0sleep00-21swapper/009:55:280
1340749210,0sleep21340941-21strings09:55:182
1339346210,0sleep00-21swapper/009:50:230
1338577210,0sleep20-21swapper/209:50:172
1337491210,1sleep00-21swapper/009:46:310
1335797210,0sleep20-21swapper/209:45:012
1334549210,0sleep20-21swapper/209:40:212
1334191210,0sleep00-21swapper/009:40:190
1333356210,0sleep00-21swapper/009:35:260
1332050210,0sleep20-21swapper/209:35:162
1331366210,0sleep00-21swapper/009:30:340
1330770210,0sleep20-21swapper/209:30:202
1329602210,0sleep00-21swapper/009:28:020
1326721210,0sleep00-21swapper/009:20:210
1323940211,0sleep2331-21plymouthd09:15:152
1319908210,1sleep00-21swapper/009:05:160
1319428210,1sleep00-21swapper/009:02:080
1315802210,0sleep20-21swapper/208:55:022
1314139210,0sleep00-21swapper/008:50:150
1313887210,0sleep20-21swapper/208:50:012
1311236210,0sleep20-21swapper/208:40:212
1310924210,0sleep00-21swapper/008:40:190
1306878210,0sleep20-21swapper/208:30:162
1306507210,0sleep00-21swapper/008:30:140
1305151210,0sleep20-21swapper/208:25:202
1304588210,0sleep00-21swapper/008:25:140
1303037210,0sleep00-21swapper/008:20:140
1300426210,0sleep00-21swapper/008:15:010
1299585210,0sleep00-21swapper/008:10:210
1298475210,1sleep00-21swapper/008:09:330
1298057210,0sleep20-21swapper/208:05:312
1294590210,0sleep20-21swapper/207:59:102
1293431210,0sleep00-21swapper/007:55:160
1291922210,0sleep00-21swapper/007:50:200
1291602210,0sleep20-21swapper/207:50:182
1289924210,0sleep00-21swapper/007:45:190
1288845210,1sleep00-21swapper/007:44:110
1287243210,0sleep20-21swapper/207:40:132
1285203210,0sleep20-21swapper/207:35:132
1284602210,0sleep20-21swapper/207:33:532
1282314210,0sleep00-21swapper/007:25:300
1281139210,0sleep20-21swapper/207:25:162
1279552210,0sleep20-21swapper/207:20:162
1278650210,0sleep20-21swapper/207:16:362
1276569210,0sleep00-21swapper/007:15:020
1384499200,0sleep20-21swapper/211:40:042
1344418200,0sleep20-21swapper/210:05:022
1326084200,0sleep20-21swapper/209:20:032
1321809200,0sleep20-21swapper/209:10:032
1317719200,0sleep20-21swapper/209:00:022
1316037200,0sleep00-21swapper/008:55:040
1308352200,0sleep20-21swapper/208:35:052
1302602200,0sleep20-21swapper/208:20:042
1300660200,0sleep20-21swapper/208:15:032
1298745200,0sleep20-21swapper/208:10:032
1294916200,0sleep00-21swapper/008:00:040
1285189200,0sleep00-21swapper/007:35:030
1283012200,0sleep00-21swapper/007:30:020
1274860200,0sleep20-21swapper/207:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional